Medical imaging device and method for medical imaging

Abstract

The invention relates to a medical imaging device (410) comprising: an illumination unit (412) having at least one light source (414) configured to provide illumination light (416) for illuminating an object (418) to be depicted; and an image acquisition unit (420) comprising at least one image acquisition sensing mechanism (422) and at least one observation filter (424). The observation filter (424) is set to block light including visible light in a first spectral range (426) and to transmit light in a second spectral range (428) different from the first spectral range (426). The image acquisition unit (420) is designed to capture a fluorescence image (430) of the object (418) to be depicted through the observation filter (424), during the capture of the image acquisition unit, illumination light (432) whose spectrum lies at least partially within a first spectral range (426) is used as excitation light, and the image acquisition unit (420) is designed to capture the fluorescence image (430) of the object (418) to be depicted through the observation filter (424). When the image capture unit captures an image, light (434) emitted by the object (418) to be depicted is also detected by the image capture sensor (422), the spectrum of which lies at least partially within the second spectral range (428). Furthermore, the image capture unit (430) is designed to capture an anatomical image (436) of the object (418) to be depicted, to use illumination light (438), the spectrum of which lies at least partially within a second spectral range (428), during the capture of the image capture unit, and to detect light (440) diffusely reflected by the object (418) to be depicted by the image capture sensor (422) during the capture of the image capture unit, the spectrum is at least partially within the second spectral range (428). The imaging device further comprises a view generation unit (442) configured to generate at least one view (444) from the fluorescence image (430) and the anatomical image (436). The invention also relates to a method, program code and computer readable medium (448) for medical imaging.

Description

Technical Field

[0001] This invention relates to medical imaging equipment, particularly endoscopes, exoscopes and / or microscopes, methods for medical imaging, associated program code and associated computer program products. Background Technology

[0002] Imaging devices known in the prior art for performing fluorescence imaging can capture both fluorescence and white light images. Appropriate excitation light is used to selectively excite fluorescent dyes or, where necessary, naturally fluorescing substances, and the emitted light is detected and used for imaging. To simultaneously display anatomical structures in an image region to the user, white light images are typically captured in parallel or sequentially. The user can then evaluate whether the anatomical structure has been depicted based on the white light image. Fluorescence and white light images can also be overlaid, allowing the user to simultaneously perceive and analyze anatomical and fluorescence information.

[0003] Imaging devices that generate multispectral or hyperspectral images, such as endoscopic or excisional devices, are also known from the prior art. Multispectral or hyperspectral images have a spectral dimension in addition to two spatial dimensions (e.g., the spatial dimension of a conventional image from a camera). The spectral dimension includes multiple spectral bands (wavelength bands). The main difference between multispectral and hyperspectral images lies in the number and width of their spectral bands. This system can, in principle, also be applied to performing fluorescence imaging.

[0004] Especially in the context of medical applications, several imaging devices are known for generating such multispectral or hyperspectral images. For example, DE 20 2014 010 558 U1 describes an apparatus for capturing hyperspectral images of an examination area of ​​a body. This apparatus includes an input lens for generating an image in the image plane and a slit-shaped aperture for concealing the image in the image plane. Light passing through the aperture is fanned out by a dispersive element and captured by a camera sensor. Thus, a large number of spectra can be captured by the camera sensor along the longitudinal direction of the slit-shaped aperture, with corresponding spatial coordinates. The described apparatus is further configured to capture other spectra along the longitudinal direction of the slit-shaped aperture in directions different from the longitudinal direction of the slit-shaped aperture. The method for generating multispectral or hyperspectral images on which this disclosure is based is also known as the so-called pushbroom method.

[0005] Besides push-broom methods, there are other methods for generating multispectral or hyperspectral images. In so-called push-broom methods, the area or object being examined is scanned point-by-point, and the spectrum is acquired for each point. In contrast, staring methods capture multiple images with the same spatial coordinates. Here, different spectral filters and / or illumination sources are used between the individual images to distinguish the spectral information. There are also methods that decompose a two-dimensional multicolor image into multiple individual spectral images by using suitable optical elements, such as optical slicers, lenses, and prisms, which are simultaneously acquired on different detectors or detector regions. This is sometimes referred to as a snapshot approach.

[0006] As described in DE 10 2020 105 458 A1, multispectral and hyperspectral imaging devices are particularly well-suited as endoscopic imaging devices. In this context, multispectral and / or hyperspectral imaging is used, for example, in diagnostics and in fundamental applications for evaluating the success or quality of surgical procedures.

[0007] Multimodal imaging devices allow for the optional capture of white light images and / or multispectral images and / or fluorescence images and / or hyperspectral images. Examples of this type of imaging device are multimodal endoscopes and multimodal exoscopes.

[0008] Regardless of the exact design, tissue is illuminated within a specific wavelength range to capture fluorescence images, allowing for the targeted excitation of fluorescent dye molecules introduced into specific entities, such as tissue regions. The subsequently emitted light, with its redshifted wavelength, can be observed through a suitably chosen filter, which can conceal the excitation light. If the wavelength range of both the excitation and emitted light is within a longer wavelength range, particularly the near-infrared range—i.e., beyond visible white light—relative to the white light used for parallel or sequential white light imaging, white light imaging can still be performed despite the presence of the observation filter. However, dyes that can be excited by visible light are increasingly being used recently. Known methods of image generation are not feasible here because the filters required for fluorescence imaging impair white light images by blocking specific wavelength ranges of visible light or by typically transmitting only or at least primarily transmitting light below specific wavelengths. If fluorescent dyes that should be excited in the visible range are used, the aforementioned parallel or sequential white light imaging is therefore not feasible. However, if white light imaging is omitted, it becomes difficult for the user to properly evaluate anatomical structures. Summary of the Invention

[0009] Based on existing technology, the purpose of this invention is to enable fluorescence imaging in a wide range of applications.

[0010] According to the present invention, this objective is achieved by imaging devices, methods for medical imaging, program code, and computer program products, as described herein and defined in the following technical solutions.

[0011] According to the present invention, a medical imaging device, particularly an endoscope, exoscope, and / or microscope, includes an illumination unit having at least one light source configured to provide illumination light for illuminating the object to be depicted. Furthermore, the medical imaging device includes an image acquisition unit comprising at least one image acquisition sensing mechanism and at least one observation filter. The observation filter is configured to block light, including visible light, within a first spectral range and transmit light within a second spectral range different from the first spectral range. Additionally, the image acquisition unit is configured to capture a fluorescence image of the object to be depicted through the observation filter, wherein, during image acquisition, illumination light with a spectrum at least partially within the first spectral range is used as excitation light, and the image acquisition sensing mechanism also detects light emitted by the object to be depicted, the spectrum of which is at least partially within the second spectral range. Furthermore, the image acquisition unit is configured to capture an anatomical image of the object to be depicted, using illumination light with a spectrum at least partially within the second spectral range during image acquisition, and the image acquisition sensing mechanism also detects diffusely reflected light from the object to be depicted, the spectrum of which is at least partially within the second spectral range. In addition, the medical imaging device includes a view generation unit, which is configured to generate at least one view from fluorescence images and anatomical images.

[0012] The method according to the invention can be performed, in particular, using a medical imaging apparatus according to the invention. The method includes providing illumination light for illuminating the object to be depicted. Furthermore, the method includes capturing a fluorescence image of the object to be depicted through an observation filter configured to block light, including visible light, in a first spectral range and transmit light in a second spectral range different from the first spectral range, wherein, when capturing the fluorescence image, illumination light whose spectrum is at least partially within the first spectral range is used as excitation light, and light emitted by the object to be depicted whose spectrum is at least partially within the second spectral range is detected. Additionally, the method includes capturing an anatomical image of the object to be depicted, wherein, when capturing the anatomical image, illumination light whose spectrum is at least partially within the second spectral range is used, and light diffusely reflected by the object to be depicted whose spectrum is at least partially within the second spectral range is detected.

[0013] The features of the invention allow for imaging in a wide range of applications. In particular, fluorescent dyes that absorb in the visible range can be used, and convincing anatomical images can be provided to the user simultaneously. Thus, different fluorescent dyes can be used in the same manner without being limited in the creation of anatomical images.

[0014] According to the features of the invention, fluorescence images and anatomical images can be captured even with fluorescence excitation in the visible range, without having to pivot the filter in and out of the beam path between each capture. Furthermore, even if fluorescence excitation should be performed in the visible range, anatomical images do not necessarily have to be completely abandoned. In principle, it is also possible to incident white light and fluorescence excitation light in parallel and separate the fluorescence and white light via the Bayer mode of the detector. However, due to the associated and anticipated sensor crosstalk, this requires considerable effort during evaluation, and the expected image quality may be low.

[0015] Imaging devices can be microscopic imaging devices, macroscopic imaging devices, and / or excisional imaging devices. Imaging devices can be configured as microscopes, macroscopes, and / or excisionals and / or include such microscopes, macroscopes, and / or excisionals. In some embodiments, the imaging device is an endoscopic imaging device. The imaging device can be an endoscopic device. It can include endoscopes and / or endoscopic systems and / or be configured as such endoscopes and / or endoscopic systems, and / or constitute at least a portion and preferably at least a majority and / or a major component of endoscopes and / or endoscopic systems. "At least a majority" can mean at least 55%, preferably at least 65%, preferably at least 75%, particularly preferably at least 85%, and very particularly preferably at least 95%, especially in terms of the volume and / or mass of the object.

[0016] In some embodiments, the imaging device is configured to be introduced into cavities for identification and / or observation, such as artificial and / or natural cavities, like the interior of a body, body organs, tissues, etc. The imaging device may also be configured to be introduced into housings, covers, wells, pipes, or other, especially, artificial structures, for identification and / or observation.

[0017] Especially when the imaging device is an endoscopic imaging device, it can be set to capture images of tissue parameters, wounds, body parts, etc. For example, the imaging device can be set to depict the surgical field of view.

[0018] The image acquisition sensing mechanism can be configured to detect light in the visible and near-infrared ranges. In some embodiments, the minimum detectable wavelength can be at most 500 nm, at most 450 nm, or even at most 400 nm. In some embodiments, the maximum detectable wavelength can be at least 800 nm, at least 900 nm, or even at least 1000 nm. For example, the image acquisition sensing mechanism may include at least one white light image sensor and at least one near-infrared image sensor. In some embodiments, the imaging device includes a sensing mechanism for white light image acquisition and / or a white light camera. The imaging device can be configured for white light imaging. Anatomical images can be captured using the sensing mechanism for white light image acquisition and / or the white light camera.

[0019] The image acquisition unit may include a filter unit with an optical observation filter. The filter unit may define multiple fluorescence modes defined by different observation filters. For example, different edge filters may be used that absorb / block the correspondingly used spectrum for exciting the associated light-emitting element and transmit at least substantially only fluorescence. Thus, an observation filter that blocks light in a first spectral range is part of the filter unit. In some embodiments, the observation filter may also switch between multispectral and fluorescence modes.

[0020] Imaging devices, and in particular optics and / or image acquisition sensing mechanisms, can be configured for multispectral and / or hyperspectral imaging, especially for acquiring and / or generating multispectral and / or hyperspectral image data. Multispectral imaging or multispectral image data here specifically refers to imaging in which at least two, especially at least three, and in some cases at least five spectral bands are acquired and / or can be acquired independently of each other. Hyperspectral imaging or hyperspectral image data here specifically refers to imaging in which at least 20, at least 50, or even at least 100 spectral bands are acquired and / or can be acquired independently of each other. The imaging device can operate according to push-broom and / or swing-broom and / or staring methods and / or snapshot principles.

[0021] For some applications, it can be advantageous to use a large spectral resolution. This is suitable for hyperspectral imaging, which can be combined with white light imaging. Thus, observation via white light images can be performed in real time, even if only spectral-resolved image data is acquired substantially in real time (i.e., it takes several seconds, for example, to create a spectral-resolved image). For some applications, it can be advantageous to generate spectral image data in real time. This includes, for example, the generation of spectral-resolved images in less than a second or even multiple times per second. Multispectral imaging is suitable here. Thus, the lower spectral resolution may be offset by a higher refresh rate. Depending on the application, it may be sufficient to consider only a small number of different spectral ranges and / or wavelengths, such as two, three, four, or typically less than ten. Additional white light imaging can be selectively omitted here. Spectral-resolved image data acquired in real time or multiple images delivered per second can also be used for monitoring purposes, where it is not necessary to force the creation of images to be reproduced for the user, and the image data can be processed in the background.

[0022] Medical imaging devices may have at least one proximal segment, a distal segment, and / or an intermediate segment. The distal segment is particularly configured to be introduced and / or located within the cavity to be examined during operation, such as during diagnostic and / or therapeutic procedures. The proximal segment is particularly configured to be positioned outside the cavity to be examined during operation, such as during diagnostic and / or therapeutic procedures. "Distal" should be understood in particular as being closer to the patient and / or farther from the user during use. "Proximal" should be understood in particular as being farther from the patient and / or closer to the user during use. Proximal is particularly the opposite of distal. In particular, the medical imaging device has at least one, preferably flexible, rod. The rod may be an elongated object. Furthermore, the rod may at least partially and preferably at least largely constitute the distal segment. "Elongated object" should be understood in particular as an object whose principal extension is at least five times, preferably at least ten times, and particularly preferably at least twenty times greater than the object's maximum extension perpendicular to its principal extension, i.e., in particular, the object's diameter. The "primary extension" of an object should be understood in particular as the longest extension of the object along its primary extension direction. The "primary extension direction" of a component should be understood here in particular as the direction parallel to the longest side of the smallest imaginary cube that exactly completely encloses the component.

[0023] Image acquisition units may be arranged at least partially and preferably at least mostly in the proximal segment and / or constituting the proximal segment. In other embodiments, image acquisition units may be arranged at least partially and preferably at least mostly in the distal segment and / or constituting the distal segment. Furthermore, image acquisition units may be arranged to be at least partially distributed across both the proximal and distal segments. The image acquisition sensing mechanism particularly has at least one image sensor. Furthermore, the image acquisition sensing mechanism may also have at least two, and preferably more, image sensors, which may be arranged one after another. Moreover, the two, and preferably more, image acquisition sensors may have spectral acquisition sensitivities with different configurations than each other, such that, for example, a first sensor in the red spectral range, a second sensor in the blue spectral range, and a third sensor in the green spectral range are particularly sensitive or relatively more sensitive than other sensors. The image sensor may be configured, for example, as a CCD sensor and / or a CMOS sensor.

[0024] The optics of the image acquisition unit may include suitable optical elements such as lenses, mirrors, gratings, prisms, optical fibers, etc. The optics may be configured to guide object light from the object being depicted to the image acquisition sensing mechanism, for example, to focus and / or project it.

[0025] The image acquisition unit is specifically configured to generate at least two-dimensional spatial image data. The image acquisition unit may be spatially resolved, i.e., it provides a resolution of at least 100 pixels, preferably at least 200 pixels, more preferably at least 300 pixels, and advantageously at least 400 pixels in at least two different spatial directions. The image data is preferably at least three-dimensional, wherein at least two dimensions are spatial dimensions and / or at least one of the dimensions is a spectral dimension. Multiple spatially resolved images of an object region can be obtained from the image data, each associated with a different spectral band. The spatial and spectral information of the image data allows for the acquisition of associated spectra for multiple spatial pixels.

[0026] In some implementations, the image acquisition unit is configured to generate continuously updated image data. For example, the image acquisition unit may be configured to generate image data substantially in real time, including, for example, generating updated image data every 30 seconds, in some cases at least 20 seconds, and in some cases even every 10 seconds or at least every 5 seconds. Preferably, the image acquisition unit is configured to generate at least anatomical images and fluorescence images, as well as views based thereon, in real time, for example at a frame rate of at least 5 fps, at least 10 fps, at least 20 fps, or even at least 30 fps.

[0027] The lighting unit can be configured as multi-mode and includes multiple light-emitting elements that can be selectively activated in a manner independent of each other, which are configured to emit light according to different emission spectra to supply illumination.

[0028] The term "visible light" herein may specifically refer to light with wavelengths between 400 nm and 750 nm. Generally, this means light perceptible to the human eye. The first spectral range specifically includes only one subrange of visible light. The second spectral range may also include visible light. The observation filter may be an edge filter, particularly a high-pass filter. The edge of the observation filter, or generally the edge of the first spectral range, may be selected to match the fluorescent dye used. If, for example, dihydrofluorescein or Cy5 is used as the dye, excitation is performed centrally within the visible range, particularly spaced apart from its edges, for example, about 430 nm for dihydrofluorescein or about 660 nm for Cy5. To prevent the fluorescence image from being distorted by the excitation light, the excitation light must be blocked accordingly. The first spectral range is then selected to block the excitation light in any case. In the case of dihydrofluorescein, for example, an edge filter with an edge of about 450 nm may be selected. In the case of Cy5, for example, an edge filter with an edge of about 680 nm may be selected. The first and second spectral ranges are preferably at least substantially adjacent to each other. The spacing between spectral ranges can, for example, be defined solely by the width of the filter edges. A third spectral range may exist, situated between the first and second spectral ranges, and in which the transmittance of the filter, and in particular the filter's transmittance, changes significantly with wavelength. As previously mentioned, this could be a filter edge. The first and / or second spectral ranges may comprise multiple sub-ranges that can be spaced apart from each other.

[0029] In some implementations, the second spectral range extends beyond the visible range into the near-infrared range. In particular, the light detected when capturing anatomical images may also be in the near-infrared range, for example, in wavelengths exceeding 800 nm, 850 nm, or even 900 nm.

[0030] Fluorescence images and anatomical images can be captured in parallel or sequentially. Preferably, both fluorescence images and anatomical images are motion images.

[0031] Especially when the image acquisition unit is configured to capture anatomical images of the object to be depicted through the observation filter, images can be captured particularly easily and at short time intervals. Therefore, during the capture and presentation of superimposed anatomical and fluorescence images, the observation filter can remain continuously positioned in the beam path used for both anatomical and fluorescence imaging. For example, it can be replaced if different excitation wavelengths and / or different depiction modes are selected. The observation filter is located here, in particular, in front of the optical entrance of the image acquisition sensing mechanism of the imaging device. As previously mentioned, this may include sensors that respond in different spectral ranges; the observation filter is still suitably positioned in front of the entirety of these sensors, i.e., in front of the image acquisition sensing mechanism. This allows for the simple use of different filters without having to integrate the filters directly into the sensing mechanism.

[0032] In other implementations, the observation filter can be integrated into the image acquisition sensing mechanism. Especially for multi-chip image sensors, different image sensors can be equipped with different observation filters. Then, non-overlapping groups of image sensors can be used to acquire anatomical images and fluorescence images. Images can be captured in parallel. In this case, the observation spectral range used for fluorescence image acquisition is by no means suitable for anatomical image acquisition.

[0033] The minimum wavelength of the first spectral range can be greater than 430 nm, and particularly greater than 500 nm. The maximum wavelength of the first spectral range can be less than 800 nm, and particularly less than 700 nm. In some embodiments, the illumination light used as the excitation light for fluorescence imaging is narrow-band. For example, the illumination light can come from at least one colored LED, a laser diode, or another light-emitting element that emits at least substantially monochromatic radiation.

[0034] In some embodiments, the medical imaging apparatus includes an illumination device, which includes an illumination unit. The illumination device may include an optical interface for optical attachment of the imaging apparatus. The illumination unit may be configured to supply illumination light to the optical interface. The illumination unit may be configured to be multi-mode and include a plurality of light-emitting elements that can be selectively activated independently of each other, configured to emit light according to different emission spectra to supply illumination light. The illumination unit may operate in at least one multispectral mode, wherein a first group of light-emitting elements is at least temporarily activated, and wherein the illumination unit supplies illumination light for multispectral imaging. Furthermore, the illumination unit may operate in at least one fluorescence mode, wherein a second group of light-emitting elements is at least temporarily activated, and wherein the illumination unit supplies illumination light for fluorescence imaging. The light-emitting elements may include at least one light-emitting element contained in both the first and second groups.

[0035] Furthermore, a method for generating illumination light for an imaging apparatus using an illumination device can be provided. The illumination device includes an optical interface for optical attachment to the imaging apparatus and an illumination unit configured to supply illumination light to the optical interface. The illumination unit includes a plurality of light-emitting elements that can be selectively activated independently of each other, configured to emit light according to different emission spectra to supply illumination light. The method includes the steps of at least temporarily activating a first group of light-emitting elements to supply illumination light for multispectral imaging and at least temporarily activating a second group of light-emitting elements to supply illumination light for fluorescence imaging. At least one of the light-emitting elements is at least temporarily activated both when the first group of light-emitting elements is at least temporarily activated and when the second group of light-emitting elements is at least temporarily activated.

[0036] The optical interface can optionally be detachable and connectable. Furthermore, the optical interface can be combined with a mechanical interface to automatically establish an optical connection, for example, during mechanical connection of the imaging device.

[0037] The light-emitting element may include a monochromatic LED (light-emitting diode) and / or a laser diode. Furthermore, at least one of the light-emitting elements may be a white LED or another white light source. In some embodiments, the illumination unit includes at least one blue light-emitting element, at least one red light-emitting element, at least one deep red light-emitting element, and at least one Nah-IR light-emitting element (near-infrared light-emitting element), particularly an LED or a laser diode, respectively. Additionally, the illumination unit may include at least one white LED or another white light source.

[0038] The first group may include at least two luminescent elements that emit in different ways in terms of the spectrum. High efficiency can be achieved in multispectral imaging when the multispectral mode includes different states (in which specific luminescent elements or specific types of luminescent elements are at least temporarily activated). This allows for targeted illumination within a specific spectral range, enabling the acquisition of different spectral images. The different luminescent elements activated in different states can serve as different support points for multispectral imaging. At least one of the support points can be selected such that it is adapted to a characteristic point of the absorption spectrum of a physiologically relevant component, such as the isoabsorption point of the hemoglobin oxidation curve. Multispectral imaging may additionally include the use of appropriate observation filters.

[0039] Furthermore, the second group may include at least two light-emitting elements that emit in different spectral manners. The fluorescence mode may include different sub-modes and / or states in which a specific light-emitting element or a specific type of light-emitting element is at least temporarily activated. This allows for targeted excitation within a specific spectral range, enabling fluorescence imaging of a specifically selected dye. In other words, at least one light-emitting element included in both the first and second groups can be used in both multispectral and fluorescence modes.

[0040] In some embodiments, the first group includes only some, not all, of the light-emitting elements. Alternatively or additionally, in some embodiments, the second group includes only some, not all, of the light-emitting elements. In multispectral mode, in particular only the light-emitting elements of the first group are activated at least temporarily, while light-emitting elements not belonging to the first group are deactivated. In fluorescence mode, in particular only the light-emitting elements of the second group are activated at least temporarily, while light-emitting elements not belonging to the second group are deactivated. It is generally understood that the light-emitting elements may include different types of light-emitting elements, and in particular, exactly one light-emitting element is present in each type. It is understood that mixed operating modes can occur according to the invention, in which the mentioned modes are used sequentially. For example, multispectral imaging and fluorescence imaging can be performed sequentially.

[0041] When at least one light-emitting element included in the first and second groups emits light in the red spectral range, particularly in the spectral range between 600 nm and 680 nm, for example between 610 nm and 650 nm, or between 620 nm and 660 nm, or between 630 nm and 670 nm, synergy can be achieved in terms of using the light-emitting element for different modes and the associated efficiency gain. The spectral range can be narrowband and includes a wavelength of 660 nm. "Narrowband" can include a spectral width of up to 80 nm, particularly up to 40 nm, or even up to 20 nm. The at least one light-emitting element can be configured to excite dyes that absorb in the red spectral range and contribute to supplying illumination for multispectral imaging in the red spectral range.

[0042] In some implementations, the illumination unit can operate in at least one white light mode, wherein the illumination unit supplies illumination light for white light imaging. The illumination light for white light imaging can be broadband white light. Alternatively, the illumination light for white light imaging can include multiple narrow bands separated from each other, such as blue, red, and deep red bands. "Deep red" can be understood herein as "long wavelengths are red" and refers to spectral position rather than light intensity. The illumination light for white light imaging can be composed of a mixture of light from different light-emitting elements.

[0043] In white light mode, a third group of light-emitting elements can be activated at least temporarily to supply illumination light for white light imaging. The light-emitting elements may include at least one element contained within the first and / or second and third groups. In some cases, the third group may include only some, not all, of the light-emitting elements. In white light mode, specifically only the light-emitting elements of the third group are activated at least temporarily, while those not belonging to the third group are deactivated. In other words, the illumination unit may include light-emitting elements for one, two, or all three of the mentioned illumination modes. Thus, multiple light-emitting elements can be employed multiple times.

[0044] At least one light-emitting element included in the first and / or second and third groups can emit light in the red spectral range, particularly in the spectral range between 600 nm and 680 nm, for example between 610 nm and 650 nm, or between 620 nm and 660 nm, or between 630 nm and 670 nm. The advantages of using light-emitting elements in combination are particularly evident when at least one red light-emitting element is available in all three modes.

[0045] At least one light-emitting element included in the first group and / or the second and third groups can emit light in the blue spectral range, particularly in the spectral range between 440 and 480 nm. At least one blue light-emitting element can be suitably used in both fluorescent and white light modes.

[0046] Generally, as described above, the light-emitting element may include at least one, particularly blue, light-emitting element that emits light in a spectral range between 440 and 480 nm. Furthermore, as described above, the light-emitting element may include at least one, particularly red, light-emitting element that emits light in a spectral range between 600 and 680 nm, for example, between 610 nm and 650 nm, or between 620 and 660 nm, or between 630 and 670 nm. Alternatively or additionally, the light-emitting element may include at least one, particularly deep red, light-emitting element that emits light in a spectral range between 750 and 790 nm. Alternatively or additionally, the light-emitting element may include at least one, particularly near-infrared emitting element that emits light in a spectral range between 920 and 960 nm. Furthermore, the light-emitting element may include a white light-emitting element. In particular, when at least one of the aforementioned light-emitting element types is present, a compact and versatile illumination unit can be provided. For example, in fluorescence mode, both blue and red light-emitting elements can be used, and a deep red light-emitting element may also be used if necessary, provided a suitable dye is used. In multispectral mode, deep red and near-infrared emitting light-emitting elements can be used. In white light mode, white light emitting elements can be used. This can be supplemented by blue emitting elements and, if necessary, red emitting elements. Thus, the wavelength range can be supplemented by colored emitting elements, in which the white light emitting element provides a reduced intensity, for example, due to its structure, but especially due to the filters and optics of the illumination unit. Furthermore, colored emitting elements can be used to adjust the color temperature during white light imaging.

[0047] In some embodiments, the second group includes a single light-emitting element and / or a single type of light-emitting element. For example, white light-emitting elements, red light-emitting elements, and infrared-emitting light-emitting elements can be provided, with the aforementioned values ​​being particularly relevant in terms of possible spectral ranges. Thus, the first group can include, for example, red and infrared-emitting light-emitting elements. The second group can include infrared-emitting light-emitting elements, particularly as a single light-emitting element or as a single type of light-emitting element.

[0048] Especially when the illumination unit includes at least one crossbeam splitter, a beneficial arrangement of light-emitting elements can be achieved, by means of which light can be deflected from opposing entrance sides to exit sides, wherein at least one light-emitting element is correspondingly arranged on the opposing entrance sides of the crossbeam splitter. In some embodiments, two or more crossbeam splitters can be provided, arranged one after another optically. The at least one crossbeam splitter may include two beam splitter elements whose transmittance is adapted to the correspondingly associated light-emitting elements. The beam splitter elements particularly include band-stop filters, such that they reflect in narrow spectral bands but transmit in other cases. The spectral position and / or width of the corresponding notches can be adapted to the spectral range of the correspondingly associated light-emitting elements, such that their light is deflected, but the light from other light-emitting elements is transmitted at least as much as possible.

[0049] In some embodiments, the light-emitting element may include at least four narrow-band emitting monochromatic light-emitting elements and at least one broadband emitting white light-emitting element, the narrow-band emitting monochromatic light-emitting elements having different spectral ranges. Related information can also be found in the above embodiments concerning colored light-emitting elements.

[0050] A wide range of functions can be achieved, combining a compact structural design with the utilization of synergistic effects when using light-emitting elements, particularly when the illumination unit can operate in at least one hyperspectral mode, in which multiple light-emitting elements are activated, their emission spectra collectively covering at least one spectral range from 450 nm to 850 nm, and in which the illumination unit supplies illumination light for hyperspectral imaging. In particular, all light-emitting elements can be used in this context.

[0051] It is understandable that, especially when using a laser diode in the optical filters mentioned herein, a suitable polarization filter can be used. Furthermore, especially when using a laser diode, at least one cross beamsplitter with polarization filters configured in its beamsplitter elements can be used. Selective light transmission can then be achieved through different combinations of polarizations.

[0052] The views generated by the view generation unit from fluorescence images and anatomical images can include combined views, especially overlay views, based on a combination of fluorescence and anatomical images. Users can then easily correlate fluorescence information with anatomical information. In particular, the fluorescence images and anatomical images can point to the same object, especially the same anatomical segment. Image segments may differ from each other in this case.

[0053] Imaging equipment may include a display and / or be configured to connect to a display. A corresponding interface may be provided for this purpose. The view generation unit may be configured to generate a view for the display. For example, the display may include a screen on which a view can be provided to a user.

[0054] In some implementations, the image acquisition unit is configured to capture fluorescence and anatomical images in real time. Furthermore, the view generation unit can be configured to generate at least one view in real time. This allows the user to obtain motion images based on anatomy and fluorescence, even when excitation occurs within the visible range.

[0055] As described above, in some embodiments, the image acquisition unit can be configured to sequentially capture fluorescence images and anatomical images. Advantageously, the view generation unit can be configured to correlate the sequentially captured fluorescence images and anatomical images, particularly in terms of time, and generate at least one view based on the correlated fluorescence images and anatomical images. Correlation can be performed in a frame-synchronized manner. "Frame synchronization" here means that the correlated fluorescence images and anatomical images are temporally linked. This is not necessarily interpreted as simultaneity in the narrow sense. Furthermore, the term "frame synchronization" also includes situations where a first number of fluorescence images and a different second number of anatomical images are captured alternately. For example, according to the invention, the update rate of the anatomical images can be specified as greater than the update rate of the fluorescence images. Captures are still frame-synchronized within the meaning of this disclosure when correlated in such a way that there is a temporal correlation between the images shown. In other words, the combined view can be based on at least one fluorescence image and at least one anatomical image captured within a predetermined time period, for example, within a time period of at most 1000 ms, at most 500 ms, at most 100 ms, or even at most 50 ms.

[0056] In addition to the above-described embodiments of the image acquisition sensing mechanism, it can generally be specified that the image acquisition sensing mechanism includes at least one first image acquisition sensor configured to acquire image information for fluorescence images, and at least one second image acquisition sensor configured to acquire image information for anatomical images. The image acquisition sensors can be combined using at least one optical element such that detected light always, or at least optionally simultaneously, falls on multiple or all of the image acquisition sensors. The first image acquisition sensor may include at least one near-infrared image sensor. The second image acquisition sensor may include a white light image acquisition chip. Alternatively or additionally, the second image acquisition sensor may include different color channels, such as red, green, and blue color channels. This can be achieved, for example, by using color filters with suitable modes. In some embodiments, Bayer sensors are used, for example, but other components can also be used according to the invention. Furthermore, it can be specified that a separate image sensor with its own two-dimensional resolution is used for each color channel. It is understood that in some embodiments, fluorescence images may additionally or alternatively be generated using a first image acquisition sensor, and / or anatomical images may additionally or alternatively be generated using a second image acquisition sensor. For example, anatomical images may include multiple anatomical images and / or multiple individual images associated with different color channels, such as images from the red color channel, green color channel, blue color channel, and / or near-infrared color channel. Alternatively or additionally, a single anatomical image may include multiple color channels, such as the red color channel, green color channel, blue color channel, and / or near-infrared color channel.

[0057] In other embodiments, the image acquisition sensing mechanism includes a single image acquisition sensor, particularly a single-chip image acquisition sensor and / or a single-chip camera head, which depicts in the visible and near-infrared ranges.

[0058] In some implementations, the image acquisition sensor can be configured to simultaneously capture fluorescence images and anatomical images. "Simultaneously" here specifically refers to temporal simultaneity, which differs from, for example, from the sequential capture of fluorescence and anatomical images. In this case, for example, the capture of anatomical images can be triggered and the capture of fluorescence images can be triggered simultaneously within a time period of up to 500 ms, up to 100 ms, or even up to 20 ms. However, "simultaneously" also includes, for example, capturing corresponding images for different durations when using different illumination durations.

[0059] Especially when the view generation unit is configured to generate at least one anatomical image from multiple, particularly monochrome, single images and / or from multiple color channels of an anatomical image, the available image information can be used in a purposeful manner and to generate a convincing anatomical image. In this way, an anatomical image can be synthesized from multiple color channels, thereby at least partially compensating for the loss of specific color channels and / or specific spectral ranges due to observation filters, if necessary. Depending on the image acquisition sensing mechanism used, a single image sensor can also supply a single image, such as a monochrome single image, such as a blue, green, red, and / or near-infrared single image, or it can supply partially multi-color single images, such as RGB single images and near-infrared single images, in different ways and if necessary.

[0060] In some implementations, the anatomical image corresponds to a white light image with multiple color channels, wherein at least one color channel from the visible range is replaced by at least one color channel located outside the visible range, particularly in the near-infrared range. This allows for the generation of almost natural anatomical images, even if spectral information is lost due to observation filters.

[0061] The present invention also relates to program code configured to, when implemented in a processor, cause execution of the method according to the invention.

[0062] The present invention also relates to program code, including a computer-readable medium, wherein the program code according to the invention is stored on a computer-readable medium.

[0063] In this context, the apparatus and method according to the invention should not be limited to the applications and embodiments described above. In particular, the apparatus and / or method according to the invention used to implement the working principles described herein may have quantities different from those mentioned herein for the various elements, components, units, and method steps. Furthermore, values ​​within the range of values ​​given in this disclosure, and those within the mentioned limits, are also considered publicly available and arbitrarily usable.

[0064] It is particularly important to note that all features and characteristics described with reference to the device, as well as methodological approaches, can be adapted for use within the scope of this invention and are considered commonly disclosed. The same applies in reverse. That is, structures mentioned with reference to the method, i.e., features of the device, can be considered, protected, and are also considered part of the disclosure within the scope of related technical solutions.

[0065] The invention will now be described by way of example with reference to the accompanying drawings. The drawings, description, and claims contain a number of combined features. Those skilled in the art will also suitably consider these features individually and use them meaningfully in combination within the scope of the claims.

[0066] If a particular object has more than one example, then only one of them will be designated as a reference numeral in the drawings and, where necessary, in the specification. The description of that example can be correspondingly applied to the other examples of the object. If the objects are named, in particular, by ordinal numbers, such as first, second, third, etc., these are used to name and / or associate these objects. Thus, for example, first and third objects may be included, but second objects may not be included. However, additionally, the number and / or order of objects can be inferred from the ordinal numbers. Attached Figure Description

[0067] In the attached diagram:

[0068] Figure 1 A schematic diagram of an imaging device with an illumination device is shown;

[0069] Figure 2 A schematic diagram of the lighting equipment is shown;

[0070] Figure 3 A schematic transmission curve of a beam splitter element in a lighting device is shown;

[0071] Figure 4 A schematic diagram of the imaging device is shown;

[0072] Figure 5 A schematic diagram of another embodiment of the imaging device is shown;

[0073] Figure 6 A schematic diagram illustrating yet another embodiment of the imaging device is shown;

[0074] Figure 7 A schematic perspective view of another embodiment of the imaging device is shown;

[0075] Figure 8 A schematic flowchart of a method for generating illumination light for an imaging device using an illumination device is shown;

[0076] Figure 9 A schematic flowchart of a method for operating an imaging device is shown;

[0077] Figure 10 A schematic flowchart of a method for operating an imaging device is shown;

[0078] Figure 11 A schematic diagram of a medical imaging device is shown;

[0079] Figure 12 A schematic spectrum of the fluorescent dye and the transmission curves of the associated observation filter are shown.

[0080] Figure 13 A schematic spectrum of the fluorescent dye and the transmission curves of the associated observation filters are shown.

[0081] Figure 14 A schematic diagram of a series of fluorescence images and anatomical images is shown;

[0082] Figure 15 A schematic diagram of the color channels in an anatomical image is shown;

[0083] Figure 16 A schematic diagram illustrating a first example of calculating fluorescence images and anatomical images is shown;

[0084] Figure 17 A schematic diagram illustrating a second example of calculating fluorescence images and anatomical images is shown;

[0085] Figure 18 A schematic diagram illustrating a third example of calculating fluorescence images and anatomical images is shown;

[0086] Figure 19 A schematic diagram is shown to illustrate a fourth example of calculating fluorescence images and anatomical images;

[0087] Figure 20 A schematic flowchart of a method for medical imaging is shown; and

[0088] Figure 21 A schematic diagram of a computer program product is shown. Detailed Implementation

[0089] Figure 1 A schematic diagram of imaging device 10 is shown. In the exemplary embodiment, imaging device 10 is an endoscopic imaging device, specifically an endoscope. Alternatively, imaging device 10 may be an exoscopy imaging device, a microscopic imaging device, or a macroscopic imaging device. Imaging device 10 is exemplarily shown as a medical imaging device. Imaging device 10 is, for example, configured for examining cavities.

[0090] Imaging device 10 includes medical imaging device 14. In the illustrated case, this is an endoscope.

[0091] Furthermore, the imaging device 10 includes an illumination device 12 having an optical interface 16 and an illumination unit 18. The imaging device 14 can be optically attached to the optical interface 16. The optical interface 16 can be part of an opto-mechanical interface that is optionally detachable and connectable. The illumination device 14 can optionally be detached from the illumination device 12. The illumination unit 18 is configured to supply illumination light to the optical interface 16. When imaging with the aid of the imaging device 14, the illumination unit 18 can correspondingly provide the required illumination light, which is directed to the illumination device 14 and output from there to the object to be depicted, such as a part.

[0092] In the illustrated case, the imaging device 10 also includes a display unit on which images based on image data acquired by the imaging device 14 can be displayed. These images may include video images, still images, overlays of different images, partial images, image sequences, etc.

[0093] Imaging device 10 is multi-mode. For example, the imaging device can operate in three basic modes: multispectral mode, fluorescence mode, and white light mode. Furthermore, it can be specified that imaging device 10 can be attached to or alternatively operated in hyperspectral mode in addition to multispectral mode.

[0094] The illumination device 12 is multi-mode. It can operate in different illumination modes, supplying light for different imaging modes. Currently, the illumination device 12 can operate in three basic modes: multispectral mode, fluorescence mode, and white light mode. Similarly, the imaging device 14 can operate in different operating modes, specifically at least in multispectral mode, fluorescence mode, and white light mode. The modes of the illumination device 12 are coordinated with each other in the corresponding operating modes of the imaging device 10.

[0095] Figure 2 A schematic diagram of the lighting device 12 is shown. The lighting unit 18 includes multiple light-emitting elements 20, 22, 24, 26, and 28 that can be activated independently of each other. These light-emitting elements are configured to emit light according to different emission spectra to supply illumination light, i.e., the corresponding emission spectra differ among the individual light-emitting elements.

[0096] For example, light-emitting elements 20, 22, 24, 26, and 28 are configured as LEDs. Specifically, a first light-emitting element 20 is configured as a red LED, a second light-emitting element 22 is configured as a deep red LED, a third light-emitting element 24 is configured as a blue LED, and a fourth light-emitting element 26 is configured as a near-infrared LED. The colored light-emitting elements 20, 22, 24, and 26 emit in a narrow band manner, such as having emission peaks at wavelengths of 660 nm (first light-emitting element 20), 770 nm (second light-emitting element 22), 460 nm (third light-emitting element 24), and 940 nm (fourth light-emitting element 26).

[0097] In addition, a fifth light-emitting element 28 is provided, which is currently a white light-emitting element, such as a white LED. The fifth light-emitting element 28 emits light, for example, in a spectral range of about 400 to 700 nm. In other embodiments, a laser diode may also be used, especially as a colored light-emitting element.

[0098] Depending on the lighting mode, some of the light-emitting elements 20, 22, 24, 26, and 28 are activated at least temporarily, while other light-emitting elements 20, 22, 24, 26, and 28 are not used in the relevant lighting mode when necessary.

[0099] Currently, the first group includes a first light-emitting element 20 and a fourth light-emitting element 26. The first group may additionally include light-emitting elements 22 and / or 24. The first group is used for multispectral imaging, where light-emitting elements 20 and 26, and, if necessary, light-emitting elements 22 and 24, serve as support points. In multispectral mode, for example, illumination is first achieved using the first light-emitting element 20, and an image is captured. Next, illumination is achieved using the fourth light-emitting element 26, and an image is captured. These images are based on diffuse reflection, i.e., observation of light scattered and reflected from the object to be depicted. Due to these two different support points, spectral information about the object to be depicted can be obtained. For example, specific tissue types, perfusion states, tissue properties, etc., can be evaluated.

[0100] Furthermore, the second group includes a first light-emitting element 20, a second light-emitting element 22, and a third light-emitting element 24. This second group is used for illumination during fluorescence imaging. Here, for example, objects specifically stained with appropriately selected dyes can be observed. Different dyes can also be introduced into different tissue types, etc., and observed simultaneously. Specific dyes are specifically excited to induce fluorescence. The fluorescence is then depicted. The first light-emitting element 20 is, for example, suitable for exciting the dye Cy5.5. The second light-emitting element 22 is suitable for exciting the dye Indocyanine Green (ICG). The third light-emitting element 24 is suitable for exciting the dye Dihydrofluorescein.

[0101] Furthermore, the third group includes a fifth light-emitting element 28. In this embodiment, the third group also includes a first light-emitting element 20 and a third light-emitting element 24. The third group is used to provide illumination light for white light imaging. For this purpose, the white light from the fifth light-emitting element 28 can be mixed with the light from a specific colored light-emitting element, thereby compensating for spectral loss and / or allowing for targeted adjustment of the color temperature.

[0102] It can be seen that some of the light-emitting elements 20, 22, 24, 26, and 28 belong to multiple groups. For example, the first light-emitting element 20 belongs to all three groups, and the third light-emitting element 24 and, if necessary, the second light-emitting element 22 belong to the second and third groups.

[0103] Alternatively or additionally, some or all of the light-emitting elements 20, 22, 24, 26, and 28 may be used in hyperspectral mode. A broad excitation spectrum is then generated. Then, in conjunction with a suitable hyperspectral detector, spectral information about the entire visible and near-infrared spectrum relating to the object to be depicted can be acquired. Imaging device 14 may include a pushbroom arrangement as a hyperspectral detector for this purpose. In other embodiments, a whiskbroom arrangement, a staring arrangement, and / or a snapshot arrangement are used. Imaging device 14 may be a hyperspectral imaging device. For different methods of hyperspectral imaging and the components required for it, see the article “Review of spectral imaging technology in biomedical engineering: achievements and challenges” by Quingli Li et al., published in Journal of Biomedical Optics 18(10), 100901, Oktober 2013, and the article “Medical hyperspectral imaging: a review” by Guolan Lu and Baowei Fei, published in Journal of Biomedical Optics 19(1), 010901, Januar 2014.

[0104] The illumination unit 18 includes two cross beam splitters 30 and 32. They each include exit sides 42 and 44, entrance sides 37 and 41 opposite to the exit sides 42 and 44, and two entrance sides 34, 36, 38, and 40 opposite each other. All entrance sides 34, 36, 37, 38, 40, and 41 guide incident light to their corresponding exit sides 42 and 44. The exit side 42 of the first cross beam splitter 30 is close to the entrance side 41 of the second cross beam splitter 32. The exit side 44 of the second cross beam splitter 32 is close to the optical interface section 16. These two cross beam splitters 30 and 32 are preferably arranged coaxially with each other and / or with the optical interface section.

[0105] The illumination unit 18 may include suitable optical elements, such as lenses and / or mirrors (not shown). Figure 2 Multiple lenses 78, 80, 82, 84, 86, and 88 are exemplarily shown. Lens 78 is associated with optical interface 16 and inputs light from the exit side 44 of the second crossbeam splitter 32 into optical interface 16. Furthermore, each of the light-emitting elements 20, 22, 24, 26, and 28 is associated with a corresponding lens 80, 82, 84, 86, or 88. A particularly high degree of compactness can be achieved when the light-emitting elements 20, 22, 24, 26, and 28 do not have mirrors located at the entrance sides 34, 36, 37, 38, and 40 of at least one crossbeam splitter 30 and 32, respectively. Therefore, the light-emitting elements 20, 22, 24, 26, and 28 can be placed very close to at least one crossbeam splitter 30 and 32.

[0106] Cross beam splitters 30 and 32 each include two beam splitter elements 90, 92, 94, and 96. They are, in principle, semi-transparent, so that light from all entrance sides 34, 36, 37, 38, 40, and 41 is redirected to the corresponding exit sides 42 and 44. In this embodiment, beam splitter elements 90, 92, 94, and 96 are selectively transparent. Further reference... Figure 3 To clarify this point, beam splitter elements 90, 92, 94, and 96 can be filters that reflect only within a limited range, but otherwise possess high transmittance. Figure 3Transmission curves 98, 100, 102, and 104 of the beamsplitter elements 90, 92, 94, and 96 of the two cross beamsplitters 30 and 32 are shown. Each of the colored light-emitting elements 20, 22, 24, and 26, or each of the opposite entrance sides 34, 36, 38, and 40, is associated with one of the beamsplitter elements 90, 92, 94, and 96. The beamsplitter elements 90, 92, 94, and 96 are selected such that they reflect within the wavelength range emitted by the associated light-emitting elements 20, 22, 24, and 26, but transmit as much as possible elsewhere. For this purpose, a band-stop filter can be used in the intermediate wavelength range, which can exemplarily have transmission spectra 100 and 102. High-pass or low-pass filters can be used instead of band-stop filters at the spectral edges, see transmission spectra 98 and 104.

[0107] Due to the specific transmission spectra 98, 100, 102, and 104 of the cross beam splitters 30 and 32, the light from the fifth light-emitting element 28 is spectrally cut off. Therefore, the light blocked by the beam splitters 30 and 32 can be suitably and specifically supplemented by light-emitting elements 20 and 24, and, if necessary, by light-emitting elements 22 and / or 26, in the manner described above. Thus, supplementation can be specifically achieved within the spectral range where the light from the fifth light-emitting element 28 is absorbed and / or reflected by the beam splitters 30 and 32 (but in any case, not transmitted to the optical interface section 16). The supplementary light-emitting elements 20 and 24, and, if necessary, 22, are preferably operated at lower power or at an appropriate power. The objective here is to at least as much as possible recover the original spectrum of the fifth light-emitting element 28.

[0108] In some embodiments, the fifth light-emitting element 28 may alternatively be a green light-emitting element, or a generally colored light-emitting element that emits primarily within the spectral range transmitted by at least one beam splitter 30, 32. For example, in these embodiments, the fifth light-emitting element 26 may be an LED having an emission peak at approximately 530 nm. A green laser diode may also be considered for this purpose. It may be specified here that color mixing is performed in white light mode and, in particular, instead of using a single white light source such as a white LED, white light from individual light-emitting elements is selectively mixed.

[0109] It is understandable that, with suitable dyes, this green light-emitting element can also be used in fluorescence mode. Alternatively or additionally, it can be used in multispectral mode.

[0110] The illumination unit 18 defines a common optical path 54 into which the light emitted by the light-emitting elements 20, 22, 24, 26, and 28 can enter. The common optical path 54 extends from the exit side 44 of the second cross beam splitter 32 to the optical interface. The common optical path 54 is currently arranged coaxially with the fifth light-emitting element 26.

[0111] In the illustrated embodiment, the first group of light-emitting elements 20, 26 are arranged such that light emitted from the light-emitting elements 20, 26 travels at least substantially the same optical path length from the respective light-emitting elements 20, 26 to the optical interface portion 16. The first group of light-emitting elements 20, 26 each has a light-emitting surface 56, 58. The light-emitting surfaces 56, 62 are arranged equidistantly with respect to a common optical path 54. This is achieved by arranging the two light-emitting elements 20, 26 at the same distance from the beam splitter 32 (currently exemplarily a second beam splitter 32) associated with them, particularly their opposite entrance sides 28, 40. Light is then input into the common optical path 54 by the cross beam splitter 32.

[0112] The beam splitters 30 and 32 are arranged such that the light emitting surfaces 56, 58, 60, 62, and 64 of the light-emitting elements 20, 22, 24, 26, and 28 are arranged equidistantly with reference to the cross beam splitters 30 and 32 associated thereto.

[0113] By using cross beam splitters 30 and 32 and light-emitting elements 20, 22, 24, 26, and 28 that can be used together for different modes, the illumination unit 18 or illumination device 12 has a high degree of compactness. Furthermore, the equidistant arrangement ensures that no spectral shift occurs when the imaging device 14 or its light conductor is twisted relative to the optical interface portion 16.

[0114] It is understood that different numbers of light-emitting elements 20, 22, 24, 26, 28 and / or different numbers of cross beam splitters 30, 32 can be used. The use of cross beam splitters 30, 32 has proven to be particularly suitable. However, in other embodiments, other types of beam splitters and / or other optical elements can be used to input light from the light-emitting elements 20, 22, 24, 26, 28 into the optical interface section 16.

[0115] Figure 4 A schematic diagram of the imaging device 10 is shown. The imaging device 14 is optically connected to the optical interface section 16, for example, via a light conductor 106, such as at least one fiber optic cable.

[0116] Imaging device 10 has a control unit 66 configured to automatically coordinate the operating state of imaging device 14 and the illumination mode of illumination unit 18. Currently, the user can preset the operating mode of imaging device 14 through user operation. Then, control unit 66 can adjust the illumination mode of illumination unit 18 to match this. Alternatively or additionally, the user can adjust a specific illumination mode of illumination unit 18 through user operation. Then, control unit 66 can adjust the operating mode of imaging device 14 to match this. For example, illumination device 12 and / or imaging device 10 have a user interface through which the user can submit corresponding commands.

[0117] Imaging device 14 includes camera unit 68 and a distal lever 76. The distal lever 76 is optically coupled to camera unit 68. Camera unit 68 may have a connector for the distal lever 76, wherein the distal lever 76 may optionally be disengaged and coupled. The distal lever 76 may also be permanently optically and / or mechanically coupled to camera unit 68. Camera unit 68 is arranged proximally relative to lever 76. Camera unit 68 includes imaging sensing mechanism 108, which, in this case, is exemplarily a white light sensor 110 and a near-infrared sensor 112. Imaging sensing mechanism 108 may generally have one or more at least spatially resolved light sensors / image sensors, such as at least one CMOS sensor and / or at least one CCD sensor. Lever 76 includes an optical element (not shown) by means of which light can be directed to camera unit 68 so that the object to be depicted can be optically acquired. In addition, the rod 76 includes at least one optical path 114, defined for example by an optical conductor such as an optical fiber, which extends to the distal section 116 of the rod 76, and by means of the optical path, illumination light from the optical interface 16 of the illumination device 12 can be output to the object to be depicted.

[0118] The camera unit 68 has different operating states, specifically, for example, at least one multispectral operating state and a fluorescence operating state, and additionally, in this embodiment, a white light operating state, and, if necessary, a hyperspectral operating state. The control unit 66 automatically adapts the illumination mode of the illumination unit 18 to the current operating state of the camera unit 68. Here, the control unit 66 can adjust the image capturing behavior of the camera unit 68. For example, the control unit 66 can adjust the illumination duration, sensitivity / enhancement / gain, and / or other operating parameters of the camera unit 68, or in particular its image acquisition sensor 108, and, if necessary, its optics, thereby defining different operating states of the imaging device 14. In the present case, the control unit 66 triggers camera synchronization of the illumination unit 18.

[0119] Imaging device 14 includes filter unit 46 with optical filters 48, 50, and 52. Three optical filters are shown exemplarily, but it will be understood that different numbers of optical filters can be used. Filter unit 46 can switch between multispectral and fluorescence modes. Furthermore, filter unit 46 can be additionally switched to white light and / or hyperspectral modes. Optical filters 48, 50, and 52 can optionally be incorporated into the observation beam path 70 of camera unit 68, thereby defining different observation modes. They currently define the operating state of camera unit 68.

[0120] A basic imaging mode can be configured with multiple optical filters 48, 50, and 52. Especially for fluorescence imaging, other suitable optical filters can be used depending on the light-emitting elements 20, 22, 24, 26, and 28 used for excitation. For example, currently, the first light-emitting element 20 (red) is combined with an optical filter that transmits wavelengths greater than 730 nm but blocks shorter wavelengths. This allows for the detection of only fluorescence without detecting the excitation light itself. For example, this optical filter can absorb at least in the range of 600 nm to 730 nm. Furthermore, currently, for example, the second light-emitting element 22 (deep red) is combined with a filter that absorbs in the range of 700 to 850 nm or transmits significantly only above 850 nm.

[0121] The user can select specific filters 48, 50, and 52, and then immediately select the associated observation mode or operating state of the camera unit 68. For this purpose, the camera unit 68 has a filter sensor 72, which can automatically identify the optical filter currently being brought into the observation beam path 70. Therefore, the user can manually bring the selected filters 48, 50, and 52 into the observation beam path 70. In the example shown, the optical filters 48, 50, and 52 are mounted on a filter carrier 118. This filter carrier can be moved to different positions, thereby allowing one of the optical filters 48, 50, and 52 to be selected accordingly. Next, the filter sensor 72 identifies the currently selected optical filters 48, 50, and 52. Then, the control unit can determine the current operating state of the camera unit 68 and therefore the imaging device 14 based on the sensor signal from the filter sensor 72, and automatically adapt the illumination mode of the illumination unit 18 accordingly. Therefore, the user can place the entire imaging device 10 into the desired mode through simple user operations (such as manually selecting optical filters 48, 50, 52). In principle, the user can combine different filters with different illumination modes and thus produce different contrast types.

[0122] In the illustrated configuration, imaging device 14, and particularly rod 76, includes a broadband transmission optics 77, which can be used consistently under different illumination modes. In the present case, the broadband optics 77 are designed for a spectral range of at least 400 nm to 1000 nm. They are used consistently for different illumination and / or observation spectral ranges.

[0123] In some embodiments, the imaging device 14 may be configured as a stereoscopic endoscope including stereoscopic eyepieces on both sides. Different optical filters may be connected in series with these sides in a manner independent of each other, thereby allowing different contrast images to be superimposed on each other.

[0124] In the following text, the same reference numerals as described above are used in the context of other embodiments and variations using the same or similar components. In principle, reference to the above embodiments is sufficient for their description, while the differences between embodiments are mainly explained below. Furthermore, for clarity, reference numerals are partially omitted in the following figures.

[0125] Figure 5 A schematic diagram of another embodiment of the imaging device 10 is shown. The imaging device 10 includes an illumination device 12 and an illumination unit 18 having an optical interface 16, and an imaging device 14 attached to the optical interface 16. The imaging device 14 includes a camera unit 68 having an automatic filter unit 210. The automatic filter unit 210 includes a plurality of optical filters 48, 50, and 52, which can be automatically introduced into the observation beam path 70 of the camera unit 68 according to an observation mode predetermined by the user.

[0126] The automatic filter unit 210 includes a filter driver 212 configured to automatically move optical filters 48, 50, 52 into or out of the observation beam path 70. The optical filters 48, 50, 52 may be mounted on a filter carrier 118 attached to the filter driver 212. The filter driver 212 may be configured to move, for example, shift and / or rotate and / or pivot the filter carrier 118.

[0127] The imaging device 14 has a user interface 214, through which the user can adjust the desired observation mode. For example, the desired position of the filter carrier 118 can be predetermined by means of the user interface 214.

[0128] The imaging device 14 also includes a control unit 66. The control unit 66 is coupled to the filter driver 212 and the user interface 214. The control unit 66 is specifically configured to process user-preset values ​​for the observation mode and operate the filter unit 210 and the illumination unit 18 according to these user-preset values. The control unit 66 can therefore adjust the operating state of the imaging device 14 and the illumination mode of the illumination unit 18 in accordance with the observation mode selected by the user.

[0129] Figure 6 A schematic diagram of another embodiment of the imaging device 10 is shown. The imaging device 10 includes an illumination device 12 and an illumination unit 18 having an optical interface 16, and an imaging apparatus 14 attached to the optical interface 16. The imaging apparatus 14 includes a proximal base unit 310. The proximal base unit 310 is attached to the optical interface 16 of the illumination device 12. Therefore, illumination light generated by the illumination device 12 is supplied to the proximal base unit 310. The imaging apparatus 14 also includes a control unit 66, which in some embodiments may be integrated into the base unit 310.

[0130] Optionally, different replacement rods 312, 314 can be optically and electronically connected to the proximal base unit 310. The base unit 310 has an interface 316 for connecting the different replacement rods 312, 314. This interface 316 supplies illumination light from the illumination device 12 to the connected replacement rods 312, 314. Furthermore, the interface 316 is configured to power the connected replacement rods 312, 314 and / or electronically attach them to the control unit 66 of the imaging device 14.

[0131] Replacement levers 312 and 314 each have integrated cameras 318 and 320, and integrated optical filters 322 and 324, respectively. The integrated cameras 318 and 320 are configured as tipcams. Currently, the integrated camera 318 of the first replacement lever 312 is configured for multispectral imaging. Furthermore, the integrated camera 310 of the second replacement lever 314 is configured for fluorescence imaging. Existing optical filters 322 and 324 can be adapted to it.

[0132] In other implementations, alternative levers may be used that include only optical filters but not an integrated camera. These can then be coupled to a near-side camera unit. In some cases, the near-side camera unit may be configured without an additional filter unit. Specific optical filters or specific observation modes can be selected by choosing an appropriately equipped alternative lever.

[0133] The control unit 66 is configured to identify the connected replacement levers 312 and 314. This can be achieved through software, mechanical means, and / or sensor identification. The control unit 66 then determines, based on the identified replacement levers 312 and 314, in which operating state or observation mode the imaging device 14 should operate. The control unit 66 is also configured to adjust the illumination mode of the illumination unit 18. Therefore, the control unit 66 is configured to adjust the illumination mode of the illumination unit 18 according to the observation mode defined by the currently connected replacement levers 312 and 314.

[0134] Replacement levers 312 and 314 and imaging device 10 are, in this case, part of medical imaging system 316. Medical imaging system 316 allows the user to select appropriate replacement levers 312 and 314, connect them to base unit 310, and thereby determine the mode used for the entire imaging device 10. Thus, through the simple replacement of replacement levers 312 and 314, illumination device 18 automatically adapts to the desired image acquisition mode.

[0135] Figure 7 A schematic perspective view of another embodiment of the imaging device 10' is shown. The reference numerals in this embodiment are apostrophized for distinction. In this embodiment, the imaging device 10' is configured as an exoscopy imaging device. It includes an illumination device 12' and an imaging device 14'. Their basic operating principles correspond to those described above; however, in this embodiment, the imaging device 14' is configured as an exoscopy.

[0136] The aspects described above can also be summarized or described as follows. Figure 8 A schematic flowchart illustrating a method for generating illumination light for an imaging device 14 using an illumination device 12 is shown. The flow of this method is also derived from the above embodiment. The illumination device 12 here includes an optical interface 16 for optical attachment to the imaging device 14 and an illumination unit 18 configured to supply illumination light to the optical interface 16. The illumination unit 18 includes a plurality of light-emitting elements 20, 22, 24, 26, 28 that can be selectively activated independently of each other, and are configured to emit light according to different emission spectra to supply illumination light.

[0137] The method includes step S11, which involves at least temporarily activating a first group of light-emitting elements 20, 22, 24, 26, and 28 to supply illumination light for multispectral imaging. Furthermore, the method includes step S12, which involves at least temporarily activating a second group of light-emitting elements 20, 22, 24, 26, and 28 to supply illumination light for fluorescence imaging. One of the light-emitting elements 20, 22, 24, 26, and 28 is activated at least temporarily both during the activation of the first group and during the activation of the second group.

[0138] Figure 9 A schematic flowchart of a method for operating imaging device 10 is shown. The flow of this method is also derived from the above embodiment. In step S21, imaging device 10 is provided with imaging apparatus 14. In step S22, illumination light is supplied to imaging apparatus 14. According to reference... Figure 8 The described method supplies illumination light to the imaging device 14.

[0139] Figure 10 A schematic flowchart of a method for operating imaging device 10 is shown. The flow of this method is also derived from the above embodiment. The method includes step S31 of providing illumination device 12 to provide illumination light for imaging device 14. Imaging device 14 here includes an optical interface portion 16 for optical attachment of imaging device 14 and an illumination unit 18 configured to supply illumination light to optical interface portion 16. Illumination unit 18 is configured to be multi-mode and can operate in a variety of different illumination modes. Furthermore, the method includes step S32 of providing imaging device 14, which can be connected to the optical interface portion 16 of illumination device 12. Furthermore, the method includes step S33 of automatically coordinating the operating state of imaging device 14 and the illumination mode of illumination unit 18.

[0140] The following section will describe aspects involving the generation of views from fluorescence images and anatomical images. Figure 11 A schematic diagram of a medical imaging device 410 according to this aspect is shown. The medical imaging device 410 can, in principle, be configured and / or constructed as described in imaging device 10 or as described in imaging device 10'. In particular, reference is made to the above description regarding the details of the operating principles and design schemes of the components of the imaging device 410. For the purpose of illustrating this aspect, reference may be made to purely illustrative diagrams for understanding. Figure 11 Other accompanying figures are used to describe the technical situation.

[0141] In a specific example, the imaging device 410 is an endoscope, but it could also be an exoscope and / or a microscope. The imaging device 410 includes an illumination unit 412 having at least one light source 414. For example, the illumination unit 412 can be constructed as described above with reference to illumination device 12. For the following description, it is assumed that the illumination unit 412 is constructed in this manner. However, this is purely exemplary for understanding purposes. In principle, the illumination unit 412 is configured to provide illumination light 432, 438, by means of which the object 418 to be depicted can be illuminated. This will be discussed in more detail below.

[0142] Imaging device 410 also includes an image acquisition unit 420 with a suitable image acquisition sensing mechanism 422. The image acquisition sensing mechanism 422 is currently configured to capture images in both the visible and near-infrared ranges. For example, the image acquisition sensing mechanism 422 is sensitive at least in the range between 450 nm and 950 nm, and in some embodiments, it is sensitive in the range between 400 nm and 1000 nm.

[0143] The object 418 to be depicted is, for example, an anatomical structure, such as an anatomical structure within a patient's cavity. The anatomical structure includes a region 454 marked with a fluorescent dye. Using the imaging device 410, a user can observe the anatomical structure and the marked region 454, and the fluorescence of the marked region 454 distinguishes it from the surrounding tissue. The anatomy of the marked region 454 is referenced as an exemplary application, where other applications of fluorescent labeling of tissues are also familiar to those skilled in the art.

[0144] In the current case, the marked area 454 is marked with a fluorescent dye that absorbs light in the visible range and also fluoresces at least partially or only in the visible range. Exemplary absorption and emission spectra are shown in... Figure 12 The upper region is represented by a continuous line or dashed line in the graph, where the intensity is plotted as a function of wavelength. To excite the dye, light is incident with wavelengths within the dye's absorption range. This is in Figure 12 The wavelengths are indicated by dashed lines, with the relevant wavelengths marked as points on the x-axis. This relates to... Figure 11 The middle arrow indicates illumination light 432.

[0145] The dye is, for example, dihydrofluorescein. This dye can be suitably excited at wavelengths of 430 nm or 460 nm. In particular, this can be achieved using the third light-emitting element 24 described above. Another example of a dye is Cy5. This dye can be suitably excited at a wavelength of 660 nm. In particular, this can be achieved using the first light-emitting element 20 described above.

[0146] To perform fluorescence imaging, the image acquisition unit 420 includes an observation filter 424. It is positioned in front of and / or integrated into the image acquisition sensing mechanism 422, such that the illumination light 432 is not diffusely reflected onto the image acquisition sensing mechanism 422 or at least not diffusely reflected onto its individual sensors, but rather only or at least primarily diffusely reflected the light 434 emitted by the dye-based fluorescence excitation of the object 418.

[0147] exist Figure 12 In the lower region, the appropriate transmission spectrum of the observation filter 424 is indicated, which allows for this fluorescence imaging. The observation filter 424 is configured to block light in a first spectral range 426 and transmit light in a second spectral range 428, which is different from the first spectral range 426. The observation filter 420 is appropriately selected according to the dye used or the absorption and emission spectra. As described above, the imaging device 410 may include multiple optical filters, which may optionally be used as observation filters. Thus, fluorescence imaging for different fluorescent dyes can be performed by means of the imaging device 410.

[0148] have Figure 12 The transmissive observation filter 424 shown is a high-pass edge filter. In the edge regions, the transmission behavior of the observation filter 424 changes abruptly, where the corresponding edge can still have a certain width. The edge regions may, in some cases, not belong to either of the two spectral ranges 426 and 428.

[0149] Based on the location, width, and shape of the absorption peaks of the relevant dyes, an observation filter with two edges can be used instead of an observation filter 424 with a single edge. This is in Figure 13 The example is shown below. The first spectral range 426' is located between two sub-ranges of the second spectral range 428'. Therefore, transmitted light is both above and below the first spectral range 426'. In this case, the observation filter hides only one sub-range of the observable spectral range, which is within the visible range.

[0150] The image acquisition unit 420 is also configured to operate in a white light mode or an anatomical mode, wherein the object 418 is illuminated by illumination light 438 that is at least partially located within the second spectral range 428, and wherein light 440 diffusely reflected by the object 418 is detected. Figure 11As schematically shown, a portion of the diffusely reflected light 440 is blocked by the observation filter 424, while the portion located outside the first spectral range 426 or within the second spectral range 428 is allowed to pass through to reach the image acquisition sensor 422. If the first spectral range 426 is selected based on the dye used, such that it falls within the visible range, then even if white light is incident, a complete white light image cannot be captured. This can be achieved, for example, by means of a white light emitting element as described above.

[0151] The following will be added to the discussion. Figure 14 For reference. The image acquisition unit 420 is configured to capture a fluorescence image 430 of the object to be depicted through the observation filter 424 in the manner described. Furthermore, the image acquisition unit 420 is configured to capture an anatomical image 436 of the object to be depicted 418 in the manner described. Currently, the anatomical image 436 is an image in which broadband illumination light is incident and diffusely reflected light is detected. Figure 14 The diagram illustrates a scenario where multiple anatomical images 436 and multiple fluorescence images 430 are captured over time, or corresponding image data is obtained. Specifically, these images are captured sequentially by alternating between capturing one or more anatomical images 436 and then one or more fluorescence images 430 (or vice versa) according to a specific logic, or by capturing anatomical images 436 and fluorescence images 430 simultaneously. This depends on the design and operating type of the image acquisition sensor mechanism 422.

[0152] Because the images are captured through observation filter 424, the anatomical images 436 are not true white light images. Rather, they are acquired by processing individual images and / or color channels according to one or more of the principles described below. Imaging device 410 also includes a view generation unit 442 configured to generate views 444 from fluorescence images 430 and anatomical images 436. These currently include combined views and / or overlay views based on a combination or overlay of one or more anatomical images 436 and one or more fluorescence images 430.

[0153] The view generation unit 442 is configured to associate the captured fluorescence image 430 and the captured anatomical image 436 with each other. This can be done either when the images are captured sequentially or simultaneously. In the case shown, this involves temporal association. This association is based on information about the time point in time when the images were captured, so the view 444 contains temporally related anatomical and fluorescence information. For example, motion images can be provided to the user in real time.

[0154] like Figure 11As illustrated schematically, the imaging device 410 includes a display 452, through which a generated view 444 can be displayed to a user. This design is purely exemplary for illustrative purposes. In particular, in other embodiments, the display may be connected to the imaging device 410 only via an interface, and is not necessarily an integral part thereof.

[0155] As described above, even under broadband illumination, image information cannot be obtained across the entire visible area when capturing anatomical images 436 based on observation filter 424. If conventional white light imaging is performed, the associated white light images may be distorted in terms of color, or in some cases may fail to correctly display specific anatomical structures.

[0156] Therefore, it is stipulated that, in addition to image information from the visible range, image information from the near-infrared range is also used to generate the anatomical image 436. Thus, information that is unavailable in some cases due to the observation filter 424 can be provided in other ways.

[0157] This is Figure 15 The four color channels of the image are shown purely exemplarily, as might be obtained when illuminated with white light and near-infrared light. For illustrative purposes, it should be assumed that specific anatomical structures or other image information can be seen only in the blue (B), green (G), or red (R) color channels and / or individual images. If these color channels and / or individual images B, G, R are fully combined, a correct white light image of object 418 may be obtained. However, due to imaging through observation filter 424, image information, such as from the blue color channel and / or individual blue images, is missing. If only the green and red color channels and / or individual green and red images are combined, an incomplete image may be obtained. However, this aspect specifies the additional addition of near-infrared color channels (NIR) and / or individual near-infrared images. Thus, details of anatomical structures can be seen where necessary, which are visible in the unavailable spectral range (exemplarily in blue here). If this additional image information is now combined with the available color channels and / or individual images, an anatomical image 436 that correctly shows the anatomy can be obtained, although it is not a true white light image.

[0158] Then, the anatomical image 436 obtained in this manner is combined with the fluorescence image 34 in the manner and method described to generate a view 444 containing information on the anatomy of the object 418 and the fluorescence of the marked region 454.

[0159] Various possibilities are described below for different design schemes of the image acquisition sensing mechanism 422 and / or for different means of acquiring anatomical images 436 using available information. Accordingly, it is assumed that a multi-mode illumination unit is used. For example, consistent with the embodiments described above, it includes white light image emitting elements as well as blue emitting elements, for example, emitting at 430 nm or 460 nm; red emitting elements, for example, emitting at 660 nm; deep red emitting elements, for example, emitting at 765 nm or 770 nm; and near-infrared emitting elements, for example, emitting at 940 nm. However, as mentioned above, this is mainly for comprehension, and illumination units of different designs may also be used.

[0160] Figure 16 A first example is shown, in which the image acquisition sensing mechanism 422 includes a dual-chip image sensor. As exemplarily described above, the depicting light is distributed across the two sensors. The first image sensor (VIS) operates in the visible range, for example, at wavelengths up to about 700 nm, and the second image sensor (NIR) operates in the near-infrared range, for example, at wavelengths starting from about 700 nm. In this example, dihydrofluorescein is used as the dye. It is excited by means of a blue light-emitting element. Due to the observation filter 424, the blue light cannot be detected. In addition to the illumination used to excite the dye, illumination is provided, for example, with a deep red light-emitting element and / or a near-infrared light-emitting element.

[0161] A fluorescence image 430 is acquired using a VIS image sensor. An anatomical image 436 is acquired using a NIR image sensor. The anatomical image 436 is output as a grayscale image, ensuring that acquisition within the near-infrared range, imperceptible to the user, is not an obstacle. The view generation unit 442 thus generates a view 444, which superimposes the grayscale anatomical image 436 and the fluorescence image 436 onto each other. The fluorescence image 430 and the anatomical image 436 can be captured in real time, for example, at at least 24 fps, at least 30 fps, or even at least 60 fps. Since different image sensors are used to acquire the fluorescence image 430 and the anatomical image 436, they can also be acquired simultaneously. Sequential acquisition is not required.

[0162] Figure 17 A second example is shown, in which the image acquisition sensing mechanism 422 also includes a dual-chip image sensor. As previously described, the fluorescence image 430 is captured using a VIS image sensor. However, unlike the first example, the anatomical image 436 and the fluorescence image 430 are captured sequentially. This allows for the use of both an NIR image sensor and a VIS image sensor for the anatomical image 436.

[0163] The VIS image sensor provides three color channels 436B, 436G, and 436R, all of which can in principle be used for the anatomical image 436. Due to the observation filter 424, the blue color channel 436B is almost unusable or completely unusable because little or no light diffusely reflected by the object 418 passes through the observation filter 424 in the corresponding spectral range. Therefore, the blue color channel 436B is not considered at this time. However, the anatomical image 436 is obtained using the green color channel 436G and the red color channel 436R from the VIS image sensor image data, as well as a single near-infrared image 436NIR from the NIR image sensor. Therefore, the anatomical image 36 is reconstructed by replacing the blue channel with the near-infrared channel or the single near-infrared image. Thus, a color anatomical image can be generated. However, because the anatomical image 436 and the fluorescence image 430 are captured sequentially, the frame rate is halved in this example.

[0164] In some applications, a lower refresh rate for fluorescence information than for anatomical information may be acceptable. For example, starting with a usable frame rate of 60 fps, multiple anatomical images, such as two, three, or five, can always be captured sequentially before capturing the fluorescence image. The view generation unit then associates the last captured fluorescence image with each of the multiple anatomical images. For example, this approach could capture 50 anatomical images and 10 fluorescence images per second. In this example, the actual refresh rate for the fluorescence information is only 10 fps, but this is imperceptible to the user when necessary due to the higher refresh rate for the anatomical information.

[0165] Figure 18 A third example is shown. In this example, the image acquisition sensing mechanism 422 includes a one-chip image sensor (OC). It uses red, green, and blue channels and is also capable of detecting near-infrared light in all three channels. In this example, the dye Cy5 is excited. This is accomplished, for example, by means of a red light-emitting element.

[0166] Anatomical image 436 and fluorescence image 430 are captured sequentially. For fluorescence image 430, image data from the image sensor can be used unchanged.

[0167] In this case, the observation filter 424 hides the first spectral range 426 from approximately 600 nm to approximately 700 nm. The second spectral range 428 lies both above and below the first spectral range 426 (see [reference]). Figure 13(Exemplary view in the image). Due to the observation filter 424, light in the first spectral range 28 is not detected. If the anatomical image 436 is captured, the red channel still supplies the signal because near-infrared light is acquired by all three channels of the image sensor. In this example, the anatomical image 436 is calculated by combining the three channels in a suitable manner. For example, an anatomical image 436 with color channels R'G'B' is obtained by using the red channel of the image sensor as the red channel of the anatomical image 436, i.e., R' = R, by using the difference between the green and red channels of the image sensor as the green channel G', i.e., G' = GR, and by using the difference between the blue and red channels of the image sensor as the blue channel of the anatomical image 436, i.e., B' = BR.

[0168] It is understood that any other combination, especially linear combinations, can be used. They can also be weighted as necessary based on the response behavior of the relevant image sensor and / or based on the observation filter 424 used. As another example, in the case of excitation of dihydrofluorescein (in which the corresponding blue light will be blocked), the color channels of the anatomical image 436 can be calculated as follows: R' = RB; G' = GB; B' = B.

[0169] Figure 19 A fourth example is shown. In this example, the image acquisition sensing mechanism 422 includes a four-chip image sensor having separate image sensors for a blue channel (B), a green channel (G), a red channel (R), and a near-infrared channel (NIR). Light from object 418 is distributed to these four sensors. In this example, an illumination unit may also be used instead of a white light emitting element, comprising a combination of three or more emitting elements that mixes the light so that it can be used instead of white light. For example, a combination of red, green, and blue emitting elements can be used. Although they emit only within a specific and, if necessary, very narrow wavelength range, this provides illumination for capturing red, green, and blue images, thereby obtaining an image perceived by the user as a white light image. In this case, for example, there are monochromatic emitting elements as described above, and additionally, the aforementioned combination of colored emitting elements is used instead of a white light emitting element.

[0170] In principle, this configuration can operate in a manner similar to the first and second examples described above. The observation filter 424 is then positioned, for example, in front of the four-chip image sensor. Another variant will be explained below, which can be implemented using the system according to the fourth example.

[0171] For example, dihydrofluorescein is again used as a dye. To excite the dye, light is incident via a blue light-emitting element. The diffusely reflected light falls within the green range and is detected by a green image sensor. A filter integrated into the green image sensor and / or arranged in front of the image sensor (which makes the image sensor selective for green light) serves as observation filter 424. Therefore, the image from the green image sensor can be used as the fluorescence image 430 because the blue excitation light does not fall on the green image sensor.

[0172] To additionally acquire anatomical images, illumination is also provided, for example, using a near-infrared luminescent element. Therefore, light is diffusely reflected by the object in both the blue and near-infrared ranges. Furthermore, the dye used does not fluoresce in these ranges. The dye dihydrofluorescein primarily emits in the green range, and its emission spectrum extends into the red range at lower intensities. Therefore, green and red image sensors are not used for anatomical image 436. Thus, anatomical image 436 is obtained by combining a single blue image 436B acquired using a blue image sensor and a single near-infrared image 436NIR acquired using a near-infrared image sensor.

[0173] It is understandable that a similar situation could occur when using another dye, for example, which can be excited by green light and emit red light.

[0174] Figure 20 A schematic flowchart of a method for medical imaging is shown, and the flow of the method is also derived from the above embodiment. In step S41, illumination light 438 is provided to illuminate the object 418 to be depicted. In step S42, a fluorescence image 430 of the object 480 to be depicted is captured through an observation filter 424, which is configured to block light including visible light within a first spectral range 426 and transmit light within a second spectral range 428 different from the first spectral range 426. When capturing the fluorescence image 430, illumination light 432 (whose spectrum is at least partially within the first spectral range 426) is used as excitation light, and light 434 emitted by the object 418 to be depicted (whose spectrum is at least partially within the second spectral range 428) is detected. Furthermore, the method includes step S43, in which an anatomical image 436 of the object 418 to be depicted is captured, wherein when capturing the anatomical image 436, an illumination light 438 (whose spectrum is at least partially within the second spectral range 428) is used, and light 440 diffusely reflected by the object 414 to be depicted (whose spectrum is at least partially within the second spectral range 428) is detected.

[0175] Figure 21A schematic diagram of a computer program product 448 having a computer-readable medium 450 is shown. Program code is stored on the computer-readable medium and is configured to, when implemented in a processor, cause execution of one and / or all of the described methods.

[0176] Explanation of reference numerals in the attached figures

[0177] 10 Imaging equipment

[0178] 12 Lighting equipment

[0179] 14 Imaging devices

[0180] 16 Optical Interface Section

[0181] 18 lighting units

[0182] 20 Light-emitting elements

[0183] 22 Light-emitting elements

[0184] 24 Light-emitting elements

[0185] 26 Light-emitting elements

[0186] 28 Light-emitting elements

[0187] 30 beam splitter

[0188] 32 beam splitters

[0189] 34. Entrance side

[0190] 36. Entrance side

[0191] 37. Entrance side

[0192] 38. Entrance side

[0193] 40 Entrance side

[0194] 41. Entrance side

[0195] 42 Export side

[0196] 44 Export side

[0197] 46 filter units

[0198] 48 Filters

[0199] 50 filter

[0200] 52 Filter

[0201] 54 Optical Path

[0202] 56 light-emitting surfaces

[0203] 58 light-emitting surfaces

[0204] 60 light-emitting surface

[0205] 62 light-emitting surfaces

[0206] 64 light-emitting surfaces

[0207] 66 Control Department

[0208] 68 camera units

[0209] 70 Observation beam path

[0210] 72 Filter Sensor

[0211] 74 display units

[0212] 76 strokes

[0213] 77 Optical Devices

[0214] 78 Lenses

[0215] 80 lens

[0216] 82 lens

[0217] 84 lens

[0218] 86 lens

[0219] 88 lens

[0220] 90 beam splitter elements

[0221] 92 beam splitter elements

[0222] 94 beam splitter elements

[0223] 96 beam splitter elements

[0224] 98 Transmission Spectrum

[0225] 100 Transmission Spectrum

[0226] 102 Transmission Spectrum

[0227] 104 Transmission Spectrum

[0228] 106 Optical Conductor

[0229] 108 Imaging Sensor Mechanism

[0230] 110 White Light Sensor

[0231] 112 Near-infrared sensor

[0232] 114 Optical Path

[0233] 116 Distal Section

[0234] 210 filter unit

[0235] 212 Filter Driver

[0236] 214 User Interface

[0237] 310 Base Unit

[0238] 312 Replacement lever

[0239] 314 Replacement Rod

[0240] 316 Imaging System

[0241] 318 camera

[0242] 320 camera

[0243] 322 filter

[0244] 324 filter

[0245] 410 Imaging Equipment

[0246] 412 Lighting Units

[0247] 414 Light Source

[0248] 416 illumination light

[0249] 418 Objects

[0250] 420 Image Acquisition Unit

[0251] 422 Image Acquisition Sensing Mechanism

[0252] 424 observation filter

[0253] 426 First spectral range

[0254] 428 Second Spectral Range

[0255] 430 Fluorescence Image

[0256] 432 illumination light

[0257] 434 Light

[0258] 436 Anatomical Images

[0259] 438 illumination light

[0260] 440 light

[0261] 442 View Generation Unit

[0262] 444 Views

[0263] 448 Computer Program Products

[0264] 450 Computer-readable media

[0265] 452 Monitor

Claims

1. A medical imaging device (410), in particular an endoscope, an exoscopic device and / or a microscope device, comprising: an illumination unit (412) having at least one light source (414) configured to provide illumination light (416) for illuminating an object (418) to be depicted; and - an image acquisition unit (420) comprising at least one image acquisition sensor mechanism (422) and at least one observation filter (424), wherein the observation filter (424) is configured to block light including visible light within a first spectral range (426) and transmit light within a second spectral range (428) different from the first spectral range (426); The image acquisition unit (420) is configured to capture a fluorescence image (430) of the object (418) to be depicted through the observation filter (424); when the image acquisition unit captures the image, illumination light (432) whose spectrum is at least partially within the first spectral range (426) is used as excitation light; and when the image acquisition unit captures the image, the image acquisition sensor mechanism (422) detects light (434) emitted by the object (418) to be depicted, whose spectrum is at least partially within the second spectral range (428); and wherein the image acquisition unit (420) is configured to capture an anatomical image (436) of the object (418) to be depicted, using illumination light (438) whose spectrum is at least partially within the second spectral range (428) when the image acquisition unit captures the image, and also detecting light (440) diffusely reflected by the object (418) to be depicted, whose spectrum is at least partially within the second spectral range (428) when the image acquisition unit captures the image, by the image acquisition sensor mechanism (422); and A view generating unit (442) is configured to generate at least one view (444) from the fluorescence image (430) and the anatomical image (436).

2. The medical imaging device (410) according to claim 1, wherein the image acquisition unit (24) is configured to capture the anatomical image (436) of the object (84) to be depicted through the observation filter (424).

3. The medical imaging device (410) according to any of the preceding claims, wherein the minimum wavelength of the first spectral range (426) is greater than 430 nm and in particular greater than 500 nm.

4. The medical imaging device (410) according to any one of the preceding claims, The at least one view (444) comprises a combined view, in particular an overlay view, which is based on a combination of a fluorescence image (34) and an anatomical image (436).

5. The medical imaging device (410) according to any one of the preceding claims, The image acquisition unit (420) is configured to capture the fluorescent image (430) and the anatomical image (436) in real time, and The view generation unit (442) is configured to generate the at least one view (444) in real time.

6. The medical imaging device (410) according to any one of the preceding claims, The image acquisition unit (24) is configured to sequentially capture the fluorescent image (430) and the anatomical image (436), The view generation unit (442) is configured to associate sequentially captured fluorescence images (430) and anatomical images (436) with each other, in particular in terms of time, and to generate the at least one view (444) based on the associated fluorescence images (430) and anatomical images (436).

7. The medical imaging device (410) according to any one of the preceding claims, The image acquisition sensor mechanism (422) includes at least one first image acquisition sensor (VIS, NIR, OC, R, G, B), wherein the first image acquisition sensor is configured to acquire image information for the fluorescent image (430), and The image acquisition sensing mechanism (422) includes at least one second image acquisition sensor (VIS, NIR, OC, R, G, B), and the second image acquisition sensor is configured to acquire image information for the anatomical image (436).

8. The medical imaging device (410) according to any one of the preceding claims, The image acquisition sensor mechanism (422) is configured to simultaneously capture a fluorescent image (430) and an anatomical image (436).

9. The medical imaging device (410) according to any one of the preceding claims, The view generation unit (442) is configured to generate at least one anatomical image (436) from a plurality of, in particular monochrome, individual images (436B', 436NIR') and / or from a plurality of color channels of an anatomical image (436B, 436G, 436R, 436NIR).

10. The medical imaging device (410) according to any one of the preceding claims, The anatomical image (436) comprises at least two color channels, at least one of which is within the visible range and at least one of which is outside the visible range, in particular within the near infrared range.

11. The medical imaging device (410) according to any one of the preceding claims, The anatomical image (436) corresponds to a white light image having a plurality of color channels, in which at least one color channel from the visible range is replaced by at least one color channel located outside the visible range, in particular in the near infrared range.

12. The medical imaging device (410) according to any one of the preceding claims, The lighting unit (412) is constructed to be multi-mode and includes a plurality of light-emitting elements (20, 22, 24, 26, 28) that can be optionally activated independently of each other and are configured to emit light according to different emission spectra to provide the lighting light (438).

13. The medical imaging device (410) according to any one of the preceding claims, The image acquisition unit (420) is configured for multispectral and / or hyperspectral imaging.

14. A method for medical imaging, in particular a method for medical imaging using a medical imaging device (410) according to any one of the preceding claims, comprising: providing illumination light (438) for illuminating an object to be depicted (418); capturing a fluorescence image (430) of the object (480) to be depicted through an observation filter (424), the observation filter being set to block light including visible light within a first spectral range (426) and transmit light within a second spectral range (428) different from the first spectral range (426), wherein when capturing the fluorescence image (430), illumination light (432) whose spectrum is at least partially within the first spectral range (426) is used as excitation light, and light (434) emitted by the object (418) to be depicted, whose spectrum is at least partially within the second spectral range (428), is detected; and An anatomical image (436) of the object (418) to be depicted is captured, wherein illumination light (438) whose spectrum at least partially lies within the second spectral range (428) is used when capturing the anatomical image (436), and light (440) diffusely reflected by the object (418) to be depicted is detected, whose spectrum at least partially lies within the second spectral range (428).

15. Program code, which is designed to cause the execution of the method according to claim 14 when it is executed in a processor.

16. Computer program product (448) comprising a computer readable medium (450) on which the program code according to claim 15 is stored.

Images