Medical imaging device, method for operating a medical imaging device, and method for medical imaging

Abstract

The invention relates to a medical imaging device (10), comprising: a spatially and spectrally resolved image acquisition unit (12), which comprises at least one optical device (14) and at least one image acquisition sensor (16) coupled to the optical device, which are configured to perform an image acquisition of an image region (18), generating image data of spatial and spectral resolution in image acquisition, wherein the image data comprises both spatial information and spectral information; an evaluation unit (20), which is designed to create an analysis of the spatially and spectrally resolved image data, which analysis is based on the spatially and spectral information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data; a disturbance detection unit (22), which is designed to detect the presence of a disturbance during image acquisition and to determine a disturbance situation during image acquisition, independently of the analysis of the image data and independently of the calculated analysis parameters; and an output unit (24) configured to generate a user output based on the analysis parameter in accordance with the disturbance situation. The invention also relates to a method for operating a medical imaging device (10) and to a method for medical imaging.

Description

Technical Field

[0001] The invention relates to a medical imaging device, a method for operating a medical imaging device and a method for medical imaging. Background Art

[0002] Medical imaging devices, such as endoscopic devices or exoscopic devices, which generate multispectral or hyperspectral images are known from the prior art. Multispectral or hyperspectral images have a spectral dimension in addition to two spatial dimensions (such as the spatial dimensions of a conventional image of a camera). The spectral dimension includes a plurality of spectral bands (wavelength bands). Multispectral and hyperspectral images differ primarily in the number and width of their spectral bands.

[0003] In particular, in the context of medical applications, some imaging devices are known for generating such multispectral or hyperspectral images. For example, DE 20 2014 010 558 U1 describes a device for capturing hyperspectral images of an examination area of ​​a body. An input lens for generating an image in an image plane and a slit-shaped aperture for hiding a slit-shaped area of ​​the image are arranged in the device. The light passing through the aperture is fanned out with the aid of a dispersion element and recorded with the aid of a camera sensor, whereby a large number of spectra can be recorded by the camera sensor along the longitudinal direction of the slit-shaped aperture, and the spectra have correspondingly assigned spatial coordinates. The described device is further configured to record other spectra along the longitudinal direction of the slit-shaped aperture in a direction different from the longitudinal direction of the slit-shaped aperture. The method for generating multispectral or hyperspectral images on which this disclosure is based is also referred to as a so-called push-scan method.

[0004] In addition to the push-broom method, there are other methods for generating multispectral or hyperspectral images. In the so-called swing-broom method, the inspection area or object is scanned point by point, and a spectrum is obtained for each point. In contrast, the staring method captures multiple images with the same spatial coordinates. Here, different spectral filters and / or illumination sources are used between the individual images to distinguish the spectral information. There is also a method according to which a two-dimensional polychromatic image is decomposed into multiple spectral single images by appropriate optical elements, such as optical slicers, lenses and prisms, which are collected simultaneously on different detectors or detector areas. This is sometimes called a snapshot method.

[0005] As described in DE 10 2020 105 458 A1, multispectral and hyperspectral imaging devices are particularly suitable as endoscopic imaging devices. In this context, multispectral and / or hyperspectral imaging is used, for example, in the basic field of application for diagnosis and for evaluating the success or quality of an operation.

[0006] The durability and low error susceptibility of the imaging device are crucial in order to enable a high quality and reliability of the imaging device-based interpretation of multispectral and hyperspectral images for the user. The durability and error susceptibility may depend on the influence of disturbances during the image acquisition process. Disturbances known in this context may be, for example, smoke after thermal manipulation of tissue, contaminated or vaporized lenses of the imaging device or even inorganic materials (instruments, scrapers, wires, etc.) in the image area. These disturbances may lead to disturbing conditions of the image acquisition, which may make a reliable interpretation of the multispectral and hyperspectral images difficult. Summary of the invention

[0007] Starting from the prior art, the object of the present invention is to provide an imaging device and an imaging method, by means of which disturbances and / or disturbance conditions during image acquisition can be identified.

[0008] The imaging device according to the invention may comprise a spatially and spectrally resolved image acquisition unit, the image acquisition unit comprising at least one optical device and at least one image acquisition sensor mechanism connected to the optical device, the optical device and the image acquisition sensor mechanism being configured to perform image acquisition on an image area, generating spatially and spectrally resolved image data during the image acquisition, the image data comprising both spatial information and spectral information. Furthermore, the imaging device may comprise an evaluation unit, which is configured to create an analysis of the spatially and spectrally resolved image data, the analysis being based on the spatial and spectral information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data. The imaging device may also comprise an interference recognition unit, which is configured to recognize the presence of interference during image acquisition and to determine the interference condition during image acquisition. Finally, the imaging device may comprise an output unit, which is configured to generate a user output based on the analysis parameters according to the interference condition.

[0009] According to one aspect, a medical system is provided that includes an imaging device and a medical instrument.

[0010] Furthermore, the present invention may relate to a method for operating a medical imaging device, wherein the medical imaging device comprises a spatially and spectrally resolved image acquisition unit. The image acquisition unit comprises at least one optical device and at least one image acquisition sensor mechanism connected to the optical device, wherein the at least one optical device and the at least one image acquisition sensor mechanism are configured to perform image acquisition of an image region and generate spatially and spectrally resolved image data during the image acquisition. The image data comprises both spatial information and spectral information. An imaging device according to the present invention may be involved here. The method may comprise the step of acquiring spatially and spectrally resolved image data of an image region by means of a medical imaging device. Furthermore, the method may comprise the step of creating an analysis of the spatially and spectrally resolved image data, which is based on the spatial and spectral information and based on at least one analysis parameter calculated from the spatially and spectrally resolved image data. The method may also comprise performing interference recognition, wherein the presence of interference during image acquisition is recognized and the interference condition during image acquisition is determined. The method may also comprise the step of generating a user output based on the analysis parameter according to the interference condition.

[0011] Furthermore, the present invention may include a method for medical imaging. The method may be performed with an imaging device according to the present invention and / or a medical system according to the present invention. The method may include performing an image acquisition of an image region, generating spatially and spectrally resolved image data in the image acquisition, which includes both spatial information and spectral information. Furthermore, a step of the method is to create an analysis of the spatially and spectrally resolved image data, which is based on the spatial and spectral information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data. The method may also include a step of performing interference identification, in which the presence of interference during image acquisition is identified and the interference condition during image acquisition is determined. Furthermore, the method may include a step of generating a user output based on the analysis parameters according to the interference condition.

[0012] The features according to the invention make it possible to reliably perform and / or evaluate diagnostic and / or therapeutic actions. In particular, high-quality multispectral and / or hyperspectral imaging can be achieved, since possible interferences of spatially and spectrally resolved information in the form of spatially and spectrally resolved image data can be identified during display. By outputting the interferences during image acquisition and the interference conditions during image acquisition to the user in this way, incorrect interpretations on the part of the user can be avoided. With reference to the example of the application of the invention as part of a medical system, incorrect interpretations of physiological tissue parameters such as oxygen saturation, blood content, water content or fat content, which are the basis for performing and / or evaluating therapeutic and / or diagnostic measures, can be prevented.

[0013] The interference recognition unit may be configured to recognize the presence of interference during image acquisition and determine the interference condition during image acquisition in a manner independent of the analysis of the image data and the calculated analysis parameters. Alternatively or additionally, in the method according to the present invention for operating a medical imaging device and / or in the method according to the present invention for medical imaging, the step of performing interference recognition may include, during interference recognition, recognizing interference during image acquisition and determining the interference condition of image acquisition in a manner independent of the analysis of the image data and independent of the calculated analysis parameters.

[0014] The imaging device can be a microscopic imaging device, a macroscopic imaging device and / or an exoscopic imaging device. The imaging device can be constructed as a microscope, a macroscope and / or an exoscope and / or include such a microscope, a macroscope and / or an exoscope. In some embodiments, the imaging device is an endoscopic imaging device. The imaging device can be an endoscopic device. It can include an endoscope and / or an endoscope system and / or be constructed as such an endoscope and / or an endoscope system, and / or constitute at least a part and preferably at least a majority and / or a main component of an endoscope and / or an endoscope system. "At least a majority" can refer to at least 55%, preferably at least 65%, preferably at least 75%, particularly preferably at least 85% and very particularly preferably at least 95%, specifically especially in terms of the volume and / or mass of the object.

[0015] In some embodiments, the imaging device is configured to be introduced into a cavity for identification and / or observation, for example, an artificial and / or natural cavity, such as the interior of the body, a body organ, a tissue, etc. The imaging device can also be configured to be introduced into a housing, a housing, a well, a tube or other, in particular artificial, structure for identification and / or observation.

[0016] In particular, when the imaging device is an endoscopic imaging device, it may be configured to record tissue parameters, images of wounds, images of body parts, etc. For example, the imaging device may be configured to depict a surgical field of view.

[0017] Imaging devices and in particular optical devices and / or image acquisition sensing mechanisms can be configured for multispectral and / or hyperspectral imaging, in particular for collecting and / or generating multispectral and / or hyperspectral image data. Multispectral imaging or multispectral image data can in particular refer to such imaging in which at least two, in particular at least three, and in some cases at least five spectral bands are collected and / or can be collected independently of each other. Hyperspectral imaging or hyperspectral image data can in particular refer to such imaging in which at least 20, at least 50 or even at least 100 spectral bands are collected and / or can be collected independently of each other. The imaging device can work according to a push-sweep method and / or a swing-sweep method and / or a stare-and-snapshot principle.

[0018] In some embodiments, the imaging device includes a white light camera and / or a sensing mechanism for white light image acquisition. In addition to spectrally resolved imaging, the imaging device can also be configured for white light imaging. For this purpose, separate optical devices and / or shared optical devices can be used. White light imaging and spectrally resolved imaging can be performed simultaneously or alternately or temporarily simultaneously and temporarily sequentially.

[0019] For some applications, it may be advantageous to use a large spectral resolution. Thus, this is suitable for hyperspectral imaging. It may be combined with white light imaging. Thus, even if only spectrally resolved image data are collected substantially in real time (i.e., for example, it takes a few seconds to create a spectrally resolved image), it is still possible to observe in real time through a white light image. For some applications, it may be advantageous to generate spectral image data in real time. For example, this includes the generation of spectrally resolved images that are performed in less than one second or even multiple times per second. It may be advantageous here to use multispectral imaging. Thus, a possibly lower spectral resolution is offset by a higher image refresh rate. Depending on the application, it may be sufficient to consider only a small number of different spectral ranges and / or wavelengths, such as two or three or four or generally less than ten. Additional white light imaging may be selectively omitted here. The spectrally resolved image data acquired in real time or the multiple images delivered per second may also be used for monitoring purposes, wherein it is not necessary to compulsorily create an image to be reproduced for the user, but the image data may also be processed in the background.

[0020] The medical imaging device may have at least one proximal section, a distal section and / or an intermediate section. The distal section is particularly configured to be introduced and / or located in the cavity to be examined in the operating state, for example during the diagnosis and / or treatment action. The proximal section is particularly configured to be arranged outside the cavity to be examined in the operating state, for example during the diagnosis and / or treatment action. "Distal" should be understood in particular as being close to the patient and / or away from the user when in use. "Proximal" should be understood in particular as being away from the patient and / or close to the user when in use. The proximal side is particularly opposite to the distal side. In particular, the medical imaging device has at least one, preferably flexible rod. The rod can be an elongated object. In addition, the rod can at least partially and preferably at least mostly constitute the distal section. "Elongated object" should be understood in particular as an object whose main extension is at least five times, preferably at least ten times, and particularly preferably at least twenty times greater than the maximum extension of the object perpendicular to its main extension, that is, in particular the diameter of the object. The "main extension" of an object is to be understood in particular as the longest extension of the object along its main extension direction. The "main extension direction" of a component is to be understood here in particular as a direction running parallel to the longest side of the smallest imaginary cube that completely surrounds the component.

[0021] The image acquisition unit can be at least partially and preferably at least mostly arranged in the area of ​​the proximal section and / or constitute the proximal section. In other embodiments, the image acquisition unit can be at least partially and preferably at least mostly arranged in the distal section and / or constitute the distal section. In addition, the image acquisition unit can be arranged to be at least partially distributed to the proximal section and the distal section. The image acquisition sensor mechanism has at least one image sensor in particular. In addition, the image acquisition sensor mechanism can also have at least two and preferably more image sensors, which can be arranged one after another. In addition, two and preferably more image acquisition sensors can have spectral acquisition sensitivities that are constructed differently from each other, so that, for example, the first sensor in the red spectral range, the second sensor in the blue spectral range, and the third sensor in the green spectral range are particularly sensitive or relatively more sensitive than other sensors. The image sensor can be constructed, for example, as a CCD sensor and / or a CMOS sensor.

[0022] The optics of the image acquisition unit may include suitable optical elements, such as lenses, mirrors, gratings, prisms, optical fibers, etc. The optics may be configured to guide object light from the image area to the image acquisition sensor device, for example to focus and / or project it. In particular, the object light may be generated from the illumination of the image area.

[0023] The image acquisition unit is in particular configured to generate at least two-dimensional spatial image data. The image acquisition unit can be spatially resolved in that it delivers a resolution of at least 100 pixels, preferably at least 200 pixels, preferentially at least 300 pixels and advantageously at least 400 pixels in at least two different spatial directions, respectively. The image data are preferably at least three-dimensional, wherein at least two dimensions are spatial dimensions and / or wherein at least one dimension is a spectral dimension. A plurality of spatially resolved images of the image region can be obtained from the image data, which are respectively associated with different spectral bands. The spatial and spectral information of the image data can be characterized in that associated spectra can be obtained therefrom for a plurality of spatial pixels.

[0024] In some embodiments, the image acquisition unit is configured to generate continuously updated image data. For example, the image acquisition unit can be configured to generate image data substantially in real time, including, for example, generating updated image data at least every 30 seconds, in some cases at least every 20 seconds, and in some cases even at least every 10 seconds or at least every 5 seconds.

[0025] The image region may include at least a part and / or a section of the depicted object. The image region may relate to a tissue and / or an organ and / or a part of the patient's body. The image region may relate to a site.

[0026] The imaging device may include an illumination device, which includes at least one light emitting device, which is set to illuminate and / or illuminate the object area in at least one operating state. The light emitting device may include a white light source, in particular an adjustable monochromatic light source, a laser, a white light laser, at least one light emitting diode and / or a light emitting diode array, at least one laser diode and / or a laser diode array, etc. The illumination device may be configured to be integral with the image acquisition unit. In particular, the illumination device may utilize individual or all components of the optical device of the image acquisition unit and / or have an illumination optical device separate therefrom. The illumination light beam may be guided and / or may be guided at least sectionally in a coaxial manner with the measuring light beam.

[0027] In order to determine the analysis parameters, the analysis can be based on both spatial and spectral information. In particular, the analysis parameters can be obtained from the spectral information associated with the image area by mathematical rules. Here, the analysis parameters can in particular have a continuous value range of 0 to 100% or a discrete value range of 0, 1, 2, ... The mathematical rules can include algebraic calculation rules and / or machine learning methods, such as KI models. The analysis parameters are in particular based on spectral values ​​for a specific wavelength and / or a specific wavelength range and / or a specific spectral band.

[0028] In some embodiments, the analysis may include a parameter image. The analysis parameters may in particular be spatially resolved. The parameter image may, for example, display the values ​​of the analysis parameters according to image coordinates. Alternatively or additionally, the analysis may provide a spectrum. The analysis parameters may here be, for example, spectrally resolved intensity values.

[0029] It can be provided that interference cannot be identified and / or can be identified from spatial and spectral information, and / or the interference identification unit does not or at least does not only access spatial and spectral information. Interference identification can be based on spatial and spectral information. Interference identification can identify interference with the help of mathematical rules. Mathematical rules can include algebraic calculation rules and / or machine learning methods, such as KI models. Mathematical rules can also include, for example, at least one filtering rule, which can change the image data in a targeted manner with an algorithm. In addition, at least one optical filter can be integrated into the imaging device. In addition, mathematical rules can be used to calculate comparison parameters from spatial and spectral image data, which can be compared with other parameters based on interference-free imaging based on experience.

[0030] Interferences can include smoke, dirt and / or wear of the imaging device, in particular of the optics of the imaging device, inorganic materials, in particular instruments, meshes, tilters, wires, trocars, overexposed and / or underexposed image areas, contrast agents, motion artifacts, in particular motion artifacts caused by a relative movement of the imaging device relative to the image area, incorrect white balance in white light imaging provided in some embodiments and / or the end of the endoscope being located in the trocar during the generation of image data by the imaging device. Another form of interference can occur when recording in / underwater, for example in arthroscopy or urology. Floating particles in water, such as urine or blood, can obscure the view of the tissue, which can also lead to incorrect parameters, a situation that is somewhat similar to the situation described here and below for smoke, but in a different medium.

[0031] In order to implement the functional units mentioned herein and / or perform the method steps mentioned herein, the imaging device and in particular the interference identification unit can respectively include at least one processor and / or associated memory, and / or associated working memory and / or associated port and / or data interface and / or electronic circuit with program code for implementing the functions and steps. One or more processors, memories, working memories, ports, data interface and / or circuits can also be assigned to one or more functional units and / or implement one or more method steps.

[0032] The output unit may be configured to output a visual output and / or any other output that can be perceived by a user. To this end, the output unit may include suitable components, such as one or more lamps, lighting fixtures, speakers, screens, etc. The output unit may include a computer and / or a processor and / or a memory and / or a working memory and / or a port and / or a data interface for receiving, processing and outputting unprocessed, preprocessed and / or processed output data.

[0033] The imaging device may include a display unit, which is configured to display images, in particular moving images, to a user. The display unit may be part of and / or constitute an output unit. The displayed image may be based on image data. The display unit may include a screen and / or control electronics. The display unit may include a computer and / or a processor and / or a memory and / or a working memory and / or a port and / or a data interface portion for receiving, processing and outputting unprocessed, preprocessed and / or processed image data and / or display data. The output generation unit may be connected to the display unit via an interface portion. The generated output may be processed and / or output by the display unit.

[0034] The output unit can be configured to change the user output according to the interference condition of the imaging device. For example, after the interference condition is identified, the interference condition can be indicated to the user. In particular, the image displayed by the display unit can be targeted not to display and / or identify the spatial and spectral information collected under the influence of the interference condition. Examples include color coding and / or shaping, such as symbols and / or geometric figures. For example, the scan lines (Bildzeile) collected under the influence of the interference condition in the imaging device can be marked and output as black, red or other color scan lines, for example. For example, incorrect scan lines may appear in the case of imaging using the push-broom method. In addition, it can be provided that the image data collected under the influence of the interference condition is collected again according to the interference condition. In other embodiments, the imaging device, in particular the optical device, the image acquisition sensor mechanism, the lighting device and / or the white balance parameters can be adapted and / or optimized according to the interference condition.

[0035] The interference detection unit can be configured to detect the presence of interference based on the evaluation of spatially and spectrally resolved image data. The presence of interference can thus be inferred in a simple manner from the available data. In particular, interference can be detected independently of white light imaging. The interference detection unit can be configured to process the spatial and spectral information based on at least one mathematical rule. For example, by applying the mathematical rule, a comparison parameter can be calculated from the image data and compared with a parameter within a desired range for interference-free image acquisition. In particular, the parameter can be calculated from the spectral information.

[0036] The interference recognition unit can also be configured to recognize image exposure conditions based on spatially and spectrally resolved image data, and to recognize the presence of interference if the exposure conditions at least partially indicate underexposure and / or overexposure. This can prevent the user from drawing erroneous conclusions due to an incorrect spectrum. For example, overexposure occurs when an image acquisition sensor mechanism, in particular a CCD sensor and / or a CMOS sensor, is exposed to an exposure that oversaturates the image acquisition sensor mechanism. This can mean that a threshold value specific to the image acquisition sensor mechanism for acquiring the exposure has been exceeded. Underexposure can mean that the exposure of the image acquisition sensor mechanism is lower than the threshold value required for acquiring the exposure, and in some cases is lower than the threshold value required to distinguish between adjacent image data points and / or image data rows.

[0037] Interference can be related to the presence of inorganic materials in the image area in particular. The interference recognition unit can be set to recognize interference caused by inorganic materials in the image area. In particular, incorrect interpretation of medical equipment can be avoided thereby. Inorganic materials can mainly include instruments, trocars, nets, clamps and / or wires. The identification of inorganic materials can be based on the processing of spectral information, in particular the processing of spectral information at at least one, for example two or three or four specific wavelengths and / or within at least one, for example two or three or four specific wavelength ranges, and the comparison of spectral information with known spectra and / or with known selected values, which are associated with inorganic materials. This can be used in particular to distinguish between organic materials and inorganic materials. In principle, the distinction between organic materials and inorganic materials can be carried out in many ways, in particular in the way already described.

[0038] In addition, the medical imaging device may include a video acquisition unit, which includes a camera. The camera can be set to generate video image data of the image area. In addition, the video acquisition unit can be arranged in particular to be additionally used for spectrally resolved imaging. The video acquisition unit can be used together with all units of the imaging device, in particular, units such as optical devices, lighting devices and / or output units of the imaging device. In other embodiments, the video acquisition unit can be partially or completely separately constructed. The interference recognition unit can be set to identify the presence of interference based on the image analysis of the video image data. Thus, the presence of interference can be identified according to the situation and at least substantially in real time. Here, in addition to the image analysis of the video image data for interference recognition, spatial and spectral information can also be used. According to the present invention, interference recognition that only identifies interference based on the image analysis of the video image data can also be performed. It can be particularly advantageous that the video image data is substantially in real time and preferably in real time, that is, for example, has a time delay of several milliseconds. Image analysis can include mathematical rules, in particular algebraic calculation rules and / or machine learning methods, such as KI models.

[0039] If the interference recognition unit of the medical imaging device is set to determine the range of motion of the camera relative to the image area based on the image analysis of the video image data and recognize the presence of interference when a certain range of motion exceeds a threshold value, incorrect or inaccurate recordings can be prevented in particular effectively. Since multispectral and hyperspectral imaging of individual images may occur over a period of time, in which the spatial coordinates of the image data points at the beginning of imaging no longer correspond to the spatial coordinates of the same image data points during the imaging period due to movement, the spatial coordinates of the image may no longer be associated with the image area. The movement of the camera relative to the image area during imaging can be determined by image analysis of the video image data. It can be advantageous here that the video image data can be acquired at a higher refresh rate than the multispectral and hyperspectral image data. In particular, a threshold value can be defined by the user, which represents an acceptable spatial displacement of the image data points during imaging. According to one embodiment, the range of motion of the camera relative to the image area determined based on the image analysis of the video image data can be compared with the threshold value in order to identify interferences in the image acquisition.

[0040] Furthermore, the interference detection unit of the medical imaging device can be configured to detect the presence of dirt and / or moisture on at least a part of the optics of the spatially and spectrally resolved image acquisition unit based on the image analysis of the video image data and to detect the presence of interference based on the detection of dirt and / or moisture. Incorrections due to dirt and / or moisture on at least a part of the optics can thereby be avoided.

[0041] In addition, in order to achieve the best image quality, accurate spectral calibration of the imaging device may be particularly important. For example, spectral calibration can be performed by white balancing. According to one embodiment, the video acquisition unit can also be calibrated with the help of white balancing.

[0042] The interference detection unit can be configured to evaluate, based on a comparison of the spatially and spectrally resolved image data with the video image data, whether the white balance of the spatially and spectrally resolved image acquisition unit and the white balance of the video acquisition unit are consistent at least within a predetermined tolerance range and to detect the presence of interference if the predetermined tolerance is exceeded. Since the white balance of the video acquisition unit is usually less complex than the white balance of the spatially and spectrally resolved image acquisition unit, it can be advantageous to first perform the white balance of the video acquisition unit and to use the video image data as reference values ​​in the comparison with the spatially and spectrally resolved image data.

[0043] In the event of a detected disturbance, the user can be asked to perform a new white balance of the spatially and spectrally resolving image acquisition unit. According to another embodiment, the white balance of the spatially and spectrally resolving image acquisition unit can be automatically performed according to the disturbance situation.

[0044] Furthermore, an interference recognition unit of the medical imaging device can be configured to recognize the unexpected presence of a medical device in the image region based on an image analysis of the video image data and to recognize the presence of interference in accordance with the recognition of the unexpected presence of the medical device. This enables the user to be alerted to possible inaccuracies in the recording due to the medical device. In particular, the interference recognition unit can be configured to compare the recognized medical device with the expected medical device in the image region and to recognize the presence of interference when the recognized medical device differs from the expected medical device. Furthermore, based on the recognition of the presence of the medical device, a sub-region of the image region in which the medical device is present can be excluded from the parameter representation. This can include excluding the sub-region from the underlying calculation.

[0045] Furthermore, the interference detection unit of the medical imaging device can include a distal end portion, which includes at least a part of the optics of the image acquisition unit, wherein the interference detection unit is configured to detect that the image region at least partially includes the interior of the trocar, and wherein the output unit is configured to generate a user output containing the information that the distal end portion is at least partially located within the trocar. During imaging, the imaging device can be located in the vicinity of the trocar in such a space, so that interference with the spatial and spectral information can occur. In particular, incident light can be reflected by the trocar, resulting in interference with the spatial and spectral information. By detecting an undesirable positioning that is partially located within the trocar, corresponding inaccuracies in the recording can be prevented.

[0046] According to one embodiment, the medical imaging device may include a fluorescence imaging unit, which is configured to acquire an image region in the form of fluorescence imaging and generate fluorescence imaging data, wherein the interference recognition unit is configured to recognize the presence of interference based on an evaluation of the fluorescence imaging data. Individual wavelengths of the spectral information may be located in the emission spectrum of the fluorescence imaging unit and may therefore be affected by the fluorescence imaging unit. For example, the measured intensity of these wavelengths may be changed by the fluorescence imaging unit, which may cause interference conditions in the image acquisition. The evaluation unit may then calculate incorrect analysis parameters due to the interference. In particular, tissues located in the image region may be incorrectly assigned to different tissue types.

[0047] The interference recognition unit of the medical imaging device can also be configured to recognize the presence of a contrast agent in at least a portion of the image area based on the fluorescence imaging data, wherein the output unit can be configured to generate a user output based on the analysis parameters in such a way that the portion of the image area in which the interference recognition unit recognizes the presence of the contrast agent is omitted. This makes it possible, for example, to analyze portions of the image area that are not subject to interference caused by fluorescence. This is advantageous because multimodal imaging can be achieved in this way, in which it is possible to select the advantages of each mode for the tissue to be examined. For example, a contrast agent can be supplied to a type of tissue in a targeted manner and in this way it can be subjected to fluorescence imaging, while the remaining types of tissue in the same image area can be further subjected to hyperspectral and / or multispectral imaging.

[0048] Furthermore, the medical imaging device may comprise a sensor unit having at least one sensor, the sensor being configured to measure at least one measurement variable describing a condition of the imaging device and / or an environment of the imaging device and being configured to generate a sensor signal representing the measurement variable. In this context, the sensor unit may operate independently of the imaging device. The sensor unit may operate simultaneously with the imaging device and generate the sensor signal before or after acquiring the multispectral and / or hyperspectral information. The interference recognition unit may be configured to recognize the presence of interference based on the sensor signal.

[0049] As already described, there can be a relative movement between the imaging device and the image area. In particular, in order to detect this relative movement, the sensor can be an acceleration sensor, wherein the sensor signal represents the movement of the imaging device. In this case, the interference detection unit can be configured to determine the range of movement based on the sensor signal and to detect the presence of interference when a certain range of movement exceeds a threshold value.

[0050] Too small and / or too large a distance between the imaging device and an object in the image area may also cause interference in the image acquisition. In particular, in this context, the sensor may be a distance sensor. It may be configured to determine the distance between the imaging device and an object in the image area.

[0051] Treatment actions, such as thermal manipulation of tissue, especially vessel sealing or coagulation using electrosurgical devices such as high-frequency coagulation devices, may cause smoke in the image area. Smoke can change the spectral information of the image area before acquisition by the imaging device and thus cause interference. This can lead to incorrect calculation of analysis parameters by means of the evaluation unit of the imaging device. The interference detection unit of the medical imaging device can be set to detect the presence of smoke in the image area based on image analysis and to detect the presence of interference based on the detection of smoke in the image area. The interference detection unit can detect smoke here by means of an analysis of video image data of a video acquisition unit. Alternatively or additionally, smoke detection can be performed by analysis of hyperspectral and / or multispectral information.

[0052] The interference recognition unit of the medical imaging device can be configured to prevent the acquisition of spatially and spectrally resolved image data by means of the spatially and spectrally resolved image acquisition unit when interference is detected. For example, the interference recognition unit can be configured to at least temporarily deactivate the image acquisition unit and / or to at least temporarily make image acquisition unavailable. Alternatively or additionally, a user output can be performed to indicate the interference situation to the user. The user can then, for example, clear the interference situation and continue to acquire spatially and spectrally resolved image data and / or continue to acquire spatially and spectrally resolved image data despite the interference situation.

[0053] In particular, the recorded erroneous regions can be pointed out to the user in a targeted manner if the output unit of the medical imaging device is configured to generate a spatially resolved parameter representation of the image region according to the analysis parameters and the interference detection unit detects these as disturbing parts of the image region. For example, the disturbed parts of the image region can be distinguished by black or other colored image data points. Furthermore, the affected image regions can be highlighted by circling, smearing or other emphasizing methods.

[0054] The output unit of the medical imaging device can also be configured to provide the user with information on how to remove the interference when interference is identified. For example, the interference identification unit can be configured to identify the type of interference. This can be based on one and / or a combination of the methods described. After the interference is identified, the user can be asked to remove the medical instrument from the image area, perform white balancing and / or clean the contaminated lens, for example. In principle, any type of interference can be identified and the user can be asked and / or instructed to remove the interference.

[0055] The present invention will be described exemplarily below with reference to the accompanying drawings. The drawings, the specification and the claims contain many combined features. Those skilled in the art will also conveniently consider these features individually and use these features in meaningful combinations within the scope of the claims.

[0056] If a particular object has more than one example, in some cases only one of them is provided with a reference numeral in the drawings and in the description. The description of this example can be transferred to the other examples of the object accordingly. If the objects are named in particular with the aid of ordinal numbers, for example the first, second, third object, etc., they are used to name and / or associate these objects. Thus, for example, the first object and the third object can be included, but the second object is not included. However, in addition, the number and / or order of the objects can also be derived from the ordinal numbers. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In the attached picture:

[0058] Figure 1 A schematic diagram of a medical system having a medical imaging device is shown;

[0059] Figure 2 A schematic structural diagram of an imaging device is shown;

[0060] Figure 3 A schematic diagram showing an image region;

[0061] Figure 4 Another schematic diagram of the image area is shown to illustrate possible interference;

[0062] Figure 5 Another schematic diagram of the image area is shown to illustrate another possible interference;

[0063] Figure 6 Another schematic diagram of the image area is shown to illustrate another possible interference;

[0064] Figure 7 Another schematic diagram of the image area is shown to illustrate another possible interference;

[0065] Figure 8 Another schematic diagram of the image area is shown to illustrate another possible interference;

[0066] Fig. 9 Another schematic diagram of the image area is shown to illustrate another possible interference;

[0067] Fig.10 Schematic diagram showing absorption curves of tissues with different degrees of coagulation;

[0068] Fig.11 A schematic perspective view showing an alternative imaging device;

[0069] Fig.12 A schematic flow chart showing a method for operating a medical imaging device; and

[0070] Fig.13 A schematic flow chart of a method for medical imaging is shown. DETAILED DESCRIPTION

[0071] Figure 1 FIG. 1 is a schematic diagram of a medical system 60 having a medical imaging device 10. In some embodiments, the medical system 60 further has a medical instrument 34. Figure 2 A schematic block diagram of an imaging device 10 and a medical device 62 is shown in FIG. In the following, reference is made in part to both drawings.

[0072] In the exemplary case shown, the imaging device 10 is an endoscopic imaging device, in particular an endoscope. Alternatively, the imaging device 10 may be an exoscopic imaging device, a microscopic imaging device or a macroscopic imaging device. Medical imaging devices are provided for examining cavities.

[0073] In the case shown, the medical instrument 34 is a bipolar electrosurgical instrument. The medical instrument 34 is configured to introduce energy into tissue in a targeted manner to coagulate the tissue, for example for vascular occlusion. This design should be understood as being merely exemplary. Other types of energy introduction parts and other common types of medical devices, such as surgical, diagnostic, imaging, surgical support, anesthesia or other medical instruments and / or devices, may be provided.

[0074] The imaging device 10 has, by way of example, a medical imaging device 64. In the case shown, this is an endoscope. In addition, the medical imaging device 10 may include an illumination device 66. In the case shown, the illumination device 66 is connected to the imaging device 64 via an optical conductor. Thus, illumination light can be guided to the imaging device 64 and can be directed from the imaging device to an object, in particular a part, to be depicted.

[0075] The imaging device 10 has, by way of example, a control device 68. The control device 68 is connected to the imaging device 64, for example, via a cable and / or an optical path and / or an optical conductor.

[0076] The imaging device 10 and in particular the imaging means 64 , for example, has one or more windows 70 , through which illumination light and / or object light can be emitted.

[0077] The imaging device 64 has a distal section 72, which includes the distal end 36. Generally speaking, this is the distal end 36 of the imaging device 10. The distal section 72 is configured to be introduced into the cavity in an operating state. The distal section 72 is close to the patient in an operating state. The distal section 72 is far away from the user in an operating state. In addition, the medical imaging device 64 has a proximal section 74. The proximal section 74 is arranged outside the cavity in an operating state. The proximal section 74 is far away from the patient in an operating state. The proximal section 74 is close to the user in an operating state.

[0078] The imaging device 64 has a manipulation portion 76. The manipulation portion 76 is illustratively configured to be manipulated by a user. Alternatively or additionally, the manipulation portion 76 can be configured to be placed and / or coupled to a medical robot. In some embodiments, the imaging device 64 can also be configured to be integrated with the robot. The position and / or orientation of the imaging device 64 relative to the patient is variable, for example, by manipulation by a user and / or by appropriate movement of the robot.

[0079] The medical system 60 has a display device 78. The display device 78 may be a part of the imaging apparatus 10. The display device 78 may be a separate display unit, such as a screen, etc. In other embodiments, the display device 78 may also be integrated into the imaging device 64 and / or the control device 68.

[0080] The imaging device 10 has an equipment interface portion 80, and the medical instrument 34 can be connected to the imaging device 10 via the equipment interface portion. In the illustrated case, the equipment interface portion 80 is a part of the control device 68. In the illustrated case, the equipment interface portion 80 is wired. The equipment interface portion 80 is detachable. In addition, the equipment interface portion 80 can be set to be connected to different medical devices. The equipment interface portion 80 may include a socket and / or an electrical port. In some embodiments, the equipment interface portion 80 may also be constructed to be partially or completely wireless, that is, the medical instrument 34 can then be connected to the imaging device 10 wirelessly (e.g., by radio communication), and the imaging device 10 and the medical instrument 34 may have suitable antennas correspondingly.

[0081] In other embodiments, the medical device 34 may be completely independent of the imaging device 10. Thus, in some cases, it may not have a device interface.

[0082] The imaging device 10 has a user interface 82 via which a user can make inputs. The user interface 82 can include a plurality of operating elements, which can be attached to different components of the imaging device 10 and / or the medical system 60.

[0083] The imaging device 10 has a spatially and spectrally resolving image acquisition unit 12, which has at least one optical device 14. The image acquisition unit 12 also has an image acquisition sensor system 16 connected to the optical device 14. The optical device 14 and the image acquisition sensor system 16 are configured to generate image data of an image region 18. Figure 1 exemplarily shows an image area 18 on a display portion of a display device 78. The image data comprises optical and spectral information. In the present case, the image data corresponds to two-dimensional spatial data defining spatial pixels, and spectral data associated with each pixel. Thus, a spectrum for each pixel can be obtained from the image data. Furthermore, a two-dimensional image for each spectral band can be obtained from the image data. The image data corresponds to a multispectral or hyperspectral data cube.

[0084] The optical device 14 includes an optical element, not shown, which collects the object light and guides it to the image acquisition sensor mechanism 16. The image acquisition sensor mechanism 16 includes a CMOS or CCD sensor, not shown. The optical device 14 and the image acquisition sensor mechanism 16 are arranged together in a push-sweep arrangement. In other embodiments, a swing-sweep arrangement, a gaze arrangement, and / or a snapshot arrangement are used. In the current case, the image acquisition unit 12 is configured for hyperspectral image acquisition, and the imaging device 10 is correspondingly a hyperspectral imaging device. For different methods of hyperspectral imaging and the components required for this purpose, see the professional article "Review of spectral imaging technology in biomedical engineering: achievements and challenges" by Quingli Li et al., published in Journal of Biomedical Optics 18(10), 100901, October 2013, and the professional article "Medical hyperspectral imaging: a review" by Guolan Lu and Baowei Fei, published in Journal of Biomedical Optics 19(1), 010901, January 2014. In other embodiments, the imaging device 10 can also be multispectral. For example, multiple spectral ranges can be observed by filters that can be selectively introduced into the object light path and / or by sequentially illuminating with different wavelengths.

[0085] The image acquisition unit 12 is at least partially included in the imaging device 64. Parts of the optical device 14 and / or the image acquisition sensor mechanism 16 can be included in the control device 68. For example, the object light can be guided to the image acquisition sensor mechanism 16 via an optical conductor, and it is arranged in the control device 68. In other embodiments, the entire image acquisition sensor mechanism 16 is included in the imaging device 64, and only the data is transmitted to the control device 68.

[0086] The imaging device 10 further comprises an evaluation unit 20. It is configured to analyze the image data. The analysis is based on spatial and spectral information. The analysis comprises at least one analysis parameter. This will be discussed in more detail below.

[0087] In an exemplary case, the imaging device 10 includes an output unit 24. The output unit 24 may include a display device 78 and / or other output devices. In the illustrated case, the output unit 24 includes a speaker 86 and an additional display 88 in addition to the display device 78, which is exemplarily configured at the control device 68. In other embodiments, the output unit 24 has an interface portion for combining one or more output devices. The output generation unit 84 may also include the output unit 24 or its components.

[0088] The imaging device 10 comprises a control unit 90. It comprises a processor, a working memory, a memory and a correspondingly constructed circuit. A program code is stored on the memory, and when the program code is subsequently executed by the processor, it executes the method described herein or realizes the functions of the described units.

[0089] Furthermore, the imaging device 10 in an embodiment comprises a database 92. The evaluation unit 20 can access the database in order to create an evaluation of the image data. For example, the evaluation unit 20 can compare the evaluation parameters calculated by the evaluation unit 20 with the parameters stored in the database 92. This will be discussed in more detail below.

[0090] The interference identification unit 22 is configured to identify interference during image acquisition and determine interference conditions during image acquisition. The interference identification unit 22 may identify interference conditions based on hyperspectral and / or multispectral information. Alternatively or additionally, the interference identification unit 22 may determine interference conditions based on video image data generated by means of the video acquisition unit 28 and / or based on fluorescence imaging data generated by means of the fluorescence imaging unit 38. In some embodiments, the interference identification unit 22 may be additionally or alternatively configured to determine interference conditions based on sensor signals generated by means of the sensor unit 42. Interference identification will be discussed in more detail below.

[0091] The imaging device 10 also includes a video acquisition unit 28, which includes a camera 30 and is configured to generate video image data of the image area 18. The video acquisition unit 28 can also be configured to generate other types of illustrations, such as pseudo-color illustrations, in addition to or instead of white light images. Video image data that does not contain spectral information is acquired by means of the video acquisition unit 28. In many cases, image acquisition with spectral information takes more time than video data acquisition. Video image data can be generated and / or output in real time. Image data including spectral information can be acquired and / or output substantially in real time or at a slower refresh rate / as a single image. It can be advantageous, for example, to operate the imaging device 10 for positioning a medical instrument 34 or for positioning the image acquisition unit 12 without generating image data with spectral information. In this case, the video acquisition unit 28 can generate video image data in particular in real time. In some embodiments, the imaging device 10 can be constructed as a multi-mode. Image data can be generated in different modes. Different modes can be used as much as possible simultaneously, alternately and / or sequentially.

[0092] In the present case, the image acquisition unit 12 is configured to generate a white light image and a hyperspectral image of the image region 18. The white light image does not contain spectral information. The two modes of hyperspectral imaging and white light imaging can be performed simultaneously and / or alternately and / or sequentially. The images of the two modes can be combined after the imaging is completed. Alternatively or additionally, the hyperspectral image can also be combined with video image data different from the white light image.

[0093] The imaging device 10 also includes a fluorescence imaging unit 38. The fluorescence imaging unit 38 is configured to capture the image area 18 by means of fluorescence imaging and to generate fluorescence imaging data. For example, a specific tissue type can be made identifiable by fluorescence imaging with the aid of a contrast agent 40. The fluorescence imaging data generated by the fluorescence imaging unit 38 represent a mode that can be used as simultaneously, alternately and / or sequentially as possible with other modes. The interference recognition unit 22 is configured to recognize interferences based on an evaluation of the fluorescence imaging data. In particular, the interference recognition unit 22 can recognize the presence of a contrast agent 40 in at least a portion of the image area 18.

[0094] According to an embodiment, the imaging device 10 further comprises a sensor unit 42 comprising at least one sensor 44. The sensor 44 is configured to measure a measurement variable describing a condition of the imaging device 10 and / or an environment of the imaging device 10. The interference recognition unit 22 is configured to recognize the presence of interference based on the sensor signal.

[0095] The sensor 44 may be, for example, an acceleration sensor which measures the movement of the imaging device relative to the image region 18. The interference detection unit 22 is configured to determine the range of motion from the sensor signal and to detect the presence of interference when a certain range of motion exceeds a threshold value.

[0096] In another exemplary embodiment, the sensor 44 can be a distance sensor. It is configured to determine the distance between the imaging device 10 and an object (not shown in detail) located in the image region 18. Depending on the distance, an optimized imaging can be achieved automatically or after output by the user via the output unit 24.

[0097] In this application example, spatially and spectrally resolved image data are acquired following a push-broom method. Figures 3 to 10 , the image acquisition performed by means of the imaging device 10 using the interference recognition unit 22 is explained. Interference recognition is not limited to the push-scan method. For example, if the image data is acquired point by point using the swing-scan method, interference recognition can also be applied. In addition, not all possible interferences are listed. The interferences shown in the following figures are selected only as examples in order to explain the functional principle of the interference recognition unit 22.

[0098] Figure 3 Schematic representation of the image region 18 is shown. For example, the image region 18 is observed within the scope of minimally invasive surgery. For this purpose, the imaging device 64 (see Figure 1 ) is introduced into the lumen. Various native structures 94, 96 as well as vessels 98, such as blood vessels, which are to be sealed by means of the medical device 62 are located in the image region.

[0099] First, spatially and spectrally resolved image data of the image region 18 are generated. For this purpose, the image region 18 is illuminated, after which object light from the image region 18 is acquired. In the present case, the acquired spectral information relates to light absorption. Correspondingly, an absorption spectrum can be obtained for each pixel. Currently, the image data of the image region 18 are also acquired at least by a video acquisition unit 28. The image data of the image region 18 generated by means of the video acquisition unit 28 have a higher refresh rate than the spatially and spectrally resolved image data. While the spatially and spectrally resolved image data are generated via the output unit 24, the user can observe the image region 18 in real time based on the video image data. The interference recognition unit 22 can call up the spatially and spectrally resolved image data as well as the video image data.

[0100] Additionally, the distance from the imaging device 12 to at least one object in the image region 18 and / or the relative movement between the imaging device 12 and at least one object in the image region 18 is acquired. The objects mentioned may be, for example, the medical instrument 34 and / or native structures 94, 96 and / or vessels 98.

[0101] If, as in the present example, a medical device 62 is to be used to seal a vessel 98, a high-quality hyperspectral imaging of the vessel 98 is very important for assessing the quality and success of the operation. If disturbances are detected by the sensor unit 42 due to large relative movements between the imaging device 12 and the vessel 98, the user is informed of the disturbance. He can then be asked to re-image the image region 18 with a hyperspectral imaging.

[0102] The evaluation unit 20 is configured to analyze the spatially and spectrally resolved image data. The evaluation includes, for example, image segmentation and comparison of the spectral information with information stored in a database 92 and relating to the properties of various structures, tissue entities, etc. The spectral properties of the regions identified within the scope of the image segmentation can be analyzed. In the database 92, for example, it is stored which tissue entities are usually characterized by which absorption spectra and / or which show specific absorption values ​​for specific spectra, in particular relative to other spectral bands.

[0103] At least one analysis parameter is created by the evaluation unit 20. The analysis parameter may, for example, indicate which tissue entity the corresponding image segment is.

[0104] Medical instruments 34 can also be identified within the scope of the evaluation. As in this example of a medical instrument 34, the presence of inorganic material 26 can lead to interference conditions in the image acquisition. The medical instrument 34 can be identified and assigned based on the hyperspectral information. For this purpose, the known spectral properties of the inorganic material in question can be taken into account.

[0105] A low degree of error susceptibility can be achieved if the presence of inorganic materials 26 is checked by the KI algorithm in addition to the video image data generated by the hyperspectral image acquisition by the video acquisition unit 28. A high degree of accuracy in the identification of inorganic materials 26 can thereby be achieved.

[0106] Furthermore, based on the analysis, a highlight 99 is generated, which can be output via the output unit 24 (see Figure 1 ) is displayed to the user. Figure 4 As illustrated in , different identified tissue entities are emphasized in different ways, for example by highlighting with color overlay, texture, text or a combination. Thus the user can easily understand which sub-regions, instruments, organs, vessels, nerves, fascia, etc. are located in the image region 18. The creation of the analysis and the generation of the highlights can be performed repeatedly. As described above, the video image data can form the basis thereof. The highlighted, spectral information-based emphasis on different tissue structures can be updated substantially in real time.

[0107] The medical instrument 34 is identified by the interference recognition unit 22 based on the video image data and the spatial and spectral information. In the present example, the medical instrument 34 can be assigned to the data on the database 92 based on the spectral information and identified based on the corresponding comparison. The accuracy of the assignment is increased by the video image data. If there is an inorganic material that cannot be assigned in the image area 18, it is identified by the interference recognition unit 22 and is not, for example, highlighted 99 or marked in color, especially black, and is not displayed in a spectral parameter diagram. The interfering sub-area 48 in which the inorganic material is present is identified and the interfering sub-area 48 is identified via the output unit. This is achieved, for example, by surrounding the interfering sub-area 48 with color emphasis.

[0108] As explained, according to this application example, interference detection of inorganic materials 26 is performed with the aid of two types of image data. On the one hand, inorganic materials 26 are detected with the aid of spectral information. Interference detection is therefore performed sequentially after image acquisition. On the other hand, inorganic materials 26 are detected from video image data with the aid of the KI algorithm. Interference detection is performed before and / or during, in particular simultaneously with, the image acquisition of spatially and spectrally resolved image data.

[0109] exist Figure 5 Another possible interference is shown in FIG. The same image area 18 as in the previous figures can be seen, so structures 94, 96 and vessels 98 can be seen. In the image area 18, it can also be seen that the optical device 14 (see FIG. Figure 2 ) is caused by dirt and / or water vapor 32. The dirt and / or water vapor 32 shown is identified from the video image data by means of the KI algorithm. According to this example, the user is asked to clean the optical device 14 in order to achieve a more interference-free imaging. According to other embodiments, after the interference caused by dirt and / or water vapor 32 is identified, the optical device 14 can be automatically cleaned.

[0110] Figure 6 The same image region 18 with known structures 94, 96 and vessels 98 is shown again to illustrate another possible interference. Only a section of the image region 18 can be clearly seen, because according to this example the distal end 36 is still partially located in the cannula 37, which is used to introduce the imaging device 10. Figure 6 A portion of the interior of the trocar 37 can be seen in the image region 18. The trocar 37 in the image region 18 is identified based on the video image data. For this purpose, the user can be asked to eliminate interference, for example by pushing the distal end 36 further through the trocar 37 for imaging.

[0111] Figure 7The image region 18 with structures 94, 96 and the vessel 98 and the medical instrument 34 is shown a short time after the vessel 98 has coagulated, for example a few seconds. Due to the coagulation of the vessel 98, smoke 46 appears, which is between the vessel 98 and the optical device 14 and can be seen in the image region 18. The smoke 46 means that the spectral information of the vessel 98 covered by the smoke 46 is not acquired and / or is acquired in a disturbing manner at most. The smoke 46 can be identified based on the spectral information. Alternatively or additionally, the smoke 46 can be identified based on the video image data. In the latter case, a suitable KI algorithm is used for smoke recognition, for example a binary classification with ResNet 50. The combination of the two recognition methods improves the reliability and accuracy of the recognition. The user can identify the image data points associated with the smoke 46. In addition, the disturbing sub-region 48 of the image region 18 is emphasized visually on the output unit 24, for example by a color-emphasized enclosure. The user is also asked to restart the acquisition of spatial and spectral information of image region 18, if necessary while observing a suitable waiting time. Alternatively or additionally, the user may be asked to activate a smoke extraction system (not shown).

[0112] exist Figure 8 and Fig. 9 FIG. 4 shows an image acquisition of the image region 18 with the additional use of the fluorescence imaging unit 38. The vessels 98 are colored with the fluorescent contrast agent 40. The fluorescence imaging unit 38 identifies the Fig. 9 The vessels 98 colored with contrast agent 40 are highlighted by the shadow in the image and displayed to the user in combination with the white light image. In addition, spatial and spectral information of the image region 18 is acquired, evaluated and displayed to the user by means of highlighting 99.

[0113] In the evaluation of the spatial and spectral information, interfering subregions 48 are excluded in which contrast agent 40 is present and detected by the fluorescence imaging unit 38 and / or the interference detection unit 22. In these regions, tissue detection may provide incorrect results or fail due to the contrast agent.

[0114] In addition to the fluorescent contrast agent 40, inorganic materials 26 can be seen in the image region 18. These are identified in the manner already described by the interference detection unit 22 on the basis of the spectral information and the video image data. This application example illustrates the multimodal nature of the invention. Spatial and spectral information is acquired simultaneously with the white light image, the video image data and the fluorescence image data. Thus, various types of interference, Fig. 9 In this case, these are the fluorescent contrast agent 40 and the inorganic material 26 , and the imaging device 10 can display the tissue entities in the sub-region of the image region 18 in which no interference has been detected by highlighting 99 .

[0115] It should be understood that interference detection can be performed at any time, in particular simultaneously with image acquisition.

[0116] Fig.10 Schematic absorption curves in the visible and near infrared range of tissue coagulated with different parameters are shown. Such curves can be obtained from spatially and spectrally resolved image data within the scope of the evaluation, for example by averaging over the image area 18 or appropriately selected sub-areas. The analysis can include the absorption curve instead of the parameter image as described above or in addition to it. The analysis parameter in this case is, for example, the spectrally resolved intensity.

[0117] The inventors have found that the absorption curves of less and more coagulated tissues behave differently in different spectral ranges. Fig.10 The absorption decreases with increasing coagulation, as marked by line a1 in the figure. In the long-wave region, it Fig.10 The absorption increases with the increase of solidification as marked by line a2 in the spectrum. Fig.10 In the example, the absorption value at line n is normalized by dividing by the corresponding absorption value at line n. Based on this, an analysis and evaluation can be performed to determine whether the coagulation process has been completed with sufficient quality, as described below.

[0118] The analysis is based on a before-after comparison, in which the image data are used as a reference before diagnostic and / or therapeutic actions are performed. The before-after comparison involves the formation of differences, which gives the extent to which the absorption has changed in the observed spectral range. In order to compensate for influences due to different tissue amounts or other deviations in the observed image area, the spectra to be compared are normalized, e.g. Fig.10 In the present case, for example, the difference between lines a1 and a2 is determined as the evaluation parameter.

[0119] In the database 32 are stored which relationships, differences and / or other connections between these evaluation parameters allow conclusions to be drawn about the coagulation quality. The evaluation unit 24 uses this information as evaluation information and evaluates the evaluation parameters obtained from the analysis based on this information. In the present case, a binary attribute is determined in this evaluation, which can assume the values ​​"complete coagulation" and "incomplete coagulation".

[0120] If interferences, such as one of the above-mentioned interferences, are present when acquiring spatially and spectrally resolved image data, from which such an absorption curve is generated, then the absorption curve may not be usable. As described above, one or more interferences can be correspondingly identified by the interference identification unit 22. It should be understood that the interferences are not identified here, or at least not only based on the considered analysis parameters, but are identified in a manner independent of them.

[0121] A user output based on the analysis parameters may then be generated in accordance with the identified interference condition. For example, the absorbance spectrum may be displayed and / or marked as available only if no interference condition exists.

[0122] exist Fig.11 An alternative imaging device 10' can be seen in the figure. For the sake of clarity, the reference numerals in this embodiment are provided with a prime. The alternative imaging device 10' is part of a medical system 60', which is configured to perform endoscopic imaging. For example, the medical system 60' can be used to observe a surgical site during a surgical operation. The medical system 60' basically has the same functional principle as the previous embodiment. The medical system 60' includes an image acquisition unit 12', an evaluation unit 20', an interference recognition unit 22', an output unit 24', via which an image area 18' as well as interferences and highlights, etc. are displayed, and reference can be made to the above-mentioned embodiments for its functions.

[0123] Fig.12 A schematic flow chart of a method for operating an imaging device is shown. The flow of the method can also be derived from the above embodiments.

[0124] The imaging devices 10 , 10 ′ described above are operated in an exemplary manner.

[0125] The method comprises a step S11 of acquiring spatially and spectrally resolved image data of the image region 18 by means of the medical imaging device 10 , 10 ′.

[0126] The method further comprises a step S12 of creating an analysis of the spatially and spectrally resolved image data based on the spatial and spectral information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data.

[0127] Furthermore, the method comprises a step S13 of performing a disturbance detection, in which the presence of disturbances during the image acquisition is detected independently of the evaluation of the image data and the calculated evaluation parameters, and in which the disturbance situation during the image acquisition is determined.

[0128] The method further comprises a step S14 of generating a user output based on the analysis parameters according to the interference condition.

[0129] Fig.13 A schematic flow chart of a method for medical imaging is shown. The flow of the method can also be derived from the above embodiments.

[0130] The method is carried out in an exemplary manner with the aid of the imaging device 10 , 10 ′ described above.

[0131] The method comprises a step S21 of performing an image acquisition of the image region 18, wherein spatially and spectrally resolved image data comprising both spatial and spectral information are generated.

[0132] The method further comprises a step S22 of creating an analysis of the spatially and spectrally resolved image data based on the spatial and spectral information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data.

[0133] Furthermore, the method comprises a step S23 of carrying out a disturbance detection, in which the presence of a disturbance during the image acquisition is detected independently of an evaluation of the image data and calculated evaluation parameters, and in which the disturbance situation during the image acquisition is determined.

[0134] The method further comprises a step S24 of generating a user output based on the analysis parameters according to the interference condition.

[0135] It can also be concluded from the above embodiments that the process of steps S11 to S14 or S21 to S24 is not necessarily continuous. In this regard, Fig.12 and Fig.13 It should be understood as purely exemplary.

[0136] Description of Reference Numerals

[0137] 10 Imaging equipment

[0138] 12 Image acquisition unit

[0139] 14 Optical Devices

[0140] 16 Image acquisition sensor mechanism

[0141] 18 Image area

[0142] 20 evaluation units

[0143] 22 Interference Identification Unit

[0144] 24 output units

[0145] 26 Inorganic materials

[0146] 28 Video Capture Unit

[0147] 30 Camera

[0148] 32 Dirt and / or moisture

[0149] 34 Medical devices

[0150] 36 Distal end

[0151] 37 Trocar

[0152] 38 Fluorescence Imaging Unit

[0153] 40 Contrast media

[0154] 42 sensor units

[0155] 44 Sensors

[0156] 46 Smoke

[0157] 48 Interference

[0158] 60 Medical System

[0159] 64 Imaging device

[0160] 66 lighting fixtures

[0161] 68 Control Device

[0162] 70 Windows

[0163] 72 Distal segment

[0164] 74 proximal segment

[0165] 76 Operation Unit

[0166] 78 Display device

[0167] 80 Equipment interface

[0168] 82 User interface

[0169] 84 Output generation unit

[0170] 86 Speakers

[0171] 88 Display

[0172] 90 Control Unit

[0173] 92 Database

[0174] 94 Structure

[0175] 96 Structure

[0176] 98 Vascular

[0177] 99 Highlight

Claims

1. A medical imaging device (10), in particular an endoscopic imaging device and / or an exoscopic imaging device and / or a microscopic imaging device, comprising: A spatially and spectrally resolved image acquisition unit (12), the image acquisition unit comprising at least one optical device (14) and at least one image acquisition sensor mechanism (16) connected to the optical device, the optical device and the image acquisition sensor mechanism being configured to perform image acquisition on an image region (18), generating spatially and spectrally resolved image data during the image acquisition, the image data comprising both spatial information and spectral information; an evaluation unit (20) configured to create an analysis of the spatially and spectrally resolved image data, the analysis being based on the spatially and spectrally resolved information and on at least one analysis parameter calculated from the spatially and spectrally resolved image data; an interference recognition unit (22), the interference recognition unit being configured to recognize the presence of interference during image acquisition and determine the interference condition during image acquisition in a manner independent of the analysis of the image data and independent of the calculated analysis parameters; as well as An output unit (24) is configured to generate a user output based on the analysis parameters according to the interference condition.

2. The medical imaging device (10) according to claim 1, The interference detection unit (22) is configured to detect the presence of interference based on an evaluation of the spatially and spectrally resolved image data.

3. The medical imaging device (10) according to claim 2, The interference detection unit (22) is configured to detect an image exposure condition based on the spatially and spectrally resolved image data and to detect the presence of an interference if the exposure condition at least partially indicates underexposure and / or overexposure.

4. The medical imaging device (10) according to claim 2 or 3, The interference recognition unit (22) is configured to recognize the presence of interference based on the inorganic material (26) recognized in the image area (18).

5. The medical imaging device (10) according to any one of the preceding claims, It also includes a video acquisition unit (28), which includes a camera (30) and is configured to generate video image data of the image area (18). The interference recognition unit (22) is configured to recognize the presence of interference based on image analysis of the video image data.

6. The medical imaging device (10) according to claim 5, The interference recognition unit (22) is configured to determine a range of motion of the camera relative to the image area (18) based on an image analysis of the video image data and to recognize the presence of interference when a certain range of motion exceeds a threshold value.

7. The medical imaging device (10) according to claim 5 or 6, The interference recognition unit (22) is configured to recognize the presence of dirt and / or water vapor (32) on at least a part of the optical device of the spatially and spectrally resolved image acquisition unit (12) based on image analysis of the video image data and to recognize the presence of interference based on the recognition of dirt and / or water vapor (32).

8. The medical imaging device (10) according to any one of the preceding claims, The interference recognition unit (22) is configured to evaluate, based on a comparison of the spatially and spectrally resolved image data with the video image data, whether the white balance of the spatially and spectrally resolved image acquisition unit and the white balance of the video acquisition unit are consistent at least within a predetermined tolerance range and to recognize the presence of interference when the predetermined tolerance is exceeded.

9. The medical imaging device (10) according to any one of claims 5 to 8, The interference detection unit (22) is configured to detect the unexpected presence of a medical instrument (34) in the image area (18) based on an image analysis of the video image data and to detect the presence of interference based on the detection of the unexpected presence of the medical instrument (34).

10. The medical imaging device (10) according to claim 9, wherein the imaging device (10) comprises a distal end (36) comprising at least a portion of the optical device (14) of the image acquisition unit (12), The interference detection unit (22) is configured to detect that the image area (18) at least partially includes the interior of the trocar (37), and The output unit (24) is configured to generate a user output containing information that the distal end (36) is at least partially located within the trocar (37).

11. The medical imaging device (10) according to any one of the preceding claims, It also includes a fluorescence imaging unit (38), which is configured to collect the image area (18) in a fluorescence imaging manner and generate fluorescence imaging data. The interference recognition unit (22) is configured to recognize the presence of interference based on an evaluation of the fluorescence imaging data.

12. The medical imaging device (10) according to claim 11, The interference recognition unit (22) is configured to recognize the presence of a contrast agent (40) in at least a portion of the image region (18) based on the fluorescence imaging data, and The output unit is configured to generate the user output based on the analysis parameter in such a way that a portion of the image region (18) in which the interference detection unit (22) detected the presence of a contrast agent (40) is omitted.

13. The medical imaging device (10) according to any one of the preceding claims, Also comprising a sensor unit (42) having at least one sensor (44), the sensor being configured to measure at least one measurement variable describing a condition of the imaging device (10) and / or an environment of the imaging device (10) and being configured to generate a sensor signal representing the measurement variable, The interference detection unit (22) is configured to detect the presence of interference based on the sensor signal.

14. The medical imaging device (10) according to claim 13, The sensor (44) is an acceleration sensor, wherein the sensor signal represents the movement of the imaging device (10), and wherein the interference recognition unit (22) is configured to determine the range of movement based on the sensor signal and recognize the presence of interference when a certain range of movement exceeds a threshold value.

15. The medical imaging device (10) according to claim 13 or 14, The sensor (44) is a distance sensor which is configured to determine the distance between the imaging device (10) and an object in the image region (18).

16. The medical imaging device (10) according to any one of the preceding claims, The interference detection unit (22) is configured to detect the presence of smoke (46) in the image region (18) based on an image analysis and to detect the presence of interference based on the detection of smoke (46) in the image region (18).

17. The medical imaging device (10) according to any one of the preceding claims, The interference detection unit (22) is designed to prevent the acquisition of spatially and spectrally resolved image data by means of the spatially and spectrally resolved image acquisition unit (12) if interference is detected.

18. The medical imaging device (10) according to any one of the preceding claims, The output unit (24) is configured to generate a spatially resolved parameter representation of the image region (18) according to the analysis parameters and the interference detection unit (22) detects the spatially resolved parameter representation as a disturbing part (48) of the image region (18).

19. The medical imaging device (10) according to any one of the preceding claims, The output unit (24) is designed to provide a user with information on how to eliminate the disturbance if a disturbance is detected.

20. A method for operating a medical imaging device (10), in particular a medical imaging device according to any of the preceding claims, The medical imaging device (10) comprises a spatially and spectrally resolved image acquisition unit (12), the image acquisition unit comprising at least one optical device (14) and at least one image acquisition sensor mechanism (16) connected to the optical device, the optical device and the image acquisition sensor mechanism being configured to perform image acquisition on an image region (18), generating spatially and spectrally resolved image data during the image acquisition, the image data comprising both spatial information and spectral information; The following steps are involved: - acquiring spatially and spectrally resolved image data of an image region (18) by means of the medical imaging device (10); - creating an analysis of said spatially and spectrally resolved image data, said analysis being based on said spatially and spectrally resolved information and on at least one analysis parameter calculated from said spatially and spectrally resolved image data; - performing a disturbance detection, in which the presence of disturbances during the image acquisition is detected and the disturbance situation during the image acquisition is determined independently of the analysis of the image data and independently of the calculated analysis parameters; as well as - generating a user output based on the analysis parameters in accordance with the interference condition.

21. A method for medical imaging, in particular a method performed by a medical imaging device (10) according to any one of claims 1 to 19, comprising the following steps: - performing an image acquisition of the image region (18), in which the spatially and spectrally resolved image data are generated, the image data comprising both spatial information and spectral information; - creating an analysis of said spatially and spectrally resolved image data, said analysis being based on said spatially and spectrally resolved information and on at least one analysis parameter calculated from said spatially and spectrally resolved image data; - performing a disturbance detection, in which the presence of disturbances during the image acquisition is detected and the disturbance situation during the image acquisition is determined independently of the analysis of the image data and independently of the calculated analysis parameters; as well as - generating a user output based on the analysis parameters in accordance with the interference condition.

Images