Controller for imaging system, system and corresponding method

The controller for an imaging system determines a region of interest in a second type of image to optimize focus and exposure, addressing the challenge of predefined autofocus areas missing the user's intended region, resulting in improved image quality and user experience.

CN119072608APending Publication Date: 2024-12-03LEICA INSTRUMENTS (SINGAPORE) PTE LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380035812.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-22
Filing Date
2023-03-21
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

Existing imaging systems struggle to automatically focus on the desired area of an object and set imaging parameters accurately, as predefined autofocus areas often miss the user's intended region of interest.

Method used

A controller for an imaging system that determines a region of interest based on a second type of image, different from the first, and adjusts imaging parameters such as focus, exposure, and exposure, and exposure time based on this region, using image processing to select the sharpest edges and fluorescence intensity, allowing for intelligent autofocus and parameter setting.

Benefits of technology

Enables accurate and intelligent adjustment of imaging parameters, ensuring the focus and exposure are optimized on the user's desired region, improving image quality and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119072608A_ABST
    Figure CN119072608A_ABST
Patent Text Reader

Abstract

The present invention generally relates to a controller (150) for an imaging system (102) configured to acquire an image (120) of a first type of an object and to automatically set one or more imaging parameters (140, 142, 144), where the controller (150) is configured to: determine a region of interest (130) at the object (114) based on an image (122) of a second type, wherein the second type is different from the first type; controlling the imaging system (102) to automatically set at least one of the one or more imaging parameters (140, 142, 144) based on the region of interest (130); and controlling the imaging system (102) to acquire an image (120) of the first type of the object (114). The invention also relates to a method and a system (170) comprising such a controller (150).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention generally relates to a controller for an imaging system, the imaging system being configured to acquire images of an object, a system having such an imaging system, and a method for controlling an imaging system. Background Art

[0002] In surgical microscopes, or other application areas, for example, an image of an object such as a sample or tissue can be imaged and displayed on a display, for example, in real time. In order to focus on the object, the focus can be automatically adjusted (autofocus). Other imaging parameters can also be automatically set. Depending on the object to be imaged and the type of imaging, however, it may be difficult to automatically focus on a desired area of ​​the object or to set imaging parameters for the desired area. Summary of the Invention

[0003] In view of the above, there is a need for improvements in the automatic setting of imaging parameters. According to embodiments of the present invention, a controller for an imaging system, a system, and a method for controlling an imaging system are provided, having the features of the independent claims. Advantageous further developments form the subject matter of the dependent claims and of the subsequent description.

[0004] One embodiment of the present invention relates to a controller for an imaging system, the imaging system being configured to acquire a first type of image of an object and automatically set one or more imaging parameters. The controller is configured to: determine a region of interest at the object based on a second type of image, wherein the second type is different from the first type. It should be noted that the first type of image is the type of image that should (at least) be acquired by the imaging system. Further, the controller is configured to control the imaging system to automatically set the one imaging parameter or at least one of the more imaging parameters based on the region of interest. For example, the imaging system can be controlled to automatically focus on the region of interest. Depending on how the second image is acquired or received, it may be useful for the first type of image and the second type of image to have the same field of view. Further, the controller is configured to control the imaging system to acquire the first type of image of the object, i.e., using the previously set imaging parameters.

[0005] Autofocus, or automatically setting focus, can be based on an image acquired by an imaging system. Several images with different focus settings can be acquired based on a specific region within the image or the entire image. Through image processing or image analysis, for example, one of the images with the sharpest edge of a specific region can be selected. Corresponding focus parameters can then be set.

[0006] In such images, autofocus functions typically have a predefined area that serves as a focus reference; for example, the area in the middle of the image can be used. However, it often turns out that the user's area or location of interest is not within this autofocus location, or is even completely different from it. This can cause the imaging system to focus on a location that is not the one the user intended.

[0007] When such a region of interest is determined in another type of image (the second type of image) rather than the type in which the user is actually interested (the first type of image), the region of interest can be more easily selected as the correct or desired region.

[0008] When the first type of image is or includes a white light image, for example, automatically finding a region of interest that the user may be interested in can be very difficult. For the second type of image, which may be a fluorescence image, for example, this is much easier. In a fluorescence image, typically only some area or even only one area is visible (for light emitted only from a fluorophore, such as a bright spot, while the rest of the image is dark or black). This area is typically the area of ​​interest to the user. This results in a more intelligent autofocus or automatic parameter setting function.

[0009] This allows to automatically set image parameters like focus in an intelligent and meaningful way, i.e., for example, the autofocus will be able to follow certain image features instead of spatially fixed locations in the image. It should be noted in this regard that over time, the region of interest can change from one image to the next of a second type.

[0010] According to a further embodiment of the invention, the one or more imaging parameters are selected from the following parameters: focus (ie autofocus function), exposure time and aperture. This allows different parameters to be automatically adjusted to current requirements.

[0011] According to a further embodiment of the present invention, the image of the second type is, includes or is at least based on one of the following: a fluorescence image, a reflectance image and an image derived or calculated from one of these images. In an embodiment, the image of the second type is, includes or is based on an image derived or calculated from an image of the first type. In addition, many other types of images can be considered or used as the second type, which will be mentioned later. Depending on the specific second type to be selected, this allows to easily find a region of interest in the image of the second type, which is of particular interest for a specific application or user. In addition, the image of the second type can be selected differently for different applications. By image processing and / or analysis, the derivation or calculation of the image of the second type from a specific type of image can be performed. Therefore, a particularly easy method is to use an image derived or calculated from an image of the first type as the image of the second type.

[0012] According to a further embodiment of the present invention, the controller is configured to determine the region of interest at the object based on the second type of image by: assigning different weights to different regions of the second type of image; and selecting the region of interest from the different regions based on the weights. This makes it very easy to find a suitable region of interest. For example, more interesting parts, i.e., parts with higher intensity, can be assigned higher weights. Then, for example, the region of interest can be selected to include regions with weights above a certain threshold.

[0013] According to a further embodiment of the present invention, the second type of image is, includes, or is at least based on a fluorescence image. The weighting is then provided based on the fluorescence intensity in the second type of image. For example, locations with high fluorescence intensity may be more important for focusing than locations with low fluorescence intensity.

[0014] According to a further embodiment of the present invention, the second type of image is, includes, or is at least based on a reflective image. The weighting is then provided based on the intensity of the reflections in the second type of image. For example, locations with specular reflections can be excluded from the region of interest to avoid disrupting sharpness optimization algorithms typically used in autofocus.

[0015] According to a further embodiment of the present invention, the controller is configured to cause the imaging system to automatically set the imaging parameter or at least one of the imaging parameters based on the image or images of the first type. For example, this may include acquiring several images with different focus points, selecting focus for images with sharp edges. This is an easy way to set the exposure time, for example, because the first type of image, which may be of particular interest, only has specific illumination in the region of interest. Therefore, when searching for the region of interest based on the second type of image, parameters can be set based on the first type of image.

[0016] According to a further embodiment of the present invention, the controller is configured to cause the imaging system to automatically set the imaging parameter or at least one of the imaging parameters based on the image or images of the second type. For example, this is an easy way to set the focus because the second type of image can be acquired from the same object as the first type of image. Thus, the optimal focus is the same for both types of images.

[0017] According to a further embodiment of the present invention, the imaging system is further configured to acquire an image of the second type of the object. The controller may then receive the image of the second type from the imaging system. In this way, typical imaging systems of both types for imaging can be used.

[0018] According to another embodiment of the present invention, the controller is configured to receive the second type of image from an external entity, which is different from the imaging system. Thus, the external entity can be, for example, a database or a magnetic resonance imaging (MRI) system or a similar system. This increases the likelihood of selecting the second type of image. Furthermore, images from such a magnetic resonance imaging (MRI) system or a similar system can be stored in such a database after acquisition.

[0019] A further embodiment of the present invention relates to a system comprising an imaging system configured to acquire a first type of image of an object and automatically set one or more imaging parameters. The system also comprises the controller of one of the above embodiments.

[0020] According to a further embodiment of the present invention, the imaging system is further configured to acquire a second type of image of the object, comprising an imaging optical device, a first imaging detector for acquiring the first type of image, and a second imaging detector for acquiring the second type of image.

[0021] According to a further embodiment of the present invention, the system comprises a microscope, such as a surgical microscope, which comprises or is configured as (or is) the imaging system.

[0022] A further embodiment of the present invention relates to a method of controlling an imaging system configured to acquire a first type of image of an object and automatically set one or more imaging parameters. The method includes determining a region of interest at the object based on an image of a second type, wherein the second type is different from the first type; controlling the imaging system to automatically set the one or more imaging parameters based on the region of interest; and controlling the imaging system to acquire the first type of image of the object.

[0023] With regard to advantages and further embodiments of the imaging system, the microscope and the method, reference is made to the comments regarding the controller, which apply accordingly thereto.

[0024] A further embodiment of the invention relates to a computer program having a program code for performing the above-mentioned method when the computer program runs on a processor.

[0025] Further advantages and embodiments of the invention become apparent from the description and the accompanying drawings.

[0026] It should be pointed out that the aforementioned features and the features further described below can not only be used in the combination indicated respectively, but can also be used in further combinations or alone without departing from the scope of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 Schematically illustrates a system having a microscope and a controller according to an embodiment of the present invention;

[0028] Figure 2 A method according to another embodiment of the present invention is schematically illustrated. DETAILED DESCRIPTION

[0029] Figure 1 The system 170 is schematically illustrated and includes a microscope 100, for example, a surgical microscope, and a controller 150 according to an embodiment of the present invention. The microscope includes or is an imaging system 102, and the controller 150 may include one or more processors 152 and / or one or more memory devices 154.

[0030] The imaging system 102, for example, is configured to acquire a plurality of images 120 of a first type of an object 114. For example, the imaging system 120 may include imaging optics 104 and a first imaging detector 106 for acquiring the first type of the images 120. In an embodiment, the first type of the images 120 are white light images, i.e., images showing the object 114 in all visible colors, such as Figure 1Different parts or regions of the object 114 are indicated by different shadows.

[0031] In an embodiment, the imaging system 102 is further configured to acquire a second type of image 122 of the object 114. For example, the imaging system 120 may include a second imaging detector 108 for acquiring the second type of image 122. The imaging optics (or illumination and imaging optics) 104 may also be used to acquire the second type of image 122, and the imaging optics may include different lenses, illumination, and the like.

[0032] In an embodiment, the second type of image 122 is a fluorescence image. In order to receive or acquire such a fluorescence image, a fluorophore such as 5-ALA (5-aminolevulinic acid) can be given to the patient 112; when illuminated by appropriate excitation light, the fluorophore causes a specific portion of the tissue, such as a mass, to emit fluorescent light of a certain color (usually light pink). Therefore, such a fluorescence image typically only shows a specific area of ​​the object 114 with a strong light of a specific color, while the portion where the hole is enlarged is dark. For two such areas, marked 130, 132, this is Figure 1 The 3D images are illustrated in Figure 1 by dark shading, while the rest of the image has no color or shading (note that this is for illustration purposes only).

[0033] Furthermore, the imaging system 102 is configured to automatically set one or more imaging parameters, such as focus 140, exposure time 142, and aperture 144. Automatically setting the focus can be performed, for example, by acquiring several images with different focus values, analyzing the images for the sharpest edges, for example, and selecting the focus value corresponding to the image with the sharpest edges. Automatically setting the exposure time can be performed, for example, by analyzing the illumination intensity of a determined area (or the entire image) and setting the exposure time value so that the illumination intensity combined with the exposure time value will result in a specific value. Automatically setting the aperture can be performed, for example, by varying the aperture value, analyzing the overall illumination intensity reaching the detector, for example, and selecting the aperture value that results in a desired illumination intensity reaching the detector.

[0034] By way of example, the microscope 100 includes the imaging system 102 so that a user 110 such as a surgeon can view or examine the object 114, which may be the head of a patient 112. Such an automatic setting may be initiated or caused by the controller 150.

[0035] The controller 150 for the imaging system 102 is configured to determine a region of interest 130 at the object 114 based on the second type of image 122. As described above, the imaging system 102 may be capable of acquiring this second type of image 122 (fluorescence image), and thus, the controller 150 may cause the imaging system 102 to acquire it. As mentioned, this second type of image 122 may also (or may be) received by the controller 150 from an external entity 162, or it may be derived or calculated from the first type of image. The controller 150 would then have to cause the imaging system 102 to acquire the first type of image, receive it, and calculate the second type of image.

[0036] exist Figure 1 In the example illustrated in FIG, the controller 150 causes the imaging system 102 to acquire the second type of image 122, which is illustrated in solid lines. It should be noted that, depending on the configuration of the controller and / or the imaging system, the first type of image may be acquired simultaneously; in this case, the first type of image is not considered at this stage. If the second type of image is derived from the first type of image, the controller 150 may cause the imaging system 102 to acquire the first type of image, which may then be processed.

[0037] In an embodiment, determining the region of interest 130 in the fluorescence image 122 (the second type of image) can be performed by assigning different weights to different regions of the fluorescence image 122. For example, the higher the intensity in a region (e.g., this can be a single pixel or a certain number of adjacent pixels), the higher the weight can be. By way of example, regions 130 and 132 in the fluorescence image 122 will exhibit a certain measurable intensity; region 130 has a higher intensity than region 132, which is indicated by a darker shading. Therefore, region 130 (or several subregions such as pixels therein) can be assigned a higher weight than region 132. Region 130 is then selected as the region of interest based on the weights; for example, only weights having a value above a certain threshold can be used for the region of interest.

[0038] According to the second type of multiple images, usually only a few areas of possible interest within the image are present. In the fluorescence images mentioned above, usually only areas with masses are present, ie, show at least a certain degree of intensity. Figure 1 This is especially true compared to the first type of image 120 shown in . In the image 120 , the region of interest 130 may not be easily or even automatically selected; it is worth noting that such a region of interest should necessarily be of interest to the user 110 , such as a surgeon.

[0039] For example, if the image of the second type is a reflective image, a weight can be provided based on the reflection intensity. For example, the higher the reflectivity, the lower the weight. For example, this will result in selecting a region of interest with a low reflection intensity.

[0040] As mentioned above, many other types of images can be used for the image of the second type. According to an embodiment, the image of the second type is, comprises or is based on at least one of the following images:

[0041] - Fluorescence images,

[0042] - images derived or calculated from fluorescence images,

[0043] - reflected image,

[0044] - an image derived or calculated from the reflected image,

[0045] - spectral images, preferably including at least one of multispectral images and hyperspectral images,

[0046] - an image derived or calculated from such spectral image,

[0047] - Raman images,

[0048] - images derived from or calculated from Raman images,

[0049] - laser speckle images,

[0050] - an image derived from or calculated from the laser speckle image,

[0051] -confocal images,

[0052] - images derived or calculated from confocal images,

[0053] - optical property images, in particular μa (absorption coefficient) and / or μs (scattering coefficient),

[0054] - an image derived from or calculated from an optical property image,

[0055] - Ultrasound images,

[0056] - images derived from or calculated from ultrasound images,

[0057] - Photoacoustic imaging,

[0058] - images derived or calculated from photoacoustic images,

[0059] - 3D surface scan images,

[0060] - images derived from or calculated from three-dimensional surface scans,

[0061] - Kinetic mapping images, such as the dynamics of indocyanine green clusters,

[0062] - images derived from or calculated from kinetic mapping images,

[0063] - Capturing functional images of any modality with at least one of pre-operative, intra-operative, and real-time characteristics,

[0064] - an image derived or calculated from such functional image,

[0065] - an anatomical estimate derived from tissue imaging in combination with comparison to an anatomical database, e.g., an anatomical database indicating the location of anatomical and / or functional tissue regions,

[0066] - an image derived or calculated from such anatomical estimation image,

[0067] - an image derived or calculated from an image of said first type.

[0068] Depending on the specific requirements and / or configuration of the available imaging system or microscope, a suitable second type may be selected.

[0069] Furthermore, based on the region of interest 130, the controller 150 controls the imaging system 102 to automatically set the above-mentioned imaging parameter or at least one of the plurality of imaging parameters 140, 142, 144. Depending on the imaging parameters and / or the configuration of the imaging system 102, this may be performed based on the first type of image and / or the second type of image.

[0070] For example, automatically setting the focus may be performed on the first type of images and the second type of images. Figure 1 In the example shown, both types of images are acquired from the same object 114 using the same imaging optics 104. Therefore, the focus will be the same for both types of images. If the second type of images were received from an external entity, for example, setting the focus could be performed on multiple images of the first type. In this case, it should be noted that the field of view of both types of images is identical.

[0071] In addition to focus, exposure time can also be set differently based on the region of interest. If the region of interest is a low-intensity area, while the rest of the object or image is high-intensity, a typical way to set the exposure time would be based on an average over the entire image. With the use of a specific region of interest, it is found that in the second type of image, the exposure time can be set longer and, as a result, the region of interest will appear better illuminated in the final image of the first type. It is worth noting that the region of interest is determined based on the second type of image, and the exposure time (and any other imaging parameters mentioned) can be set based on the first type of image. This is similar for the aperture, which can be selected to be low or high, for example.

[0072] For example, automatically setting the exposure can be advantageously performed on multiple images of the first type because the lighting and intensity conditions are typically different in the two types of images: while in a fluorescence image, a region of interest appears high intensity, in a corresponding white light image, the illumination intensity in this region of interest may be low.

[0073] After setting a plurality of imaging parameters, the controller 150 controls the imaging system 102 to acquire the first type of image 120 of the object 114. In addition, the controller 150 can control the imaging system 102 to simultaneously acquire the second type of image 122 of the object 114, such as Figure 1 The acquisition of these two types of images is illustrated by the dashed lines. Both images 120, 122 can then be displayed on a display 160 so that the user 110 can view them. In an embodiment, the display 160 is included in the system 170.

[0074] It is noteworthy that acquiring the two images can be performed repeatedly so that the user 110 can view the object 114 on the display 160 through both white light and fluorescence views, for example, simultaneously and in real time. In addition, determining the region of interest in the second type of image can be performed repeatedly so that the user 110 can view the object 114 and focus on the currently desired region. For example, some masses may have been determined to be regions of interest due to high fluorescence intensity in the fluorescence image. When the mass has been removed, another mass with lower fluorescence intensity in the fluorescence image can then be determined as a region of interest (because this may then be the region with the highest intensity).

[0075] Figure 2A method according to an embodiment of the present invention is schematically illustrated by a flow chart. In step 200, an image of a second type of object, such as a fluorescence image, may be acquired by causing the imaging system to do so. Alternatively, such an image of the second type may be received externally or otherwise determined, as described above.

[0076] In step 202, different weights may be provided or assigned to different regions of the image of the second type, as mentioned above. Figure 1 In step 204, a region of interest may be selected from the different regions based on the weights.

[0077] Therefore, in step 206, the region of interest is determined at the object based on the second type of image. Furthermore, in step 208, the imaging system is controlled to automatically set one or more imaging parameters, such as focus, exposure time, and aperture radius, based on the region of interest. In step 210, the imaging system is controlled to acquire the first type of image of the object; the imaging system may also be controlled to simultaneously acquire the second type of image of the object. For example, these steps may be repeated to provide a user, such as a surgeon, with properly focused images in real time.

[0078] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0079] Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of a corresponding method, where a block or device corresponds to a method step or a feature of a method step. Similarly, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of a corresponding apparatus.

[0080] Some embodiments relate to a microscope comprising a system, such as a Figures 1 to 2 Alternatively, the microscope may be part of or connected to a system such as that described above. Figures 1 to 2 One or more of the related ones. Figure 1A schematic diagram of a system 170 configured to perform the methods described herein is shown. System 170 includes a microscope 110 and a computer system or controller 150. Microscope 110 is configured to capture images and is connected to computer system 150. Computer system 150 is configured to perform at least a portion of the methods described herein. Computer system 150 can be configured to execute a machine learning algorithm. Computer system 150 and microscope 110 can be separate entities, but can also be integrated into a common housing. Computer system 150 can be part of a central processing system of microscope 110, and / or computer system 150 can be part of a subcomponent of microscope 110, such as a sensor, actuator, camera, or lighting unit of microscope 110.

[0081] The computer system 150 may be a local computer device (e.g., a personal computer, laptop, tablet, or mobile phone) having one or more processors and one or more storage devices, or may be a distributed computer system (e.g., a cloud computing system having one or more processors and one or more storage devices distributed in different locations, such as at a local client and / or at one or more remote server farms and / or data centers). The computer system 150 may include any circuit or combination of circuits. In one embodiment, the computer system 150 may include one or more processors that may be of any type. As used herein, a processor may refer to any type of computing circuit, such as, but not limited to, a microprocessor, a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other type of processor or processing circuit. Other types of circuitry that may be included in computer system 150 may be custom circuitry, application-specific integrated circuits (ASICs), or the like, such as one or more circuits (e.g., communication circuitry) for wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. Computer system 150 may include one or more storage devices, which may include one or more storage elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard disk drives, and / or one or more drives that handle removable media such as compact disks (CDs), flash memory cards, digital video disks (DVDs), and the like. Computer system 150 may also include a display device, one or more speakers, and a keyboard and / or controller, which may include a mouse, trackball, touch screen, voice recognition device, or any other device that allows a system user to input information to and receive information from computer system 150.

[0082] Some or all of the method steps can be performed by (or using) hardware devices, such as processors, microprocessors, programmable computers or electronic circuits. In some embodiments, one or more of the most important method steps can be performed by such devices.

[0083] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or in software. Implementation may be performed using a non-transitory storage medium, such as a digital storage medium, such as a floppy disk, DVD, Blu-ray disc, CD, ROM, PROM, EPROM, EEPROM, or FLASH memory, on which electronically readable control signals are stored that cooperate (or are capable of cooperating) with a programmable computer system to perform the respective methods. Thus, the digital storage medium may be computer readable.

[0084] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that the system performs one of the methods described herein.

[0085] Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer. The program code may, for example, be stored on a machine-readable carrier.

[0086] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0087] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0088] Therefore, another embodiment of the present invention is a storage medium (or data carrier, or computer-readable medium) comprising a computer program stored thereon, which, when executed by a processor, is for performing one of the methods described herein. The data carrier, digital storage medium, or recorded medium is typically tangible and / or non-transitory. Another embodiment of the present invention is a device as described herein, comprising a processor and a storage medium.

[0089] Therefore, a further embodiment of the present invention is a data stream or a sequence of signals representing the computer program for performing one of the methods described herein.For example, the data stream or the sequence of signals may be configured to be transmitted via a data communication connection, for example via the Internet.

[0090] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0091] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0092] A further embodiment according to the present invention comprises an apparatus or system configured to transmit (e.g., electronically or optically) a computer program for performing one of the methods described herein to a receiver. For example, the receiver may be a computer, a mobile device, a storage device, or the like. For example, the apparatus or system may comprise a file server for transmitting the computer program to the receiver.

[0093] In some embodiments, a programmable logic device (e.g., a field programmable gate array) can be used to perform some or all of the functions of the methods described herein. In some embodiments, the field programmable gate array can collaborate with a microprocessor to perform one of the methods described herein. In general, these methods are preferably performed by any hardware device.

[0094] Reference Signs List

[0095] 100 microscopes

[0096] 102 Imaging System

[0097] 104 Imaging Optics

[0098] 106 first imaging detector

[0099] 108 second imaging detector

[0100] 110 users

[0101] 112 patients

[0102] 114 objects

[0103] 120 First Type Image

[0104] 122 Second Type of Image

[0105] 130 Area of ​​Interest

[0106] 132 Area

[0107] 140,142,144 Imaging parameters

[0108] 150 Controller

[0109] 152 processors

[0110] 154 Storage Devices

[0111] 160 Display

[0112] 162 External Entity

[0113] 170 System

[0114] Steps of the 200-210 method

Claims

1. A controller (150) for an imaging system (102), the imaging system (102) being configured to acquire a plurality of images (120) of a first type of an object and automatically set one or more imaging parameters (140, 142, 144), wherein: The controller (150) is configured to: determining a region of interest (130) at the object (114) based on an image (122) of a second type, wherein the second type is different from the first type; Based on the region of interest (130), controlling the imaging system (102) to automatically set the one imaging parameter (140, 142, 144) or at least one of the more imaging parameters (140, 142, 144); as well as The imaging system (102) is controlled to acquire an image (120) of the first type of the object (114).

2. The controller (150) of claim 1, wherein the one or more imaging parameters are selected from the group consisting of: - Focus (140), - exposure time (142), - Aperture diameter (144).

3. A controller (150) as claimed in claim 1 or 2, wherein the image (120) of the first type is or comprises a white light image.

4. The controller (150) of any one of the preceding claims, wherein the image (122) of the second type is, includes, or is based on at least one of: - Fluorescence images, - images derived from or calculated from fluorescence images, - reflected image, - An image derived or calculated from a reflected image.

5. The controller (150) of any one of the preceding claims, configured to determine the region of interest (130) at the object (114) based on the image (122) of the second type by: providing different weights for different regions (130, 132) of the image (122) of the second type; and The region of interest is selected from the different regions based on the weights (130).

6. The controller (150) of claims 4 and 5, wherein said image (122) of said second type is, comprises or is at least based on a fluorescent image, and Wherein said weight is provided based on fluorescence intensity in said image (122) of said second type.

7. A controller (150) as claimed in claims 4 and 5 or claim 6, wherein said image (122) of said second type is, comprises or is at least based on a reflected image, and Wherein said weight is provided based on an intensity of reflections in said image (122) of said second type.

8. The controller (150) of any of the preceding claims, configured to cause the imaging system (102) to automatically set the one imaging parameter (140, 142, 144) or at least one of the more imaging parameters (140, 142, 144) also based on the image (120) of the first type or the images of the first type.

9. The controller (150) of any of the preceding claims, configured to cause the imaging system (102) to automatically set the one imaging parameter (140, 142, 144) or at least one of the more imaging parameters (140, 142, 144) also based on the image (122) of the second type or the plurality of images of the second type.

10. The controller (150) of any one of the preceding claims, wherein the imaging system (102) is further configured to acquire a plurality of images (122) of the second type of the object (114).

11. The controller (150) of claim 10, further configured to receive the image (122) of the second type from the imaging system (102).

12. The controller (150) of any one of claims 1 to 9, further configured to receive the image (122) of the second type from an external entity (162), the external entity (162) being different from the imaging system (102).

13. A system (170) comprising an imaging system (102) configured to acquire a plurality of images (120) of a first type of an object (114) and automatically set one or more imaging parameters (140, 142, 144), the system (170) further comprising the controller (150) of any of the preceding claims.

14. The system (170) of claim 13, wherein the imaging system (102) is further configured to acquire a second type of multiple images (122) of the object (114), comprising an imaging optical device (104), a first imaging detector (106) for acquiring the first type of the multiple images (120), and a second imaging detector (108) for acquiring the second type of the multiple images (122).

15. The system (170) of claim 13 or 14, comprising a microscope (100), the microscope (100) comprising or configured as the imaging system (102).

16. A method for controlling an imaging system (102), the imaging system (102) being configured to acquire a plurality of images (120) of a first type of an object (114) and automatically set one or more imaging parameters (140, 142, 144), the method comprising: determining (206) a region of interest (130) at the object (114) based on an image (122) of a second type, wherein the second type is different from the first type; Based on the region of interest (130), controlling (208) the imaging system (102) to automatically set the one imaging parameter (140, 142, 144) or at least one of the more imaging parameters (140, 142, 144); and The imaging system (102) is controlled (210) to acquire the first type of image (120) of the object.

17. A computer program having a program code for executing the method of claim 16 when the computer program is run on one or more processors or the controller (150) of any one of claims 1 to 15.