Microscope control device, microscope system, method for controlling a microscope, and computer program

The microscope controller with phosphor control widgets simplifies fluorescence microscopy by providing intuitive illumination feedback and unified settings, enhancing user-friendliness and result accuracy across different modes.

JP2024542827AActive Publication Date: 2024-11-15LEICA MICROSYSTEMS CMS GMBH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024533855
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-12-06
Publication Date
2024-11-15
Estimated Expiration
2041-12-06

Smart Images

  • Figure 2024542827000001_ABST
    Figure 2024542827000001_ABST
Patent Text Reader

Abstract

A microscope controller (10) is provided, the microscope controller (10) including one or more processors (140) and one or more storage devices (150). The microscope controller (10) is configured to provide a control parameter. The microscope controller (10) is further configured to process phosphor information indicative of one or more phosphors and derive a control parameter based on the phosphor information. The microscope controller (10) is further configured to render a graphical user interface (1000) and, as part of the graphical user interface (1000), one or more phosphor control widgets (1110, 1120, 1130, 1140), the one or more phosphor control widgets (1110, 1120, 1130, 1140) corresponding to a phosphor or one of the phosphors indicated by the phosphor information. Each of the or each of the phosphor control widgets (1110, 1120, 1130, 1140) includes a first widget zone (1112, 1122, 1132, 1142) providing user feedback indicative of a corresponding phosphor and a second widget zone (1114, 1124, 1134, 1144) indicating an illumination intensity associated with the phosphor. A microscope system (1), a method (500) for providing microscope control parameters and a computer program comprising program code for implementing the method (500) are also part of the invention.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a microscope control device, a microscope system, a method for controlling a microscope, and a computer program. [Background technology]

[0002] EP 3721279 A1 discloses a microscope system including a detection unit adapted to detect the fluorescence response of a fluorophore in a number of different color channels using a number of detectors. Each of the fluorophores can be excited using light from a light source such as a light emitting diode. In the embodiment described in relation to FIG. 3, two detection units can be provided and light can be guided to any one of these detection units via a corresponding beam path by a switchable or displaceable mirror. One of the detection units can be connected to or be part of a wide-field detection system and one of the detection units can be connected to or be part of a confocal detection system. In an embodiment, a wide-field illumination unit and a confocal illumination unit corresponding to the detection unit are also provided. In general, a microscope system is disclosed in which the fluorescence response of one or more fluorophores can be detected and the detection and illumination settings are adjusted accordingly by the user. Summary of the Invention [Problem to be solved by the invention]

[0003] The present invention has the object of improving the operation of a microscope system in which the fluorescent response of one or more fluorophores is detected, particularly in terms of effectiveness and user-friendliness. [Means for solving the problem]

[0004] A microscope controller is provided, the microscope controller including one or more processors and one or more storage devices. The microscope controller is configured to provide a control parameter. The microscope controller is configured to process phosphor information indicative of one or more phosphors and derive a control parameter based on the phosphor information. The microscope controller is also configured to render a graphical user interface and one or more phosphor control widgets as part of the graphical user interface, the phosphor control widget or each of the plurality of phosphor control widgets corresponding to one of the phosphors or the plurality of phosphors indicated by the phosphor information. The phosphor control widget or each of the plurality of phosphor control widgets includes a first widget zone and a second widget zone, the first widget zone providing user feedback indicative of the corresponding phosphor and the second widget zone indicating an illumination intensity associated with the phosphor. In one embodiment of the invention, in the phosphor control widget or each of the plurality of phosphor control widgets, the second widget zone may be rendered as a rim surrounding the first widget zone, a percentage of the rim corresponding to the illumination intensity being rendered differently than the remaining percentage.

[0005] The proposed microscope controller, including the user interface and phosphor control widgets, enables substantially phosphor-based operation of a fluorescence microscope, which is a departure from the traditional operating paradigm based on specific instrument settings, and in particular allows inexperienced or less experienced users, as well as more experienced users, to adjust and control settings for inspecting samples in a more user-friendly and less error-prone manner.

[0006] The term "widget", as understood herein, refers to any element of interaction that is rendered as part of a user interface, including, but not limited to, elements configured for selection and display of elements or collections, such as buttons (including radio buttons, check boxes, toggle switches, toggle buttons, split buttons, cycle buttons), sliders, list boxes, spinners, drop-down lists, menus (including context menus and pie menus), menu bars, toolbars (including ribbons), combo boxes, icons, tree views, grid views, elements configured for navigation, such as links, tabs and scroll bars, elements for text input, such as text and combo boxes, elements for outputting information, such as labels, tooltips, help balloons, status bars, progress bars and information bars, and containers, such as (modal) windows, windows, dialog boxes, palettes, frames and canvas elements. The term "user interface" should be understood to refer generally to graphical user interfaces.

[0007] In one embodiment of the invention, the microscope controller may be configured to receive user input in a number of different input modes and convert the user input in the number of different input modes into interactions with the phosphor control widget in a number of different interaction modes. This allows a user to interact with the system in a manner familiar to users from user input devices in other technical fields. Providing multiple different interaction modes for the same user input device advantageously allows one device to be used to trigger multiple different functions.

[0008] In one embodiment of the present invention, the microscope control device may be configured to receive user input in a number of different input modes from one or more user input devices selected from a mouse, a touchpad, a joystick, a trackball and a touch screen, the interaction modes including at least one of a first button click, a second button click, a drag-and-drop action, a touch action and a mouseover action, or a hover action. In particular, each of the aforementioned interaction modes may be associated with one particular function. Thus, a user may use the same input device to trigger multiple different functions without distraction, for example while placing a cursor or mouse pointer at a particular position.

[0009] In one embodiment of the present invention, the microscope controller may be configured to, in response to an interaction in one of the interaction modes, toggle at least one of: illumination for exciting the corresponding fluorophores, use of fluorophore information regarding the corresponding fluorophores in an un-mixing method to determine the contribution of the fluorophores in a common fluorescent response, and display of an image obtained based on the fluorescent response of the corresponding fluorophores. That is, a fluorophore (i.e., parameters related to its excitation and detection) can be advantageously switched "on" and "off" using a single user action instead of individually adjusting multiple instrument settings.

[0010] In one embodiment of the present invention, the microscope controller may be configured to render a fine-tuning panel in response to an interaction in one of the interaction modes. Thus, a user may fine-tune a parameter for one of a plurality of fluorophores without having to specifically select a different window for such adjustment, yet still use the very same control widget. This allows the microscope to be operated in a less distracting manner.

[0011] In this regard, the microscope control device may be configured to modify the control parameters based on user input received using the fine-tuning panel, which, as described above, is advantageously possible in a less distracting manner than is the case with prior art microscope control devices.

[0012] In particular, in one embodiment of the present invention, the microscope control device may be configured to reposition the phosphor control widgets in the graphical user interface in response to a decision to interact in one of the interaction modes. Such repositioning and regrouping may be useful in particular for associating the control widgets and the phosphors corresponding to the control widgets with a plurality of different processing techniques in a particularly intuitive manner.

[0013] In this regard, the fluorophore information may indicate multiple fluorophores, and the microscope controller may be configured to provide control parameters that specify sequential or parallel excitation of the multiple fluorophores. In this regard, repositioning the fluorophore control widget may allow for particularly easy association of one or more fluorophores with a particular processing technique.

[0014] In one embodiment of the invention, the microscope controller may be configured to provide control parameters that specify whether multiple fluorophores are required to be excited sequentially or in parallel based on the grouping state of corresponding fluorophore control widgets in the graphical user interface. Thus, multiple fluorophores can be intuitively associated with different processing techniques (sequential or parallel), e.g., grouping multiple fluorophore control widgets in one subunit of the user interface, such as a canvas area or subwindow, indicates parallel processing, while locating multiple fluorophore control widgets in different subunits indicates sequential processing.

[0015] In one embodiment of the invention, the microscope controller may be configured to provide control parameters that further specify camera and / or scanner settings. In such an embodiment, many more parameters than those related to the illumination may be controlled based on the fluorophore information, thus further improving the advantageous operating paradigm provided.

[0016] In one embodiment of the invention, the microscope controller may be configured to control the operation of a fluorescence microscope including multiple light sources, and the controlled illumination intensity may be that of one or more of the light sources primarily used for excitation of the corresponding fluorophores, i.e., a single user interface action may be used to simply switch "on" and "off" the primary fluorescence response of a fluorophore (not including the fluorescence response due to cross-excitation).

[0017] In one embodiment of the invention, in the microscope control device the control parameters may be configured for use in the wide-field and confocal fluorescence inspection techniques, and the microscope control device is therefore particularly useful for controlling a fluorescence microscope operable in both the wide-field and confocal fluorescence inspection techniques as mentioned in the introduction, using the advantageous operating paradigm described above.

[0018] A microscope system is also provided, comprising a fluorescence microscope and a microscope control device.Regarding the features and advantages of the microscope system, reference is made to the description of the different aspects above, which also apply to the microscope system.

[0019] Further, a method for providing microscope control parameters is proposed, in which phosphor information indicative of one or more phosphors is processed and control parameters are derived based on the phosphor information. A graphical user interface and, as part of the graphical user interface, one or more phosphor control widgets are rendered, the phosphor control widget or each of the plurality of phosphor control widgets corresponds to one of the phosphors or the plurality of phosphors indicated by the phosphor information. The phosphor control widget or each of the plurality of phosphor control widgets includes a first widget zone and a second widget zone, the first widget zone providing user feedback indicative of the corresponding phosphor and the second widget zone indicating the illumination intensity associated with the phosphor. Again, with regard to the features and advantages of such a method, reference is made to the description of the different aspects described above, which also apply to the method for controlling a microscope.

[0020] This also applies in particular to the corresponding method according to an embodiment of the invention, in which a microscope control device or a microscope system as described above in the different embodiments is used.

[0021] There is also provided a computer program comprising a program code for carrying out the method as described above in its different aspects, when the computer program is executed on a processor, and likewise benefits from the corresponding advantages. [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 illustrates a microscope system. [Diagram 2] FIG. 1 shows an embodiment of a microscope. [Diagram 3] FIG. 1 illustrates aspects of a graphical user interface. [Figure 4] FIG. 13 shows a fluorescence control widget. [Diagram 5] FIG. 13 illustrates user input to a fluorescence control widget. [Figure 6]FIG. 13 illustrates regrouping of the fluorescence control widget. [Figure 7] FIG. 13 illustrates further user inputs to the fluorescence control widget. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] As already mentioned at the beginning, fluorescence microscopes are known that include multiple detectors, which can be used to detect the fluorescence response of different fluorophores. In such fluorescence microscopes, and even if they only include one detector, it is not an easy task to properly adjust the fluorescence illumination settings, such as the intensity of a single light source or one of the multiple light sources, and the corresponding detection settings. In microscopes that allow the user to select between different microscope operation modes, including but not limited to a wide-field operation mode and a confocal operation mode, such adjustments become even more complicated.

[0024] This is explained below with reference to Figures 1 and 2, where Figure 1 shows in a more general way a microscope system 1 including a microscope 300, and Figure 2 shows details of the switching between widefield and confocal operation and the respective illumination and detection units of the microscope 300 configured accordingly. However, embodiments of the invention are not limited to being used with a microscope 300 capable of operating in widefield and confocal modes of operation, but may be used with numerous configurations of fluorescence microscopes. The advantages of embodiments of the invention are present in substantially all fluorescence microscopes in which illumination and detection settings can be adjusted.

[0025] As will be explained later, there are many technical elements used in the operation of the fluorescence microscope 300, and their influence on each other, on the sample being observed and on the results obtained in terms of a fluorescence image is not always predictable, especially for an inexperienced user. For example, if the illumination intensity of the light source is adjusted to a high value, it will be possible to increase the fluorescence response of fluorophores that have an excitation wavelength peak corresponding to the central wavelength of the light source. However, in such a case, the mutual excitation of other fluorophores that have a main excitation wavelength peak that does not correspond to the central wavelength of the light source may also become significantly higher, making the results obtained more unspecific ("crosstalk"). This means that the correspondence between excitation and response becomes more difficult and the output of known non-mixing techniques becomes unreliable. Furthermore, too strong illumination settings may cause photodamage to the sample or to fluorophores in the sample, also called "sample bleaching".

[0026] However, illumination settings that are too weak can result in images with too low contrast in one fluorescence channel or the cross-excitation contribution from other light sources can be relatively too high, resulting in less specific results.

[0027] Certain influences, such as the local environment of a fluorophore, may shift the main excitation and / or emission wavelengths to some extent, and therefore may require adjustment of the wavelengths used for excitation and / or detection, or may require broadening of the excitation or detection bandwidth. However, in other cases, it may be advantageous to narrow the excitation and detection bandwidth, for example to reduce crosstalk and cross-excitation.

[0028] The excitation and detection settings have an impact on the outcome of spectral unmixing techniques that can be used in particular in the context of fluorescence microscopy. Spectral unmixing is a technique that addresses the problem of overlapping emission spectra of fluorophores as a result of cross-excitation or "bleed-through" between different detection channels. These phenomena can lead to false positives if not properly addressed. The corresponding problems become particularly pronounced when samples are labeled with three or more fluorophores. Spectral unmixing may include, among others, linear unmixing, non-negative matrix factorization, deconvolution and principal component analysis. The unmixing techniques may be based on a priori knowledge of the emission spectra or may be used in conjunction with limiting the number of fluorophores to no more than the number of detection channels. In the understanding at the heart of this specification and used herein, spectral unmixing is the task of decomposing a mixed multi-channel image into its spectral signatures and the abundance of each signature at each pixel.

[0029] The settings of the specific interacting components and the microscopy results mentioned above are not exhaustive: for example, the detection time or frame rate (i.e. the frequency at which images are taken and the time used to acquire one image) in area detectors or the corresponding scanning time in scanning systems with point or line detectors can have a strong influence on the contrast, brightness and possibly detector noise, which are closely related to the illumination intensity used.

[0030] As mentioned above, FIG. 1 shows a microscope system 1 that can be used in embodiments of the present invention. The microscope system 1 can be configured to perform the methods described herein. The microscope system 1 includes a microscope 300 and a computer system 100. The microscope 300 is configured to capture images and is connected to the computer system 100 via a wired or wireless communication path or interface unit 200. The microscope 300 is a fluorescence microscope and can be configured to operate in a number of different microscope operation modes, for example a wide-field operation mode and a confocal operation mode, in one embodiment, as further shown with reference to FIG. 2. Even though FIG. 1 illustrates an upright microscope 300, embodiments of the present invention can be used with an inverted microscope, the details of which are shown in FIG. 2.

[0031] The computer system 100 may be configured to perform at least some of the methods described herein. The computer system 100 and the microscope 300, as well as the fully optional interface unit 200, may be separate entities, but may be integrated in one common housing. The computer system 100, even if illustrated as a laptop computer, may be part of the central processing system of the microscope 300, and / or the computer system 100 may be part of a subcomponent of the microscope 300, such as a sensor, actuator, camera, or lighting unit of the microscope 300, etc. The same is essentially true for the interface unit 200.

[0032] Computer system 100 may be a local computing device (e.g., a personal computer, laptop computer, tablet computer, or mobile phone) with one or more processors 140 and one or more storage devices 150, or may be a distributed computing system (e.g., a cloud computing system with one or more processors and one or more storage devices distributed at various locations, such as local clients and / or one or more remote server farms and / or data centers). Computer system 100 may include any circuit or combination of circuits.

[0033] In an embodiment of the present invention, the computer system 100 may include one or more processors 140, which are shown, but are not limited to, integrated into the housing of the computer system 100 in FIG. 1. The processors 140 may be of any type and may be provided in any number and in any location in any component of the microscope system 1. As used herein, the term processor may contemplate any type of computing circuit, such as, but not limited to, a microprocessor, a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other type of processor or processing circuit, for example, in the microscope 300 or any component (e.g., a camera) of the microscope system 1. Other types of circuits that may be included in computer system 100 may be custom circuits, application specific integrated circuits (ASICs), etc., such as one or more circuits (such as communications circuits) used in wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems.

[0034] The one or more storage devices 150 shown included in computer system 100 may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives handling removable media, such as compact discs (CDs), flash memory cards, digital video discs (DVDs), and the like.

[0035] Computer system 100 may include a display device 110, one or more speakers, a keyboard 120, and / or one or more controllers or user interaction devices. A user interaction device may be or include a mouse, or a trackpad 130 with buttons 132 and 134 as shown, a trackball, a touch screen, a joystick, a voice recognition device, or any other device that allows a user of the system to input information to and / or receive information from computer system 100.

[0036] 1, the computer system 100 may be configured to render a graphical user interface 1000, as shown in further and following embodiments, on a display device 110. The computer system 100 may be further configured to provide interaction possibilities with the graphical user interface 1000 for operating the microscope system 1 via a keyboard and / or a trackpad 130 and / or any further input device.

[0037] Microscope 300 is shown to include, among other things, a microscope housing 310, a stage 320 on which sample 20 can be placed, a focus adjustment knob 330, a transmitted light illumination unit 340, a lens barrel 360 with at least one objective lens or lens 350, an eyepiece or eyepiece set 370, a camera or detection unit 380, and an incident illumination unit 390, which is shown to include, but is not limited to, a number of different light sources 392-396. Light from illumination unit 390 is coupled through beam splitter 398, as shown by dotted lines, into a beam path, as shown by dashed lines. Additional components of an embodiment of microscope 300 are shown in FIG. 2, however, embodiments of the invention are not limited by the particular configuration shown in FIGS. 1 and 2. The microscope may be operable in a number of different microscope operating modes, such as a wide-field and a confocal mode of operation, via appropriate switching of the light sources 392-396 or illumination unit 390 and detection modalities within the detection unit 380. In general, the detection unit 380 may include a number of different detection channels, the number of which may correspond to the number of light sources 392-396 or the number of illumination channels provided by the light sources 392-396.

[0038] The computer system 100 and the interface unit 200 may be referred to as a microscope controller 10, although as used herein, this term is not limited to the microscope controller 10 including the computer and the interface unit 200. As used herein, the term "microscope controller" should be understood in particular functionally and to refer to a unit or group of units including one or more processors 140 and one or more storage devices 150 provided in the computer system 100 or otherwise configured to render a graphical user interface 1000 as further illustrated in the embodiments above and below.

[0039] As mentioned above, the corresponding microscope system 1 and operating software for the microscope 300 have traditionally required the user to adjust a number of illumination and detection settings using a number of different user interface elements, each of which typically allows specific direct adjustment of the elements used, such as the light source and detector chip, respectively. Although traditional user interfaces may use computer control in which multiple specific settings are combined, the user must still generally have detailed knowledge of the technical background of each setting and the impact they have on the results achieved.

[0040] In contrast to this, an embodiment of the present invention involves a change in the operating paradigm of the microscope system 1 and a different approach for operation, which in one embodiment is a workflow-based approach. At the heart of the new approach can be fluorophore information, which can be part of the so-called sample definition. This sample definition is the first step of the workflow-based approach. The sample definition can be provided by the user, in which the user can describe the nature of the sample to be examined. The sample definition may include the definition of the sample carrier (slide, petri dish, well plate) and the definition of the sample's dimensions (shape, diameter, etc.) and properties (adhesive, fixative, biological, etc.). The fluorophore information may include the specification of the dyes (stains or fluorophores) provided to the sample and, optionally, the name of the sample, chemical data, shelf life, sensitivity to light, etc. Via the above mentioned fluorophore information, the microscope system 1 is informed in particular regarding the spectrum to be used, i.e. regarding the excitation and emission wavelengths.

[0041] Thus, for the first time, with embodiments of the present invention, instead of a traditional (direct) hardware setup, fluorophores are central to the operation of the microscope system 1. This fluorophores-based approach allows this information to be used to provide pre-configuration and automation to the user, unlike traditional systems. This results in a completely new way of operating fluorescence applications. With only a few user interface controls, embodiments of the present invention allow the user to be provided with a clean and intuitive user interface. In embodiments, the system may be configured to automatically locate features in the sample, such as cells, and automatically identify optimal illumination settings. The user can focus entirely on the question they want to answer with the microscope, and does not need to have expert knowledge of the technical parameters and their interactions for proper illumination of the sample.

[0042] With the user interface provided by the embodiments of the present invention new user groups can be addressed since in the present invention the user needs to have little or no knowledge of the underlying technology thanks to the "smart controls".For the first time a new approach to fluorescence operation is proposed which also applies to fluorescence microscopes which are capable of operating in several different operating modes, e.g. widefield (camera) and confocal (scanner / detector) modes.

[0043] Before proceeding to a description of a user interface according to an embodiment of the present invention, FIG. 2, which will now be described, shows a fluorescence microscope 300 according to an embodiment of the present invention, which can be used as the fluorescence microscope 300 in a microscope system 1 as shown in FIG. 1, for example. The fluorescence microscope 300 as shown in FIG. 2 includes two detection units, namely a first detection unit 380a and a second detection unit 380b. By means of a switchable or displaceable mirror 382 (as indicated by the double arrow) or any other switching means, the observation light can be selectively coupled to either the first detection unit 380a or the second detection unit 380b. In the position shown in FIG. 2, the observation light is coupled to the second detection unit 380b on the right side via the mirror 382. When the mirror 382 is moved from the illustrated position as indicated by reference number 382', the light path proceeds further downwards (in the illustrated embodiment), whereby the observation light is coupled to the first detection unit 380a as indicated by the dotted edge line. The optical lenses provided in the illumination beam path and in the detection beam path are not specifically referenced.

[0044] The first detection unit 380a is a wide-field detection unit in the example shown in FIG. 2, in which the image plane is marked with the reference 384a. The observation light is collimated by using lenses not specifically marked with references and is directed to a detector arrangement 386a in the first detection unit 380a. The detector arrangement 386a may be configured to split the observation light into a number of different detection channels. With regard to the detector arrangement 386a usable in the first detection unit 380a, specific reference is made to EP 3721279, in particular the detection unit 10 shown in FIG. 3 and the corresponding description, the disclosure of which is incorporated by reference. An illumination unit for wide-field detection in the first detection unit 380a is illustrated in a simplified manner and marked with the reference 390a. The light of the illumination unit for wide-field detection may be coupled into the illumination beam path of the microscope 300 in any manner known in the field of microscope illumination, such as by using a dichroic mirror 391a.

[0045] The second detection unit 380b is a confocal detection unit in the example shown in FIG. 2, in which the image plane is given the reference 384b. For confocal detection using the confocal detection unit 380b, a point light source 390b can be provided. The point light source 390b can in particular be a (single) pinhole aperture into which the laser light can be focused or the end of a light guide or optical fiber from which the light emerges in a point form. The point light source 390b is conjugate with the intermediate image plane 384b in the sample 20 and with the object plane 21, so that the illumination light can be focused to a point in the object plane 21 via a dichroic mirror 391b and illumination optics, not specifically given a reference, so that scanning can be performed with an X / Y scanner 395b, which can be arranged in a telecentric plane or in a plane conjugate to the telecentric plane. This makes it possible to perform a scanning of the sample 20 in the sample plane 21, as is generally known. The pinhole is given the reference 397b. Again, for further details, specific reference is made to EP 3721279, in particular to the detection unit 20 shown in Fig. 3 and the corresponding description, the disclosure of which is incorporated by reference. The same applies to the detector arrangement 386b, which may be configured to split the observation light into several different detection channels. Specific reference is also made to EP 3721279 with regard to the detector arrangement 386b usable in the second detection unit 380b.

[0046] As is evident from the sheer number of components present in a microscope capable of operating in a number of different microscope operating modes, such as the microscope 300 shown in FIG. 2, a very large number of settings may be implemented separately in each of these operating modes, including, but not limited to, the selection or intensity of the light sources 392-396 in any of the operating modes, and possibly corresponding filters. In addition, such settings may include detector settings such as exposure time, sensor gain, area sensor crop, area sensor binning, or selection of a particular area sensor in the case of a wide-field operating mode, and detector settings such as scanning speed, scanning resolution, pinhole size, detector gain, and selection of a particular detector to be used in the case of a confocal operating mode. While the setting or tuning of the operating parameters of some of these components can be simplified, for example, by selecting appropriate default values, using optimization algorithms, combining appropriate tuning, etc., tuning of at least some of the components used in any one of the operating modes is conceptually strictly separated in conventional devices.

[0047] In other words, the above-mentioned difficulties in adjusting the illumination and detector parameters for a single fluorophore and / or operating mode become even more pronounced in microscopes that allow the user to select between several different microscope operating modes. As mentioned above, in such microscopes, the operating concepts in each operating mode are significantly different from each other. Settings that affect the images obtained in these operating modes include, for example, illumination settings of the wide-field light source (area sensor or "camera") versus illumination settings for the scanning light source and the respective illumination beam path components, and detection settings for area detectors versus detection settings for components such as line detectors or point detectors, including the respective detection beam path components. Each of these components, if adjustable, generally can have an effect on the image result and must therefore be adjusted individually and carefully.

[0048] In embodiments, the present invention allows in such cases a unified control of different microscope operation modes in one unified operating concept. Such a unified control has not been realized so far due to the involvement of different devices, components and their parameters. The combination of automaticity, mathematical models and functions in embodiments of the present invention can serve to share common control elements or control widgets between different operation modes. The appropriate settings for each of the operation modes are transparently differentiated in the background without further user interaction.

[0049] A user of microscope 300 in each of a number of different operational modes eliminates the need for the user to conceptually and mentally "switch" between a number of different operational and interaction concepts that would typically be required in the past, particularly for a user with no experience in one of the operational modes, or in relatively stressful observation situations, such as when observing a moving sample, and reduces distraction from the actual task of observing and inspecting a sample.

[0050] In other words, according to the embodiments of the present invention, an advantageous operating concept is realized that abstracts the operation of the microscope even in different operating modes from the underlying technical details. According to the embodiments of the present invention, a target-oriented operation can be realized, i.e. the operating concept can start from or be centered on the fluorophores used and the results to be achieved, such as image resolution, image size and exposure time, or even acquisition speed. In general, the embodiments of the present invention ensure that the user does not generally have to know much about the technology underlying the different operating modes, and can concentrate on the actual operation or quality and parameters of the microscope image. As mentioned above, the embodiments of the present invention are not limited to widefield and confocal operation, even if they are described below with a focus on these specific microscope operating modes.

[0051] In conventional concepts for operating a fluorescence microscope 300, the user still has to have detailed knowledge of the technical background of each of the operating modes and what the effect of each of these technical backgrounds is on the results achieved. As mentioned above, in conventional devices the user is even required to conceptually and mentally "switch" between several different operating and interaction concepts in general. This problem is overcome by embodiments of the present invention, which, as will now be further explained, provide a phosphor-based control of the microscope (system) in particular in several different microscope operating modes in one integrated operating concept.

[0052] In other words, embodiments of the present invention provide an advantageous operating concept that abstracts the operation of a microscope from the underlying technical details, particularly in different operating modes, such as may be used with a user interface 1000 as shown diagrammatically in Figure 3, where the components of the user interface 1000 may be arranged as shown, but also in any other conceivable manner.

[0053] As shown in Fig. 3, but not limited thereto, the user interface 1000 may be divided into an input panel 1100 including multiple input widgets or widget groups 1101-1105, and a display panel 1200, which in the example shown in Fig. 3 displays four different images 1201-1204 obtained by capturing fluorescence responses in four different channels. The images may be acquired in any one of the microscope operation modes if the microscope 300 is accordingly configured, i.e. they may be the output of multiple different area sensors in the detection unit 380 used in a widefield operation mode, or they may be representations of scanning responses captured in one or more detectors or sensors used in a confocal operation mode. The images 1201-1204 may be an overlay of two or more fluorescence responses, each used in the same microscope operation mode, or possibly each used in different microscope operation modes. The images may be resolution-aligned with each other or relative to a common value in embodiments of the present invention. At least one of the images 1201-1204 may be a two-dimensional representation of three-dimensional image data, for example a slice of such three-dimensional image data, or a projection of such three-dimensional image data onto a plane.

[0054] The embodiments of the present invention are in no way limited by the number of images 1201-1204 displayed and their origin, processing technique, or source. For example, the images 1201-1204 may be displayed in pseudo-color or as a (pseudo) colored representation if captured as grayscale images. For example, the images 1201-1204 may be displayed in colors corresponding to the peaks of the fluorescence emission spectrum in the fluorescence channel in which the images 1201-1204 were captured, or the display colors may be freely selected by a user of the microscope system 1 or the microscope control device 10, for example to differentiate the images in an overlay image.

[0055] The image captured in the fluorescence microscope may be monochrome (grayscale) or colored according to wavelength and displayed on the display panel 1200. In this way, overlay of a single channel with multiple different colors is possible. If the user uses fluorophores that are very close to each other in the sample (e.g., Alexa568 and Alexa594 are both orange fluorophores), the overlay structures from the two channels will be detected in the same color in nature. Here, it may be desired to increase the contrast as much as possible to be able to better distinguish both fluorophores. To solve this problem, the user can associate another different display color with one or both fluorophores.

[0056] The images 1201-1204 may be displayed as still images 1201-1204, or as videos 1201-1204, or as a mixture of still and videos 1201-1204, and the user interface may be configured to take "snapshots" of, for example, a moving sample, for example, switching between still and video views of the images 1201-1204 at predefined time intervals or in response to a request of a microscope user, for example via a widget in the user interface 1000. According to embodiments of the invention, it is generally possible to provide a simultaneous mixed view of still images 1201-1204 and videos 1201-1204, which allows, for example, visual tracking of the movement of the sample 20 or components of the sample 20 and, in parallel, inspecting the sample 20 or components of the sample 20 in detail.

[0057] Aspects of embodiments of the invention may include acquiring and / or displaying images 1201-1204 as shown in Figure 3, possibly via multiple different microscope operating modes, and possibly with multiple different detection modes, sizes, resolutions, detection channels, etc., where a fluorophore-based control concept is used to acquire such images 1201-1204 via user interface 1000. Aspects include setting parameters, possibly using the same user interface widgets for multiple different microscope operating modes, based on predefined fluorophore information, and transparently translating corresponding user inputs into specific illumination (excitation) and / or detection settings for any of the possibly different operating modes.

[0058] As shown in Fig. 4, in an embodiment of the present invention, this is achieved by using fluorescent control widgets 1110, 1120, 1130, 1140 provided in a widget area that may correspond, without limitation, to the input panel 1100 already shown in Fig. 3 and is therefore also referred to herein as an input panel. In an embodiment of the present invention, sub-panels 1101 and 1102 of the input panel 1100 may be provided, or only one sub-panel may be provided. The sub-panels 1101 and 1102 may be similar or dissimilar to the widget groups 1101 and 1102 as shown in Fig. 3, or may be provided as additional widgets or widget groups. The fluorescent control widgets 1110, 1120, 1130, 1140 are user interface components that can achieve the fluorescent-based operations according to the above-described embodiments of the present invention, as will be further described below.

[0059] For this purpose, each of the fluorophore control widgets 1110, 1120, 1130, 1140 is provided to correspond to one or more of the fluorophores indicated by the fluorophore information. The number of control widgets 1110, 1120, 1130, 1140 is dynamic and depends on the number of fluorophores indicated and specified by the user, for example in the sample information in which such fluorophore information is provided, in addition to other sample parameters as described above. Alternatively, the fluorophore information may be provided by the user separately from further sample information or without sample information. The fluorophore information, whether provided in addition to the sample information or together with the sample information, may include, but is not limited to, at least one of the following: the name of the fluorophore, an excitation wavelength or wavelength range usable to excite the fluorophore, and an emission wavelength or wavelength range characterizing the fluorescence response of the fluorophore. The wavelength range may be provided in the form of, among others, a central wavelength and a bandwidth of a wavelength band. The fluorophore information may include information regarding the chemical or physical stability of the fluorophore. For example, the fluorophore information may specify, without limitation, one, two, three, four, or five fluorophores, a number that corresponds to or is less than the number of detection channels (i.e., camera chips, area detectors, scanning detectors, etc.) of the microscope 300, among others.

[0060] The control widgets 1110, 1120, 1130, 1140 are provided to provide the user with information regarding the excitation and detection of fluorophores corresponding to these control widgets 1110, 1120, 1130, 1140 as well as possibilities for interaction with the excitation and detection of fluorophores corresponding to these control widgets 1110, 1120, 1130, 1140. Optionally, the control widgets 1110, 1120, 1130, 1140 may be used instead of information means of conventional information widgets of graphical or non-graphical user interfaces conventionally used to provide information on the illumination settings, the fluorescence response and the parameters set in the corresponding microscopes, and optionally, the control widgets 1110, 1120, 1130, 1140 may be used instead of adjustment means for such illumination and detection.

[0061] The control widgets 1110, 1120, 1130, 1140 are control elements that allow the user to set up all the settings, especially for several different fluorophores, in a few interaction steps, for example with a few mouse clicks. Even without specialist knowledge, the user can use the control widgets 1110, 1120, 1130, 1140 to set up an experiment for a specific problem. In this way, the user can work much faster and obtain meaningful results compared to conventional systems. This time saving applies both to widefield and confocal microscopy, if the corresponding microscope 300 is configured to operate in widefield and confocal modes. The saving is much larger on the confocal side, since the mathematical model stored for this mode of operation essentially takes into account many more parameters and the user no longer has to set up each of the components involved himself,

[0062] Thus, the control widgets 1110, 1120, 1130, 1140 can be used for multiple different microscope operating modes or detection types and user interactions with the control widgets 1110, 1120, 1130, 1140 can be translated into any of the multiple operating modes or detection types, thereby realizing one common control concept via the user interface 1000. Thus, aspects of embodiments of the present invention include setting parameters for multiple different microscope operating modes, such as widefield and confocal modes, using the same user interface widgets and transparently translating corresponding user inputs into specific settings for any of the operating modes, as described further below.

[0063] As shown in Fig. 4, each of the phosphor control widgets 1110, 1120, 1130, 1140 includes a first widget zone 1112, 1122, 1132, 1142 that provides user feedback indicative of a corresponding phosphor and a second widget zone 1114, 1124, 1134, 1144 that indicates a lighting intensity associated with the phosphor. In particular, the phosphor control widgets 1110, 1120, 1130, 1140, illustrated as round buttons in Fig. 4, can provide a user with information regarding the nature of a specified phosphor and the lighting intensity currently being used, respectively. Thus, there is a bimodal nature of the phosphor control widgets 1110, 1120, 1130, 1140, each of which provides the user with substantially all the information the user needs in one location and in an intuitive manner. In particular, the phosphor control widgets 1110, 1120, 1130, 1140 may be configured to provide the first widget zone 1112, 1122, 1132, 1142 with a color corresponding to the (primary) excitation wavelength or emission wavelength of the phosphor associated with the phosphor control widget 1110, 1120, 1130, 1140, and the first widget zone 1112, 1122, 1132, 1142 is provided with the fluorescence information based on this color. The color may be freely selected by the user.

[0064] The fluorophore control widgets 1110, 1120, 1130, 1140 may be configured to provide second widget zones 1112, 1122, 1132, 1142 to inform the user of the illumination intensity of the light sources 392, 394, 396, e.g. light-emitting diodes or lasers, used to illuminate the sample and to excite the corresponding fluorophores. Thus, the user can be informed about the illumination intensity at any time without distraction, e.g. without selecting another different window or part of the user interface, and in this way can be warned about overly powerful and / or overly extended illumination, in particular to avoid damage to the fluorophores. The parameters displaying the illumination intensity can also be adjusted based on the fluorophore information, e.g. taking into account the stability of the fluorophores.

[0065] 4, the second widget zones 1114, 1124, 1134, 1144 are in each case rendered as a rim surrounding the first widget zones 1112, 1122, 1132, 1142, with a proportion of the rim that corresponds to illumination intensity being rendered differently from the remaining proportion. The proportion that corresponds to illumination intensity may correspond linearly to illumination intensity or may be provided based on a function such as an exponential or irregular function, e.g. in cases where the fluorescence response or emission is not linearly dependent on illumination intensity.

[0066] In particular, if the second widget zone 1114, 1124, 1134, 1144 is rendered as a rim surrounding the first widget zone 1112, 1122, 1132, 1142, the lighter part of this rim can correspond to the illumination intensity in the form of a percentage of the maximum illumination intensity, and the darker part can correspond to the remainder. In FIG. 4, the lighter part is shown in white and the darker part is shown in black. The maximum illumination intensity can be the true maximum illumination intensity of the light source or the light source currently used, or it can be the maximum allowed illumination intensity defined elsewhere, such as the fluorescence information or the sample information. The maximum allowed illumination intensity can be selected based on the stability of the fluorophores. In one embodiment, the second widget zone 1114, 1124, 1134, 1144, or a part thereof, can be rendered in a "warning" color, for example red or orange, to warn the user of possible damage to the sample if a certain illumination setting is exceeded.

[0067] 4, the second widget zone 1114 displays approximately 60% lighting intensity, the second widget zone 1124 displays approximately 40% lighting intensity, the second widget zone 1134 displays approximately 80% lighting intensity, and the second widget zone 1144 displays approximately 20% lighting intensity. This display is particularly intuitive to a user because it resembles the minutes of an hour indicated by the hands of a traditional watch or clock, where one revolution of a circle corresponds to one hour and each minute circle corresponds to a fraction of the hour.

[0068] In fluorescence microscopy, especially with living specimens, avoiding or at least reducing bleaching effects plays a very important role. In conventional systems, the user has to adjust the light manually. An embodiment of the invention can free the user from this task. Controls for adjusting and balancing the laser intensity may no longer be present. An automatic illumination procedure can be used to calculate the optimal light intensity. However, since there may be many different combinations of fluorophores in the sample, very different intensity dynamics may be encountered between the different wavelengths. For this reason, it is very interesting for the user to have a feedback of the exposure of his sample. For this purpose, the second widget zones 1114, 1124, 1134, 1144 can be used, especially in the manner described above. The second widget zones 1114, 1124, 1134, 1144 display for each fluorophore the illumination intensity, for example of the main excitation laser or of the light emitting diode, for example in relation to the attenuator used. Thus, the user has direct feedback on the intensities being used and can simply glance at the phosphor control widgets 1110, 1120, 1130, 1140 at each step of the experiment to assess the exposure of the sample and take corrective action if necessary.

[0069] According to an embodiment of the present invention, the color of the second widget zones 1114, 1124, 1134, 1144, or more precisely, the portions of the second widget zones 1124, 1134, 1144 indicating illumination intensity, may be rendered in a color related to or similar to the excitation wavelength used for the corresponding fluorophore.

[0070] Further control widgets 1151, 1152, 1161, 1162 may be provided, which may be particularly adapted to initiate an experiment or data acquisition and fast acquisition mode, or any other parameters related to an experiment.

[0071] Figure 5 illustrates user inputs into a fluorescence control widget according to one embodiment of the present invention. Some of the components and their functions illustrated in Figure 5 have already been described in relation to Figure 4, and only additional components of them will be further described below.

[0072] As shown in Fig. 5, using a user interaction means such as a mouse or trackpad 130 as already shown in Fig. 1, a user can interact with the phosphor control widgets 1110, 1120, 1130, 1140. In Fig. 5, a mouse pointer is referenced 132' and the user can click on the phosphor control widgets 1110, 1120, 1130, 1140, for example using the left mouse button or any suitable interaction mode. In response, the corresponding illumination and detection can be switched off by a single user action, as indicated by the grayed out phosphor control widgets 1110, 1120. For example, according to an embodiment of the present invention, in a fluorescence un-mixing method used in unravelling the fluorescence responses from multiple different fluorophores, certain detection channels can be switched or ignored, and certain fluorescence responses can also be ignored or not taken into account.

[0073] More generally, the microscope controller 10 used to render the user interface 1000 is configured to, in response to a user interaction in one of the interaction modes, toggle at least one of: illumination to excite the corresponding fluorophores, use of fluorophore information regarding the corresponding fluorophores in a separation method to determine the contribution of the fluorophores in the common fluorescence response, and display of an image obtained based on the fluorescence response of the corresponding fluorophores. As described above, according to the embodiment shown herein, multiple settings are toggled by a single action.

[0074] When the user is exploring a location of interest in the sample in 3D, the system must be set in biomode to illuminate the sample. Here, it is important to protect the sample from illumination as much as possible for the duration of the exploration. For this procedure, it is not necessary to illuminate all fluorophores. This makes it possible to switch off all light sources that are not required. By left-clicking on the fluorophore control widgets 1110, 1120, 1130, 1140 (or any other defined interaction method), it is possible to activate or deactivate fluorophores, which is equivalent to indirectly switching on or off the corresponding light sources, but in a more user-friendly manner. In particular, switching back and forth between activation and deactivation becomes much easier. Switched-off fluorophores may be represented by the fluorophore control widgets 1110, 1120 in grey or with a faded representation. When the corresponding light source is activated, the first widget zone 1112, 1122, 1132, 1142 may be rendered in a color corresponding to the emitted light color, or any other color defined by the user with respect to the display color on the display panel 1200, such as a (pseudo) color as described above, or may be selected based on these colors.

[0075] By interacting with the phosphor control widgets 1110, 1120, 1130, 1140 in a particular interaction mode, for example by right clicking, the color used in the display panel 1200 for the image of the corresponding phosphor can be changed, as described above for phosphors having colors very close to each other in the sample. When the user selects a new color, the first widget zones 1112, 1122, 1132, 1142 can be rendered accordingly.

[0076] In one embodiment of the present invention, selecting and deselecting phosphors by acting on the phosphor control widgets 1110, 1120, 1130, 1140 changes the lighting scenario, for example reducing cross-excitation of other phosphors, so that a new automatic lighting procedure can be initiated.

[0077] Figure 6 shows a regrouping of the fluorescence control widget. Again, some of the components and their functions shown in Figure 6 have already been described above in large part in connection with Figures 3 and 4, and only additional subject matter and components thereof will be further described below.

[0078] In practice, there exist combinations of fluorophores whose spectra overlap unfavorably, and it is not possible to separate these fluorophores. Instead of rejecting such combinations for the microscope system 1, sequential acquisition can be used as a fallback. In one embodiment of the present invention shown in Fig. 6, the user can separate interfering fluorophores and split them into new sequences by drag-and-drop actions. Thus, in a corresponding embodiment, complex combinations can be recorded in just a few seconds.

[0079] For this purpose, the microscope control device 10 provided according to an embodiment of the present invention may be configured to reposition the fluorophore control widgets 1110, 1120, 1130, 1140 in the graphical user interface 1000 depending on the decision of the interaction in one of the interaction modes. In the illustrated example, it is determined whether the excitation and detection of the fluorophores should be performed sequentially or in parallel based on the grouping state of the corresponding fluorophore control widgets 1110, 1120, 1130, 1140 in the graphical user interface 1100. As shown in Fig. 6, the fluorophores corresponding to the fluorophore control widgets 1110, 1120, 1130 grouped in the user interface area 1101 are excited and detected in parallel. A phosphor control widget 1140 that is moved by the user from user interface area 1101 to user interface area 1102 by a drag-and-drop action is removed from this parallel excitation and detection and the phosphor corresponding to this phosphor control widget 1140 is therefore subsequently excited and detected. The drag-and-drop action is indicated by the mouse pointer 132' along arrow 132'', starting at starting position 1140' and ending at a new position in area 1102.

[0080] Of course, further sequential excitation and detection can be configured by providing further user interface areas such as interface areas 1101, 1102, and in each of interface areas 1101, 1102, any number of phosphor control widgets 1110, 1120, 1130, 1140 can be grouped together to request parallel excitation and detection.

[0081] Figure 7 illustrates user inputs to a fluorescence control widget in a further embodiment of the present invention. As noted above, several components and their functions illustrated in Figure 7 have been largely already described above, and only additional subject matter and components thereof will be further described below.

[0082] The automatic lighting provides the user with an image with an improved or optimized signal-to-noise ratio in relation to the current lighting environment. However, the image impression may be subjectively evaluated very differently by different users. In order to give the user discretion in this regard, in one embodiment of the present invention, fine-tuning of the automatic lighting may be provided as a response to user interaction with the phosphor control widgets 1110, 1120, 1130, 1140 in user interaction modes such as mouse-over actions.

[0083] In other words, by providing a fine-tuning panel 1126 including suitable means according to such an embodiment, the image impression can be adjusted to the user's personal taste. In other words, when the user moves the mouse over one of the phosphor control widgets 1110, 1120, 1130, 1140, a slider or set of sliders can be displayed after a certain time, for example for a few seconds, which can be used for fine-tuning. An "optimize" button can be provided to resume the automatic lighting and new parameters can be incorporated into the image. In one embodiment, the slider values ​​can be changed via the mouse wheel.

[0084] More generally, the microscope controller 10 used in this embodiment may be configured to render a fine-tuning panel 1126 in response to an interaction in one of the interaction modes, and may be configured to modify control parameters, in particular control parameters related to automatic illumination settings, based on user input received using the fine-tuning panel 1126.

[0085] As used in this specification, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0086] Although some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step, and similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus.

[0087] Some or all of the steps may be performed by (or using) a hardware apparatus, such as, for example, a processor, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, any one or more of the crucial steps may be performed by such an apparatus.

[0088] Depending on certain implementation requirements, the embodiments of the present invention can be implemented in hardware or software. The implementation can be performed by a non-transitory recording medium, such as a digital recording medium, for example a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM and EPROM, an EEPROM or a FLASH memory, on which electronically readable control signals are stored, which cooperate (or can cooperate) with a programmable computer system to implement the respective methods. Thus, the digital recording medium can be computer readable.

[0089] Some embodiments of the present invention include a data carrier having electronically readable control signals capable of cooperating with a programmable computer system to perform any of the methods described herein.

[0090] Generally, embodiments of the present invention can be implemented as a computer program product comprising program code which is operable to perform any of the methods when the computer program product is run on a computer, the program code may for example be stored on a machine readable carrier.

[0091] Another embodiment comprises the computer program for performing any of the methods described herein, stored on a machine readable carrier.

[0092] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing any of the methods described herein, when the computer program runs on a computer.

[0093] Therefore, another embodiment of the present invention is a recording medium (or data carrier or computer readable medium) containing a computer program stored thereon for performing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the present invention is an apparatus as described herein, including a processor and a recording medium.

[0094] A further embodiment of the invention is therefore also a data stream or a sequence of signals representing the computer program for performing any of the methods described herein, the data stream or the sequence of signals being for example adapted to be transmitted via a data communication connection, for example the Internet.

[0095] Another embodiment comprises a processing means, for example a computer, or a programmable logic device configured to or adapted to perform any of the methods described herein.

[0096] Another embodiment comprises a computer having the computer program installed thereon for performing any of the methods described herein.

[0097] Another embodiment of the invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, include a file server to transfer the computer program to the receiver.

[0098] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform any of the methods described herein. In general, the methods are advantageously performed by any hardware apparatus. [Explanation of symbols]

[0099] 1. Microscope system 10 Microscope control device 20 Samples 21 Object Plane 100 Computer Systems 110 Display 120 Keyboard 130 Trackpad 132 First Button 132' Mouse Pointer 132'' Movement Arrow 134 Second Button 140 processors 150 Storage Device 200 Interface Unit 300 Microscope 310 Microscope Housing 320 Microscope Stage 330 Focus adjustment knob 340 Transmitted Light Illumination Unit 350 Microscope Objective Lens 360 Microscope tube 370 Eyepiece Set 380 Detection Unit 380a, 380b Wide-field detection unit and confocal detection unit 382 Displaceable Mirror 382' Displaced mirror position 384a, 384b Wide-field image plane and confocal image plane 386a, 386b Wide-field detector device and confocal detector device 390 Incident Lighting Unit 390a, 390b Wide-field illumination unit and confocal illumination unit 391a, 391b Dichroic mirror 392~394 light source 395b X / Y Scanner 397b Pinhole 1000 Graphical User Interface 1100 Input Panel 1101~1105 Input widget or widget group, subpanel 1126 Tweak Panel 1140' starting position 1200 Display Panel 1201~1204 Images 1110~1140 Fluorescence control widget 1112~1142 1st widget zone 1114~1144 Second widget zone

Claims

1. A microscope control device (10) including one or more processors (140) and one or more storage devices (150), the microscope control device (10) being configured to provide control parameters; the microscope control device (10) is configured to process phosphor information indicative of one or more phosphors and to derive the control parameters based on the phosphor information; the microscope control device (10) is configured to render a graphical user interface (1000) and, as part of the graphical user interface (1000), one or more phosphor control widgets (1110, 1120, 1130, 1140), the one or more phosphor control widgets (1110, 1120, 1130, 1140) corresponding to the phosphor or one of the plurality of phosphors indicated by the phosphor information; each of the or each of the plurality of phosphor control widgets (1110, 1120, 1130, 1140) includes a first widget zone (1112, 1122, 1132, 1142) providing user feedback indicative of the corresponding phosphor and a second widget zone (1114, 1124, 1134, 1144) indicating an illumination intensity associated with the phosphor; A microscope control device (10).

2. the second widget zones (1114, 1124, 1134, 1144) are rendered as rims surrounding the first widget zones (1112, 1122, 1132, 1142); a proportion of the rim that corresponds to the illumination intensity is rendered differently from the remaining proportions. The microscope control device (10) of claim 1.

3. the microscope control device (10) is configured to receive user input in a plurality of different input modes and convert the user input in a plurality of different input modes into interactions with the phosphor control widgets (1110, 1120, 1130, 1140) in a plurality of different interaction modes; 3. A microscope control device (10) according to claim 1 or 2.

4. the microscope control device (10) is configured to receive the user input in the plurality of different input modes from one or more user input devices (130) selected from a mouse, a touchpad, a joystick, a trackball, and a touchscreen; the interaction modes include at least one of a click of a first button (132), a click of a second button (134), a drag-and-drop action, a touch action, and a mouse-over action; The microscope control device (10) according to claim 3.

5. the microscope control device (10) is configured to, in response to an interaction in one of the interaction modes, toggle at least one of: illumination for exciting the corresponding fluorophores, use of fluorophore information regarding the corresponding fluorophores in a separation method for determining the contribution of the fluorophores in a common fluorescence response, and display of an image obtained based on the fluorescence response of the corresponding fluorophores. A microscope control device (10) according to claim 3 or 4.

6. the microscope control device (10) is configured to render a fine-tuning panel (1126) in response to the interaction in one of the interaction modes; A microscope control device (10) according to any one of claims 3 to 5.

7. the microscope control device (10) is configured to modify the control parameters based on user input received using the fine-tuning panel (1126); The microscope control device (10) according to claim 6.

8. the microscope control device (10) is configured to change the position of the phosphor control widgets (1110, 1120, 1130, 1140) in the graphical user interface (1000) in response to a decision of an interaction in one of the interaction modes; A microscope control device (10) according to any one of claims 2 to 7.

9. the phosphor information indicates a plurality of phosphors, The microscope control device (10) is configured to provide a control parameter that specifies sequential or parallel excitation of the multiple fluorophores. The microscope control device (10) according to claim 8.

10. The microscope control device (10) is configured to provide a control parameter specifying whether the multiple fluorophores are required to be excited sequentially or in parallel based on a grouping state of the corresponding fluorophore control widgets (1110, 1120, 1130, 1140) in the graphical user interface (1100). The microscope control device (10) according to claim 9.

11. The microscope control device (10) is configured to provide control parameters further specifying at least one of camera settings and scanner settings. A microscope control device (10) according to any one of the preceding claims.

12. The microscope control device (10) is configured to control the operation of a fluorescence microscope (300) including a plurality of light sources (392, 394, 396); the illumination intensity being the illumination intensity of one or more of the light sources (392, 394, 396) primarily used for excitation of the corresponding phosphor; A microscope control device (10) according to any one of the preceding claims.

13. The control parameters are configured for use in wide-field and confocal fluorescence inspection techniques. A microscope control device (10) according to any one of the preceding claims.

14. A fluorescence microscope (300); A microscope control device (10) according to any one of claims 1 to 13, A microscope system (1) comprising:

15. A method (500) for providing microscope control parameters, comprising: Phosphor information indicative of one or more fluorophores is processed and control parameters are derived based on said phosphor information; a graphical user interface (1000) and, as part of said graphical user interface (1000), one or more phosphor control widgets (1110, 1120, 1130, 1140) are rendered, said phosphor control widget (1110, 1120, 1130, 1140) or each of said plurality of phosphor control widgets (1110, 1120, 1130, 1140) corresponding to one of said phosphor or plurality of phosphors indicated by said phosphor information; each of the or each of the plurality of phosphor control widgets (1110, 1120, 1130, 1140) includes a first widget zone (1112, 1122, 1132, 1142) providing user feedback indicative of the corresponding phosphor and a second widget zone (1114, 1124, 1134, 1144) indicating an illumination intensity associated with the phosphor; Method (500).

16. The method (500) comprises using a microscope control device (10) according to any one of claims 1 to 13 or a microscope system (1) according to claim 14, The method (500) of claim 15.

17. comprising a program code for performing the method (500) according to claim 15 or 16, when the program code is executed on a processor, Computer program.

Citation Information

Patent Citations

  • Fluorescent illuminating device for microscope

    JP2005321453A

  • Culture microscope and computer program for controlling the culture microscope

    JP2006011415A

  • Microscope system, image analysis device and image analysis method

    JP2019159092A

  • Microscope system and method for controlling such a microscope system

    JP2021518580A

  • Cell observing device, cell observing method, and program

    WO2009001759A1