Microscope control device
Patent Information
- Application Number
- JP2022203183
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-21
- Filing Date
- 2022-12-20
- Publication Date
- 2025-12-26
AI Technical Summary
Conventional graphical user interfaces (GUIs) for microscopes lack guidance during focal adjustments, leading to potential collisions between the objective lens and the sample, and manual specification of z-stacks is complex without feedback on focal length.
A microscope controller with a GUI that displays a graphical focal length element and a z-position pointer, providing visual feedback and collision prevention, along with an image stack interface for easy z-stack definition.
Enables safe and efficient focal adjustments by preventing collisions and simplifying z-stack setup, enhancing user control and reducing the risk of damage to the objective lens or sample.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a microscope control device for operating a microscope focusing device adapted to adjust the relative focus position of an objective lens with respect to a sample. Furthermore, the present invention relates to a microscope focusing device and a method for operating a computer program using program code. [Background technology]
[0002] When operating a microscope, a user is faced with the task of focusing a sample by adjusting the position of the microscope objective relative to the sample along the optical axis. Such a position is commonly referred to as the z-position. The relative focus position can be changed by a microscope focusing device configured to move the objective along the optical axis relative to the sample, or conversely, move the sample along the optical axis relative to the objective.
[0003] Recently, graphical user interfaces (GUIs) have been proposed to facilitate user focusing. However, conventional GUIs typically do not provide users with guidance or direction in navigating along the optical axis when adjusting the focal position of an objective lens relative to a specimen. Specifically, once the specimen is out of focus, users typically have no idea in which direction along the optical axis they are moving the objective lens relative to the specimen when manipulating a mouse wheel or any other type of z-control element typically used in microscope systems. Furthermore, there is no indication regarding the useful focal length or the region along the optical axis where the specimen is located. That is, users currently must more or less blindly steer the objective lens along the optical axis. As a result, there is a risk that the objective lens will collide with the specimen during z-movement, resulting in scratches and / or damage to the objective lens.
[0004] Another challenge is defining the so-called z-stack, i.e., the stack of images captured one after the other along the optical axis to obtain a three-dimensional image dataset. Traditionally, users must manually define the upper and lower limits of the z-stack using a very complex z-interface. Users typically do not get feedback on how large the z-stack is relative to a useful focal length. Summary of the Invention [Problem to be solved by the invention]
[0005] It is an object of the present invention to provide a microscope control device, method and computer program that operate a microscope focus adjustment device and enable a user to perform focusing easily and safely. [Means for solving the problem]
[0006] The above object is achieved by the subject matter of the respective independent claims. Advantageous embodiments are defined in the respective dependent claims and in the following description.
[0007] A microscope control device is provided for operating a microscope focusing device adapted to adjust the focal position of an objective lens relative to a sample along the objective lens's optical axis. The microscope control device includes a display device configured to display a graphical user interface (GUI) adapted to receive user input. The microscope control device further includes at least one processor configured to control the microscope focusing device and the display device to update the GUI in response to the user input. The processor is configured to cause the GUI to display a focus control interface, the focus control interface including a graphical focal length element indicating a predetermined focal length and a graphical z position pointer indicating a current z position within the predetermined focal length. The graphical z position pointer is movable along the graphical focal length element in response to the user input to adjust the relative focus position.
[0008] The GUI displays a graphical focal length element, allowing the user to monitor whether the objective is still within a useful focal length. Therefore, the user can easily navigate the focal length by moving the graphical z-position pointer along the graphical focal length element. Specifically, the user can ensure that the objective does not collide with the sample while moving along the optical axis. Therefore, the focal length limit can be set close to the sample surface without any risk of collision.
[0009] The microscope controller preferably includes an input device configured to receive user input for controlling the GUI. For example, the input device may include a computer pointing device. Additionally or alternatively, the input device may be integrated with a touch-sensitive screen.
[0010] The graphical focal length element may comprise a bar along which a graphical z-position pointer may be movable by user input, such a graphical bar allowing the user to easily navigate the focal lengths available.
[0011] The processor may be configured to obtain first and second limits for setting the relative focus position. The processor may further be configured to cause the GUI to display a graphical focal length element between a first and second graphical focal length limit, which are assigned to the first and second limits, respectively. For example, one of the focal length limits may be determined by a focus control device integrated with the microscope. To ensure that any collision with the cover slip is avoided, the other focal length limit may be defined according to the free working distance (FWD) of the objective, taking into account the thickness of the cover slip if possible.
[0012] According to a preferred embodiment, the processor is configured to cause the focus control interface to display at least one graphical arrow icon indicating a direction in which the graphical z position pointer is moved along the graphical focal length element by user input. Such a graphical arrow icon indicates a direction in which the objective lens is to move relative to the focal length limit, thereby facilitating user navigation of the focal length.
[0013] The processor is preferably configured to cause the focus control interface to display at least one graphical out-of-range alert element indicating when a user-input adjusted relative focus position has exceeded a predetermined focus distance. By using such an alert element, the user can be reliably warned of a potential collision between the objective lens and the sample.
[0014] To further improve collision protection, the graphical out-of-distance alert element may be configured to indicate the amount by which the relative focus position, as adjusted by user input, exceeds a predetermined focus distance.
[0015] The graphical user interface may include a live image on / off button configured to be operated by a user input to turn the live image display on or off, and the graphical z-position pointer may include a live image display icon configured to indicate whether the live image display is turned on or off.
[0016] According to a preferred embodiment, the focus control interface includes an image stack interface including a graphical stack definition element and a graphical stack indication element. The graphical stack definition element is configured to be manipulated by user input to define the distance of an image stack to be generated along the optical axis within a predetermined focal length indicated by the graphical focal length element. The graphical stack indication element is configured to indicate the distance of the image stack defined by the graphical stack definition element. The image stack interface allows a user to easily predetermine a z-stack, based on which a series of images are captured along the optical axis to obtain a three-dimensional image dataset. The z-stack is displayed by the GUI for available focal lengths, so that the user always knows where the z-stack is located relative to the focal length.
[0017] The graphical user interface may include a stack control on / off button configured to be operated by user input to turn on and off the display of the image stack interface. Thus, a user may always display the image stack interface in the form of a thin z-interface as an overlay to the viewer shown on the screen of the display device. However, the image stack interface may also be hidden by activating the stack control on / off button, for example, with a simple mouse click.
[0018] According to a preferred embodiment, the graphical stack indicator has a fixed size regardless of the size of the image stack. Thus, both the available focal lengths and the z-stack can be displayed in parallel, with the graphical representation of the z-stack having a fixed size relative to the graphical representation of the focal length regardless of the actual size of the z-stack. Thus, the user can always see where the current z-position is within the z-stack, regardless of how large or small the z-stack is.
[0019] Alternatively, the size of the graphical stack designator may indicate the size of the image stack relative to the size of the predetermined focal length.
[0020] The graphical stack definition element is preferably integrated with a graphical z position pointer, which therefore makes it easy for the user to define the z stack limits.
[0021] The image stack interface may include a graphical z position pointer indicator element configured to indicate where the graphical z position pointer is located along the graphical stack indicator element.
[0022] The graphical stack definition element is preferably configured to be manipulated by user input to set a position to update the image stack limits closer to that position, in this way allowing the image stack to be easily redefined.
[0023] The graphical stack specifying element may be further configured to be manipulated by user input to specify a position along the graphical stack specifying element to recenter the image stack at that position, wherein recentering the image stack is an efficient operation for updating the stack without tedious setup.
[0024] According to a preferred embodiment, the GUI includes a graphical multi-function button configured to be operated by user input to select the activation of one of the following functions assigned to the graphical stack definition element: a function in which, in response to user input, the graphical definition element defines a first limit of the image stack; a function in which, in response to user input, the graphical definition element defines a second limit of the image stack; and a function in which, in response to user input, the graphical stack definition element recenters the image stack at a current z-position.
[0025] According to another aspect, there is provided a method for operating a microscope focusing device adapted to adjust a relative focal position of an objective lens with respect to a sample along an optical axis of the objective lens using the microscope control device described above. The method includes displaying a GUI adapted to receive user input and controlling the microscope focusing device and a display device to update the GUI in response to the user input. The GUI displays a focus control interface including a graphical focal length element indicating a predetermined focal length and a graphical z position pointer indicating a current z position within the predetermined focal length. The graphical z position pointer is moved along the graphical focal length element in response to the user input to adjust the focal position relative to the z position indicated by the graphical z position pointer.
[0026] Furthermore, a computer program using program code is provided for causing a microscope control device to carry out the above method. Specific embodiments will be described below with reference to the drawings. [Brief explanation of the drawings]
[0027] [Figure 1] 1 is a block diagram illustrating a microscope including a microscope control device for operating a microscope focusing device according to an embodiment. [Figure 2] FIG. 1 illustrates a graphical user interface according to an embodiment. [Figure 3] FIG. 1 illustrates how the limits of available focal lengths are determined. [Figure 4] FIG. 1 illustrates a graphical arrow icon of a GUI according to an embodiment. [Figure 5] FIG. 10 illustrates an out-of-distance alert element of a GUI according to an embodiment. [Figure 6] FIG. 1 illustrates a GUI stack control interface according to an embodiment. [Figure 7]FIG. 10 illustrates the functionality of a GUI to move the z position pointer to the z-stack limit, according to an embodiment. [Figure 8] FIG. 10 illustrates a GUI feature for moving the z position pointer to the center of the z-stack, according to an embodiment. [Figure 9] FIG. 10 illustrates the stack control interface after moving the z position pointer to the center of the z stack, according to an embodiment. [Figure 10] FIG. 1 illustrates manual setting of a z-stack according to an embodiment. [Figure 11] FIG. 10 is a diagram illustrating the functionality of a GUI for starting an autofocus (AF) operation according to an embodiment. [Figure 12] FIG. 10 illustrates the functionality of a GUI for automatically defining a z-stack according to an embodiment. [Figure 13] FIG. 10 illustrates a display of an image stack interface after automatically defining a z-stack, according to an embodiment. [Figure 14] FIG. 10 illustrates the functionality of a GUI to update z-stack limits, according to an embodiment. [Figure 15] FIG. 10 illustrates a display of an image stack interface after updating the z-stack limits, according to an embodiment. [Figure 16] 16 shows a schematic diagram of a system for carrying out the method of FIG. 15. DETAILED DESCRIPTION OF THE INVENTION
[0028] An embodiment of a microscope 100 is shown in Figure 1. Figure 1 is a schematic diagram only, showing only those components of microscope 100 that may be useful for understanding its mode of operation. The microscope 100 shown here is an inverted microscope, although the setup described can also be used with an upright microscope.
[0029] The microscope 100 includes a microscope control device 102 that can be operated by a user to adjust the relative focus position of the objective lens 104 with respect to the sample 106. In the embodiment shown in FIG. 1 , the sample 106 is disposed on a sample support 108. A coverslip 110 is provided on the opposite side of the sample support 108, covering the sample 106. In this embodiment, the sample support 108, the coverslip 110, and the sample 106 disposed therebetween form a microscope specimen, generally designated 113. However, this configuration is understood to be exemplary only. For example, specimen configurations without a coverslip are also contemplated.
[0030] The microscope 100 comprises a microscope focusing device 112, e.g., a motor-driven actuator, that can be controlled to move the objective lens 104 along its optical axis O relative to the sample 106, as indicated by the arrow P in FIG. 1 . According to the common nomenclature of coordinate axes in the art, the optical axis O is assumed to be parallel to the z direction. Thus, a position along the optical axis O is referred to as a z position. According to the example shown in FIG. 1 , the relative focus position is adjusted by moving the objective lens 104 while the sample 106 remains fixed. However, it is also possible to move the specimen 113 containing the sample 106 while the objective lens 104 remains fixed.
[0031] The microscope controller 102 includes at least one processor 114 that functions to operate the microscope focusing device 112 under user control. To this end, a display device 116 is provided that is configured to display a graphical user interface (GUI) 118. The GUI 118 allows a user to interact with the microscope controller 102 through graphical elements, as will be described in more detail below with reference to Figures 2 and 4-16.
[0032] The display device 116 may include a computer screen 120 that displays the GUI 118. Additionally, the microscope control device 102 may include an input device configured to receive user input. Based on the user input, the GUI 118 is controlled, which operates the microscope focusing device 112. For example, the input device may include a computer pointing device such as a computer mouse. Additionally or alternatively, the screen 120 may be a touch-sensitive screen with an integrated input device. Note that this configuration is merely an example, and other hardware components may be provided to allow a user to interact with the GUI 118.
[0033] 2 shows an example of GUI 118 displayed on screen 120. GUI 118 allows a user to perform microscope operations by directly manipulating the graphical elements of GUI 118. Specifically, GUI 118 is controlled by processor 114 to receive input from the user and to update the graphical elements in response to the user input.
[0034] The GUI 118 may include various graphical control elements, not all of which are germane to the specific control of the microscope focusing device 112 that is important in the present context. Graphical control elements not specifically related to focus control shown in FIG. 2 will not be described in detail below.
[0035] The GUI 118 may be included in a viewer having an image display area 222 capable of displaying a live image 224 of the sample 106 captured by the objective lens 104. According to the embodiment shown in Figure 2, the image display area 222 includes a region of interest (ROI) area 226 that displays an image 228 of the ROI of the sample 106. The GUI 118 includes a live image on / off button 240 that is operated by a user to turn the image display area 222 on or off.
[0036] The processor 114 causes the graphical user interface 118 to display a focus control interface 230. The focus control interface 230 includes a graphical focal length element 232 and a graphical z-position pointer 234. The graphical focal length element 232 indicates a predetermined focal length. The focal length may be displayed in the form of a bar. The focal length defines the distance the microscope focusing device 112 can move the objective lens 104 along the optical axis O (z-direction) relative to the sample 106. The graphical z-position pointer 234 forms a graphical control element that is manipulated by a user to adjust the z-position of the objective lens 104 within the focal length. Thus, the graphical z-position pointer 234 may be displaced along the graphical focal length element 232 to change the focal position of the objective lens 104 relative to the sample 106. Positioning the graphical z-position pointer 234 relative to the graphical focal length element 232 visualizes the current z-position of the objective lens 104 within the available focal lengths.
[0037] The processor 114 can obtain first and second limits for setting the relative focus position and cause the GUI 118 to display the graphical focal length element 232 between the first graphical focus limit 236 and the second graphical focal length limit 238. The first graphical focus limit 236 and the second graphical focal length limit 238 are assigned the first and second limits, respectively. Figure 3 shows an example of how the first and second limits corresponding to the first graphical focus limit 236 and the second graphical focal length limit 238 displayed by the GUI 118 can be obtained.
[0038] 3 shows that the objective lens 104 is continuously displaced from left to right along the optical axis O towards the coverslip 110 to determine the focal length limits 236, 238. By way of example only, the microscope 100 may be provided with a focus control device (not shown) adapted to emit light through the objective lens 104 onto the coverslip 110. At the lower surface 340 of the coverslip 110, which forms a partially reflective interface between media with different refractive indices, a portion of the emitted light is reflected back to the objective lens 104 and detected by a position-sensitive detector of the focus control device. Based on the detected light reflection, the axial distance from the front lens of the objective lens 104 to the coverslip 110 is determined, and a first limit value is determined as the z-value z LL Therefore, the first (lower) graphical focal length limit 236 displayed on the focus control interface 230 is defined as z-value z LL Then, taking into account the free working distance (FWD) of the objective lens 104, the second limit value is set to the z value z UL The thickness of the cover slip 110 along the optical axis O can be calculated as z to prevent the objective lens 104 from colliding with the cover slip 110 when the objective lens 104 is moved toward the cover slip 110 when the relative focus position is changed. UL Therefore, the second (upper) graphical focal length limit 238 displayed on the focus control interface 230 can be taken into account in the calculation of the z value z (which depends on the objective lens). UL The z position is calculated from LL and z position z UL The difference between determines the axial focal length FR corresponding to the graphical focal length element 232.
[0039] 2, the GUI 118 may display a graphical objective icon 248 below the lower focal length 236. The objective icon 248 represents the objective 104 currently being used by the microscope 100 to image the sample 106.
[0040] 4 is a detailed view of the lower portion of the graphical focal length element 232, including the first graphical focal length limit 236. According to the example shown in FIG. 4, it is assumed that the user displaces the graphical z position pointer 234 upward along the graphical focal length element 232. In this situation, the processor 114 causes the focus control interface 230 to display a graphical arrow icon 448 indicating the upward movement direction of the graphical z position pointer 234. If the user moves the graphical z position pointer 234 downward, a corresponding arrow icon is displayed. Thus, the user can always understand whether the objective lens 104 is moving toward or away from the sample 106.
[0041] As shown in Figure 4, the graphical z position pointer 234 may include a live image display icon 450 that indicates whether the live image display is turned on or off. In the example of Figure 4, the live image display icon 450 shows an eye symbol. When the live image display is turned off, the eye symbol is crossed out.
[0042] FIG. 5 is another detailed view of focus control interface 230, showing the lower portion of graphical focal length element 232. According to the example shown in FIG. 5, processor 114 causes focus control interface 230 to display a graphical out-of-distance alert element 552 as a user warning. Specifically, when a user manipulates graphical z-position pointer 234 and displaces pointer 234 along graphical focal length element 232 beyond lower focal length limit 236, graphical setting pointer 234 stops at focal length limit 236 and out-of-distance alert element 552 is displayed. As shown in FIG. 5, out-of-distance alert element 552 preferably also indicates the amount by which the user-adjusted relative focus position exceeds the predetermined focal length. Similarly, out-of-distance alert element 552 is displayed if graphical z-point position 234 is moved along graphical focal length element 232 beyond upper focal length limit 238.
[0043] 2, GUI 118 includes an image stack interface 242 that includes a graphical toolbar 244 that is provided with several toolbar buttons 244a, 244b, 244c, 244d, 244e, 244f, 244g, and 244h. Display of graphical toolbar 244 can be turned on and off by the user via stack control on / off button 246.
[0044] The image stack interface 242 allows a user to prepare and perform sequential acquisition of multiple images along the optical axis O. Specifically, the image stack interface 242 allows a user to determine an image stack, or z-stack, along the optical axis O as successive z-positions of the objective 104 relative to the sample 106 and display a given image stack. An image of the sample 106 is then captured based on the image stack.
[0045] The image stack interface 230 may include a stack definition element for defining a partial distance along the graphical focal length element 232 as a z-stack. In this example, the stack definition element is integrated with the graphical z position pointer 234. That is, the graphical z position pointer 234 is used not only to move the objective lens 104 along the optical axis O but also to determine the lower and upper limits of the partial distance defining the z-stack. For this purpose, the toolbar button 244b may be configured as a multi-function button operated by the user to select the activation of one specific function from multiple functions selectively assigned to the graphical z position pointer 234. The specific function currently assigned to the graphical z position pointer 234 may be displayed as a message next to the toolbar button 244b. For example, when the mouse cursor is moved over the toolbar button 244b, a message such as "Start Set Z Stack" may pop up next to the toolbar button 244b to inform the user that the z position pointer 234 can define the first limit of the z-stack at a position along the graphical focal length 232. Thus, the user moves z position pointer 234 along graphical focal length element 232 to a desired z position and confirms this z position as the first limit of the z stack by clicking toolbar button 244b. The user then moves z position pointer 234 along focal length element 232 to another z position and confirms this z position as the second limit of the z stack by clicking toolbar button 244b. The function currently assigned to z position pointer 234 may again be displayed as a message such as "End Set Z Stack" that pops up when the mouse cursor is moved over toolbar button 244b. Once the first and second limits have been determined, the partial distance along graphical focal length 232 between these limits represents the z stack.
[0046] The image stack interface 242 may further include a graphical stack indicator element 654 that indicates the z-distance of the image stack as defined by the z-position pointer 234 that interacts with the toolbar button 244b as described above. An exemplary configuration of the graphical stack indicator element 654 is shown in FIG.
[0047] According to the example shown in FIG. 6 , a stack indicator element 654 may be configured to pop up once the z-distance of the image stack has been defined. The stack indicator element 654 may include a bar displayed parallel to the focal length element 232. The stack indicator element 654 is defined by two z-stack limits 656, 658 ("Start" and "End" in FIG. 6 ), which correspond to the first and second limits previously defined, respectively. The image stack interface 242 includes a graphical z-position pointer indicator element 660 (see FIG. 8 ) that indicates the z-position along the graphical stack indicator element 654 at which the z-position pointer 234 is positioned. Additionally, small horizontal tick marks may be displayed along the graphical stack indicator element 654 to represent multiple frame ticks corresponding to multiple images to be captured in the image stack.
[0048] The stack designator element 654 preferably has a fixed size regardless of the size of the image stack, so that the image stack is clearly visible to the user even if its size is small compared to the available focal length indicated by the graphical focal length element 232. On the other hand, if the relative size of the image stack is important, the stack designator element 654 may be displayed with a size that indicates the stack size compared to the available focal length.
[0049] FIG. 7 illustrates a situation in which z-position pointer 234 is moved to a z-position outside the z-stack. In this example, z-position pointer 234 is positioned above z-stack upper limit 658 of graphical stack indicator 654. To conveniently move z-position pointer 234 to a position corresponding to z-stack upper limit 658, a user presses toolbar button 244a. A message displayed next to toolbar button 244a, such as "Go to Z-stack upper limit," may indicate the function of toolbar button 244a. In response to activation of toolbar button 244a, processor 114 controls microscope focusing device 112 to move objective lens 104 along optical axis O to a z-position corresponding to z-stack upper limit 658 of graphical stack indicator 654. Similarly, a user can press toolbar button 244h to move z-position pointer 234 to z-stack lower limit 656 of stack indicator 654 and cause microscope focusing device 112 to move objective lens 104 in the corresponding axial direction.
[0050] 8 illustrates an operation that may be performed by a user to move z-position pointer 234 to the center of a previously set image stack displayed by graphical stack indicator 654. To do this, the user operates toolbar button 244c, which has the message "Move to Center" next to it. As a result, z-position pointer 234 is displaced to center position 960 along stack indicator 654, as shown in FIG. 9. Thus, in response to activation of toolbar button 244c, processor 114 controls microscope focusing device 112 to move objective lens 104 along optical axis O to a z-position corresponding to center position 960 of graphical stack indicator 654.
[0051] Referring again to FIG. 6 , there is another function selectively assigned to the graphical z position pointer 234 in combination with the toolbar button 244b. This function is indicated by the message “Re-center Z stack at current Z position” popping up next to the toolbar button 244b. Thus, the graphical z position pointer 234 can be used in combination with the multi-function button 244b to conveniently recenter the image stack at the current z position along the focal length element 232 in addition to determining the z limits of the image stack as described above. To perform the recentering operation, the user moves the z position pointer 234 to the desired z position and confirms this z position as the new center of the z stack by clicking the toolbar button 244b. As a result, the image stack is updated so that new z stack limits 1056, 1058 equidistant from the current z position are defined to represent the new center (see, e.g., FIG. 13 ). The new z stack limits 1056, 1058 can be defined automatically so that the size of the recentered image stack remains unchanged. This allows the user to conveniently displace the image stack as a whole without having to perform any operations to reset the z-stack limits.
[0052] It should be noted that, although automatic updating of the z-stack limits may be preferred, toolbar 244 also allows for manual configuration of the image stack, and specifically, updating of the image stack. To this end, the user may operate toolbar button 244g, such that the user is presented with a list of multiple configuration options, as shown in FIG. 10. These configuration options include, among others, the z-stack limits ("Start" and "End") and the z-stack size ("Size").
[0053] The image stack interface 242 may allow for an autofocusing (AF) function to be activated. In this embodiment, the AF operation is initiated by activating the toolbar button 244e, as shown in FIG. 11. To find the plane of the sample 106 on which the objective lens 104 is currently focused, the processor 114 controls the microscope focusing device 112 to perform the AF operation. The AF function is indicated by the message "Refocus Position" displayed next to the toolbar button 244e.
[0054] Additionally, toolbar 244 allows for the execution of an operation to automatically identify a suitable z-stack. To initiate this operation, toolbar button 244d is activated, as indicated by the message "Run Z Range Finder" shown in FIG. 12. In response to activation of toolbar button 244d, processor 114 determines the suitable settings for the z-stack. An example of such a stack identification process is shown in FIG. 13. Specifically, it can be seen from FIG. 13 that z-position pointer 234 is centered within the z-stack and the z-stack limits are equidistant from z-position pointer 234.
[0055] The graphical z-position pointer 234 may be configured to be manipulated by the user to set a z-position in order to update the image stack limit closer to that z-position. According to the example shown in FIG. 14 , the z-position pointer 234 is moved to a z-position in the z-stack that is closer to the z-stack upper limit. The z-position pointer 234 can then be manipulated, for example, by clicking a mouse. As a result, the z-stack upper limit is displaced to the current position of the z-position pointer 234, and the display of the graphical stack indicator element 654 is updated, as shown in FIG. 15 . Thus, one-click definition of the z-stack limit can be achieved. Specifically, the thickness of the z-stack can be reduced depending on the particular sample 106 being imaged. If the number of divisions or frames in the updated (thinner) z-stack is too large, the number can be reduced by adapting the corresponding settings (see “Number of Divisions” in FIG. 10 ).
[0056] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".
[0057] While some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step, and similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus.
[0058] Some embodiments relate to a microscope including a system such as that described in connection with one or more of FIGS. 1-15. Alternatively, the microscope may be part of a system such as that described in connection with one or more of FIGS. 1-15 or may be connected to a system such as that described in connection with one or more of FIGS. 1-15. FIG. 16 shows a schematic diagram of a system 1600 configured to perform the methods described herein. The system 1600 includes a microscope 1610 and a computer system 1620. The microscope 1610 is configured to capture images and is connected to the computer system 1620. The computer system 1620 is configured to perform at least a portion of the methods described herein. The computer system 1620 may be configured to execute a machine learning algorithm. The computer system 1620 and the microscope 1610 may be separate entities or may be integrated into a common housing. The computer system 1620 may be part of the central processing system of the microscope 1610, and / or the computer system 1620 may be part of a subordinate component of the microscope 1610, such as a sensor, actor, camera, or lighting unit of the microscope 1610.
[0059] The computer system 1620 may be a local computing device (e.g., a personal computer, laptop, tablet computer, or mobile phone) with one or more processors and one or more storage devices, or may be a distributed computing system (e.g., a cloud computing system with one or more processors and one or more storage devices distributed at various locations, such as local clients and / or one or more remote server farms and / or data centers). The computer system 1620 may include any circuit or combination of circuits. In one embodiment, the computer system 1620 may include one or more processors, which may be of any type. As used herein, a processor may contemplate any type of computing circuit, such as, but not limited to, a microprocessor of a microscope or microscope component (e.g., a camera), a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other type of processor or processing circuit. Other types of circuitry that may be included in computer system 1620 may be custom circuitry, application specific integrated circuits (ASICs), etc., such as one or more circuits (e.g., communications circuits) used in wireless devices such as cell phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. Computer system 1620 may also include one or more storage devices, which may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives that handle removable media, such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.Computer system 1620 may also include a display device, one or more speakers and a controller which may include a keyboard and / or mouse, trackball, touch screen, voice recognition device, or any other device that allows a user of the system to input information to and receive information from computer system 1620.
[0060] Some or all of the steps may be performed by (or using) a hardware apparatus, such as, for example, a processor, microprocessor, programmable computer, or electronic circuitry. In some embodiments, any one or more of the critical steps may be performed by such an apparatus.
[0061] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. The implementation may be performed by a non-transitory storage medium, such as a digital storage medium, for example, a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM, or a FLASH memory, on which electronically readable control signals are stored that cooperate (or can cooperate) with a programmable computer system to implement the respective methods. Therefore, the digital storage medium may be computer-readable.
[0062] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system to perform any of the methods described herein.
[0063] Generally, embodiments of the present invention may be implemented as a computer program product comprising program code that is operative to perform any of the methods when the computer program product is run on a computer, and that may be stored, for example, on a machine-readable carrier.
[0064] Further embodiments comprise the computer program for performing any of the methods described herein, stored on a machine readable carrier.
[0065] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing any of the methods described herein when the computer program runs on a computer.
[0066] Therefore, another embodiment of the invention is a recording medium (or data carrier or computer readable medium) containing a computer program stored thereon for performing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the invention is an apparatus as described herein, comprising a processor and a recording medium.
[0067] A further embodiment of the present invention is, therefore, a data stream or a sequence of signals representing the computer program for performing any of the methods described herein, the data stream or sequence of signals being for example adapted to be transmitted via a data communication connection, for example the Internet.
[0068] Another embodiment comprises a processing means, for example a computer, or a programmable logic device configured to or adapted to perform any of the methods described herein.
[0069] Another embodiment comprises a computer having installed thereon the computer program for performing any of the methods described herein.
[0070] Another embodiment of the present invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.
[0071] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform any of the methods described herein. In general, the methods are advantageously performed by any hardware apparatus. [Explanation of symbols]
[0072] 100 microscopes 102 Microscope control device 104 Objective Lens 106 samples 108 Sample support 110 Coverslips 112 Microscope focus adjustment device 113 Specimens 114 processors 116 Display Devices 118 Graphical User Interface 120 screens 222 Image display area 224 Live Images 226 ROI area 228 ROI images 230 Focus Control Interface 232 Graphical Focal Length Element 234 Graphical z position pointer 236 First Graphical Focal Length Limit 238 Second Graphical Focal Length Limit 240 Live Image On / Off Button 242 Image Stack Interface 244 Toolbar 244a~244h Toolbar buttons 246 Stack Control On / Off Button 246 Graphical Objective Icons 340 Bottom 448 Graphical Arrow Icons 450 Live Image Display Icon 552 Graphical Out-of-Distance Alert Element 654 Graphical Stack Indicator Elements 656,658 z-stack limit 660 Graphical z-position pointer indication element 960 center position 1056,1058 Updated z-stack limits
Claims
1. 1. A microscope controller (102) for operating a microscope focus adjustment device (112) adapted to adjust a relative focus position of an objective lens (104) with respect to a sample (106) along an optical axis (O) of the objective lens (104), the microscope controller (102) comprising: a display device (116) configured to display a graphical user interface (118) adapted to receive user input; at least one processor (114) configured to control the microscope focusing device (112) and the display device (116) to update the graphical user interface (118) in response to the user input; Equipped with The processor (114) is further configured to cause the graphical user interface (118) to display a focus control interface (230), the focus control interface (230) including a graphical focal length element (232) indicating a predetermined focal length and a graphical z-position pointer (234) indicating a current z-position within the predetermined focal length; the graphical z-position pointer (234) is movable along the graphical focus element (232) in response to the user input to adjust the relative focus position to the current z-position indicated by the graphical z-position pointer (234). A microscope control device (102).
2. the microscope control device (102) comprises an input device configured to receive the user input for controlling the graphical user interface (118); The microscope control device (102) of claim 1.
3. the graphical focal length element (232) comprises a bar along which the graphical z-position pointer (234) is movable in response to the user input; The microscope control device (102) of claim 1.
4. The processor (114) is configured to obtain a first limit value and a second limit value for setting the relative focus position, and the processor (114) is further configured to cause the graphical user interface (118) to display the graphical focal length element (232) located between a first graphical focus limit (236) and a second graphical focal length limit (238) assigned to the first limit value and the second limit value, respectively. The microscope control device (102) of claim 1.
5. the processor (114) is configured to cause the focus control interface (230) to display at least one graphical arrow icon (448) indicating a direction in which the graphical z-position pointer (234) will be moved along the graphical focus element (232) by the user input. The microscope control device (102) of claim 1.
6. the processor (114) is configured to cause the focus control interface (230) to display at least one graphical out-of-distance alert element (552) indicating that the relative focus position adjusted by the user input has exceeded the predetermined focus distance. The microscope control device (102) of claim 1.
7. the graphical out-of-distance alert element (552) is configured to indicate the amount by which the relative focus position, as adjusted by the user input, exceeds the predetermined focus distance. The microscope control device (102) of claim 6.
8. the graphical user interface (118) includes a live image on / off button (240) configured to be operated by a user input to turn a live image display on or off, and the graphical z-position pointer (234) includes a live image display icon (450) configured to indicate whether the live image display is turned on or off; The microscope control device (102) of claim 1.
9. the focus control interface (230) includes an image stack interface (242) including a graphical stack definition element and a graphical stack indication element (654); the graphical stack definition element is configured to be manipulated by user input to define a distance of an image stack to be generated along the optical axis (O) within the predetermined focal length indicated by the graphical focal length element (232); the graphical stack indicator element (654) is configured to indicate a distance of the image stack defined by the graphical stack definition element. The microscope control device (102) of claim 1.
10. the graphical user interface (118) includes a stack control on / off button (246) configured to be operated by a user input to turn on and off the display of the image stack interface (242); The microscope control device (102) of claim 9.
11. the graphical stack indicator element (654) has a fixed size regardless of the size of the image stack; The microscope control device (102) of claim 9.
12. the size of the graphical stack indicator (654) indicates the size of the image stack relative to the size of the predetermined focal length; The microscope control device (102) of claim 9.
13. the graphical stack definition element is integrated with the graphical z-position pointer (234); The microscope control device (102) of claim 9.
14. the image stack interface (242) includes a graphical z-position pointer indicator (660) configured to indicate where the graphical z-position pointer (234) is located along the graphical stack indicator (654); The microscope control device (102) of claim 9.
15. the graphical stack definition element is configured to be manipulated by the user input to set a position to update the image stack limit closer to the position; The microscope control device (102) of claim 9.
16. the graphical stack defining element is further configured to be manipulated by a user input to define a position along the graphical stack indicating element (654) to recenter the image stack at a position. The microscope control device (102) of claim 9.
17. The graphical user interface (118) is operable to activate one of the following functions assigned to the graphical stack definition element: responsive to the user input, the graphical stack definition element defining a first limit of the image stack; In response to the user input, the graphical stack definition element defines a second limit of the image stack; and in response to the user input, the graphical stack definition element recenters the image stack relative to the current z-position; a graphical multi-function button (244b) configured to be operated by a user input to select activation of one of The microscope control device (102) of claim 9.
18. the image stack interface (242) includes a graphical button (244d) configured to be operated by user input to automatically define the image stack; The microscope control device (102) of claim 9.
19. 19. A method for operating a microscope focusing device (112) adapted to adjust a relative focus position of an objective lens (104) with respect to a sample (106) along an optical axis (O) of the objective lens (104) by a microscope control device (102) according to any one of claims 1 to 18, said method comprising: displaying a graphical user interface (118) adapted to receive user input; controlling the microscope focusing device (112) and the display device (116) to update the graphical user interface (118) in response to the user input; Including, causing the graphical user interface (118) to display a focus control interface (230) including a graphical focal length element (232) indicating a predetermined focal length and a graphical z-position pointer (234) indicating a current z-position within the predetermined focal length; the graphical z position pointer (234) is moved along the graphical focal length element (232) in response to the user input to adjust the relative focus position to a current z position indicated by the graphical z position pointer (234); method.