Methods for controlling the imaging of samples by a microscope and the corresponding microscopes

Abstract

This invention relates to a microscope and a corresponding method. The microscope includes a control system for controlling the imaging of a sample, the control system being connected to an illumination system for illuminating the sample and an imaging system for delivering microscopic images of the sample, and is configured to detect changes in image influence in microscope settings and / or sample position that cause changes in the sample image, and to enable the imaging system to deliver a real-time image stream of real-time images of the sample in a first imaging mode, or a still image stream of one or more still images of the sample in a second imaging mode, and, when no changes in image influence are detected, switch from the first imaging mode to the second imaging mode, using one of the last real-time images from the first imaging mode for at least a portion of the still image stream in the second imaging mode, and reducing the illumination intensity of the illumination system during the second imaging mode. This invention reduces dye and sample fading and protects the user's eyes in fluorescence microscopy.

Description

Technical Field

[0001] The present invention relates to a microscope including a control system for controlling the imaging of a sample imaged by the microscope, and to a corresponding method for controlling the imaging of a sample imaged by the microscope, particularly in the field of microscopy of biological samples, such as fluorescence microscopy of live samples like cells. Background Technology

[0002] In the field of fluorescence microscopy for observing live samples, precautions are taken to protect the samples from ambient light and to protect the human eye from direct observation of the fluorescence emitted by the samples. To this end, current fluorescence microscopes have mechanisms to avoid exposing samples to direct sunlight or external light. Such mechanisms may include sample chambers that can be closed and sensors that detect whether they are closed. To protect the human eye, modern microscopes can omit eyepieces and examine samples only through a digital camera. Microscope software typically offers a "real-time mode," in which the camera's live image is displayed on the user's screen / display. To observe samples in "real-time mode," the sample needs to be illuminated with a strong light source of a specific wavelength. This illumination causes the fluorescent dye to emit at a sufficient intensity at a specific emission wavelength. However, this also causes dye degradation and may lead to sample decay. This effect is called dye and / or sample "fading."

[0003] To minimize fading effects, real-time images are typically displayed at low illumination power while simultaneously at high exposure times or high gain values ​​on the microscope camera. However, this produces noisy, often blurry, real-time images. Summary of the Invention

[0004] In view of the above problems, there is a need for an improved method for controlling the imaging of samples by a microscope, especially a fluorescence microscope, and a corresponding microscope that includes a control system for controlling such imaging of the sample, particularly reducing the fading effect in fluorescence microscope imaging.

[0005] An embodiment of the present invention provides a microscope including a control system for controlling the imaging of a sample imaged by the microscope, wherein the microscope includes an illumination system for illuminating the sample and an imaging system for delivering a microscopic image of the sample, the control system being connected to the illumination system and the imaging system and configured to: detect changes in image influence in the microscope setup and / or the position of the sample, the changes in image influence causing a change in the sample image; enable the imaging system to deliver a real-time image stream of real-time images of the sample in a first imaging mode, or a still image stream of one or more still images of the sample in a second imaging mode; switch from the first imaging mode to the second imaging mode when no changes in image influence are detected, using one of the last real-time images from the first imaging mode for at least a portion of the still image stream in the second imaging mode; and reduce the illumination intensity of the illumination system during the second imaging mode.

[0006] "Image effect change" is defined as any change in microscope setup and / or sample position that results in a alteration / change in the sample image delivered by the microscope's imaging system. In cases of such image effect change, it is desirable to display a real-time image of the sample on the screen. In other words, image effect change causes visible changes in the microscopic image, such as sample movement due to stage or focus driver movement, movement of a live sample / sample, changes in illumination such as light intensity or color, or changes in image-related camera parameters such as exposure time or gain value. In the absence of such changes, providing the user with a still image is sufficient, as the image does not change or changes only slowly. Therefore, instead of continuously providing the user with a live image stream, still images of the sample are provided until the image effect change is identified. This, in turn, allows for reducing the illumination intensity or even turning off the illumination during the period when still images are delivered to the user. Through these measures, the inventive concept can significantly reduce fading and protect the sample to be examined.

[0007] In this application, the term "still image stream of one or more still images" is defined as representing an image stream of a single still image or an image stream of two or more still images, wherein, for example, from time to time, actual real-time images are captured to refresh the still image stream.

[0008] When switching from the first imaging mode to the second imaging mode, the last live image is specifically used as the still image to be presented to the user. However, if the last live image is blurry, has poor contrast, or is of low quality, another of the last live images with higher quality can be selected as the still image for the second imaging mode.

[0009] It is advantageous if the control system is further configured to switch the imaging system from the second imaging mode (back) to the first imaging mode when a change in image influence is detected. Simultaneously, in the first imaging mode, the reduced illumination intensity of the second imaging mode can be omitted / removed / cancelled. After switching back to the first imaging mode, the control system is specifically configured to restore the previously set illumination intensity of the previous first imaging mode or to set the illumination intensity according to the current needs of the user or system / software. Restoring the previously set illumination intensity of the previous first imaging mode ensures that the user will not notice any brightness differences in the image, thus ensuring a smooth mode switch. On the other hand, if the system / software / user requires a different illumination intensity, the imaging mode switches back to the first imaging mode, while simultaneously setting the currently required illumination intensity.

[0010] As described above, image effect changes specifically include at least one of the following: movement of the sample itself, particularly in the case of live samples, such as cells, and / or manipulation of the sample; movement of the microscope stage on which the sample is placed relative to the microscope objective, including movement of the stage in the xy direction and movement of the stage or objective in the z direction by means of the focus driver; changes in illumination system parameters, such as changes in illumination intensity / power or illumination color / wavelength; changes in imaging system parameters, such as changes in the exposure time, gain, frame rate and / or digital zoom of the camera used in the microscope's imaging system; and user input at the microscope user interface indicating image effect changes, wherein the user can change any of the above parameters or microscope components through the corresponding user interface, typically a GUI (Graphical User Interface).

[0011] The changes in the image effects described above are detected in particular by corresponding sensors located in or at the microscope stage (or its associated components), microscope focusing drive (or its associated components), imaging system (camera), and / or illumination system (or its associated components), further, by detecting the user's physical access to the sample, for example by corresponding sensors located in or at the door, cover, or opening providing access to the sample, further, by the user input described above indicating changes in the image effects, and further, by image analysis performed in the background based on real-time images of the sample (real-time image display (movement of the live sample, which can therefore be detected by image analysis).

[0012] As mentioned above, it is advantageous if the control system is configured to reduce the illumination intensity to zero during the second imaging mode in order to optimally avoid fading. Illumination intensity can be reduced by decreasing the illumination power and / or by using the shutter or a filter, etc.

[0013] In another advantageous embodiment, during the second imaging mode, the control system is configured to either shut down the camera of the imaging system or keep the camera running without using the image stream of real-time images delivered by the camera. While shutting down the camera can save power, keeping the camera running so that the real-time image stream can be reactivated as quickly as possible when switching back to the first imaging mode may be more advantageous.

[0014] In another particularly advantageous embodiment, in the second imaging mode, the control system is configured to cause the imaging system to capture actual real-time images after a preset time period. These actual real-time images are used in subsequent still image streams to refresh the still image stream. This measure is particularly suitable for situations where changes in the microscopic images are very slow or minimal after a period of time. In these cases, a timer can be activated, for example, to trigger the refresh of the displayed still image stream at a predefined repetition rate (e.g., every 10 seconds). This will still reduce fading while still displaying relatively up-to-date images.

[0015] In another embodiment, during the second imaging mode, the control system is configured to perform predetermined background operations.

[0016] Even when, for example, the microscope stage or focusing drive is moved, such background operations / tasks performed during the second imaging mode, also referred to herein as "virtual real-time mode," should not result in a switch back to the first imaging mode. Therefore, the user will not notice the background operation being performed from the presented sample image.

[0017] Examples of such background operations include: 3D scanning of a sample, typically achieved by determining a focus map through autofocus at multiple different xy positions, or determining the type of surface or material of the sample. The type of surface or material of a sample can be determined by guiding a measurement beam onto the sample and analyzing the optical properties of the reflected beam, which provides information about the type of surface or material.

[0018] As already noted, such background operations / tasks can preferably be performed while presenting a stream of still images to the user, so that the user will not notice any movement of the sample and / or focus during the background operation. Therefore, any changes in the settings of the microscope components (stage, focus driver, illumination settings, imaging / camera settings) required to perform the background operation are not assessed / classified as "image effect changes" in the sense of this application. However, if the image effect change is not a result of the background operation, it is preferable to immediately interrupt the background operation and switch back to the first (real-time) imaging mode, while simultaneously resetting the microscope settings, such as the previous xyz position, previous focus settings, etc. Otherwise, when resuming the real-time streaming mode, the user will passively perceive image changes or time lags.

[0019] In another aspect, embodiments of the present invention provide a method for controlling the imaging of a sample imaged by a microscope, wherein the microscope includes an illumination system for illuminating the sample and an imaging system for delivering microscopic images of the sample, wherein changes in image influence in the microscope settings and / or the position of the sample are detected by a control system, the changes in image influence causing changes in the sample image, wherein in a first imaging mode, a real-time image stream of real-time images of the sample is delivered by the imaging device, or in a second imaging mode, a still image stream of one or more still images of the sample is delivered, and when no changes in image influence are detected, the first imaging mode is switched to the second imaging mode, one of the last real-time images of the first imaging mode is used for at least a portion of the still image stream in the second imaging mode, and wherein, during the second imaging mode, the illumination intensity of the illumination system is reduced.

[0020] For a detailed description of the features and potential advantages of this method, refer to the corresponding features and advantages of the microscope conceived according to the present invention.

[0021] As used herein, the term “and / or” includes any and all combinations of one or more of the related listed items and may be abbreviated to “ / ”.

[0022] Although this document describes some aspects in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a box or device corresponds to a method step or feature of a method step. Similarly, aspects described in the context of a method step also represent a description of a corresponding box or item or feature of the corresponding apparatus.

[0023] Another aspect of the present invention relates to a computer program comprising program code for implementing the method according to the present invention when the program is run on a processor, particularly on a processor of a microscope control system according to the present invention. Furthermore, the present invention relates to a computer program product having such a computer program stored thereon.

[0024] Embodiments of the inventive concept are described in more detail in the following figures. Attached Figure Description

[0025] Figure 1 An incident light microscope according to an embodiment of the present invention is illustrated schematically.

[0026] Figure 2 It is shown schematically in chronological order. Figure 1 The microscope's display schematically illustrates a real-time image stream and a still image stream according to an embodiment of the invention, and

[0027] Figure 3 A flowchart illustrating an embodiment of a method conceived according to the present invention is shown. Detailed Implementation

[0028] Figure 1 A microscope 120 in the form of an incident light microscope is schematically illustrated according to an embodiment of the present invention. Note that since the present invention is not directly related to the type of microscope, it is also applicable to transmitted light microscopes. Microscope 120 includes an illumination system 130, which typically includes an illumination source and a condenser lens for generating an illumination beam, the path of which is labeled 132. Microscope 120 further includes a microscope stage 150 movable in the xy directions, both perpendicular to the optical axis 147 defined by a microscope objective 145. In this embodiment, the microscope objective 145 is movable in the z-direction (as indicated by the arrow) and therefore movable in the direction of the optical axis 147, thereby enabling focusing actuation. A sensor / encoder 126 is provided for detecting the position of the microscope stage 150 and / or the objective 145, thereby detecting any movement of the sample 155 on the microscope stage 150 relative to the objective 145.

[0029] Microscope 120 further includes an operating system 128 for operating / controlling the movement of microscope stage 150 and / or objective lens 145. This operation can be performed manually by a user, typically using a user interface such as GUI 160, or automatically by control system 110. Although operating system 128 and controller 110 are described as separate entities for illustrative purposes, they can also be combined or integrated into a single unit. The same applies to GUI 160 and display 149.

[0030] Figure 1The sample 155 on the microscope stage 150 is further shown, wherein the sample 155 is illuminated by an illumination beam, which, in the case of fluorescence microscopy, has a specific wavelength range and intensity to excite fluorescence radiation in the sample 155. The illumination beam and the emitted fluorescence beam are conducted through the microscope objective 145. Typically, mirror 121 is depicted as a dichroic mirror, which deflects the excitation light, and fluorescence can pass through this dichroic mirror for imaging purposes. The light passing through the dichroic mirror 121 is used as the observation light, which is deflected by mirror 122 into the image detector 148. The corresponding observation beam path is labeled 142. The imaging system 140 of the microscope 120 includes at least the image detector 148, typically in the form of a camera, particularly a digital camera, and / or a display 149 for displaying a microscope image 170 of the sample 155. The image detector 148 is configured to deliver a real-time image stream of real-time images of the sample 155, and at least one of the exposure time, frame rate, and gain value of the image detector / camera 148 is adjustable. The corresponding image data is transmitted to the control system 110, which, after further image data processing, transmits the image data to the display 149, where the image 170 is displayed in real time for user observation. Alternatively, the image detector / camera 148 can be directly connected to the display 149 to transmit image data, and then the control system 110 will be connected to at least one of the components of the imaging system 140, namely the camera 148 and / or the display 149.

[0031] The control system 110 is configured to control the image detector / camera 148 and / or the display 149 to deliver a real-time image stream of real-time images of the sample 155 in a first imaging mode, the real-time images being captured at predetermined values ​​for exposure time, frame rate, and gain. Furthermore, the control system 110 is configured to control the image detector / camera 148 and / or the display 149 to deliver a still image stream of one or more still images of the sample 155 in a second imaging mode. Additionally, the control system 110 is configured to detect any movement of the sample 155 due to movement of the microscope stage 150 relative to the microscope objective 145 and / or due to movement of the sample 155 itself.

[0032] Movement of the sample itself, particularly of a live sample / cell, can be detected in different ways: at the start of observation, the user can specify via the GUI whether the sample / sample is stationary (i.e., cannot move) or alive (i.e., may move). In the latter case, the user can, empirically, indicate a certain speed of movement. In the case of a moving sample, the second imaging mode can be interrupted at intervals according to a predetermined or user-indicated speed of movement to provide actual real-time images (“refresh the image stream”). If the possible movement and speed of movement cannot be indicated, movement detection can be performed through a conventional background task (as described above), which takes the form of image analysis of real-time images captured by the camera but not used to display to the user. Such image analysis will, for example, compare the position of the sample in subsequent images to detect movement.

[0033] Sensor / encoder 126 senses / detects the relative movement of the microscope stage with respect to microscope objective 145 and transmits the corresponding signal to control system 110. As discussed above, other sensors or methods can be provided to detect movement of the sample itself, for example, in the case of live cells, or manipulation of sample 155, etc. Furthermore, since control system 110 is connected to operating system 128, which can in particular be a user operating system, control system 110 can detect any user input. The same applies to any changes in illumination system parameters, as control system 110 is connected to illumination system 130. The same applies to any changes in imaging system parameters, as control system 110 is connected to imaging system 140, which in turn connects to camera 148 and display 149. It should be noted that, as described above, any changes in imaging parameters, illumination parameters, and any movement of the sample can be initiated by the user of the system, but also by the software controlling microscope 120, which is typically used in the case of automated microscopes. Since such changes / movements typically affect / alter the image of sample 155, control system 110 is configured to switch the imaging system, in the form of camera 148 and display 149, from still image mode, i.e., “virtual real-time image mode”, to real-time image mode, in which one or more still images of sample 155 are delivered and displayed on display 149.

[0034] In the absence of such image-affected changes, to reduce "fading," the control system 110 is configured to switch the imaging system to a "virtual real-time image mode." For this purpose, the last real-time image, or one of the last real-time images, is used as a still image in the still image stream. Simultaneously, the control system 110 causes the illumination system 130 to reduce the illumination intensity, specifically, the illumination intensity can be reduced to zero to effectively prevent fading. During the second imaging mode, the camera 148 can be turned off or kept running; however, the real-time image stream delivered by the camera is not used. Instead, still images are displayed on the monitor 149.

[0035] Preferably, after a certain period of time, such as five or ten seconds, and after restoring the previously set illumination intensity, the actual real-time image is acquired to refresh the still image stream with the updated real-time image, which is then used as the still image in the still image stream. This is particularly advantageous when changes in the sample image are very slow.

[0036] Figure 2 schematically shown Figure 1 The display 149 displays microscope images of sample 155 in chronological order. The first four images 170 belong to a first imaging mode, in which a real-time image stream 272 displays real-time images. As sample 155 moves in the first three images, the first imaging mode is activated. In the fourth image 170, no such movement is detected. Therefore, the system switches to a second imaging mode and delivers a still image stream 274 by providing the same still image 170 on the display 149. The still image is the last image displayed in the real-time image stream 272. At the end of the still image stream 274, movement of sample 155 is detected. Therefore, the system reverts to the first imaging mode and displays the real-time image stream 272.

[0037] In the following text, combined with Figure 3 Further embodiments of "open" and "closed" microscopes are described.

[0038] An "open" microscope is a type of microscope where the user has physical access to the current sample / sample. Therefore, without a suitable sensor, the user can disturb the sample without the control system noticing. In these cases, it may be necessary to reactivate the live image stream, for example, when the user changes the sample or manipulates it directly. A "closed" microscope is a type of microscope where the sensor recognizes any access to the sample. In these cases, the control system notices the user's interference with the sample and automatically switches to live image mode, so the user doesn't even need to know that the image mode switching function has been activated.

[0039] In the aforementioned "closed" microscope, every access port is coded, meaning the software can determine whether the corresponding access port is open or closed. Furthermore, the microscope is equipped with a motorized focusing drive and stage control, which can be controlled via software or input devices (see [link to documentation]). Figure 1 The operating system 128 in the system controls the system and then sends corresponding signals to the software. The software may be part of or integrated with the control system 110. Figure 1 The control system 110 communication.

[0040] In such a "closed" microscope, a "virtual" real-time image mode, also known as a second imaging mode, can be achieved: when the user activates the real-time image, the microscope operates in the same way as any other ordinary microscope with a real-time mode. In real-time mode, some changes can be made to the camera parameters to adjust the brightness of the real-time image. This can be done by manually changing the corresponding settings in the software or through certain automatic exposure routines.

[0041] like Figure 3 As shown, during real-time image mode "272", if the software (of or in communication with control system 110) detects A = true, where A =

[0042] - Camera or lighting parameters were not changed (manually or automatically), and

[0043] -The focus remains unchanged, and

[0044] - The xy position of the microscope stage has not changed, and

[0045] - All physical access to the sample is disabled, and

[0046] -The sample is not a living organism, meaning it cannot move on its own.

[0047] Then routine B is triggered:

[0048] - Camera image 170 is saved and will be presented to the user as a "virtual" live image, although it is a still image and is recognized by the user as a still image stream;

[0049] - Camera 148 remains running in the background, but no longer displays the live image stream delivered by the camera to the user, so that the first imaging mode can be reactivated as soon as possible;

[0050] - The light source for illuminating the sample was turned off.

[0051] If A is not true, the imaging system 140 continues to deliver the real-time image stream 272.

[0052] After triggering routine B, the software continues to check if A = true. If A is not true (e.g., the user moves the microscope stage 150, operates the focus driver, or opens the door to manually change the sample), then routine C is executed, i.e.

[0053] -Restore lighting;

[0054] - The live stream from camera 148 is redirected to display 149 for user viewing, i.e., the imaging system delivers a live image stream 272 to the user.

[0055] During real-time image mode "272", the control system 110 continues to monitor the above condition A in order to repeat the above process.

[0056] In "open" microscopes, some, but not all, components are electrically powered / coded and / or connected to the control system, making it impossible to safely determine whether and when a sample change / manipulation / movement has occurred. However, a "virtual" real-time mode can still be achieved in such microscopes. The software / control system can detect as many conditions (A) as possible (depending on the electrically powered or coded components). More information can be gathered through user input. Once the user manually changes any microscope component / sample or manipulates the sample, the user can operate / click the corresponding element in the user interface / GUI 160 to notify the control system 110. In this case, the control system 110 reactivates the real-time image stream.

[0057] The aforementioned software, which is part of or connected to the control system 110, represents a computer program for implementing the method conceived in accordance with the present invention.

[0058] Figure 1 A schematic diagram of a control system 110 configured to perform the methods described herein is shown. A microscope 120 is configured to capture images and is connected to the control system 110. The control system 110 is configured to perform at least a portion of the methods described herein. The control system 110 may be configured to execute machine learning algorithms. The control system 110 and the microscope 120 may be separate entities, but may also be integrated together into a common housing. The control system 110 may be part of the central processing system of the microscope 120, and / or the control system 110 may be part of a sub-component of the microscope 120, such as a sensor, actuator, camera, or illumination unit of the microscope 120.

[0059] Control system 110 may be a local computer device (e.g., a personal computer, laptop, tablet, or mobile phone) having one or more processors and one or more storage devices, or it may be a distributed computer system (e.g., a cloud computing system having one or more storage devices and one or more processors distributed across multiple locations, such as distributed across local clients and / or one or more remote server farms and / or data centers). Control system 110 may include any circuitry or combination of circuitry. In one embodiment, control system 110 may include one or more processors that can be of any type. As used herein, a processor may refer to any type of computing circuitry, such as, but not limited to, microprocessors for microscopes or microscope components (e.g., cameras), microcontrollers, complex instruction set computing (CISC) microprocessors, reduced instruction set computing (RISC) microprocessors, very long instruction word (VLIW) microprocessors, graphics processors, digital signal processors (DSPs), multi-core processors, field-programmable gate arrays (FPGAs), or any other type of processor or processing circuitry. Other types of circuitry that may be included in control system 110 may be custom circuitry, application-specific integrated circuits (AS1Cs), etc., such as one or more circuits (e.g., communication circuitry) for wireless devices, such as mobile phones, tablets, laptops, two-way radios, and similar electronic systems. The control system 110 may include one or more storage devices, which may include one or more storage elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard disk drives, and / or one or more drives that process removable media, such as optical discs (CDs), flash memory cards, digital video discs (DVDs), etc. The control system 110 may also include a display device, one or more speakers, and a keyboard and / or controller, which may include a mouse, trackball, touchscreen, voice recognition device, or any other device that allows a system user to input and receive information in and from the control system 110.

[0060] Some or all of the method steps can be executed by (or using) hardware devices, such as processors, microprocessors, programmable computers, or electronic circuits. In some embodiments, one or more of the most important method steps can be executed by such devices.

[0061] Depending on certain implementation requirements, embodiments of the present invention can be implemented in hardware or software. Implementation can be performed using non-transitory storage media, such as digital storage media like floppy disks, DVDs, Blu-ray discs, CDs, ROMs, PROMs, EPROMs, EEPROMs, or flash memory, storing electronically readable control signals that cooperate (or are capable of cooperating with) a programmable computer system to perform the corresponding methods. Therefore, the digital storage medium can be computer-readable.

[0062] According to some embodiments of the present invention, a data carrier having electronically readable control signals capable of cooperating with a programmable computer system to perform one of the methods described herein.

[0063] Typically, embodiments of the present invention can be implemented as a computer program product having program code that, when run on a computer, is operable to perform one of the methods. The program code may, for example, be stored on a machine-readable medium.

[0064] Other embodiments include a computer program stored on a machine-readable medium for performing one of the methods described herein.

[0065] In other words, therefore, an embodiment of the method of the present invention is a computer program having program code for performing one of the methods described herein when the computer program is run on a computer.

[0066] Therefore, another embodiment of the invention is a storage medium (or data carrier or computer-readable medium) comprising a computer program stored thereon for performing one of the methods described herein when executed by a processor. Data carriers, digital storage media, or recorded media are typically tangible and / or non-transitory. Another embodiment of the invention is an apparatus as described herein, comprising a processor and a storage medium.

[0067] Therefore, a further embodiment of the invention represents a data stream or signal sequence for performing one of the methods described herein. The data stream or signal sequence may, for example, be configured to be transmitted via a data communication connection, such as via the Internet.

[0068] Further embodiments include processing means, such as a computer or programmable logic device, configured or adapted to perform one of the methods described herein.

[0069] Further embodiments include a computer having a computer program installed on it for performing one of the methods described herein.

[0070] Further embodiments of the invention include an apparatus or system configured (e.g., electronically or optically) to transmit a computer program for performing one of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, include a file server for transmitting the computer program to the receiver.

[0071] In some embodiments, a programmable logic device (e.g., a field-programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, the field-programmable gate array may cooperate with a microprocessor to perform one of the methods described herein. Generally, the method is preferably performed by any hardware device.

[0072] List of reference numerals

[0073] 110 Control System

[0074] 120 microscope

[0075] 121 Dichroic mirror

[0076] 122 mirrors

[0077] 126 Encoder, Sensor

[0078] 128 operating system

[0079] 130 Lighting System

[0080] 132 Illumination Beam Path

[0081] 140 Imaging System

[0082] 142 Observe the beam path

[0083] 145 Microscope Objective

[0084] 147 optical axis

[0085] 148 Image detector, camera

[0086] 149 Monitor

[0087] 150 Microscope stage

[0088] 155 samples

[0089] 160 User Interface (GUI)

[0090] 170 Microscopic image

[0091] 272 Real-time image stream

[0092] 274 Still Image Streams

Claims

1. A microscope (120) comprising a control system (110) for controlling the imaging of a sample (155) imaged by said microscope, The microscope (120) includes an illumination system (130) for illuminating the sample and an imaging system (140) for delivering a microscopic image (170) of the sample. The microscope (120) includes one or more access openings for providing physical access to the sample (155) and is configured to open or close, wherein any access opening is coded. The control system (110) is connected to the lighting system (130) and the imaging system (140) and is configured to: The image influence changes in the microscope settings and / or the position of the sample cause a change in the sample image (170). Determine whether the corresponding access opening is open or closed, and The imaging system (140) delivers a real-time image stream (272) of real-time images of the sample in a first imaging mode, or a still image stream (274) of one or more still images of the sample in a second imaging mode, and switches from the first imaging mode to the second imaging mode when no image effect change is detected, using one of the last real-time images from the first imaging mode for at least a portion of the still image stream (274) in the second imaging mode, and Reduce the illumination intensity of the illumination system (130) during the second imaging mode; The control system (110) is also configured to: a) If any access opening is detected to be open, continue using the first imaging mode, or b) When in the second imaging mode and any access opening is detected to be open, automatically switch to the first imaging mode and restore the illumination intensity of the lighting system.

2. The microscope (120) according to claim 1, wherein, The control system (110) is further configured to: when a change in image influence is detected, switch the imaging system (140) from the second imaging mode to the first imaging mode, and in the first imaging mode, eliminate the reduction in illumination intensity of the second imaging mode.

3. The microscope (120) according to claim 1, wherein, The control system (110) is configured to detect changes in image influence in the microscope setup and / or the position of the sample by detecting at least one of the following: Movement and / or manipulation of the sample (155) itself; The movement of the microscope stage (150) on which the sample (155) is placed relative to the microscope objective (145); Changes in lighting system parameters; Changes in imaging system parameters; The indicator image at the microscope user interface (160) affects the changing user input.

4. The microscope (120) according to claim 1, wherein, The control system (110) is configured to reduce the illumination intensity to zero during the second imaging mode.

5. The microscope (120) according to claim 1, wherein, The control system (110) is configured to reduce the illumination intensity by reducing the illumination power during the second imaging mode.

6. The microscope (120) according to claim 1, wherein, During the second imaging mode, the control system (110) is configured to either turn off the camera (148) of the imaging system (140) or keep the camera (148) running but not using the image stream delivered by the camera.

7. The microscope (120) according to claim 1, wherein, During the first imaging mode, after a change from the first imaging mode to the second imaging mode and back to the first imaging mode, the control system (110) is configured to restore the previously set illumination intensity of the previous first imaging mode or set the currently required illumination intensity.

8. The microscope (120) according to claim 1, wherein, In the second imaging mode, the control system (110) is configured to cause the imaging system (140) to capture an actual real-time image after a preset time period, the actual real-time image being used in a subsequent still image stream (274) to refresh the still image stream.

9. The microscope (120) according to claim 1, wherein, During the second imaging mode, the control system (110) is configured to perform predetermined background operations.

10. The microscope (120) according to claim 9, wherein, If the background operation requires changes in the image effects in the microscope settings and / or the position of the sample, the control system (110) is configured not to switch to the first imaging mode.

11. The microscope (120) according to claim 9, wherein, The background operation is at least one of the following: 3D scan of the sample; Determining the focus plot; The determination of the type of surface or material of the sample.

12. A method for controlling the imaging of a sample by a microscope (120), The microscope includes an illumination system (130) for illuminating the sample and an imaging system (140) for delivering a microscopic image (170) of the sample. The microscope (120) includes one or more access openings for providing physical access to the sample (155) and is configured to open or close, wherein any access opening is coded. in, The image influence changes in the microscope settings and / or the position of the sample are detected by the control system (110), and these changes cause alterations in the sample image (170). In a first imaging mode, a real-time image stream (272) of real-time images of the sample is delivered via the imaging device (140); or in a second imaging mode, a still image stream (274) of one or more still images of the sample is delivered. When no image effect change is detected, the first imaging mode is switched to the second imaging mode, and at least a portion of the still image stream (274) in the second imaging mode is used from one of the last real-time images of the first imaging mode. During the second imaging mode, the illumination intensity of the illumination system (130) is reduced; and a) If any access opening is detected to be open, continue using the first imaging mode, or b) When in the second imaging mode and any access opening is detected to be open, automatically switch to the first imaging mode and restore the illumination intensity of the lighting system.

13. The method according to claim 12, wherein, When a change in image influence is detected, the imaging system (140) switches from the second imaging mode to the first imaging mode, and in the first imaging mode, the reduction in illumination intensity of the second imaging mode is eliminated.

14. The method according to claim 12, wherein, Changes in image effects in the microscope setup and / or the location of the sample are detected by detecting at least one of the following: Movement and / or manipulation of the sample (155) itself; The movement of the microscope stage (150) on which the sample (155) is placed relative to the microscope objective (145); Changes in lighting system parameters; Changes in imaging system parameters; The indicator image at the microscope user interface (160) affects the changing user input.

15. The method according to claim 12, wherein, During the second imaging mode, the illumination intensity is reduced to zero.

16. The method according to claim 12, wherein, During the second imaging mode, the illumination intensity is reduced by decreasing the illumination power.

17. The method according to claim 12, wherein, During the second imaging mode, the camera (148) of the imaging system (140) is turned off or the camera (148) is kept running but the image stream delivered by the camera is not used.

18. The method according to claim 12, wherein, During the first imaging mode, after a change from the first imaging mode to the second imaging mode and back to the first imaging mode, the previously set illumination intensity of the previous first imaging mode is restored or the currently required illumination intensity is set.

19. The method according to claim 12, wherein, In the second imaging mode, after a preset time period, an actual real-time image is captured, and the actual real-time image is used in a subsequent still image stream (274) to refresh the still image stream.

20. A computer program comprising program code, which, when run on a processor, particularly on a processor of a control system (110) of a microscope (120) according to any one of claims 1 to 11, is used to implement the method of claims 12 to 19.

21. A computer program product having a computer program stored thereon, the computer program including program code for implementing the method of claims 12 to 19 when the program is run on a processor, particularly on a processor of a control system (110) of a microscope (120) according to any one of claims 1 to 11.

Images