Method for providing a synthetic image using a digital microscope, digital microscope system, and program for providing a synthetic image using a digital microscope

Abstract

A method for providing a composite image using a digital microscope (2), the digital microscope (2) comprising an optical system (25), an image sensor (120) having a predetermined number of pixels, and a stage (10) for holding a sample (12), the stage being configured to be movable relative to the optical system and the image sensor, the method including receiving a user selection regarding a region of interest (74) of the sample, the user selection indicating a location and extension of the region of interest; selecting, in response to the user selection, one of a full resolution mode for generating individual images with a predetermined number of pixels and a low resolution mode for generating individual images with a reduced number of pixels compared to the predetermined number of pixels; moving the stage relative to the optical system and the image sensor; generating the individual images of the region of interest according to the selected one of the full resolution mode and the low resolution mode; and combining the individual images into a composite image representing the region of interest.

Description

Technical Field

[0001] The present invention relates to the technical field of digital microscopes. In particular, the present invention relates to a technique for generating a digital image of a part of a sample observed through a digital microscope.

Background Art

[0002] In recent years, it has been an object of technological progress to use a digital microscope instead of a conventional analog microscope. Current digital microscopes are generally used in either of the following two operating modes. In the first operating mode, the digital microscope is used in the same way as a conventional analog microscope. That is, the digital microscope drives a stage holding a sample to be observed to a desired position and is configured to take one image corresponding to the position of the stage using a camera. Then, this single image is presented to the user. In the second operating mode, the microscope is configured to scan the row direction or column direction of the sample based on a request for a sample image by the user and synthesize an image of the sample from the individual images taken during the scanning. However, these operating modes of current digital microscopes are not suitable for all usage scenarios of digital microscopes.

Summary of the Invention

Problems to be Solved by the Invention

[0003] Therefore, it is beneficial to provide a digital microscope system that improves the operability by the user and a method for providing a synthesized image using the digital microscope.

Means for Solving the Problems

[0004] An exemplary embodiment of the present invention is a method for providing a synthetic image using a digital microscope, the digital microscope comprising an optical system, an image sensor having a predetermined number of pixels, and a stage for holding a sample, the stage being configured to be movable relative to the optical system and the image sensor, the method comprising receiving a user selection regarding a region of interest of the sample, the user selection indicating a position and an extent of the region of interest, selecting, in response to the user selection, one of a full-resolution mode for generating individual images having a predetermined number of pixels and a low-resolution mode for generating individual images having a reduced number of pixels compared to the predetermined number of pixels, moving the stage relative to the optical system and the image sensor, generating individual images of the region of interest according to one of the full-resolution mode and the low-resolution mode selected, and combining the individual images to form a synthetic image representing the region of interest.

[0005] According to an exemplary embodiment of the present invention, it is possible to match the generation of individual images incorporated into the finally obtained composite image with the user selection for the region of interest of the sample. For the images of the portions of the sample that are of interest to the user, the provided image quality and the provided speed are optimally traded off. In particular, by selecting a resolution mode from among a full-resolution mode and a low-resolution mode for generating individual images, performing image processing on individual images with a reduced number of pixels at high speed is advantageous when the user selection indicates that the resolution of the desired sample image is sufficiently small even if it is relatively small. For example, when the user selection indicates that the user's interest extends over a fairly large portion of the sample, that is, when the user selection indicates that the extended portion of the region of interest is fairly large, the low-resolution mode may be selected. In this case, a relatively large number of individual images required to generate a display of a relatively large portion of the sample can be obtained at an excellent speed compared to the case of using the full-resolution mode. In other words, the low-resolution mode may be selected based on the premise that a user interested in a wide range in the sample is satisfied with a composite image having a resolution lower than the highest resolution, and thus, the speed of generating the composite image can be improved without sacrificing the resolution required by the user under temporary use. On the other hand, when the user selection indicates a fairly small region of interest, the full-resolution mode may be selected. In that case, a relatively small number of individual images required to generate the composite image may be obtained in high-speed operation, and furthermore, the user can obtain high image quality for the selected region of interest.

[0006] The digital microscope has an optical system. The optical system may be of any type as long as the digital microscope is suitable for achieving a desired magnification. In particular, the optical system may include an objective lens and a tube lens. The magnification may be a set value associated with the optical system provided in the digital microscope. In particular, the magnification may be set in accordance with the objective lens provided in the digital microscope.

[0007] The digital microscope has a stage for holding a sample. The sample may be placed in the form of a slide. The slide may be placed on the stage or introduced into a device specially designed to hold the slide.

[0008] The stage is provided so as to be movable with respect to the optical system and the image sensor. In particular, the digital microscope may be provided with a stage driving unit configured to drive the stage with respect to the optical system and the image sensor. The optical system and the image sensor may be substantially stationary within the microscope reference coordinate system. In order to enable two-dimensional scanning of the sample, the stage may be provided to be moved two-dimensionally by the stage driving unit. Further, the stage may be movable in a direction approaching or separating from the optical system and the image sensor. For the purpose of focusing only, the dimension of the movement of the stage may be provided to be relatively small.

[0009] The digital microscope is provided with an image sensor. The image sensor may be part of a digital camera. Thus, it can be said that the digital microscope includes a digital camera having an image sensor. The digital camera may include general and additional components in a camera, such as a shutter and an image sensor driver, for example.

[0010] In the method according to the present invention, a user selection regarding a region of interest of the sample is received. The region of interest can also be said to be a field of view that is the object of the user's interest. This field of view may in particular be the field of view that the user wishes to display on the screen when collaborating with the digital microscope. The region of interest of the sample that is the object of the user's interest corresponds to a specific part of the stage where the region of interest is located in the sample. The stage may be moved according to the relationship between the region of interest of the sample and the corresponding part of the stage, and individual images of the region of interest may be generated.

[0011] The expression of generating individual images of the region of interest refers to generating individual images of individual parts of the region of interest in the sample. The individual images may be generated by scanning the region of interest. The individual images of adjacent parts in the region of interest may overlap with each other.

[0012] The user selection indicates the position and extent of the region of interest. In particular, the user selection may implicitly specify the position and extent of the region of interest. For example, the user may make a user selection by enlarging or horizontally moving the image preview of the sample. Such zoom operations and horizontal movements can be performed via a touch screen, mouse operation, or other suitable input device. The position and extent of the region of interest result from the zoom and movement operations on the image preview. As long as a user selection is received in the method according to the present invention, the region of interest of the sample may be selected by the user in an appropriate manner, and the information may derive the position and extent of the region of interest.

[0013] In the full-resolution mode, individual images are generated with a predetermined number of pixels. In contrast, in the low-resolution mode, individual images are generated with a reduced number of pixels. By reducing the number of pixels, the image data processing of individual images can be accelerated. For example, types of post-processing filters applicable to the image data of individual images can operate faster by reducing the number of pixels. Also, when combining individual images into a composite image, any stitching operation can operate faster on individual images with reduced pixel numbers. Thus, the processing speed of image data is traded off with the resolution of the composite image, and therefore, the provision of the composite image can be adapted to the user selection. Also, the convenience of the user can be adaptively improved, and it becomes possible to improve the sample analysis speed of the user.

[0014] According to a further embodiment of the present invention, individual images with a reduced number of pixels are generated by subsampling a predetermined number of pixels of an image sensor. Subsampling is a particularly efficient method for reducing the predetermined number of pixels of individual images. In particular, subsampling directly reduces the number of pixels in the image sensor that is the source of the image data so that all subsequent post-processing is performed based on the reduced number of pixels. Subsampling means reading out from the image sensor a number of measurements that is less than the total number of available measurements. That is, subsampling refers to intentionally ignoring a part of the image data generated by the image sensor. Subsampling may be performed by reading out every nth pixel of the image sensor, such as every other pixel, every third pixel, every fourth pixel, etc., and subsampling may be applied to both dimensions of the image sensor. By applying subsampling, the readout time of the image sensor can be shortened, and the processing time of all subsequent image processing can be shortened. Therefore, it is possible to achieve high-speed processing throughout a series of image processing.

[0015] According to a further embodiment of the present invention, individual images with a reduced number of pixels are generated by downscaling the image data generated by the image sensor. Downscaling of the image data is another way to reduce the number of pixels. Compared with subsampling, as described above, all the sensed image data is used, but the image data regarding a predetermined set of adjacent pixels can be combined into a single pixel. For example, a single pixel after downscaling can be obtained by calculating from a window originally of 2 pixels × 2 pixels, or 3 pixels × 3 pixels, or 4 pixels × 4 pixels, or 5 pixels × 5 pixels, etc. In this way, based on the image data with the reduced number of pixels for all the information acquired by the image sensor, the number of pixels can be reduced. Downscaling can generally be performed at any point in a series of image processing. Immediately after reading the image data from the image sensor, downscaling of the image data may be performed. Thus, the speedup due to the reduction in the number of pixels contributes to most of the series of image processing. Note that downscaling may be performed according to an appropriate downscaling algorithm. Downscaling algorithms are themselves known to those skilled in the art.

[0016] According to a further embodiment of the present invention, in the low-resolution mode, the stage moves at least partially continuously, and during the movement of the stage, the image sensor acquires the image data of individual images. In this way, in the low-resolution mode, the speed for generating the composite image can be further increased. Since the image sensor acquires the image data of individual images during the movement of the stage, there is no time required for the operations of starting or stopping the stage to acquire the image data of individual images. In this way, since the image data of individual images are generated quickly and continuously, it is possible to provide all the image data required for image synthesis in a relatively short time. Acquiring the image data of individual images during the movement of the stage is particularly beneficial in combination with subsampling of a predetermined number of pixels of the image sensor. By performing subsampling, the image data acquired by the image sensor can be read out faster, so that the image sensor can quickly prepare to acquire more image data. Therefore, it is possible to perform the continuous image acquisition operation during the movement of the stage without hindering the reading of the image sensor. Here, the expression "at least partially continuously" refers to an operation that is generally continuous, including the possibility of stopping at several positions. For example, after a predetermined number of image data acquisition operations, the stage may stop in order to return to the starting point defined for all components of the digital microscope. Also, it may stop to change the moving direction of the stage, such as when acquiring individual images of a new row or a new column. On the other hand, it is also possible to acquire substantially all or all of the image data during the movement of the stage. This can also be said that at least most of the image data of individual images are acquired during the movement of the stage. However, it does not exclude the case where the image data is acquired when the stage stops.

[0017] According to a further embodiment of the present invention, the moving speed of the stage is selected such that the blurring of the image data is limited to a maximum of 2 pixels, particularly a maximum of 1 pixel. In other words, the moving speed of the stage is selected within a range in which each point of the sample affects the acquired image data by a maximum of 3 pixels, particularly a maximum of 2 pixels. In this way, the moving speed of the stage is adapted to the rest of the digital microscope system. The relationship between the moving speed of the stage and the degree of blurring of the image data is another aspect of the trade-off between the provision speed and the image quality of the composite image. Therefore, the handling of the digital microscope may be adapted to user selection again. Note that the blurring of the image data refers to the degree of blurring in the composite image.

[0018] According to a further embodiment of the present invention, in the full-resolution mode, the stage moves intermittently, and while the stage is stopped, the image sensor acquires the image data of individual images. With such a configuration, since there is no risk of blurring due to the movement of the stage during the acquisition of the image data, the quality of the acquired image data is particularly high. The expression that the stage moves intermittently refers to the start and stop of the movement of the stage, which is also called the drive and stop of the movement of the stage. In order to accurately acquire the image data at a certain point while the stage is stopped, the stage drive unit may be synchronized particularly with the exposure time of the image sensor.

[0019] According to a further embodiment of the present invention, when the extended portion of the region of interest is smaller than the first threshold value, the full-resolution mode is selected. In other words, the full-resolution mode is selected when the user is interested in a portion of the sample that is smaller than the threshold value. In this case, it is assumed that the user is interested in the details of the portion. Therefore, a high resolution and the accompanying high-quality composite image are selected. The first threshold value may be, for example, a one-dimensional threshold value, a two-dimensional threshold value, or a region threshold value applied to the wider dimension of the region of interest.

[0020] According to a further embodiment of the present invention, the low-resolution mode consists of a plurality of low-resolution sub-modes, and the step of selecting any one of the full-resolution mode and the low-resolution mode includes the step of selecting any one of the full-resolution mode and the plurality of low-resolution sub-modes. With such a configuration, three or more modes for generating individual images are provided, and thus, the mode selected for generating individual images can be more finely adapted according to the needs of the user. In particular, it becomes possible to select an appropriate one of the full-resolution mode and the plurality of low-resolution sub-modes according to the extended portion of the region of interest. For this selection, a plurality of thresholds may be set. Each threshold can be a one-dimensional threshold, a two-dimensional threshold, or a region threshold as described above with respect to the first threshold.

[0021] According to a further embodiment of the present invention, the plurality of low-resolution sub-modes have reduced pixel numbers specific to each sub-mode for individual images. In other words, in the plurality of low-resolution sub-modes, the reduced pixel numbers are different from each other. In the low-resolution sub-modes, the reduced pixel numbers for individual images are different from each other. The selection of any one of the full-resolution mode and the plurality of low-resolution sub-modes may be a monotonic function between the extended portion of the region of interest and the individual pixel numbers in each mode. That is, the smaller the extended portion of the region of interest, the larger the individual pixel numbers can be.

[0022] According to a further embodiment of the present invention, among a plurality of low-resolution sub-modes, at least one of the degree of subsampling of a predetermined number of pixels of the image sensor and the degree of downscaling of the image data generated by the image sensor is different. In a particular embodiment, the degree of subsampling a predetermined number of pixels of the image sensor and the degree of downscaling the image data generated by the image sensor may both be different among a plurality of low-resolution sub-modes. Also, in a plurality of low-resolution sub-modes, the acquisition of image data executed when the stage moves at least partially continuously or when the stage is in a stop position during intermittent movement may also be different. Further, when acquiring image data during stage movement, the stage movement speed may be different among a plurality of low-resolution sub-modes. In this way, the trade-off between the generation speed of individual images and the accompanying generation speed of the composite image and the image quality of the composite image can be adapted in particular detail with respect to a plurality of low-resolution sub-modes.

[0023] According to a further embodiment of the present invention, the plurality of low-resolution sub-modes have two, three, four, five, or six low-resolution sub-modes. A larger number of low-resolution sub-modes can be set similarly.

[0024] According to a further embodiment of the present invention, the user selection further indicates a representation resolution indicating the desired resolution of the composite image. Selection of the full-resolution mode or the low-resolution mode, or one of a plurality of low-resolution sub-modes, can be based on the desired resolution by the user, if applicable. With such a configuration, the resulting composite image can be directly based on the user's wishes. Also, the selection can be based on the technical characteristics of the system around the digital microscope, such as the screen on which the composite image is depicted. In a particular embodiment, the representation resolution indicates the screen resolution of the screen for depicting the composite image. In this way, selection of the full-resolution mode or the low-resolution mode enables the provision of high-quality images taking into account the screen resolution as well as the zoom level to the sample.

[0025] According to a further embodiment of the present invention, a synthetic image is displayed on the screen. In this way, the result of the method according to the present invention is provided to the user in an intuitive manner. Since the displayed synthetic image can serve as the basis for further user selections, also referred to herein as updated user selections, the user can repeatedly reach the areas of the sample that the user is particularly interested in.

[0026] According to a further embodiment of the present invention, the individual images are displayed step by step on the screen in particular. In particular, the individual images may be displayed on the screen when they become substantially available after acquisition of the image data. In this way, even before the region of interest is fully displayed on the screen, information for determining the next step in the analysis of the sample may be provided to the user. From the user's perspective, the synthetic image is constructed step by step on the screen. The synthetic image may be constructed starting from the center of the region of interest and then towards the periphery of the region of interest. Also, the synthetic image may be constructed starting from a center line or a center column and towards a row direction or a column direction. By constructing the synthetic image step by step on the screen, it becomes possible to provide the synthetic image to the user intuitively or to convey a sense of speed, and the handling of the digital microscope can be made more convenient.

[0027] According to a further embodiment of the present invention, an updated user selection regarding the updated region of interest of the sample, the updated user selection indicating the position and the extension of the updated region of interest, is received, one or more currently executed steps are interrupted, and according to the updated user selection, one of the full-resolution mode and the low-resolution mode is reselected, the stage is moved with respect to the optical system and the image sensor, individual images of the updated region of interest are generated according to the reselected one of the full-resolution mode and the low-resolution mode, and the individual images are combined to form a composite image representing the updated region of interest. In this way, it becomes possible to immediately respond to the user's command. The updated region of interest is surely converted into the composite image without delay due to the previous stage after being scanned. In this way, the user can particularly efficiently engage in the analysis of the sample by receiving highly responsive feedback.

[0028] A further embodiment of the present invention includes an optical system, an image sensor having a predetermined number of pixels, a stage for holding a sample, a stage driving unit for moving the stage relative to the optical system and the image sensor, and a control unit for controlling generation of image data for a composite image. The control unit receives a user selection regarding a region of interest of the sample, the user selection indicating a position and an extended portion of the region of interest, and in response to the user selection, selects one of a full-resolution mode for generating individual images having a predetermined number of pixels and a low-resolution mode for generating individual images having a reduced number of pixels compared to the predetermined number of pixels, controls the stage driving unit to move the stage relative to the optical system and the image sensor, and controls generation of individual images of the region of interest according to the selected one of the full-resolution mode and the low-resolution mode. Additional features, modifications, and beneficial effects as described above with respect to the method of providing a composite image using a digital microscope are similarly applicable to the digital microscope system. In particular, according to the explicit disclosure herein, the control unit may be configured to execute the steps in the above-described method, or may be configured to cause the components of the digital microscope to execute the steps in the above-described method. The digital microscope system may be a digital microscope. Alternatively, the digital microscope system may be a distributed system including a digital microscope and a data processing device such as a computer coupled to the digital microscope. The control unit may be provided in one of these, or may be a distributed component between the digital microscope and the data processing device.

[0029] According to a further embodiment of the present invention, in the low-resolution mode, the control unit controls generation of individual images by causing at least one of subsampling of a predetermined number of pixels of the image sensor and downscaling of the image data generated by the image sensor to be performed.

[0030] According to a further embodiment of the present invention, in the low-resolution mode, the control unit controls the stage driving unit to move the stage at least partially continuously, and controls the image sensor to acquire the image data of individual images during the movement of the stage.

[0031] The digital microscope may be an optical microscope. Further, the digital microscope may include an illumination unit disposed on the stage side distal to the optical system and the image sensor.

[0032] A further embodiment of the present invention is a program for providing a composite image using a digital microscope. The digital microscope includes an optical system, an image sensor having a predetermined number of pixels, and a stage for holding a sample. The stage is configured to be movable relative to the optical system and the image sensor. This program receives a user selection regarding a region of interest of the sample, the user selection indicating the position and the extended portion of the region of interest, selects one mode from the full-resolution mode and the low-resolution mode according to the user selection, instructs the stage to move relative to the optical system, instructs the image sensor to generate image data, generates individual images with a predetermined number of pixels for the region of interest based on the image data when the full-resolution mode is selected, generates individual images with a reduced number of pixels for the region of interest when the low-resolution mode is selected, and combines the individual images to form the composite image representing the region of interest. Additional features, modifications, and beneficial effects as described above with respect to the method of providing a composite image using a digital microscope are similarly applicable to this program.

Brief Description of the Drawings

[0033]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0034] Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

[0035] Figure 1 is a three-dimensional perspective view of a digital microscope 2 according to an exemplary embodiment of the present invention. The digital microscope 2 is provided with a base 4 that supports the digital microscope 2. The base 4 may be placed on a table so as to stand stably.

[0036] The base 4 is provided with an illumination unit and a stage drive unit. The illumination unit and the stage drive unit are shielded by the base housing shown in Figure 1 as described later. A stage 10 is attached to the base 4. The stage 10 is movable relative to the base 4, and in particular, in this embodiment, it is movable in two dimensions in the x and y directions. During operation, the stage 10 is moved in the x and y directions by the stage drive unit.

[0037] The stage 10 includes a transparent or translucent portion. A sample may be placed on this transparent or translucent portion. In the operation scene shown in Figure 1, the sample 12 includes two slides, and these two slides are placed on the transparent or translucent portion of the stage 10 via a clamping mechanism. During operation, the illumination unit illuminates the sample 12 from below. The plane of the transparent or translucent portion of the stage 10 is referred to as the xy plane in the digital microscope.

[0038] Further, the digital microscope 2 is provided with a support arm 6 and a tube portion 8. The support arm 6 is shaped to support the tube portion 8, and by providing the support arm 6, the tube portion 8 can be stopped above the stage 10. The tube portion 8 houses various optical components. In particular, in the exemplary embodiment of FIG. 1, the tube portion 8 houses a digital camera and an optical system, and the optical system includes a tube lens structure and an objective lens 24. In FIG. 1, the digital camera and the tube lens structure are shielded by a tube housing, but the objective lens 24 extends from the tube housing toward the stage 10.

[0039] The tube portion 8 can move relative to the support arm 6 in a moving direction orthogonal to the xy plane. That is, the tube portion 8 can move in the z direction of the microscope reference coordinate system. Although this movement is extremely limited, it is sufficient for focusing the sample 12 on the optical system housed in the tube portion 8.

[0040] During operation, the stage drive unit moves the stage 10 to a desired position in the x direction and the y direction. The stage drive unit may include any suitable type of actuator, for example, two small electric motors for movement in two directions. The illumination unit illuminates the sample 12 from below. With this configuration, it becomes possible to acquire, with the digital camera, image data of the corresponding portion of the sample 12 on the irradiation optical path from the illumination unit to the digital camera. The image data thus acquired is referred to as the image data of each individual image, indicating the image data corresponding to a specific position of the stage 10 and a specific position of the sample 12 with respect to the associated optical system and digital camera. By driving the stage 10 to various positions, a plurality of individual images can be generated.

[0041] Figure 2 is a schematic diagram of some components of the digital microscope 2 in Figure 1. In particular, Figure 2 shows the components related to the illumination of the sample 12 and the direction of light within the tube section 8. As described above, the illumination unit 40 is disposed below the stage 10, that is, below the sample 12, and irradiates light upward toward the sample 12. In the exemplary embodiment shown in Figure 2, the illumination unit 40 includes a light source 42 provided to irradiate a large amount of light toward the imaging target portion on the sample 12, and a collimating lens 44. Note that the illumination unit 40 may have an appropriate configuration and design.

[0042] The digital microscope 2 is provided with an optical system 25. In the exemplary embodiment shown in Figure 2, the optical system 25 includes a tube lens structure 22 and an objective lens 24. The tube lens structure 22 is provided with individual tube lenses 23. The objective lens is provided to magnify the imaging target portion on the sample 12 as desired. That is, the magnification of the sample 12 in the resulting individual images is set by the shape and design of the objective lens 24. In the exemplary embodiment shown in Figure 2, the magnification of the objective lens 24 is 20 times.

[0043] Furthermore, the digital microscope 2 is provided with a digital camera 20. The digital camera 20 includes an image sensor and a shutter. Also, it may be configured to include other components commonly used in the field of digital cameras to contribute to the operation of the digital camera for acquiring image data. The tube lens structure 22 directs the light from the objective lens 24 toward the image sensor of the digital camera 20. In this way, an optical path 50 is established that extends from the illumination unit 40, through the sample 12, through the objective lens 24, through the tube lens structure 22, and to the image sensor of the digital camera 20.

[0044] FIG. 3 is a schematic diagram of a digital microscope system 100 according to an exemplary embodiment of the present invention. The digital microscope system 100 includes a digital microscope 2. The digital microscope 2 can be a digital microscope 2 having the mechanical configuration described with respect to FIG. 1, the optical settings described with respect to FIG. 2, and the control settings described below with respect to FIGS. 4 and 5. In FIG. 3, attention is paid to the user's viewpoint and the user's interaction with the digital microscope system 100.

[0045] Furthermore, the digital microscope system 100 includes a computer 80 connected to the digital microscope 2 and a screen 70 connected to the computer 80. The computer 80 may be any type of processing device as long as it can appropriately connect between the screen 70 and the digital microscope 2. For example, the computer 80 may be a standard personal computer such as a desktop computer or a laptop. The exemplary processing capabilities of the computer 80 in the exemplary embodiment shown in FIG. 3 may be incorporated into the digital microscope 2 or the screen 70. The screen 70 may be, for example, a part of a tablet or a smartphone that has both the function of a screen and the processing function for directly interfacing with the digital microscope 2. The exemplary processing capabilities of the computer 80 in the exemplary embodiment shown in FIG. 3 may be configured to be obtained from a remote processing device such as a remote server as part of a cloud-based solution.

[0046] The screen 70 is a control interface provided for the user of the digital microscope system 100. In the exemplary embodiment shown in FIG. 3, since the screen 70 is a touch screen, it has both a user input function and an image output function. The user can control the entire operation of the digital microscope system 100 via the touch screen 70. On the other hand, instead of the touch screen 70, it is also possible to additionally or alternatively provide other input devices. For example, in order to realize the control of the digital microscope system 100 by the user, other appropriate input devices such as a keyboard and a mouse may be provided. It is also possible to provide a plurality of screens to output images, and further, to output images to other entities. For example, the image may be saved in a file format on a hard drive or other data storage medium.

[0047] In the exemplary embodiment shown in FIG. 3, the screen 70 outputs two different images. An image preview 72 is displayed in the upper left corner of the screen 70. The image preview 72 is an overview image of the sample placed on the stage of the digital microscope 2. This overview image can be taken with an additionally provided digital camera. The additional digital camera may be arranged adjacent to the objective lens 24, that is, at a position shifted from the objective lens 24 in the direction of looking downward at the sample. The only purpose of using the additional digital camera is to quickly provide an overview of the sample with sufficient detail to allow the user to roughly move the sample. Therefore, the additional digital camera may be a low-quality and simple one. Note that the image preview 72 may be generated by other appropriate methods. It is also possible to configure the system such that the user moves the sample without providing the image preview 72 at all.

[0048] In the usage example shown in FIG. 3, the sample is a biological sample. The sample consists of a cell culture 14 placed on a transparent slide. Therefore, to the user, the sample consisting of the cell culture 14 will appear surrounded by a blank portion.

[0049] In the exemplary embodiment of FIG. 3, the user can select a region of interest 74 within the image preview 72. The selection of the region of interest 74 is a user selection, and based on this user selection, the operation of the digital microscope and the object to be displayed on the screen 70 are determined. Hereinafter, the selection of the region of interest 74 will be described in detail. The user selection can be made in an appropriate manner on the touch screen using an auxiliary input device such as a finger, a stylus, a mouse, or a menu-based selection tool. In the illustrated example of use, assume that the user selects the region of interest 74 using his or her finger at the corresponding part of the screen 70 where the image preview 72 on the touch screen is shown. The user selection represents the position and the extended part of the region of interest. In other words, the user selection includes a clear determination of which part of the sample is the region of interest for the user. This determination can be made in any form as long as it can lead to the position and the extended part of the region of interest. For example, the user selection may be composed of the coordinates of the lower left corner of the region of interest and the coordinates of the two-dimensional extended part in the xy coordinate system of the image preview 72 as seen from the digital microscope system 100. In another example, the user selection may be composed of the coordinates of the upper left corner and the lower right corner of the region of interest as seen from the digital microscope system 100. In yet another example, the user selection may be composed of a single coordinate such as the center coordinate of the region of interest and the zoom level compared with the size of the entire sample as seen from the digital microscope system 100.

[0050] Based on user selection, the digital microscope system 100 generates a composite image corresponding to the region of interest 74 and displayed on the composite image screen section 76. Referring to FIGS. 4 and 5, the details from the system perspective for generating the composite image will be described as follows. When the region of interest 74 is selected, the composite image corresponding to the region of interest 74 of the sample is displayed on the composite image screen section 76 as being highly magnified compared to the image preview 72 as seen by the user. Here, the expression "corresponding" does not necessarily mean that the region of interest and the composite image exactly match. For example, for purposes such as adapting to the dimensions of the screen 70, the displayed composite image may show a region larger than the region of interest 74 within the sample.

[0051] In the exemplary embodiment shown in FIG. 3, the composite image screen section 76 covers the entire screen 70 except for the image preview 72. The user selection may be configured to be made in such a composite image screen section 76. For example, the user may be configured to operate the virtual representation of the sample by means of a horizontal parallel movement operation and a zoom operation, and by this operation, the virtual representation of the sample may extend outside the screen 70. Specifically, for example, a two-finger zoom command operation may be performed as in the operation of a smartphone application. The expansion of the region of interest may also be called the zoom level of the region of interest. Thus, the user selection composed of the position and zoom level of the region of interest is also an indication of the position and the expanded portion of the region of interest. Specifically, the image preview taken by a low-quality additional camera may be first displayed full-screen, and the region of interest may be moved by a horizontal parallel movement operation and a zoom operation by the user.

[0052] Figure 4 shows a block diagram of some components of the digital microscope system 100 of FIG. 3. Regarding FIG. 3, the user front end and the interaction with the user of the digital microscope system 100 were described with a focus, but regarding FIG. 4, it will be described from the system side including the hardware backend and the intervening control structure. Some components shown in FIG. 4 include two external connection elements, namely, a user selection input unit 92 and a composite image output unit 94. These two external connection elements can also be regarded as an interface to the touch screen 70 shown in FIG. 3. User selections are communicated from the touch screen 70 to the components of the digital microscope system 100 shown in FIG. 4 via the user selection input unit 92. And the composite image is returned to the touch screen 70 by the above-described components in an appropriately encrypted form for display on the composite image screen unit 76 via the composite image output unit 94.

[0053] As described above, FIG. 4 shows some components of the digital microscope system 100, particularly, the digital camera 20, the illumination unit 40, and the stage drive unit 46 described above. The digital camera 20 includes an image sensor 120, a shutter 122, and an image sensor driver 124. When the shutter 122 opens, the image sensor 120 captures image data, and the image sensor driver 124 reads the acquired image data from the image sensor 120.

[0054] Furthermore, the digital microscope system 100 includes a control unit 90, an image data post-processing unit 96, and an image synthesis unit 98. Note that the control unit 90, the image data post-processing unit 96, and the image synthesis unit 98 may be provided in the digital microscope 2, may be provided in the computer 80, or may be provided on a remote server. Alternatively, these components can also be provided on the screen 70. Also, the control unit 90, the image data post-processing unit 96, and the image synthesis unit 98 may be distributed among the digital microscope systems 100. Furthermore, each of the control unit 90, the image data post-processing unit 96, and the image synthesis unit 98 may be configured to have a hardware component, a software component, or a mixed component of a hardware component and a software component. In the exemplary embodiment shown in FIG. 4, the control unit 90, the image data post-processing unit 96, and the image synthesis unit 98 are part of a software program configured to be executed on the computer 80 to control the digital microscope 2.

[0055] The control unit 90 is connected to the user selection input unit 92 and receives a user selection regarding the region of interest of the sample. Further, the control unit 90 is connected to the illumination unit 40, the stage drive unit 46, and the digital camera 20. The control unit is configured to control the illumination unit 40, the stage drive unit 46, and the digital camera 20, particularly its shutter 122 and image sensor driver 124, according to the user selection.

[0056] Furthermore, the control unit 90 is connected to the image data post-processing unit 96 and the image synthesis unit 98. The digital camera 20 is connected to the image data post-processing unit 96, the image data post-processing unit 96 is further connected to the image synthesis unit 98, and the image synthesis unit 98 is further connected to the composite image output unit 94. With such a configuration, the control unit 90 can control a series of downstream processes described below in the image processing of the digital camera 20.

[0057] Based on the user selection, the control unit 90 determines which image to generate for the sample in order to generate a composite image corresponding to the region of interest indicated by the user selection. Using the image sensor 120 with a predetermined number of pixels and the optical system of the digital microscope 2 with a set magnification, the system parameters are used to set how much of the sample is to be converted into image data for each individual image. That is, in the sample, a partial region that can be acquired in one operation of the shutter 122 of the digital camera 20 is set. When the partial region is set, the control unit 90 determines at which position of the sample to acquire the image data of each individual image based on the position and the extended portion of the region of interest. For example, the control unit 90 may determine the individual positions in the row direction or the column direction to be scanned in the region of interest. Next, the control unit 90 controls and synchronizes the stage drive unit 46, the shutter 122, and the image sensor driver 124 to generate the image data at the determined individual positions. The control unit 90 may control the illumination unit 40 to continuously illuminate or intermittently illuminate in synchronization with other components.

[0058] The control unit 90 not only controls the position at which the image data of each individual image is acquired. The control unit 90 further determines whether to generate each individual image using the full-resolution mode or the low-resolution mode based on the user selection. When a plurality of low-resolution sub-modes are set in the digital microscope system 100, the control unit selects one resolution mode for generating each individual image from among the full-resolution mode and the plurality of low-resolution sub-modes. In an exemplary embodiment regarding FIG. 4, two low-resolution sub-modes are set in the digital microscope system 100, and the control unit 90 selects one of three different modes for generating each individual image based on the user selection.

[0059] As described above, the image sensor 120 has a predetermined number of pixels. In the full-resolution mode, each image has a predetermined number of pixels. The image sensor driver 124 reads out the predetermined number of pixels, and the image post-processing unit 96 performs desired types of post-processing, such as color filtering or other filtering, on the image data having the predetermined number of pixels. Each image output by the image post-processing unit 96 has a predetermined number of pixels.

[0060] In the digital microscope system 100 shown in FIG. 4, in one or more low-resolution modes, the number of pixels is reduced by two methods. The first method is a method of reducing the number of pixels by subsampling a predetermined number of pixels. In this case, subsampling of the predetermined number of pixels of the image sensor is performed using the image sensor driver 124. In other words, the image sensor driver 124 can read out at a number of pixels less than the predetermined number of pixels. For example, the image sensor driver 124 can read out image data every other pixel, every third pixel, every fourth pixel, etc., that is, for every nth pixel. In particular, the image sensor driver 124 may be configured to be able to read out for every nth pixel in two dimensions of the image sensor 124. In an example of image data where the image sensor driver 124 reads out every two pixels, the number of pixels becomes one-fourth. Also, in an example of image data where the image sensor driver 124 reads out every three pixels, the number of pixels becomes one-ninth.

[0061] By subsampling a predetermined number of pixels, the generation of the composite image can be doubled in speed. First, the reading of the image data from the image sensor 120 becomes faster. That is, the time required to read the image data from the image sensor 120 is shortened for each individual image. The image sensor 120 can be made ready for new image data more quickly and can continuously acquire the image data of subsequent individual images more quickly. Therefore, the acquisition of the image data can be speeded up. Second, for the downstream side of the digital camera 20, particularly for the image post-processing unit 96 and the image synthesis unit 98, the amount of image data received is reduced. Thus, by reducing the number of pixels, the image processing operations performed in these downstream parts of the digital camera 20 can be speeded up.

[0062] The second method of reducing the number of pixels is to downscale the image data acquired by the image sensor 120. In this case, the image post-processing unit 96 is used for downscaling the image data acquired by the image sensor 120. The expression "downscaling" means reducing the number of pixels by an image filtering operation. For example, by downscaling, the four pixels in a 2-pixel × 2-pixel window may be replaced by, for example, a single pixel. The single replacement pixel may be the result of a relatively simple operation such as the averaging of the four pixels in the 2-pixel × 2-pixel window. In this way, the number of pixels is reduced to one-fourth. This technique may be extended to larger pixel windows. Also, a more sophisticated technique may be adopted to calculate the replacement pixel. For example, a larger image structure such as a contour may be considered in calculating the replacement pixel. Downsampling is known per se, and it is obvious to those skilled in the art that various downsampling techniques can be used.

[0063] Downsampling of the image data may be performed at various points in a series of image processes. For example, downsampling may be performed at the time of input to the image post-processing unit 96, that is, at the time when the image data is received from the image sensor driver 124. Also, other image processes may be performed on the image data before downsampling in the image post-processing unit 96, or other image processes may be performed on the image data after downsampling in the image post-processing unit 96. Downsampling may be incorporated into a series of image processes according to the image size required for other image processing operations so that other image processing operations are applied to a larger or smaller number of pixels.

[0064] By reducing the number of pixels, all subsequent image processing operations after downsampling are speeded up. Therefore, generation of a composite image can be speeded up by downsampling the image data. Subsequent image processing operations consist of image processing on individual images by the image post-processing unit 96 and synthesis of individual images by the image synthesis unit 98. The composite image data may be configured to be output at a higher speed and in a size that can be processed more easily. Also, when the composite image data is output step by step, individual data packets may be configured to be transmitted more quickly in succession and in a size that can be processed more easily.

[0065] As described above, the digital microscope system 100 of FIG. 4 is provided with a full-resolution mode and two low-resolution sub-modes. Based on user selection, the control unit 90 selects one of the full-resolution mode and the two low-resolution sub-modes. Also, the control unit 90 controls the image sensor driver 124 and the image post-processing unit 96 according to the one selected from the full-resolution mode and the two low-resolution sub-modes.

[0066] According to the exemplary embodiment described with respect to FIG. 4, in the full-resolution mode, the control unit 90 controls the image sensor driver 124 to read out image data from the image sensor 120 for a predetermined total number of pixels. Further, the control unit 90 controls the image post-processing unit 96 so as not to perform downsampling on the image data received from the image sensor driver 124. In the example of an image sensor of 1920 pixels × 1920 pixels, the number of individual pixels is also 1920 pixels × 1920 pixels.

[0067] According to the exemplary embodiment regarding FIG. 4, in the first low-resolution sub-mode, the control unit 90 controls the image sensor driver 124 to read out image data from the image sensor 120 two-dimensionally every 3 pixels. Further, the control unit 90 controls the image post-processing unit to perform 2-fold downsampling two-dimensionally. In the example of an image sensor of 1920 pixels × 1920 pixels, the image sensor driver 124 transmits image data of 640 pixels × 640 pixels to the image post-processing unit 96, and the number of individual pixels after downsampling is 320 pixels × 320 pixels.

[0068] According to the exemplary embodiment regarding FIG. 4, in the second low-resolution sub-mode, the control unit 90 controls the image sensor driver 124 to read out image data from the image sensor 120 two-dimensionally every 3 pixels. Further, the control unit 90 controls the image post-processing unit to perform 10-fold downsampling two-dimensionally. In the example of an image sensor of 1920 pixels × 1920 pixels, the image sensor driver 124 transmits image data of 640 pixels × 640 pixels to the image post-processing unit 96, and the number of individual pixels after downsampling is 64 pixels × 64 pixels.

[0069] The image synthesizing unit 98 is configured to synthesize individual images into a synthesized image. The synthesized image is provided to the user in an appropriate manner. For example, as shown in FIG. 3, it may be presented to the user on the screen or saved in a file for later viewing. Since the number of individual pixels in the full resolution mode, the first low resolution sub-mode, and the second low resolution sub-mode is different, the synthesis time of the individual images in the image synthesizing unit 98 may be different. In particular, the synthesis time for individual images with fewer pixels is reduced. The image synthesizing unit 98 can synthesize individual images by an appropriate procedure, such as using an appropriate stitching algorithm known per se. The individual images may be generated by overlapping them between adjacent individual images so that the stitching is of high quality.

[0070] In the exemplary embodiment shown in FIG. 4, the control unit 90 selects one of the full resolution mode, the first low resolution sub-mode, and the second low resolution sub-mode based on the extended portion of the region of interest selected by the user. For this selection, the control unit 90 may be provided with two region thresholds. When the region of interest is smaller than the first region threshold, the full resolution mode is selected. When the region of interest is larger than the first region threshold but smaller than the second region threshold, the first low resolution sub-mode is selected. When the region of interest is larger than the second region threshold, the second low resolution sub-mode is selected. The theoretical basis for these thresholds is as follows. The smaller the region of interest, the more likely the user is interested in the details of the sample, and thus, it provides better image quality, that is, individual images with high resolution.

[0071] In addition to controlling the image sensor driver 124 and the image post-processing unit 96 based on the user selection, the control unit 90 may be configured to control the stage driving unit 46 and the shutter 122 according to the user selection. In particular, the movement pattern of the stage may be different between the full resolution mode and the first low resolution sub-mode and the second low resolution sub-mode. Also, the mode may be different between the case where the image sensor acquires image data while the stage is moving and the case where the image sensor acquires image data while the stage is stopped.

[0072] In the exemplary embodiment shown in FIG. 4, in the full-resolution mode, while the stage is stopped, image data is acquired by the image sensor 120. Therefore, blurring due to the movement of the stage does not occur, and the image quality is optimized. However, since the stage stops for each individual image, subsequent individual images may be generated at a non-maximum speed. Thus, the operation time of the stage driving unit becomes a limiting factor in generating individual images and composite images.

[0073] In the exemplary embodiment shown in FIG. 4, in both the first low-resolution sub-mode and the second low-resolution sub-mode, image data is acquired by the image sensor 120 while the stage is moving. In particular, the stage may be moved at a first stage movement speed in the first low-resolution sub-mode and at a second stage movement speed in the second low-resolution sub-mode. The second stage movement speed is higher than the first stage movement speed. By acquiring image data while the stage is moving, image data of subsequent individual images can be acquired more quickly and continuously, so that individual images and composite images can be generated quickly. The acquisition of image data during stage movement operates well in particular with sub-sampling of a predetermined number of pixels by the image sensor driver 124. As described above, by performing sub-sampling, rapid reading of image data becomes possible, and the image sensor can be prepared to quickly acquire new image data. This point is utilized when quickly and continuously acquiring image data while the stage is moving. The stage movement speed and the degree of sub-sampling can be adapted to each other according to the characteristics and constraints of the related technical components.

[0074] Further, the first-stage movement speed and the second movement speed may be set so that the synthesized image does not include blurring beyond the allowable range. In this regard, various factors can be taken into account. Based on the characteristics of the optical system and the physical pixel size of the image sensor, it may be determined which region of the sample is related to the pixels of the image sensor. Further, based on the degree of subsampling or downscaling, it may be determined which region of the sample is related to the pixels of the synthesized image. Furthermore, based on the allowable range of blurring in the synthesized image, it may be determined which maximum stage movement speed is allowable to keep the blurring below the allowable range. Note that the allowable range of blurring may be defined in relation to the number of adjacent pixels in the synthesized image that is affected by a predetermined point in the sample. For example, the predetermined point in the sample may be set as a quality criterion that may affect only two pixels in the synthesized image. This may also be referred to as blurring by one pixel because a predetermined point in the sample may affect at most one pixel when acquiring image data while the stage is stopped. The maximum stage movement speed may be set to the result obtained by dividing the length of the region in the sample corresponding to one pixel in the synthesized image by the shutter opening time for one imaging operation by the image sensor, after allowing blurring by one pixel. Note that when the readout operation of the acquired image data is large compared to the shutter opening time, the maximum stage movement speed may be set to the result obtained by dividing the length of the region in the sample corresponding to one pixel in the synthesized image by the total imaging / processing time for one imaging operation by the digital camera 20. Also, constraints unrelated to real time that may occur when transferring image data from the image sensor 120 to a memory configured to provide the image data for subsequent processing may be further taken into account. By setting the first-stage movement speed and the second-stage movement speed lower than the respective maximum stage movement speeds set according to the operation scenes of the first low-resolution sub-mode and the second low-resolution sub-mode, it is possible to very quickly provide the synthesized image while maintaining the blurring of the synthesized image within the allowable range.

[0075] The desired pixel size of the composite image can be made part of the user selection received by the control unit 90. That is, the user selection can include information regarding the desired resolution of the composite image. For example, the number of pixels of the screen 70 may be part of the information transmitted to the control unit 90. The control unit 90 may be configured to select one of a full-resolution mode and one or more low-resolution (sub) modes based on the extended portion of the region of interest and the desired resolution of the composite image. For example, the control unit 90 may be configured to adapt the above-described first region threshold and second region threshold according to the desired resolution of the composite image. In particular, the first region threshold and the second region threshold may be increased in accordance with a higher desired resolution. In this way, the image quality of the composite image can be adapted to the output medium, and a high-quality composite image can be presented to the user in a specific use output medium.

[0076] For the synthetic image, in order to enable the user to perform operations on a part of the synthetic image that has already been acquired, the synthetic image data may be configured to be displayed to the user step by step. For example, when a new individual image becomes available by the image post-processing unit 96, the image synthesis unit 98 performs a stitching process between this individual image and the individual images received previously. This process may be considered as joining the newly received individual image and a part of the synthetic image that has already been acquired. By performing the stitching, the image data of the individual image can be changed, so the stitching process can also be regarded as a filtering operation. The filtered individual images are provided to the screen or displayed together with a part of the synthetic image that has already been acquired, so that the displayed part that has been acquired in the synthetic image increases. By this process, the user can feel that the synthetic image is constructed step by step on the screen. In this way, it becomes possible to improve the efficiency of the user when analyzing the sample. For example, by displaying a part of the synthetic image that has already been acquired, the user can obtain an opportunity to update the region of interest, for example, by performing a zoom-in operation, before the entire synthetic image is provided. Also, before the entire synthetic image is provided, the user can obtain an opportunity to find a specific feature that the user is searching for within the sample.

[0077] FIG. 5 shows a flowchart of a method for providing a synthetic image using a digital microscope according to an exemplary embodiment of the present invention. In step 200, a user selection regarding a region of interest of a sample is received. In step 202, based on the user selection received in step 200, one of a full-resolution mode and a low-resolution mode, for example, one of the full-resolution mode and a plurality of low-resolution sub-modes, is selected. In step 204, individual images are generated for individual portions of the region of interest according to the mode selected in step 202. To generate the individual images according to the selected mode, all or part of an illumination unit, a stage drive unit, a shutter of a digital camera, an image sensor driver of the digital camera, and an image post-processing unit are controlled according to the selected mode. In step 206, the individual images are combined to generate a synthetic image. In step 208, the synthetic image is displayed on a screen for the user.

[0078] Note that steps 204, 206, and 208 may be executed in the illustrated order, or may be executed partially in parallel. As described above, while the combination of the individual images and the display of the combined image are performed for a part of the region of interest, individual images for another part of the region of interest may be generated.

[0079] In an exemplary embodiment shown in FIG. 5, the entire method may be configured to react at any point in time to an update of a user selection regarding the update of the region of interest. In particular, in the present method, the reception of the updated user selection may be interpreted as an interruption, and the currently executed step may be configured to stop. Also, in the present method, the updated user selection is interpreted as an interruption, and based on this updated user selection, it may be configured to return to step 202. The dashed line 210 shown in FIG. 5 indicates the reception of the updated user selection that may occur at any point in time during the entire method. If an individual image generated at a stage before step 204 is related to the updated user selection, it may be reused and not regenerated again. By doing so, the generation of the composite image for a slight change in the region of interest can be executed very quickly. Also, for the composite image, if a part already generated at a stage before step 206 is related to the updated region of interest, that part may continue to be displayed on the screen. The displayed part may be gradually supplemented with another part of the composite image of the updated region of interest. When an interruption time occurs on the screen, the user has to adapt to the new display, which may interfere with the analysis. However, by configuring as described above, the occurrence of such an interruption time can be prevented.

[0080] The present invention has been described with reference to exemplary embodiments. However, it is obvious to those skilled in the art that various changes can be made to the present invention without departing from the scope of the present invention, and equivalents can be used instead of the configurations in the exemplary embodiments. Furthermore, many modifications can be made to adapt a particular situation or material to the disclosure of the present invention without departing from the essential scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed, but includes all embodiments included in the appended claims.

Claims

1. A method for providing a composite image using a digital microscope (2), comprising: The digital microscope (2) includes an optical system (25), an image sensor (120) having a predetermined number of pixels, and a stage (10) for holding a sample (12), and the stage (10) is configured to be movable relative to the optical system (25) and the image sensor (120). The method includes: Receiving a user selection regarding a region of interest (74) of the sample (12), the user selection indicating the position and extent of the region of interest (74). Selecting one of a full-resolution mode for generating individual images having a predetermined number of pixels and a low-resolution mode for generating individual images having a reduced number of pixels compared to the predetermined number of pixels according to the user selection. Moving the stage (10) relative to the optical system (25) and the image sensor (120), and generating individual images of the region of interest (74) according to the one mode selected from the full-resolution mode and the low-resolution mode. Combining the individual images to form the composite image representing the region of interest (74). Displaying the composite image on a screen (70), and the individual images are displayed stepwise on the screen (70). The method further includes: Receiving an updated user selection regarding an updated region of interest of the sample, the updated user selection indicating the position and extent of the updated region of interest, when the individual images are being displayed stepwise on the screen (70). Interrupting one or more steps of the method currently being executed. Re-selecting one of the full-resolution mode and the low-resolution mode according to the updated user selection. Moving the stage (10) relative to the optical system and the image sensor, and generating individual images of the updated region of interest according to the one mode re-selected from the full-resolution mode and the low-resolution mode. Combining the individual images to form the composite image representing the updated region of interest. Method.

2. The individual images having the reduced number of pixels are generated by subsampling the predetermined number of pixels of the image sensor (120). The method according to claim 1.

3. Each of the images with the reduced number of pixels is generated by downscaling the image data generated by the image sensor (120). The method according to claim 1 or 2.

4. In the low-resolution mode, the stage (10) moves at least partially continuously, and during the movement of the stage, the image sensor (120) acquires the image data of the individual images. The method according to any one of claims 1 to 3.

5. The moving speed of the stage (10) is selected such that the blurring of the image data is limited to a maximum of 2 pixels. The method according to claim 4.

6. The moving speed of the stage (10) is selected such that the blurring of the image data is limited to a maximum of 1 pixel. The method according to claim 4.

7. In the full-resolution mode, the stage (10) moves intermittently, and during the stop of the stage, the image sensor (120) acquires the image data of the individual images. The method according to any one of claims 1 to 6.

8. The low-resolution mode consists of a plurality of low-resolution sub-modes, and the step of selecting any one of the full-resolution mode and the low-resolution mode includes selecting any one of the full-resolution mode and the plurality of low-resolution sub-modes. The method according to any one of claims 1 to 7.

9. The plurality of low-resolution sub-modes have reduced numbers of pixels specific to each sub-mode for the individual images, and at least one of the degree of sub-sampling of the predetermined number of pixels of the image sensor (120) and the degree of downscaling of the image data generated by the image sensor (120) is different among the plurality of low-resolution sub-modes. The method according to claim 8.

10. The user selection further indicates a presentation resolution indicating the desired resolution of the composite image. The method according to any one of claims 1 to 9.

11. The presentation resolution indicates the resolution of a screen (70) for presenting the composite image. The method according to claim 10.

12. An optical system (25); An image sensor (120) with a predetermined number of pixels; A stage (10) for holding a sample (12); A stage driving unit (46) that moves the stage (10) relative to the optical system (25) and the image sensor (120); A control unit (90) that controls generation of image data for a composite image; A digital microscope system (100) comprising: The control unit: Receives a user selection regarding a region of interest (74) of the sample (12), the user selection indicating a position and an extension of the region of interest (74); In response to the user selection, selects one of a full-resolution mode for generating individual images of a predetermined number of pixels and a low-resolution mode for generating individual images of a reduced number of pixels compared to the predetermined number of pixels; Controls the stage driving unit (46) to move the stage (10) relative to the optical system (25) and the image sensor (120); Controls generation of individual images of the region of interest (74) according to the one selected mode of the full-resolution mode and the low-resolution mode; Controls to combine the individual images into the composite image representing the region of interest (74); Controls to display the composite image on a screen (70), and the individual images are displayed stepwise on the screen (70); The control unit further: Receives an updated user selection regarding an updated region of interest of the sample, the updated user selection indicating a position and an extension of the updated region of interest, when the individual images are displayed stepwise on the screen (70); Interrupts one or more current processing steps of the control unit; Re-selects one of the full-resolution mode and the low-resolution mode according to the updated user selection; Controls the stage driving unit (46) to move the stage (10) relative to the optical system (25) and the image sensor (120); Controls to generate individual images of the updated region of interest according to the one re-selected mode of the full-resolution mode and the low-resolution mode; Controls to combine the individual images into the composite image representing the updated region of interest; Digital microscope system (100).

13. In the low-resolution mode, the control unit (90) controls the generation of each of the individual images by causing at least one of subsampling of a predetermined number of pixels of the image sensor and downscaling of the image data generated by the image sensor to be performed. The digital microscope system (100) according to claim 12.

14. In the low-resolution mode, the control unit (90) controls the stage drive unit (46) to move the stage (10) at least partially continuously, and controls the image sensor (120) to acquire the image data of each of the individual images during the movement of the stage. The digital microscope system (100) according to claim 12 or 13.

15. A program for providing a composite image using a digital microscope (2), the digital microscope (2) including an optical system (25), an image sensor (120) having a predetermined number of pixels, and a stage (10) for holding a sample (12), the stage (10) being configured to be movable with respect to the optical system (25) and the image sensor (120). The program receives a user selection regarding a region of interest (74) of the sample (12), the user selection indicating the position and extent of the region of interest (74). selects one mode from a full-resolution mode and a low-resolution mode according to the user selection. instructs the stage (10) to move with respect to the optical system (25). instructs the image sensor (120) to generate image data. When the full-resolution mode is selected, individual images are generated for the region of interest (74) with the predetermined number of pixels based on the image data, and when the low-resolution mode is selected, individual images are generated for the region of interest (74) with a reduced number of pixels. combines the individual images to form the composite image representing the region of interest (74). instructs to display the composite image on a screen (70), and the individual images are displayed stepwise on the screen (70). The program further When the individual images are displayed stepwise on the screen (70), receive an updated user selection regarding the updated region of interest of the sample, the updated user selection indicating the position and extent of the updated region of interest. Interrupt the processing steps of one or more of the currently executing programs. Re-select one of the full-resolution mode and the low-resolution mode according to the updated user selection. Instruct the stage (10) to move with respect to the optical system and the image sensor. Instruct the image sensor to generate the image data. Based on the image data, generate individual images of the updated region of interest according to the one re-selected mode of the full-resolution mode and the low-resolution mode. Combine the individual images into a composite image representing the updated region of interest. Program.

Images