Slide image obtaining apparatus and method

Abstract

The present invention relates to a slide image obtaining apparatus and method, which obtain an image of a sample mounted on a slide. The present invention provides the slide image obtaining apparatus comprising: a stage on which a slide with a sample placed thereon is mounted; a lens for receiving light from the sample; a beam splitting unit for splitting, into at least two rays of light, the light incident through the lens, and transmitting same; at least two image sensor units for obtaining, for each field of view (FOV) for the sample, images of the sample at different focal positions from the light transmitted from the beam splitting unit; and an image generation unit which generates, at each FOV, images to be stitched using the at least two images generated by the image sensor units, and which combines the images to be stitched in the plurality of FOVs so as to generate a composite image.

Description

Slide image acquisition device and method

[0001] The present invention relates to a slide image acquisition device and method for acquiring an image of a sample mounted on a slide.

[0002] Scanning devices used in conjunction with microscopes are known. For example, a slide scanner is a device that automatically scans a slide containing a tissue sample to be examined, enabling the image to be stored, observed, and / or analyzed. It is used to acquire images of tissue samples in various preclinical experiments and pathological examinations.

[0003] A slide scanner captures images of the tissue on a slide at magnifications tens to hundreds of times, allowing images of the tissue to be captured with a small field of view (FOV) and the captured images to be stitched together to create a digital slide image (e.g., a whole slide image (WSI)).

[0004] Typically, tissue samples for digital slide image acquisition have a thickness of less than 4 μm, while cell samples can have a thickness of several tens of μm. Furthermore, the depth at which the sample is positioned within the slide can vary.

[0005] When imaging tissue or cell samples, depth of field (DOF) is crucial to the quality of the captured image. DOF refers to the range of depth within which the image is clearly in focus. For example, when the magnification of an objective lens is increased to 20-40x, the DOF of the objective lens becomes approximately 1 μm, which is small compared to the thickness of the tissue sample. Therefore, acquiring images of the sample at the correct focal length is essential to improving the quality of slide images.

[0006] However, acquiring images of a sample in focus is not practical. When stitching images captured at a given field of view (FOV) under the imaging conditions of a slide scanner to create a digital slide image, such as a full slide image, it is necessary to effectively adjust the focal length of the objective lens in successive shots and effectively acquire images of the focused location.

[0007] The present invention aims to provide a slide image acquisition device and method capable of effectively adjusting the focal distance in successive shots when acquiring a slide image of a sample mounted on a slide, and of acquiring a slide image that is in focus overall.

[0008] The present invention provides a slide image acquisition device, comprising: a stage on which a slide having a sample placed thereon is mounted; a lens that receives light from the sample; a beam splitter that divides the light incident through the lens into at least two and transmits the light; at least two image sensor units that acquire images of the sample at different focus positions from the light transmitted from the beam splitter for each FOV (Field of View) for the sample; and an image generation unit that generates a stitching target image using the at least two images in each FOV generated by the image sensor units and synthesizes the stitching target images in a plurality of FOVs to generate a composite image; wherein the image generation unit is characterized in that it includes either a first mode for selecting any one of the at least two images in any one FOV as the stitching target image, or a second mode for dividing each of the at least two images in any one FOV into block images and generating the stitching target image using block images at the same position.

[0009] In one embodiment, in the first mode, the image generation unit can calculate a focus evaluation value for at least two images in each FOV, and select an image with a high focus evaluation value as the stitching target image.

[0010] In one embodiment, in the second mode, the image generation unit may calculate a focus evaluation value for the block images at the same location in one of the FOVs, generate a stitching target block for the block images using the focus evaluation value, and fuse the stitching target blocks in the FOV to generate the stitching target image.

[0011] Additionally, the image generation unit can determine a block image having a high focus evaluation value among the block images as the stitching target block.

[0012] In addition, the image generation unit can determine weights for the block images using the focus evaluation values ​​for the block images, and generate the stitching target block by synthesizing the block images using the weights.

[0013] In one embodiment, whether the first mode or the second mode is applied may be selected by the user or determined by a mark provided on the slide.

[0014] In one embodiment, the image generation unit can generate the stitching target image by applying the first mode to one FOV among the plurality of FOVs and applying the second mode to another FOV.

[0015] In one embodiment, the slide image acquisition device includes a main control unit that controls the operation of the stage, the objective lens, the image sensor unit, and the image generation unit, and the main control unit performs a pre-focus calculation step of calculating a focus distribution of the sample of the slide in order to acquire an image of the slide, and in the focus calculation step, focus evaluation values ​​at a plurality of focus positions in one of the FOVs are calculated, and whether to apply the first mode or the second mode can be determined based on a difference in the focus evaluation values ​​at the plurality of focus positions.

[0016] In addition, when the difference between the focus evaluation value at a focus position at a predetermined distance from a focus position having the highest focus evaluation value in the FOV and the highest focus evaluation value is within a predetermined range, the second mode may be applied, and when the difference between the focus evaluation value at a focus position at a predetermined distance from a focus position having the highest focus evaluation value and the highest focus evaluation value is outside the predetermined range, the first mode may be applied.

[0017] In one embodiment, the image generation unit may generate the stitching target image by calculating a focus evaluation value for a plurality of images having different focus positions obtained from any one of the plurality of FOVs, applying the second mode when the difference in the focus evaluation values ​​of the plurality of images is within a predetermined range, and applying the first mode when the difference in the focus evaluation values ​​of the plurality of images is outside the predetermined range.

[0018] In addition, the present invention provides a method for obtaining a slide image, which generates a digital slide image by synthesizing images acquired from a plurality of FOVs (Fields of View) for a sample mounted on a slide, the method comprising: (a) a step in which an image generating unit receives a plurality of images at different focus positions for each of the FOVs; (b) a step in which the image generating unit generates a stitching target image for each of the FOVs using the plurality of images in each of the FOVs; and (c) a step in which the image generating unit generates the digital slide image by synthesizing the stitching target images; and in the step (b), the image generating unit generates the stitching target image according to any one of a first mode in which any one of the plurality of images in any one of the FOVs is selected as the stitching target image, and a second mode in which each of the plurality of images in any one of the FOVs is divided into block images and the stitching target image is generated using block images at the same position.

[0019] In one embodiment, in the first mode, the image generation unit can calculate a focus evaluation value for at least two images in each FOV, and select an image with a high focus evaluation value as the stitching target image.

[0020] In one embodiment, in the second mode, the image generation unit may calculate a focus evaluation value for the block images at the same location in one of the FOVs, generate a stitching target block for the block images using the focus evaluation value, and fuse the stitching target blocks in the FOV to generate the stitching target image.

[0021] Additionally, the image generation unit can determine a block image having a high focus evaluation value among the block images as the stitching target block.

[0022] In one embodiment, the image generation unit can determine weights for the block images using the focus evaluation values ​​for the block images, and generate the stitching target block by synthesizing the block images using the weights.

[0023] In one embodiment, prior to step (a), a pre-focus calculation step is performed to calculate a focus distribution of the sample of the slide for image acquisition of the slide, and in the focus calculation step, focus evaluation values ​​at a plurality of focus positions in one of the FOVs are calculated, and in step (b), whether to apply the first mode or the second mode can be determined based on a difference in the focus evaluation values ​​at the plurality of focus positions.

[0024] In one embodiment, when the difference between the focus evaluation value at a focus position at a predetermined distance from a focus position having the highest focus evaluation value in the FOV and the highest focus evaluation value is within a predetermined range, the second mode may be applied, and when the difference between the focus evaluation value at a focus position at a predetermined distance from a focus position having the highest focus evaluation value and the highest focus evaluation value is outside the predetermined range, the first mode may be applied.

[0025] In one embodiment, in the step (b), the image generation unit may generate the stitching target image by calculating a focus evaluation value for a plurality of images having different focus positions obtained from any one of the plurality of FOVs, applying the second mode when the difference in the focus evaluation values ​​of the plurality of images is within a predetermined range, and applying the first mode when the difference in the focus evaluation values ​​of the plurality of images is outside the predetermined range.

[0026] According to the present invention, when generating a digital slide image for a sample of a slide, the focus accuracy and depth of the image can be improved.

[0027] In addition, according to the present invention, effective focal length adjustment is possible in continuous shooting when acquiring images of a slide.

[0028] FIG. 1 is a diagram schematically illustrating the configuration of an image acquisition device according to one embodiment of the present invention.

[0029] FIG. 2 is a drawing showing one embodiment (first mode) of an image acquisition device according to one embodiment of the present invention for generating a digital slide image using a plurality of images.

[0030] FIG. 3 is a drawing illustrating a method of adjusting a focal length for capturing images in a continuous FOV in an image acquisition device according to one embodiment of the present invention.

[0031] FIG. 4 is a drawing showing another embodiment (second mode) of an image acquisition device according to one embodiment of the present invention for generating a digital slide image using a plurality of images.

[0032] FIG. 5 is a drawing exemplarily illustrating determining a stitching target image generation mode based on a pre-focus calculation result in an image acquisition device according to one embodiment of the present invention.

[0033] FIG. 6 is a drawing exemplarily illustrating determining a stitching target image generation mode while acquiring an image in an image acquisition device according to one embodiment of the present invention.

[0034] Figure 7 is a flowchart illustrating an image acquisition method according to one embodiment of the present invention.

[0035] The present invention is capable of various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it is to be understood that all modifications, equivalents, and alternatives included within the technical spirit and scope of the present invention are included. In describing the present invention, if a detailed description of a related known technology is judged to obscure the gist of the present invention, the detailed description will be omitted.

[0036] Terms like "first" and "second" may be used to describe various components, but these terms do not limit the components themselves. These terms are used solely to distinguish one component from another.

[0037] The terminology used in this invention is solely for the purpose of describing specific embodiments and is not intended to limit the invention. The terminology used in this invention has been selected from widely used, current terms, taking into account the functions of the invention. However, this may vary depending on the intentions of those skilled in the art, precedents, or the emergence of new technologies. Furthermore, in certain cases, the applicant may arbitrarily select terms, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names of terms, but rather based on their meanings and the overall content of the invention.

[0038] Singular expressions include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "comprise" or "have" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0039] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. In describing with reference to the attached drawings, identical or corresponding components are assigned the same drawing numbers, and redundant descriptions thereof will be omitted.

[0040] FIG. 1 is a diagram schematically illustrating the configuration of an image acquisition device according to one embodiment of the present invention.

[0041] An image acquisition device (10) according to one embodiment of the present invention includes a stage (12) on which a slide (1) on which a sample (3) to be scanned is placed is mounted, a lens (20, 22) for receiving light from the sample (3), a beam splitter (24, 26) for separating and outputting light passing through the lens (20, 22), an image sensor unit (30) for acquiring an image of the sample from the light separated by the beam splitter (24, 26), an image generation unit (50) for generating a digital slide image using the image acquired by the image sensor unit (30), and a main control unit (40) for controlling the operation of the device.

[0042] The above lenses (20, 22) may include an objective lens (20) positioned opposite the sample (3) and a tube lens (22) for imaging.

[0043] The image sensor unit (30) may include at least two image sensor units (32, 34, 36) that acquire images at different focal lengths from the sample (3). In one embodiment, the image sensor unit (30) may include a first image sensor unit (32) that acquires an image at a first focal length (z1), a second image sensor unit (34) that acquires an image at a second focal length (z2), and a third image sensor unit (36) that acquires an image at a third focal length (z3). In addition, the beam splitter units (24, 26) may include a first beam splitter unit (24) and a second beam splitter unit (26) to transmit images from the sample (3) to the first to third image sensor units (32, 34, 36).

[0044] The main control unit (40) can move the stage (12) in the X-axis and / or Y-axis direction so as to acquire an image of the sample (3) according to a sequential FOV (Field of View). However, in the implementation of the present invention, it is also possible to configure the stage (12) to be fixed and the lenses (20, 22) to move relatively to the stage (12). In addition, the main control unit (40) can move the objective lens (20) in the Z-axis direction to adjust the focal length.

[0045] The image sensor unit (30) of the image capturing device (10) illustrated in Fig. 1 has three first to third image sensor units (32, 34, 36), so that multiple images at different focal lengths are acquired in one FOV.

[0046] In this embodiment, a process of generating a digital slide image using multiple images acquired from the image sensor unit (30) is described.

[0047] FIG. 2 is a drawing showing one embodiment (first mode) of an image acquisition device according to one embodiment of the present invention for generating a digital slide image using a plurality of images.

[0048] The first mode shown in Fig. 2 may be referred to as the "best focus mode." In the first mode, the image with the best focus is selected from among the multiple images acquired by the image sensor unit (30) in the corresponding FOV. The images selected from each FOV are used for stitching to create a digital slide image.

[0049] The first to third images (I) are captured by the first to third image sensor units (32, 34, 36) in the first FOV. 11 , I 12 , I 13 ) is acquired, the image generation unit (50) generates the 1-1 to 1-3 images (I 11 , I 12 , I 13 ) is the first stitching target image (I) with the best focus evaluation value. 1s ) is determined. In the same way, for the images in the subsequent 2nd to nth FOVs, one image with the best focus evaluation value is determined as the stitching target image. That is, in the nth FOV, the n-1 to n-3 images (I n1 , I n2 , I n3 ) is obtained, the image generation unit selects one image with the best focus evaluation value as the nth stitching target image (I ns ) is decided.

[0050] The image generation unit (50) generates the first to nth stitching target images (I) in the FOVs for a predetermined area or all areas for generating a digital slide image. 1s ~ I ns) can be stitched to generate a digital slide image. In one embodiment, the stitching process of the stitching target images may be performed after the stitching target images are determined in at least two consecutive FOVs, or the stitching process may be performed after the stitching target images in all FOVs are determined.

[0051] In one embodiment, a focus evaluation value for each of a plurality of images acquired from each FOV can be calculated based on the image quality, whether the focus is consistent, or whether the object of interest is included. The focus evaluation value can be Brenner gradient, Trenenbaum gradient, energy Laplace, etc. The focus evaluation value can be calculated for the entire area of ​​the image or a portion of the region of interest. For example, if the object of interest is a cell nucleus in a sample, an image with optimal clarity for the region of interest can be obtained by detecting the cell nucleus and calculating the focus evaluation value of the image centered on the cell nucleus. In addition, it is also possible to increase or decrease the focus evaluation value depending on whether the object of interest is present.

[0052] FIG. 3 is a drawing illustrating a method of adjusting a focal length for capturing images in a continuous FOV in an image acquisition device according to one embodiment of the present invention.

[0053] Referring to (a) of FIG. 3, multiple images at focus positions z1, z2, and z3 in the first FOV are acquired through the first to third image sensor units (32, 34, and 36). Some areas on the second FOV side among the images acquired in the first FOV are utilized as a focus output area (FA). The main control unit (40) can evaluate the focus of the images in the focus output area (FA) and calculate the focal length in the second FOV to adjust the objective lens (20). The z-axis height of the objective lens (20) is adjusted so that images at focus positions z1', z2', and z3' in the second FOV can be acquired.

[0054] In one embodiment, the second FOV may be a portion that continues from the first FOV or may overlap with the first FOV in some area. If it is desired to photograph cells or tissues belonging to the focus output area (FA) of the first FOV, the second FOV may be set to include the focus output area (FA) of the first FOV. This enables focus adjustment for photographing cells or tissues included in the sample (3) without having to have a separate camera or image sensor for focus output.

[0055] FIG. 4 is a drawing showing another embodiment (second mode) of an image acquisition device according to one embodiment of the present invention for generating a digital slide image using a plurality of images.

[0056] The second mode shown in Fig. 4 may be referred to as a 'focus fusion mode'. In the second mode, multiple images acquired by the image sensor unit (30) in one FOV are analyzed in predetermined units, block images with excellent image quality are selected in the predetermined units, and the selected block images are fused to generate an image to be stitched in the corresponding FOV. When the second mode is applied, there is an advantage in that the depth of the digital slide image can be improved by selecting a block that is well in focus or includes a cell or tissue of interest from multiple images according to different focal lengths in one FOV.

[0057] Referring to FIG. 4, the first to third images (I) are captured by the first to third image sensor units (32, 34, 36) in the first FOV. 11 , I 12 , I 13 ) is acquired, the image generation unit (50) generates the 1-1 to 1-3 images (I 11 , I 12 , I 13 ) Each is divided into blocks of a certain size and the image is evaluated block by block.

[0058] Videos 1-1 to 1-3 (I 11 , I 12 , I 13 ), taking the first block image (B1), the second block image (B2), and the third block image (B3) having the same position in the XY plane, the image generation unit (50) selects the block image (B1, B2, B3) with the best image quality among the three block images as the stitching target block (B f ) is decided.

[0059] Once the stitching target blocks are determined for all block images in the first FOV, they are fused to form the first stitching target image (I 1f ) is created.

[0060] A predetermined unit for dividing an image into blocks may be a predetermined number of pixels (e.g., 1×1, 4×4, 8×8, 16×16, 32×32, etc.), and the image quality in a block image divided into predetermined units may be determined by a focus evaluation value or the presence or absence of a cell or tissue of interest. In addition, in the practice of the present invention, a predetermined unit for dividing an image into blocks may be a 1-1 to 1-3 image (I 11 , I 12 , I 13 ) can also be determined based on a specific shape included in the image. For example, the 1-1 to 1-3 images (I 11 , I 12 , I 13 ) can be segmented for a specific tissue or cell to determine the area where a specific tissue or cell exists as a stitching target block.

[0061] In addition, in the implementation of the present invention, the 1-1 to 1-3 images (I 11 , I 12 , I 13 ) and apply weights to the first block image (B1), the second block image (B2), and the third block image (B3) having the same location in the XY plane to create a stitching target block (B f ) is also possible to generate. For example, if the weight w1 is given to the first block image (B1), the weight w2 is given to the second block image (B2), and the weight w3 is given to the third block image (B3) according to the image quality, then the stitching target block (B f ) can be determined as [(pixel value of the first block image (B1) × w1) + (pixel value of the second block image (B2) × w2) + (pixel value of the third block image (B3) × w3)].

[0062] In one embodiment, a stitching target image is generated by applying a fusion method as shown in FIG. 4 to other FOVs following the first FOV, and the image generating unit (50) generates the first to nth stitching target images (I) in the FOVs for a predetermined area or all areas for generating a digital slide image. 1f ~ I nf ) can be stitched to create a digital slide image.

[0063] In the implementation of the present invention, the image generation unit (50) can generate a digital slide image according to the first mode or the second mode. In addition, the image generation unit (50) can generate a digital slide image using both the first mode and the second mode.

[0064] In one embodiment, the user may input either the first mode or the second mode into the main control unit (40) in such a way as to generate a digital slide image. In some cases, the user may set the first mode and the second mode to be used in combination to generate a digital slide image.

[0065] In one embodiment, the main control unit (40) can automatically select whether to apply the first mode or the second mode.

[0066] In one embodiment, a mark indicating application of the first mode or the second mode may be provided on the slide (1). The main control unit (40) may recognize the mark indicated on the slide (1) through the image sensor unit (30) and determine an image to be stitched for generating a digital slide image according to the first mode or the second mode. The mark may be provided on the slide (1) in the form of a character, a figure, or a two-dimensional code.

[0067] In one embodiment, the image acquisition device (10) may perform a pre-focus calculation step for a sample (3) placed on a slide (1) as a preparatory step for performing slide scanning. In the pre-focus calculation step, if the difference between focus evaluation values ​​at different focal distances in a specific FOV is within a predetermined range, a stitching target image may be generated for the FOV according to the second mode.

[0068] In one embodiment, the image acquisition device (10) can selectively use the first mode or the second mode in the process of sequentially setting the FOV for the slide and generating a stitching target image in the corresponding FOV.

[0069] FIG. 5 is a drawing exemplarily illustrating determining a stitching target image generation mode based on a pre-focus calculation result in an image acquisition device according to one embodiment of the present invention.

[0070] In Fig. 5 (a) and (b), focus evaluation values ​​are exemplarily shown according to the focal distance in a specific FOV, and the focus evaluation values ​​are given as 0 to 10.

[0071] In (a) of Fig. 5, the tissues or cells (C) within the sample (3) are widely distributed in the Z-axis direction, so that the difference between the focus evaluation value at the focus position with the highest focus evaluation value and the focus evaluation value at the focus position within a predetermined distance from the focus position with the highest focus evaluation value is not large. In other words, the difference between the focus evaluation values ​​at the focus positions within a predetermined distance from the focus position with a high focus evaluation value is within a predetermined range. This indicates that the tissues or cells (C) within the sample (3) are widely distributed in the Z-axis direction, and in this case, by applying the second mode, the cells or tissues can be displayed as much as possible in the stitching target image.

[0072] In (b) of Fig. 5, the tissue or cell (C) within the sample (3) is concentrated at a specific position in the Z-axis direction, and the difference between the focus evaluation value at the focus position with the highest focus evaluation value and the focus evaluation value at the focus position within a predetermined distance from the focus position with the highest focus evaluation value is large. In other words, the difference between the focus evaluation values ​​at the focus position within a predetermined distance from the focus position with a high focus evaluation value is outside a predetermined range. This indicates that the tissue or cell (C) within the sample (3) is concentrated at a predetermined depth in the Z-axis direction, and in this case, by applying the first mode, the image with the best focus evaluation value is determined as the stitching target image.

[0073] FIG. 6 is a drawing exemplarily illustrating determining a stitching target image generation mode while acquiring an image in an image acquisition device according to one embodiment of the present invention.

[0074] In Fig. 6, image acquisition is performed sequentially from the first FOV to the third FOV.

[0075] The first to third images (I) are captured by the first to third image sensor units (32, 34, 36) in the first FOV. 11 , I 12 , I 13 ) are acquired, and a focus evaluation value is calculated for each image. Image 1-2 (I 12 ) has a focus evaluation value of 10, and the 1-1 image (I 11 ) and the 1-3rd video (I 13 ) are 8.5 and 8.0, respectively. If the difference in focus evaluation values ​​between images is greater than or equal to a predetermined value (e.g., greater than or equal to 1.0), the first mode is applied to determine the image with the highest focus evaluation value as the stitching target image. Accordingly, in the first FOV, the first stitching target image (I 1s ) is determined as the stitching target image for the digital slide image.

[0076] The 2nd FOV, the 2nd to 2nd-3rd images (I) are captured by the 1st to 3rd image sensor units (32, 34, 36). 21 , I 22 , I 23 ) is acquired, and a focus evaluation value is calculated for each image. Image 2-2 (I 22 ) has a focus evaluation value of 9.7, and the 2-1 image (I 21 ) and the 2nd-3rd video (I 23 ) are 9.0 and 9.5, respectively. If the difference in the focus evaluation values ​​between the images is less than a predetermined value (e.g., less than 1.0), the stitching target block is determined by evaluating each block in a predetermined unit, and the second mode is applied to determine the stitching target image by fusing the stitching target blocks. Accordingly, in the second FOV, the second stitching target image (I 1f ) is determined as the stitching target image for the digital slide image.

[0077] 3-1 to 3-3 images (I) acquired by the 1st to 3rd image sensor units (32, 34, 36) in the 3rd FOV 31 , I 32 , I 33 ), since the difference in focus evaluation values ​​between images is large, the first mode is applied to the third stitching target image (I 3s ) is decided.

[0078] The first stitching target image (I 1s ), the second stitching target image (I 2f ) and the third stitching target image (I 3s ) can be stitched together continuously and synthesized into a digital slide image.

[0079] Figure 7 is a flowchart illustrating an image acquisition method according to one embodiment of the present invention.

[0080] An image acquisition device (10) for acquiring a slide image acquires multiple images using an image sensor unit (30) in a set FOV (S10). In one embodiment, the image sensor unit includes first to third image sensor units (32, 34, 36), and three images at different focal lengths can be acquired in one FOV.

[0081] A stitching target image generation mode is selected to generate a stitching target image to be used for image stitching for multiple images acquired from the corresponding FOV (S20). The stitching target image generation mode may be selected by the user or determined by the image generation unit (50) of the image acquisition device (10) based on the mark on the slide, the result of the focus evaluation value calculation of the pre-focus calculation process, and the result of the focus evaluation value according to the focal distance in each FOV.

[0082] The stitching target image generation mode may include a first mode for selecting an image with the highest focus evaluation value among multiple images in the corresponding FOV as the stitching target image, and a second mode for dividing each of the multiple images in the corresponding FOV into blocks, calculating focus evaluation values ​​for the divided block images, and merging the block images with the highest focus evaluation values ​​to select them as the stitching target images.

[0083] The image generation unit (50) of the image acquisition device (10) generates a stitching target image in the corresponding FOV according to the selected stitching target image generation mode (S30).

[0084] Stitching target images are generated from multiple FOVs, and the image generation unit (50) stitches the stitching target images from multiple FOVs to generate a digital slide image (S40).

[0085] A device according to embodiments of the present invention may include a processor, a memory for storing and executing program data, permanent storage such as a disk drive, a communication port for communicating with an external device, a user interface device such as a touch panel, a key, a button, etc. Methods implemented as software modules or algorithms may be stored on a computer-readable recording medium as computer-readable codes or program instructions executable on the processor. Here, the computer-readable recording medium includes a magnetic storage medium (e.g., read-only memory (ROM), random-access memory (RAM), floppy disk, hard disk, etc.) and an optical reading medium (e.g., CD-ROM, DVD: Digital Versatile Disc)). The computer-readable recording medium may be distributed to computer systems connected to a network, so that the computer-readable code may be stored and executed in a distributed manner. The medium may be readable by a computer, stored in a memory, and executed by a processor.

[0086] Embodiments of the present invention may be represented by functional block configurations and various processing steps. These functional blocks may be implemented by various hardware and / or software components that perform specific functions. For example, embodiments may employ integrated circuit components, such as memory, processing, logic, and look-up tables, that may perform various functions under the control of one or more microprocessors or other control devices. Similarly, embodiments may be implemented in a programming or scripting language, such as C, C++, Java, or an assembler, including various algorithms implemented as a combination of data structures, processes, routines, or other programming components. Functional aspects may be implemented as algorithms that execute on one or more processors. Furthermore, embodiments may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as "mechanism," "element," "means," and "composition" can be used broadly and are not limited to mechanical or physical structures. These terms can also encompass a series of software routines, such as those associated with a processor.

[0087] The specific implementations described in the embodiments are merely exemplary and do not limit the scope of the embodiments in any way. For the sake of brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components illustrated in the drawings are merely exemplary functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as "essential," "important," etc., a component may not be absolutely necessary for the application of the present invention.

[0088] The above description is merely an illustrative description of the technical idea of ​​the present invention, and those skilled in the art will appreciate that various modifications, changes, and substitutions may be made without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical idea of ​​the present invention, but rather to explain it, and the scope of the technical idea of ​​the present invention is not limited by these embodiments and the accompanying drawings. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within a scope equivalent thereto should be interpreted as being included in the scope of the rights of the present invention.

Claims

1. A stage on which a slide with a sample is mounted; A lens for receiving light from the above sample; A beam splitter that divides the light incident through the lens into at least two and transmits them; For each FOV (Field of View) for the sample, at least two image sensor units that acquire images of the sample at different focus positions from light transmitted from the beam splitter; and An image generation unit that generates a stitching target image using at least two of the images generated by the image sensor unit in each of the FOVs, and generates a composite image by synthesizing the stitching target images in a plurality of FOVs; Including, The image generation unit is characterized in that it includes either a first mode for selecting one of the at least two images in one of the FOVs as the stitching target image, or a second mode for dividing each of the at least two images in one of the FOVs into block images and generating the stitching target image using the block images at the same position. Slide image acquisition device.

2. In paragraph 1, A slide image acquisition device characterized in that, in the first mode, the image generation unit calculates a focus evaluation value for at least two images in each FOV and selects an image with a high focus evaluation value as the stitching target image.

3. In paragraph 1. A slide image acquisition device characterized in that, in the second mode, the image generation unit calculates a focus evaluation value for the block images at the same position in one of the FOVs, generates a stitching target block for the block images using the focus evaluation value, and generates the stitching target image by fusing the stitching target blocks in the FOV.

4. In paragraph 3, A slide image acquisition device characterized in that the image generation unit determines a block image having a high focus evaluation value among the block images as the stitching target block.

5. In paragraph 3, A slide image acquisition device characterized in that the image generation unit determines weights for the block images using the focus evaluation values ​​for the block images, and generates the stitching target block by synthesizing the block images using the weights.

6. In paragraph 1, A slide image acquisition device characterized in that whether the first mode or the second mode is applied is selected by a user or determined by a mark provided on the slide.

7. In paragraph 1, A slide image acquisition device characterized in that the image generation unit generates the stitching target image by applying the first mode to one FOV among the plurality of FOVs and applying the second mode to another FOV.

8. In paragraph 7, It includes a main control unit that controls the operation of the stage, the objective lens, the image sensor unit, and the image generation unit, The above subject control unit performs a pre-focus calculation step of calculating the focus distribution of the sample of the slide in order to obtain an image for the slide, A slide image acquisition device characterized in that, in the focus calculation step, focus evaluation values ​​at a plurality of focus positions in one of the FOVs are calculated, and whether to apply the first mode or the second mode is determined based on the difference between the focus evaluation values ​​at the plurality of focus positions.

9. In paragraph 8, When the difference between the focus evaluation value at a focus position at a predetermined distance from the focus position having the highest focus evaluation value in the above FOV and the highest focus evaluation value is within a predetermined range, the second mode is applied. A slide image acquisition device characterized in that the first mode is applied when the difference between the focus evaluation value at a focus position at a predetermined distance from the focus position having the highest focus evaluation value and the highest focus evaluation value is outside a predetermined range.

10. In paragraph 7, The above image generation unit, Calculate a focus evaluation value for a plurality of images having different focus positions obtained from any one of the plurality of FOVs, A slide image acquisition device characterized in that the second mode is applied when the difference in the focus evaluation values ​​of the plurality of images is within a predetermined range, and the first mode is applied when the difference in the focus evaluation values ​​of the plurality of images is outside the predetermined range, thereby generating the stitching target image.

11. A method for acquiring a slide image, which generates a digital slide image by synthesizing images acquired from multiple FOVs (Field of View) for a sample mounted on a slide, (a) a step in which the image generation unit receives multiple images at different focus positions for each of the FOVs; (b) a step in which the image generation unit generates a stitching target image for each FOV using the plurality of images for each FOV; and (c) a step in which the image generation unit synthesizes the stitching target images to generate the digital slide image; Including, A slide image acquisition method characterized in that, in the step (b), the image generation unit generates the stitching target image according to either a first mode for selecting any one of the plurality of images in any one of the FOVs as the stitching target image, or a second mode for dividing each of the plurality of images in any one of the FOVs into block images and generating the stitching target image using block images at the same position.

12. In paragraph 11, A slide image acquisition method characterized in that, in the first mode, the image generation unit calculates a focus evaluation value for at least two images in each FOV and selects an image with a high focus evaluation value as the stitching target image.

13. In paragraph 11. A slide image acquisition method characterized in that, in the second mode, the image generation unit calculates a focus evaluation value for the block images at the same position in one of the FOVs, generates a stitching target block for the block images using the focus evaluation value, and generates the stitching target image by fusing the stitching target blocks in the FOV.

14. In paragraph 13, A slide image acquisition method characterized in that the image generation unit determines a block image having a high focus evaluation value among the block images as the stitching target block.

15. In paragraph 13, A slide image acquisition method characterized in that the image generation unit determines weights for the block images using the focus evaluation values ​​for the block images, and generates the stitching target block by synthesizing the block images using the weights.

16. In paragraph 11, Before the above step (a), a pre-focus calculation step is performed to calculate the focus distribution of the sample of the slide in order to acquire an image for the slide, In the above focus calculation step, focus evaluation values ​​are calculated at multiple focus positions in one of the above FOVs, A slide image acquisition method characterized in that, in the step (b), whether to apply the first mode or the second mode is determined based on the difference in the focus evaluation values ​​at the plurality of focus positions.

17. In paragraph 16, When the difference between the focus evaluation value at a focus position at a predetermined distance from the focus position having the highest focus evaluation value in the above FOV and the highest focus evaluation value is within a predetermined range, the second mode is applied. A slide image acquisition method characterized in that the first mode is applied when the difference between the focus evaluation value at a focus position at a predetermined distance from the focus position having the highest focus evaluation value and the highest focus evaluation value is outside a predetermined range.

18. In paragraph 11, In step (b) above, The above image generation unit, Calculate a focus evaluation value for a plurality of images having different focus positions obtained from any one of the plurality of FOVs, A slide image acquisition method characterized in that the second mode is applied when the difference in the focus evaluation values ​​of the plurality of images is within a predetermined range, and the first mode is applied when the difference in the focus evaluation values ​​of the plurality of images is outside the predetermined range, thereby generating the stitching target image.

Images