Slide scanning device and method of operation thereof

Abstract

One embodiment of the present disclosure provides a slide scanning device that may include a slide tray slot for receiving one or more slide trays, a fork for transporting the slide trays, a preview camera for capturing a preview image of the slide trays, and an optical device for capturing a scan image of one or more slides placed on the slide trays.

Description

[Technical Field]

[0001] FIELD OF THE DISCLOSURE The present disclosure relates to slide scanning devices and methods of operation thereof. [Background technology]

[0002] The Department of Pathology observes and analyzes morphological changes in a patient's cells, tissues, and tissue fluids to provide a basis for clinical doctors' treatment direction by making diagnoses. Previously, cytological or histological examinations in the Department of Pathology were typically performed by specialists who used the naked eye to interpret and diagnose the patient's cell or tissue slides under a microscope. However, with the recent introduction of digital slide scanners into pathological diagnosis, pathological diagnoses are now being performed using digital images of scanned cell-stained or tissue-stained slides in addition to pathological diagnoses using a microscope.

[0003] Slides containing patient specimens are placed in a tray, the slide tray is placed in a slide tray slot, and the slide tray placed in the slide tray slot is scanned using a digital slide scanner or the like. By performing the scan, information about the slides placed in the slide tray can be obtained and a pathological diagnosis can be performed.

[0004] In order to obtain more slide information in a short time, much research has been conducted into automating slide scanning devices. Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure seeks to provide an automated slide scanning device. [Means for solving the problem]

[0006] One embodiment of the present disclosure seeks to provide an automated slide scanning device and a slide scanning method using the same.

[0007] A slide scanning device according to an embodiment of the present disclosure includes: a slide tray slot for receiving one or more slide trays; a fork for carrying the slide tray; a preview camera for capturing a preview image of the slide tray; an optical device for acquiring a scanned image of one or more slides placed in the slide tray; may include:

[0008] In one embodiment, the fork comprises: The slide tray accommodated in the slide tray slot may be extracted and moved to at least one of a position where the preview image can be obtained and a position where the scan image can be obtained.

[0009] In one embodiment, the scanned images for the one or more slides include: It may be acquired after the preview image is acquired.

[0010] In one embodiment, the slide scanning device comprises: a shuttle disposed at a position corresponding to the optical device; The shuttle It may be moved in the xy plane to acquire scanned images of the one or more slides.

[0011] In one embodiment, the optical device comprises: It includes a scan camera, a lens barrel, a z-axis transport unit, and an objective lens, The objective lens is The z-axis translation unit may be adapted to move in the z-axis according to an autofocus algorithm.

[0012] In one embodiment, the slide scanning device comprises: The display and a memory for storing one or more instructions; and at least one processor to execute the one or more instructions stored in the memory; The at least one processor executes the one or more instructions to: The display may be controlled to output an image for at least one of the preview image and scanned images of the one or more slides.

[0013] In one embodiment, the display comprises: It may be provided on the door of the slide scanning device.

[0014] In one embodiment, the door comprises: It may be slidably installed.

[0015] One embodiment of the present disclosure is a slide scanning method for the slide scanning device, comprising: obtaining a scan request for a first slide tray; the fork transporting the first slide tray accommodated in the slide tray slot to a position where a preview image can be acquired; the preview camera capturing a preview image of the first slide tray; the fork transporting the first slide tray to a position where a scan image can be acquired; and wherein the optical device acquires a scanned image of one or more slides placed in the first slide tray.

[0016] In one embodiment, the step of the fork transporting the first slide tray to a position where a scan image can be acquired comprises: The fork may transfer the first slide tray to a shuttle.

[0017] In one embodiment, the step of the optical device acquiring a scan image of one or more slides placed in the first slide tray comprises: (a) extracting a region of interest (ROI) from a first slide; (b) performing image autofocusing (IAF) at a first point of the ROI to determine a reference focus position (RFP); (c) performing laser autofocusing (LAF) at a second point of the ROI based on the determined RFP; (d) repeating step (c) for the entire ROI of the first slide to obtain a scan image for the ROI of the first slide. In one embodiment, the first point may be a point in the ROI determined as a point where a sample is present.

[0018] In one embodiment, the first point may be determined by the autofocus device as a centroid point of the sample or a center point of the ROI.

[0019] In one embodiment, the scan image acquisition step may further include the steps of identifying a centroid of the sample, determining whether a sample is present at the centroid, and if a sample is determined not to be present at the centroid, determining a point where a sample is present that is closest to the centroid as the first point.

[0020] In one embodiment, the scan image acquisition step may further include the steps of identifying the coordinates of the center point of the ROI, determining whether a sample is present at the center point of the ROI, and if it is determined that a sample is not present at the center point of the ROI, determining the point where a sample is present that is closest to the center point of the ROI as the first point.

[0021] In one embodiment, the RFP may be determined based on the peak level of the laser reflected from the upper surface of a cover glass, the lower surface of the cover glass, the upper surface of a glass slide, or the lower surface of the glass slide.

[0022] An embodiment of the present disclosure includes a program stored on a recording medium for causing a computer to perform a method according to an embodiment of the present disclosure.

[0023] An embodiment of the present disclosure includes a computer-readable recording medium having a program recorded thereon for causing a computer to perform a method according to an embodiment of the present disclosure.

[0024] An embodiment of the present disclosure includes a computer-readable recording medium having recorded thereon a database used in an embodiment of the present disclosure. [Effects of the Invention]

[0025] According to one embodiment of the present disclosure, scan information for a large number of slides can be obtained quickly and easily. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is an exemplary diagram of a slide scanning device according to an embodiment of the present disclosure. [Figure 2] 1 is a diagram illustrating the internal configuration of a slide scanning device according to an embodiment of the present disclosure. [Figure 3] 1 is an exemplary diagram of a slide scanning device capturing a preview image according to an embodiment of the present disclosure. [Figure 4] 10A-10C are diagrams illustrating a method for inserting or removing a slide tray from a slide tray slot according to one embodiment of the present disclosure. [Figure 5] 1 is a diagram illustrating a state in which a slide tray according to an embodiment of the present disclosure is transferred to a shuttle. [Figure 6] 1 is a diagram illustrating a method for acquiring a scan image according to an embodiment of the present disclosure. [Figure 7a]1 is a diagram illustrating a method for determining a reference focal position (RFP) according to an embodiment of the present disclosure. [Figure 7b] 10 is an example graph of peak information according to an embodiment of the present disclosure. [Figure 8] 1 is a diagram illustrating a camera module that performs an autofocus procedure according to an embodiment of the present disclosure. [Figure 9] 1 is a flowchart of a method for scanning a slide by a slide scanning device according to one embodiment of the present disclosure. [Figure 10] FIG. 1 is a block diagram of a slide scanning device according to an embodiment of the present disclosure. [Figure 11] 1 is an exemplary diagram of a slide scanning device according to an embodiment of the present disclosure. [Figure 12] 1 is a diagram illustrating a slide tray according to one embodiment of the present disclosure. [Figure 13] 1 is a diagram illustrating a slide according to one embodiment of the present disclosure. [Figure 14] 1 is a diagram illustrating a slide scanning device according to an embodiment of the present disclosure. [Figure 15] 1 is a diagram illustrating a method for extracting a Region Of Interest (ROI) according to an embodiment of the present disclosure. [Figure 16] 1 is a flowchart illustrating a method for scanning an ROI according to an embodiment of the present disclosure. [Figure 17a] 1 is a diagram illustrating a method for determining a first point for performing passive autofocus according to an embodiment of the present disclosure. [Figure 17b] 1 is a diagram illustrating a method for determining a first point for performing passive autofocus according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0027] To clarify the technical concept of the present disclosure, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. When describing the present disclosure, detailed descriptions of related known functions or components will be omitted if it is determined that such descriptions may unnecessarily obscure the gist of the present disclosure. Components having substantially the same functional configurations among the drawings are given the same reference numerals and symbols whenever possible, even if they appear in different drawings. For ease of description, apparatuses and methods will be described together when necessary. Operations in the present disclosure do not necessarily have to be performed in the order described, but may be performed in parallel, selectively, or individually.

[0028] The terms used in the embodiments of the present disclosure are currently commonly used and general terms that have been selected as much as possible in consideration of the functionality of the present disclosure, but these terms may change depending on the intentions or precedents of engineers in the field, the emergence of new technologies, etc. In addition, in certain cases, the applicant may arbitrarily select terms, and in such cases, the meanings of these terms will be described in detail in the description of the embodiments. Therefore, the terms used in this specification should be defined based on the meanings of the terms and the overall content of the present disclosure, rather than simply by the names of the terms.

[0029] Throughout this disclosure, singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms such as "comprise" or "have" are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof, and should be understood as not precluding the presence or possibility of addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof. In other words, throughout this disclosure, when a part "comprises" a certain component, this does not mean that it excludes other components, but that it may further include other components, unless otherwise specified.

[0030] A phrase such as "at least one" modifies the entire list of members, and not each member of the list individually. For example, "at least one of A, B, and C" and "at least one of A, B, or C" refer to exactly A, exactly B, exactly C, both A and B, both B and C, both A and C, both A, B, and C, or any combination thereof.

[0031] Furthermore, terms such as "... unit" and "... module" used in this disclosure refer to a unit that processes at least one function or operation, which can be realized in hardware or software, or a combination of hardware and software.

[0032] Throughout this disclosure, when a part is said to be "connected" to another part, this includes not only when it is "directly connected" to another part, but also when it is "electrically connected" via another element in between. Furthermore, when a part is said to "include" a certain component, this does not mean that it excludes other components, but that it may further include other components, unless otherwise specified.

[0033] As used throughout this disclosure, the phrase "configured to" may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of," depending on the context. The term "configured to" does not necessarily mean "specifically designed to" hardware. Instead, in some contexts, the phrase "a system configured to" may mean that the system, together with other devices or components, is "capable of." For example, the phrase "a processor configured to perform A, B, and C" may refer to either a dedicated processor for performing the operations (e.g., an embedded processor) or a general-purpose processor (e.g., a CPU or application processor) that can perform the operations by executing one or more software programs stored in memory.

[0034] Terms including ordinal numbers, such as first, second, etc., are used to describe various components, but the components are not limited by the terms. Terms are used only to distinguish one component from another. For example, a first component may be designated as a second component, and similarly, a second component may be designated as a first component, without departing from the scope of the present invention. The term "and / or" includes a combination of multiple related items or any item among multiple related items.

[0035] Throughout this disclosure, a slide refers to a thin, flat piece of glass used to fix a specimen, and may include, but is not limited to, a glass slide, a glass slide, a specimen slide, a microscope slide, a glass slide on which a specimen is placed and then covered with a cover glass, etc.

[0036] Throughout this disclosure, a slide tray is a case for transporting or storing slides, and may also be referred to as a tray, glass plate, slide plate, slide holder, glass holder, slide case, glass case, slide folder, glass folder, etc.

[0037] The term "specimen" as used herein is used interchangeably with "sample" and may include anything known in the art that can be observed with an optical or light microscope. For example, a "specimen" may include, but is not limited to, cells or tissues (e.g., cells or tissues of animals, plants, fungi, protozoa, bacteria, and the like, including all normal or pathological cells / tissues), cell components (e.g., nuclei, cytoplasm, chloroplasts, mitochondria, etc.), microorganisms (e.g., bacteria, protozoa, some birds, and fungi, etc.), organoids, etc.

[0038] As used in this disclosure, the term "about" means within 10%, preferably within 5%, and more preferably within 1% of a given value or range.

[0039] FIG. 1 is an exemplary diagram of a slide scanning device according to an embodiment of the present disclosure.

[0040] 1, slide scanning device 100 may include a door 110. In one embodiment, door 110 may include a display 120 and a handle 130. For example, display 120 may include a touch monitor or a touch screen. Alternatively, display 120 may be fixed to a bracket, which may function as the door. In one embodiment, door 110 may be slidably installed.

[0041] In one embodiment, the information displayed on the display 120 may be designed to change depending on whether the door 110 is in a fully open state, an open state, or a closed state. That is, the slide scanning device 100 may identify at least one of the closed state, open state, and fully open state of the door 110 and control the display 120 to output a user interface (UI) corresponding to the door state based on the door state. For example, when the door 110 is in an open or fully open state, the slide scanning device may be controlled to disable scanning operations because the slide tray may be exposed to the outside or safety may be compromised due to equipment movement. Thus, when the door 110 is in an open or fully open state, information indicating that a slide scanning process is impossible due to the open state of the door may be displayed on the display 120.

[0042] According to one embodiment, unlike conventional equipment that provides slide scan information on a separate monitor and requires a large installation space, a slide scanning device can be provided in which the monitor is integrated in the form of a door, allowing for miniaturization.

[0043] FIG. 2 is a diagram illustrating the internal configuration of a slide scanning device according to an embodiment of the present disclosure.

[0044] 2, slide scanning device 100 may include a slide tray slot 210 for receiving one or more slide trays 260 therein, a fork 220 for carrying the slide tray, a fork support 270 to which the fork 220 is slidably connected so that the fork 220 can move up and down, a preview camera 230 for acquiring a preview image of the slide tray, an optical device 240 for acquiring a scanned image of one or more slides placed in the slide tray, a shuttle 250 disposed at a position corresponding to the optical device for acquiring the scanned image and moving in the xy plane according to a predetermined algorithm during slide scanning, and an illumination unit 280. However, none of the components illustrated in FIG. 2 are essential components of slide scanning device 100. Slide scanning device 100 may be realized with more or fewer components than those illustrated in FIG. 2.

[0045] In one embodiment, slide tray slot 210 is a device for storing slide trays and may be referred to as a slide tray storage cabinet, slide tray cabinet, slide tray storage cabinet, slide tray rack, etc. Slide tray slot 210 may include multiple slide tray storage sections arranged in a vertical stack.

[0046] In one embodiment, the fork 220 can remove the slide tray 260 accommodated in the slide tray slot 210 and transport it to a position where a preview image can be acquired. Furthermore, once the preview image has been acquired, the fork 220 can further accommodate the slide tray 260 in the slide tray accommodating portion of the slide tray slot 210.

[0047] In one embodiment, the fork 220 can remove the slide tray 260 accommodated in the slide tray slot 210 and transport it to a position where a scan image of the slide can be acquired. After the scan image has been acquired, the fork 220 can further accommodate the slide tray 260 in the slide tray accommodation portion of the slide tray slot 210.

[0048] In one embodiment, the slide scanning device 100 can acquire a preview image of the slide tray 260, recognize information about the slide tray, slide, or pathology sample from the preview image, acquire a slide scan image based on the information, and store the slide scan image in association with the information about the slide tray, slide, or pathology sample. That is, the scan image of the slide can be acquired after the preview image is acquired. That is, the slide scanning device 100 can acquire a preview image by using the preview camera 230 to photograph the slide tray 260, which has been moved by the fork 220 to a position where a preview image can be acquired, and then acquire the scan image after moving the slide tray 260 by the fork 220 to a position where a scan image can be acquired.

[0049] In one embodiment, with slide tray 260 placed on fork 220, preview images of multiple slides can be acquired using preview camera 230, and scanned images of the pathology samples contained on each slide can be acquired using optical device 240.

[0050] In one embodiment, fork 220 can transport slide tray 260 to a position where a preview image can be acquired by preview camera 230, and after acquiring the preview image, fork 220 can further transport slide tray 260 to a position where an image of the pathology sample can be acquired using optical device 240. In another embodiment, a first fork can transport slide tray 260 to a position where a preview image can be acquired by preview camera 230, and after acquiring the preview image, a second fork (separate from the first fork) can transport slide tray 260 to a position where an image of the pathology sample can be acquired using optical device 240.

[0051] In one embodiment, preview camera 230 can capture preview images of multiple slides placed on fork 220. For example, preview camera 230 can capture an image of the entire slide tray 260 as the preview image. As another example, preview camera 230 can capture an image of only a portion of the slides placed on slide tray 260 as the preview image.

[0052] In one embodiment, the fork 220 can be positioned a predetermined distance away from the preview camera 230 so that the preview camera 230 can capture preview images for multiple slides. That is, for example, the fork 220 can move the slide tray 260 to a predetermined position where the preview camera 230 can capture a full image of the slide tray 260. In one embodiment, the preview camera 230 can have a resolution suitable for capturing information to be derived from the preview image. For example, the preview camera 230 can be configured with a camera having a lower resolution than the optical device 240.

[0053] In one embodiment, preview camera 230 may include one or more lenses, an image sensor, and a focus control. Preview camera 230 can adjust the focus on the slide tray using the focus control and acquire an image that passes through one or more lenses from the image sensor.

[0054] In one embodiment, fork 220 can move slide tray 260 to a predetermined position so that optical device 240 can scan an area of ​​a slide. For example, fork 220 can carry slide tray 260 onto shuttle 250.

[0055] In one embodiment, the optical device 240 may acquire scan images of pathological samples contained in each slide. A specific configuration of the optical device 240 will be described in more detail below with reference to FIG. 8. In one embodiment, the optical device 240 may divide a slide into multiple regions, acquire scan images for each region, and then combine the images to acquire an image of the entire slide. For example, the optical device 240 may divide the slide into square tiles and acquire scan images for each region. As another example, the optical device 240 may divide the slide into multiple lines, acquire scan images using a line scan method, and then combine the images. As another example, the optical device 240 may acquire an image of the entire slide at once. However, the method by which the optical device 240 acquires slide images is not limited to this, and two or more of the above-mentioned methods may be combined.

[0056] In one embodiment, the optical device 240 may include one or more lenses, an image sensor, and a focus control. The optical device 240 may use the focus control to adjust the focus for each area of ​​the slide to be scanned and acquire images that pass through the one or more lenses with the image sensor. The method by which the optical device 240 acquires the scanned image will be described in more detail below with reference to FIGS. 6 to 8.

[0057] In one embodiment, fork 220 can support slide tray 260 on its upper surface. Fork 220 can include a fastening means (not shown) that can secure slide tray 260 to its upper surface. For example, fork 220 can include a means for fastening all or part of slide tray 260 vertically or horizontally.

[0058] In one embodiment, the shuttle 250 can move so that the optical device 240 can scan the next area of ​​the slide after completing scanning of one area of ​​the slide. For example, the shuttle 250 can move in the scan direction when the optical device 240 performs LAF (Laser AutoFocus). As another example, if the optical device 240 uses a line scan method, the shuttle 250 can move together with the slide tray 260 for line scanning. For example, the shuttle 250 with the slide tray 260 placed thereon can move in accordance with the line scan speed of the optical device 240.

[0059] In another embodiment, the fork 220 or shuttle 250 does not move, and the preview camera 230 or optical device 240 moves to a predetermined position to capture a preview image or slide image. For example, after the fork 220 or shuttle 250 is fixed in a predetermined position, the preview camera 230 or optical device 240 is attached to a movable arm and can be moved to a position to capture a preview image or slide scan image.

[0060] In one embodiment, slide scanning device 100 may include an illumination unit 280 for providing illumination to slide tray 260 and / or slides. Illumination unit 280 may provide illumination to the top or bottom of slide tray 260. In yet another embodiment, illumination unit 280 may provide illumination to both the top and bottom of slide tray 260.

[0061] In one embodiment, the acquired preview image or scanned image can be output to display 120 of FIG.

[0062] FIG. 3 is an exemplary diagram of a slide scanning device capturing a preview image according to one embodiment of the present disclosure.

[0063] Referring to FIG. 3, when the slide tray is positioned at a preview image capture position 300, the preview camera 230 can capture a preview image of the slide tray.

[0064] In one embodiment, when slide scanning device 100 receives a scan request for a first slide tray, it uses fork 220 to transport the first slide tray accommodated in slide tray slot 210 to position 300 where a preview image can be acquired, and acquires a preview image of the transported first slide tray using preview camera 230. Furthermore, when the acquisition of the preview image is completed, slide scanning device 100 can control fork 220 to further accommodate the first slide tray in slide tray slot 210, or control fork 220 to transport the first slide tray to position 300 where a scan image can be acquired so that a scan image can be immediately acquired.

[0065] FIG. 4 is a diagram illustrating a method for inserting or extracting a slide tray from a slide tray slot according to one embodiment of the present disclosure.

[0066] 4, a method for inserting or removing the slide tray 260 from the slide tray receiving portion of the slide tray slot 210 is illustrated. In one embodiment, the slide scanning device 100 can use the fork 220 to remove the slide tray 260 from the slide tray slot 210 when attempting to obtain a preview image, a scan image, or for other reasons.

[0067] In one embodiment, slide tray slot 210 may include multiple slide tray receptacles. For example, slide tray slot 210 may include 20 slide tray receptacles capable of accommodating slide trays. When slide scanning device 100 receives a request for extraction of a first slide tray (e.g., a request for obtaining a preview image), it identifies the slide tray receptacle in which the first slide tray is accommodated and uses fork 220 to extract the slide tray accommodated in the corresponding slide tray receptacle.

[0068] Similarly, when the slide scanning device 100 receives a storage request (e.g., a scan completion signal) for the first slide tray, it can identify the slide tray storage unit in which the first slide tray is stored and control the fork 220 to insert the first slide tray into the corresponding slide tray storage unit.

[0069] FIG. 5 is a diagram illustrating a state in which a slide tray according to one embodiment of the present disclosure is transferred to a shuttle.

[0070] Referring to FIG. 5, the slide scanning device 100 can use the fork 220 to place the slide tray on the shuttle 250 to acquire a scanned image of the slide tray. In one embodiment, the fork 220 can move in the z-axis by means of the fork support 270 to transport the slide tray. Therefore, when the slide scanning device 100 receives a request to acquire a scanned image of a slide, it can use the fork 220 to place the slide tray on the shuttle 250. For example, the lowest point to which the fork 220 can move may be the height at which the shuttle is located. After the slide tray is placed on the shuttle 250, the slide must be moved to a position corresponding to the optical device 240 and the illumination unit 280 to acquire a scanned image of the slide. Therefore, after the slide tray is placed on the shuttle 250, the shuttle 250, not the fork 220, can move in the xy plane. This will be described in more detail below with reference to FIG. 6.

[0071] FIG. 6 is a diagram illustrating a method for acquiring a scan image according to one embodiment of the present disclosure.

[0072] 6, after the slide tray is secured to the shuttle 250 by the fork 220, the slide scanning device 100 can acquire a scan image of the slide tray by controlling the shuttle 250 to move in the xy plane. In one embodiment, the scan image can be acquired after an automatic focusing process.

[0073] Autofocus methods for automatically focusing an image can be broadly divided into active and passive systems. Active systems use an external measuring device to measure the distance to the object and then adjust the focus based on this information. This method determines the focus through direct distance measurement and typically uses a laser, infrared, or ultrasonic sensor. The camera uses a physical measuring device to measure the exact distance to the object and adjusts the lens focus based on this information. A typical example is an infrared (IR)-based system called Laser AutoFocus (LAF). This method has a relatively fast response characteristic but suffers from relatively poor precision. In particular, for samples with thin transparent layers, ambiguity in the focus position can occur with a specific magnification objective lens, further reducing precision. This is because light reflected from both the top and bottom surfaces of a transparent object enters the light receiving unit and is focused on a similar position by the condenser lens.

[0074] In contrast, the passive method uses a camera to automatically focus by analyzing image data itself, without using external measuring devices (e.g., lasers, ultrasonic sensors, etc.). The objective lens, which is located a specified distance from the sample, is moved a certain distance from its current position while simultaneously capturing images of the sample using an image sensor. Image sharpness is calculated from these multiple images to determine the image sharpness for each position. The position with the highest image sharpness is the sample's focal position. Moving to the position with the highest image sharpness from the current position results in the object being in focus. While this method can accurately find the focal position, it is slow because it requires capturing and analyzing multiple images while moving a specified distance to find the focal position. A typical passive method is the Image AutoFocus (IAF) method.

[0075] Generally, the LAF method can quickly search for a reference focus position (RFP), but the initially detected RFP may not be the optimal focus position due to the influence of sample thickness or flatness. Therefore, the slide scanning device 100 according to an embodiment of the present disclosure may adopt a method in which the RFP is determined through the IAF and then the LAF is performed based on the determined RFP. This will be described in more detail below with reference to FIGS. 7a and 7b.

[0076] According to one embodiment, the optimal focal length is searched for before scanning the ROI (Region of Interest), taking into account the flatness of the instrument (e.g., feed system, tray, etc.), instrument vibration, and thickness variations of the sample within the slide, thereby enabling a more precise and faster scanning procedure.

[0077] FIG. 7a is a diagram illustrating a method for determining a reference focal position (RFP) according to an embodiment of the present disclosure, and FIG. 7b is an exemplary graph of peak information according to an embodiment of the present disclosure.

[0078] Referring to FIG. 7a, slide 750 may include a glass slide 760, which is a transparent lower plate having a thickness of approximately 1 mm, a sample placed on top of the glass slide 760, and a cover glass 770 having a thickness of approximately 0.1 to 0.2 mm, covering the sample. In one embodiment, slide scanning device 100 may determine a reference focal position (RFP) for performing LAF through IAF before scanning a region of interest (ROI) on the slide. For example, IAF may be performed to determine the z-axis position of the objective lens at which the clearest image is obtained, and then this may be determined as the RFP. In this case, since the objective lens moves together with the LAF module using a single motor (i.e., they are moved together as a focus transport unit set; this will be described in detail in FIG. 8), LAF may be performed at a point where a clear image is obtained through IAF, and the RFP may be found by measuring the peak laser level. For example, the slide scanning device 100 can detect RFP by measuring the peak level of the laser reflected by the upper surface 772 of the cover glass 770, the lower surface 774 of the cover glass 770, the upper surface 762 of the slide glass 760, and the lower surface 764 of the slide glass 760, and determining the z value of the LAF module at that time. In one embodiment, the slide scanning device 100 can detect RFP by measuring the peak level of the laser reflected by the lower surface 774 of the cover glass 770 or the upper surface 762 of the slide glass 760, which are central boundaries where the sample is located. For example, the slide scanning device 100 can measure the peak level of the laser reflected by the lower surface 774 of the cover glass 770, and determine the z value at that time as RFP.

[0079] In a more specific embodiment, the slide scanning device 100 may perform IAF at the first point 710 to determine the RFP. For example, the slide scanning device 100 may adjust the height of the objective lens at the first point 710 to acquire multiple images, and then determine the focal position for acquiring the clearest image. For example, the slide scanning device 100 may determine the first focal point 740 as the focal point for acquiring the clearest image at the first point 710, and determine the position of the objective lens or LAF module (collectively referred to as the "focus shifter set") at this time as the reference focal position (RFP). In one embodiment, the reference focal position (RFP) may be the distance between the focus shifter set and the sample to acquire the first focal point 740, or alternatively, the distance between the focus shifter set and the upper surface of the cover glass, the distance between the focus shifter set and the lower surface of the cover glass, the distance between the focus shifter set and the upper surface of the glass slide, or the distance between the focus shifter set and the lower surface of the glass slide. In one embodiment, the reference focus position (RFP) may be the distance between the focus-transfer set and the top surface of the cover slip or the distance between the focus-transfer set and the bottom surface of the slide.

[0080] In one embodiment, the slide scanning device 100 may acquire the clearest image of the first point 710 at the first focal point 740 (i.e., the image obtained by performing IAF), and determine the z position of the laser peak obtained through the laser emitting unit and the light receiving unit at the first focal point 740 as the RFP. For example, referring to Figure 7b, if the z position of the laser peak of the LAF for the first point obtained in the above example is 1350, this is determined as the RFP.

[0081] In one embodiment, once the RFP is determined at the first point 710, the slide scanning device 100, more specifically, the optical device 240, can move to a second point 720 to acquire images in other regions of the ROI and perform LAF based on the RFP. In one embodiment, the optical device 240 can move along a reference focal plane 730, which is determined under the assumption that the RFP determined by the first focal point 740 is the optimal focus position for the entire ROI. After moving to the second point 720 along the reference focal plane 730, the optical device 240 can perform LAF to adjust the z-position of the focus shifter set to coincide with the RFP and then acquire an image. By performing LAF for all regions of the ROI in the above manner, a high-quality scanned image of the ROI can be acquired.

[0082] In another embodiment, the optical device 240 may be fixed, with only the objective lens moving in the z-axis, and the slide tray may be moved by the shuttle 250, so that the optical device 240 performs LAF and scans at the second point. Similarly, the movement of the slide tray may proceed along the reference focal plane 730.

[0083] In the embodiment shown in FIG. 7b, if the RFP is determined as the z-position 1350 of the laser peak, when performing LAF at a second point, if the position of the focus shifting unit set deviates from the RFP 1350, it is adjusted to the RFP position, and this method is repeated at each point in the remaining region of the ROI to obtain a quicker and clearer image.

[0084] In one embodiment, the slide scanning device 100 can determine the center of the ROI region or the centroid of the sample to determine the first point at which to perform a passive autofocus procedure. If a sample is present at the center of the ROI region or the centroid of the sample, the slide scanning device 100 can determine that point as the first point and perform a passive autofocus procedure at the first point.

[0085] For example, the slide scanning device 100, e.g., the optical device 240, can identify the centroid of a sample in an ROI. If the centroid identifies the presence of a sample, the centroid can be determined as the first point for performing IAF. However, if no sample is present at that point, the focus position cannot be evaluated, and passive autofocusing, e.g., IAF, cannot be performed. Therefore, if no sample is present at the centroid or central region of the ROI, or if the detected sample presence area is partial, the slide scanning device 100, e.g., the optical device 240, can search for the location coordinates of the sample closest to the center coordinates or centroid coordinates of the ROI. For example, the slide scanning device 100 can identify white pixel areas in a binary image as locations where the sample is present. In one embodiment, the slide scanning device 100 can convert the location coordinates of the sample from image-based coordinates to feed-based coordinates and perform a passive autofocus procedure, such as IAF, at the corresponding coordinates.

[0086] That is, in one embodiment, the slide scanning device 100, e.g., the optical device 240, can identify the centroid of the sample, determine whether or not a sample is present at the centroid, and if a sample is present, determine that point as the first point; if a sample is not present, determine the point closest to the centroid where a sample is present as the first point.

[0087] In another embodiment, the slide scanning device 100, e.g., the optical device 240, can identify the coordinates of the center point of the ROI, determine whether a sample is present at the center point of the ROI, and if a sample is present, determine that point as the first point; if a sample is not present, determine the point closest to the center point of the ROI where a sample is present as the first point.

[0088] FIG. 8 is a diagram illustrating a camera module that performs an autofocus procedure according to one embodiment of the present disclosure.

[0089] Referring to FIG. 8 , the optical device 240 may include a scan camera 810, a lens barrel 820, a z-axis transport unit 830, and an objective lens 840. In one embodiment, the z-axis transport unit 830 includes a motor, which can be used to move the objective lens 840 in the z-axis direction. In this case, the scan camera 810 and the lens barrel 820 may be fixed and not moved in the z-axis direction. Furthermore, LAF modules 852 and 854 may be provided on both sides of the objective lens 840. For example, an LAF laser emitter 852 may be provided on the left side of the objective lens 840. When the LAF laser emitter 852 emits light, the light is reflected by the sample, the slide glass, the cover glass, etc., and the reflected light may be detected by the LAF light receiver 854. As a result, peak information such as that shown in FIG. 7 b may be acquired.

[0090] In one embodiment, the LAF modules 842 and 854 can be moved by a motor along with the objective lens 840. Thus, the objective lens 840 and the LAF modules 852 and 854 can be referred to as a focus transfer unit set 850. Also, a control unit 856 that controls the motor and the focus transfer unit set can be provided next to the objective lens.

[0091] FIG. 9 is a flowchart of a method for scanning a slide by a slide scanning device according to one embodiment of the present disclosure.

[0092] 9 , in operation 910, the slide scanning device 100 can acquire a scan request for a first slide tray. In one embodiment, the slide scanning device 100 can acquire a scan request for the first slide tray based on a user input touching the display 120. For example, the user input touching the display 120 can include a user input requesting initiation of a scan for the first slide tray, a user input requesting acquisition of a preview image for the first slide tray, a user input requesting initiation of a scan for all slide trays placed in the slide tray slots, including the first slide tray, etc.

[0093] In operation 930, the slide scanning device can use the fork to transport the first slide tray housed in the slide tray slot to a position where a preview image can be acquired. In one embodiment, the fork can move in the z-axis by the fork support 270, and the fork support 270 can move in the x-axis. This allows the fork 220 to move in the x-axis and z-axis. In one embodiment, the fork support 270 can move in the x-axis to allow the fork 220 to remove the first slide tray housed in the slide tray slot, and then the fork 220 can move in the z-axis to transport the first slide tray to a position where a preview image can be acquired.

[0094] In operation 950, the slide scanning device 100 can acquire a preview image of the first slide tray using a preview camera. In one embodiment, the slide scanning device 100 can acquire a preview image of the first slide tray and recognize information about the slide tray, slides, or pathology samples from the preview image. The information recognized from the preview image can include identification information for the first slide tray (e.g., numbers, barcodes, or QR codes), slide tray orientation information, identification information for each slide holder, information about the slides, and information about the pathology samples. The information about the slides can include whether a slide is present in each slide holder, whether the slide is damaged in each slide holder, whether the slide is properly positioned in each slide holder, and information about the region of interest in the slide where the pathology sample is present. Information about the pathology samples can also include the sample location, sample collection date, whether stained, the name of the staining reagent, and patient information corresponding to the pathology sample.

[0095] In one embodiment, the slide scanning device 100 can control the display 120 so that the acquired preview image, information acquired from the preview image, and the like are output to the display 120 .

[0096] In operation 970, the slide scanning device can use the forks to transport the first slide tray to a position where a scan image can be acquired. In one embodiment, the forks 220 can transport the first slide tray so that the first slide tray is placed on the shuttle 250.

[0097] In operation 990, the slide scanning device can acquire scanned images of one or more slides placed in the first slide tray using the optical device. In one embodiment, the optical device 240 can be synchronized with the shuttle 250 to acquire scanned images of one or more slides while moving the objective lens in the z-axis and moving the shuttle 250 in the xy plane.

[0098] FIG. 10 is a block diagram of a slide scanning device according to one embodiment of the present disclosure.

[0099] 10, slide scanning device 100 may include a transceiver 1010, an input device 1020, a memory 1030, and a processor 1040. However, none of the components illustrated in FIG. 10 are essential components of slide scanning device 100. Slide scanning device 100 may be realized with more or fewer components than those illustrated in FIG. 10. In addition, transceiver 1010, input device 1020, memory 1030, and processor 1040 may be realized in the form of a single chip.

[0100] In one embodiment, the transceiver 1010 can communicate with a slide tray slot, a user terminal, or other electronic device that is wired or wirelessly coupled to the slide scanning device 100 .

[0101] In one embodiment, the input device 1020 may include a touch display, a preview camera, a scan camera, an image capture device, or the like.

[0102] Various types of data, such as programs like applications and files, can be installed and stored in memory 1030. Processor 1040 can access and use data stored in memory 1030 or store new data in memory 1030. In one embodiment, memory 1030 may include a database. For example, the memory or database may normally store a preview image of a slide tray or a scanned image of an ROI.

[0103] The processor 1040 controls the overall operation of the slide scanning device 100 and may include at least one processor such as a CPU, a GPU, etc. The processor 1040 may control other components included in the slide scanning device 100 to perform operations for operating the slide scanning device 100. For example, the processor 1040 may execute a program stored in the memory 1030, read a stored file, or save a new file. In one embodiment, the processor 1040 executes a program stored in the memory 1030 to receive a scan request for a first slide tray, identify a slide tray receiving unit in which the first slide tray is received, control a fork to transport the first slide tray received in the slide tray slot to a position where a preview image can be acquired, control a preview camera to acquire a preview image of the first slide tray, control the fork to transport the first slide tray to a position where a scan image can be acquired, and acquire scan images of one or more slides placed in the first slide tray by moving the shuttle. In one embodiment, the processor 1040 executes a program stored in the memory 1030 to extract a region of interest (ROI) from a first slide, perform image autofocusing (IAF) at a first point of the ROI to determine a reference focus position (RFP) value, and perform laser autofocusing (LAF) based on the RFP to scan the ROI of the first slide.

[0104] An embodiment of the present disclosure may also be realized in the form of a recording medium containing computer-executable instructions, such as a program module executed by a computer. Computer-readable media may be any available medium that can be accessed by a computer, including both volatile and nonvolatile media, and both separate and non-separate media. Computer-readable media may also include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, separate and non-separate media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Communication media typically contain computer-readable instructions, data structures, or program modules and include any information transmission media.

[0105] FIG. 11 is an exemplary diagram of a slide scanning device according to an embodiment of the present disclosure.

[0106] Referring to FIG. 11, the slide scanning device 2000 acquires a preview image of the slide tray, recognizes information about the slide tray 2400, slide 2500, or pathology sample from the preview image, acquires a slide scan image based on the information, and stores the slide scan image in association with the information about the slide tray, slide, or pathology sample.

[0107] In one embodiment, slide scanning device 2000 may include preview camera 2100, scan camera 2200, and slide tray stage 2300. For example, with slide tray 2400 mounted on slide tray stage 2300, preview camera 2100 may be used to capture preview images of multiple slides, and scan camera 2200 may be used to capture images of the pathology samples contained on each slide 2500.

[0108] In one embodiment, slide tray stage 2300 can transport slide tray 2400 to a position where a preview image can be acquired by preview camera 2100, and after acquiring the preview image, slide tray stage 2300 can further transport slide tray 2400 to a position where an image of the pathology sample can be acquired by scan camera 2200. In another embodiment, a first slide tray stage 2300 can transport slide tray 2400 to a position where a preview image can be acquired by preview camera 2100, and after acquiring the preview image, slide tray 2400 can be transported to a position where a second slide tray stage (not shown, separate from first slide tray stage 2300) can acquire an image of the pathology sample by scan camera 2200.

[0109] In one embodiment, preview camera 2100 can capture preview images of multiple slides placed on slide tray stage 2300. For example, preview camera 2100 can capture an entire image of slide tray 2400 as the preview image. As another example, preview camera 2100 can capture an image of only a portion of the slides placed on slide tray 2400 as the preview image.

[0110] In one embodiment, preview camera 2100 may be positioned a predetermined distance from slide tray stage 2300 so as to capture a preview image of slide tray 2400 containing multiple slides. Preview camera 2100 may have a resolution suitable for capturing information to be derived from the preview image. For example, preview camera 2100 may be configured as a camera with a lower resolution than scan camera 2200.

[0111] In one embodiment, the preview camera 2100 may include one or more lenses, an image sensor, and a focus control. The preview camera 2100 can adjust the focus on the slide tray using the focus control and capture images that pass through the one or more lenses with the image sensor.

[0112] In one embodiment, the scan camera 2200 may acquire scan images of the pathology samples contained in each slide 2500. The scan camera 2200 may divide a slide 2500 into multiple regions, acquire scan images for each region, and then combine the images to acquire an image of the entire slide 2500. For example, the scan camera 2200 may divide the slide 2500 into square tiles and acquire scan images for each region. As another example, the scan camera 2200 may divide the slide region into multiple lines, acquire scan images using a line scan method, and then combine the images. As another example, the scan camera 2200 may acquire an image of the entire slide at once. However, the method by which the scan camera 2200 acquires an image of the slide 2500 is not limited to the above embodiment.

[0113] In one embodiment, the scan camera 2200 may include one or more lenses, an image sensor, and a focus control unit. The scan camera 2200 may use the focus control unit to adjust the focus for each area of ​​the slide to be scanned and acquire an image that passes through one or more lenses with the image sensor. In one embodiment, the scan camera 2200 may perform an autofocus process using either an active or passive autofocus method, and then scan a specific area of ​​the slide. This will be described in more detail below with reference to FIGS. 7a, 7b, and 16.

[0114] In one embodiment, slide tray stage 2300 can have slide tray 2400 mounted on its upper surface. In one embodiment, slide tray stage 2300 can have a fixing means (not shown) that can fix slide tray 2400 to its upper surface. For example, slide tray stage 2300 can have a means for fixing all or part of slide tray 2400 vertically or horizontally.

[0115] In one embodiment, slide tray stage 2300 can move slide tray 2400 to a position where preview camera 2100 or scan camera 2200 can acquire an image. For example, slide tray stage 2300 can move slide tray 2400 to a predetermined position where preview camera 2100 can acquire a full image of slide tray 2400. Slide tray stage 2300 can also move slide tray 2400 to a predetermined position so that scan camera 2200 can scan one area of ​​slide 2500. After scan camera 2200 has completed scanning one area, slide tray 2400 can be moved so that the next area can be scanned.

[0116] In another embodiment, the first slide tray stage 2300 can move the slide tray 2400 to a position where the preview camera 2100 or the scan camera 2200 can acquire an image. For example, the first slide tray stage 2300 can move the slide tray 2400 to a predetermined position where the preview camera 2100 can acquire a full image of the slide tray 2400. Thereafter, a second slide tray stage (not shown, separate from the first slide tray stage 2300) can move the slide tray 2400 to a predetermined position so that the scan camera 2200 can scan one area of ​​the slide 2500. Furthermore, the second slide tray stage (not shown) can move the slide tray 2400 so that the scan camera 2200 can scan the next area after completing scanning one area.

[0117] In one embodiment, if scan camera 2200 utilizes a line scan technique, slide tray stage 2300 can move slide tray 2400 for line scanning. For example, slide tray 2400 can be moved to match the line scan speed of scan camera 2200.

[0118] In another embodiment, slide tray stage 2300 does not move, and preview camera 2100 or scan camera 2200 can move to a predetermined position to capture a preview image or slide image. For example, slide tray stage 2300 is fixed in position, and preview camera 2100 or scan camera 2200 is attached to a movable arm and can be moved to a position to capture a preview image or slide scan image.

[0119] In one embodiment, slide scanning device 2000 may further include an illumination unit 2600 for providing illumination to slide tray 2400 and / or slide 2500. For example, as illustrated in FIG. 11 , illumination unit 2600 may provide illumination to the top surface of slide tray 2400. In another example, illumination unit 2600 may provide illumination to the bottom surface of slide tray 2400. In yet another example, illumination unit 2600 may provide illumination to both the top and bottom surfaces of slide tray 2400.

[0120] FIG. 12 is a diagram illustrating a slide tray according to one embodiment of the present disclosure.

[0121] Referring to FIG. 12, the slide scanning device 2000 can recognize information about the slide tray 2400 from the preview image acquired through the preview camera 2100.

[0122] In one embodiment, the slide tray 2400 may be comprised of a plurality of slide receiving sections 2450, each capable of receiving a slide. The slide tray 2400 may include identification information 2410, 2420 for the slide tray 2400, direction indicator information 2430, 2440 for the slide tray 2400, and identification information 2460 for each slide receiving section. For example, the identification information 2410, 2420 for the slide tray 2400 may be printed with letters or numbers, or may be included in the form of a barcode or QR code. If the identification information 2410, 2420 for the slide tray 2400 is printed with letters or numbers, it can be identified from a preview image using optical character recognition (OCR) technology. If the identification information is in the form of a barcode or QR code, it can be recognized to obtain the identification information for the corresponding slide tray 2400. The slide scanning device 2000 recognizes the identification information 2410, 2420 for the slide tray 2400 and can accurately identify the slide tray 2400 currently undergoing slide scanning.

[0123] In one embodiment, the slide scanning device 2000 can identify whether the slide tray 2400 is positioned on the slide tray stage 2300 in the preview image. For example, if a marker is placed at a predetermined position on the slide tray stage 2300 and the marker is placed in a position where it is hidden when the slide tray 2400 is placed on the slide tray stage 2300, the presence or absence of the slide tray 2400 can be easily determined based on whether the marker is recognized in the preview image. Furthermore, if the marker is placed so that the marker on the slide tray stage 2300 is hidden only when the slide tray 2400 is correctly placed, the presence or absence of the slide tray 2400 can be determined based on whether the marker is recognized in the preview image. As another example, the slide scanning device 2000 can identify the presence or absence of the slide tray 2400 based on whether the identification information 2410, 2420 for the slide tray 2400 or the direction indication information 2430, 2440 for the slide tray 2400 is recognized in the preview image.

[0124] In one embodiment, the direction indication information 2430, 2440 for the slide tray 2400 may include indications for the up / down or left / right directions and may be displayed as arrows for the corresponding directions or as a predetermined identifier in one of the specific directions. For example, referring to FIG. 12, the direction indication information 2430 for the slide tray 2400 may be displayed as an arrow representing the up / down direction of the slide tray 2400. As another example, the direction indication information 440 for the up / down and left / right directions may be displayed by displaying a predetermined identifier (e.g., a black dot in FIG. 12) in the upper left corner of the slide tray 2400. The slide scanning device 2000 may recognize the direction of the arrow in the preview image or a specific identifier at a predetermined position to recognize the direction indication information 2430, 2440 for the slide tray 2400. In one embodiment, the slide scanning device 2000 may use the direction indication information 2430, 2440 for the slide tray 2400 to recognize the direction in which the slide tray 2400 is placed on the slide tray stage 2300.

[0125] In one embodiment, the identification information 2460 for each slide receiving portion 2450 of the slide tray 2400 may be displayed as a number, the number of dots, the length of a line, etc. For example, the identification information 2460 for each slide receiving portion 2450 may be displayed as a number, and the slide scanning device 2000 may recognize the identification information 2460 for each slide receiving portion 2450 from the preview image using OCR technology. As another example, if the identification information 2460 for each slide receiving portion 2450 is expressed as a predetermined symbol such as the number of dots or the length of a line, the corresponding symbol may be recognized from the preview image to recognize the identification information for each slide receiving portion 2450.

[0126] In one embodiment, if a specific slide 2500 stored in a slide tray 2400 in a preview image is damaged or has fallen out of a slide storage unit 2450, the slide scanning device 2000 can identify the corresponding slide storage unit 2450 using the identification information 2460. For example, if the fourth slide from the left in the upper slide row is damaged, the slide scanning device 2000 can recognize the identification information 2460 of the corresponding slide storage unit 2450 and determine that the slide at position 4 is damaged.

[0127] FIG. 13 is a diagram illustrating a slide according to one embodiment of the present disclosure.

[0128] 13, the slide scanning device 2000 can recognize information about each slide 2500 accommodated in the slide tray 2400 from a preview image acquired through the preview camera 2100. In one embodiment, the slide 2500 may include an information display unit 2510 that displays information about the slide 2500 and a sample holder 2550 that holds a pathology sample. The information display unit 2510 of the slide 2500 can display information about the slide 2500 using letters, numbers, symbols, barcodes, QR codes, or the like. For example, if the information is displayed using letters and / or numbers, the information can be recognized using OCR technology; if the information is displayed using predetermined symbols, the information can be recognized using camera vision technology; and if the information is displayed as a QR code or barcode, the information can be recognized by decoding the QR code or barcode.

[0129] In one embodiment, the information description section 2510 of the slide 2500 may describe information about the patient corresponding to the slide 2500, information about the pathology sample, information about the scanning method, etc. For example, the information about the patient corresponding to the slide 2500 may include the patient's name, the patient's age, the patient's resident registration number, the patient ID (or patient number), the medical department, the name of the disease, etc. The information about the pathology sample may include the specimen site of the sample (e.g., liver tissue), whether or not it was stained, the name of the staining reagent, the time of specimen collection, etc. Furthermore, the information about the scanning method may include information about the priority of the sample (e.g., whether or not it is an emergency test), the scan resolution, the scan area, the scanning method, etc.

[0130] In one embodiment, the slide scanning device 2000 can recognize the position of the pathology sample on the corresponding slide 2500 in the preview image and determine in advance the region of interest (ROI) to be scanned by the scan camera 2200. For example, the slide scanning device 2000 can recognize the position of the pathology sample in the sample receiving portion 2550 of the slide 2500, store the position, and then have the scan camera 2200 scan the ROI to acquire an image of the pathology sample. For example, the ROI can be set as a rectangle including the pathology sample as shown in FIG. 13 or can be set along the outline of the pathology sample, depending on the scanning method.

[0131] FIG. 14 is a diagram illustrating a slide scanning device according to one embodiment of the present disclosure.

[0132] 14, slide scanning device 2000 may include a preview camera 2100, a scan camera 2200, a slide tray stage 2300, an illumination unit 2600, a processor 2710, a display unit 2720, an input unit 2730, a communication unit 2740, and a storage unit 2750. However, none of the components illustrated in FIG.

[0133] In one embodiment, the processor 2710 may be a general-purpose processor or a dedicated processor. The processor 2710 may read and execute program modules stored in the storage unit 2750. For example, the processor 2710 may control the preview camera 2100, the scan camera 2200, the slide tray stage 2300, the illumination unit 2600, etc. by executing the program modules stored in the storage unit 2750. The processor 2710 may also output the current status of the slide scanning device 2000, the progress of slide scanning, and / or a scanned slide image on the display unit 2720 by executing the program modules stored in the storage unit 2750. The processor 2710 may also transmit and receive information to and from an external device via the communication unit 2740 by executing the program modules stored in the storage unit 2750. The processor 2710 may also receive user input from the input unit 2730 by executing the program modules stored in the storage unit 2750. In one embodiment, the input unit 2730 may be configured in the form of a touch screen on the display unit 2720.

[0134] In one embodiment, the storage unit 2750 may store and execute program modules, such as an image recognition module 2810, a scanner control module 2820, and an image storage module 2830, via a processor. For example, the storage unit 2750 may be configured as a memory, an SSD, an HDD, or a combination thereof.

[0135] In one embodiment, image recognition module 2810 can recognize information about slide tray 2400, slide 2500, and / or pathology sample in the preview image acquired through preview camera 2100. For example, image recognition module 2810 can distinguish between slide tray area, slide area, information description section 2510 of the slide area, and sample receiving section 2550, extract information about slide tray 2400 from the slide tray area, extract information about the slide from each slide area, and recognize information about the corresponding pathology sample from information description section 2510 and sample receiving section 2550 of each slide area.

[0136] In one embodiment, the image recognition module 2810 may recognize information about the slide tray 2400 in the preview image. Here, the information about the slide tray 2400 may include whether the slide tray 2400 is present on the slide tray stage 2300, identification information about the slide tray 2400, orientation information about the slide tray 2400, or identification information 2460 of each slide receiving portion 2450 of the slide tray 2400. For example, whether the slide tray 2400 is present on the slide tray stage 2300 (which is hidden when the slide tray 2400 is placed in the correct position) can be determined by whether a sign located on the top surface of the slide tray stage 2300 is recognized. For example, the identification information about the slide tray 2400, orientation information about the slide tray 2400, or identification information 2460 of each slide receiving portion 2450 of the slide tray 2400 can be recognized by letters, numbers, symbols, barcodes, or QR codes displayed on the top surface of the slide tray 2400.

[0137] In one embodiment, the image recognition module 2810 can recognize information about the slide 2500 in the preview image. Here, the information about the slide 2500 can include information about whether the slide 2500 is present in each slide holder 2450, whether the slide 2500 is damaged in each slide holder 2450, whether the slide 2500 is properly positioned in each slide holder 2450, and information about a region of interest in which a pathological sample is present in the slide 2500. For example, the presence or absence of the slide 2500 in each slide holder 2450, whether it is damaged, and whether it is properly positioned can be obtained through analysis of the preview image, and a specific mark can be added to a predetermined position on each slide holder and / or slide for convenient image analysis. For example, information about a region of interest in which a pathological sample is present in the slide 2500 can be obtained by recognizing the outline of the pathological sample in the sample holder 2550 of each slide 2500 and setting the outline as a region of interest.

[0138] In one embodiment, the image recognition module 2810 can recognize information about the pathology sample in the preview image. Here, the information about the pathology sample can include the sample location of the pathology sample, the time of sample collection, whether or not it was stained, the name of the staining reagent, or patient information corresponding to the pathology sample. In addition, the patient information corresponding to the pathology sample can include the patient's name, patient age, patient resident registration number, patient number, patient department, or patient disease name. In one embodiment, the information about the pathology sample can include information about the priority of the pathology sample, scan resolution, scan area, or scan method. For example, information about the pathology tissue (or pathology sample) can be obtained by recognizing letters, numbers, symbols, barcodes, or QR codes written in the information writing section 2510 of each slide 2500.

[0139] In one embodiment, scanner control module 2820 controls preview camera 2100 to acquire a preview image, and controls slide scanning device 2000 to acquire a scanned image of the pathological sample using information about slide tray 2400, slide 2500, and / or pathological sample recognized by image recognition module 2810. For example, scanner control module 2820 can control scan camera 2200, slide tray stage 2300, and illumination unit 2600 to acquire a scanned image using information about slide tray 2400, slide 2500, and / or pathological sample.

[0140] In one embodiment, the scanner control module 2820 determines the lens magnification, scan resolution, size of the scan area, scan method, illumination intensity and illumination method of the illumination unit 2600, etc. of the scan camera 2200, taking into consideration the name of the patient's disease corresponding to the pathology sample, the name of the biological tissue of the pathology sample, whether or not it is stained, the name of the staining reagent, the time of specimen collection, etc., and controls the slide scanning device 2000 based on the determined information. In another embodiment, the scanner control module 2820 controls the slide scanning device 2000 based on information on the scan method (e.g., priority, scan resolution, scan area, scan method, etc.) recognized by the image recognition module 2810 in the information description unit 2510 of the slide 2500.

[0141] In one embodiment, the scanner control module 2820 can provide the user with preview images along with information about the slide tray 2400, slides 2500, and / or pathology samples, and can obtain user input regarding slide scanning selections from the user. In this case, the scanner control module 2820 can control slide scanning based on the user's selections. For example, the user can select to perform scanning only on some slides contained in the slide tray. As another example, the user can select to perform scanning preferentially on specific slides contained in the slide tray. As another example, the user can select a scanning method for specific slides.

[0142] In one embodiment, the image storage module 2830 may store the scanned image obtained by the scanner control module 2820 in association with information about the pathology sample obtained by the image recognition module 2810. For example, the image storage module 2830 may store the scanned image including, as macro information, the patient's name, the patient's age, the patient's resident registration number, the patient ID (or patient number), the medical department, the name of the disease, etc., obtained by the image recognition module 2810. For example, the image storage module 2830 may store the scanned image including, as macro information, the name of the biological tissue of the sample (e.g., liver tissue), whether or not it was stained, the name of the staining reagent, the time of specimen collection, etc., obtained by the image recognition module 2810. For example, the image storage module 2830 may store the scanned image including, as macro information, the priority (e.g., whether or not an emergency test is performed), the scan resolution, the scan area, the scan method, etc., obtained by the image recognition module 2810.

[0143] In one embodiment, the image storage module 2830 can store the corresponding scanned image by including, as macro information, the scan resolution, scan area, scan method, etc. used in the process of obtaining the corresponding scanned image in the scanner control module 2820.

[0144] In one embodiment, the image storage module 2830 may transmit the scanned image obtained by the scanner control module 2820 to an external device using the communication unit 2740 based on the information on the pathology sample obtained by the image recognition module 2810. For example, if the information on the pathology sample indicates that the pathology sample is a target for urgent testing, the image storage module 2830 may transmit the scanned image of the pathology sample in association with the information on the pathology sample to an external device. As a result, medical personnel who have requested urgent testing may be given priority in receiving images of the pathology sample.

[0145] FIG. 15 is a diagram illustrating a method for extracting a region of interest (ROI) according to one embodiment of the present disclosure.

[0146] 15, the slide scanning device 2000 may perform a process of acquiring a preview image to determine an ROI region for actual scanning from among slides placed on a slide tray. In one embodiment, the slide scanning device 2000 may capture an image of the entire slide tray using a preview camera 2100.

[0147] In one embodiment, the slide scanning device 2000 can correct the preview image acquired using the preview camera 2100 through a camera-based perspective transformation and lens distortion correction process. Furthermore, the slide scanning device 2000 can extract an image for each slide positioned in a slide tray based on the corrected image. For example, each slide image in the corrected preview image can be cropped.

[0148] In one embodiment, the slide scanning device 2000 can extract the outline and ROI region of the sample by recognizing the background and sample portions of each extracted slide image. For example, the slide scanning device 2000 can extract the outline and ROI region of the sample by using the color and brightness difference between the background and sample portions of each slide image.

[0149] In one embodiment, the slide scanning device 2000 can convert image reference coordinates for the extracted ROI region into feed-system reference coordinates. The converted feed-system reference coordinates can be used by the slide scanning device 2000 to perform autofocus and scan. The method by which the slide scanning device 2000 performs autofocus and scan will be described in more detail below with reference to Figures 7a-7b and 16-17b.

[0150] FIG. 16 is a flowchart illustrating a method for scanning an ROI according to one embodiment of the present disclosure.

[0151] 16, the slide scanning device 2000 may perform steps 610 through 670. However, the slide scanning device 2000 performing steps 610 through 670 includes detailed devices included in the slide scanning device 2000 but not specifically mentioned herein performing steps 610 through 670. Although steps 610 through 670 are described as being performed by the slide scanning device 2000 in FIG. 16, steps 610 through 670 may also be performed by other devices external to the slide scanning device 2000. Furthermore, although an embodiment of the present disclosure is described using an example in which the slide scanning device 2000 performs steps 610 through 670, steps 610 through 670 may be performed by detailed devices included in the slide scanning device 2000 or by an external device. For example, steps 610 through 670 may be performed by an autofocus device included in the slide scanning device 2000, or by an autofocus device external to the slide scanning device 2000.

[0152] In step 610, the slide scanning device 2000 can extract an ROI from the first slide. In one embodiment, the method for extracting an ROI from the first slide can be described above with reference to FIG. 15. For example, the slide scanning device 2000 can acquire an image of the slide tray through a preview camera, perform perspective transformation and lens distortion correction on the slide tray image according to the installation of the preview camera, extract individual images from the corrected image, and extract the outline of the sample and the ROI region using color differences, brightness differences, etc. between the background and the sample portion of each individual image. In this way, the ROI of the first slide can also be acquired.

[0153] In step 630, the slide scanning device 2000 may perform a passive autofocus procedure at a first point of the extracted ROI to determine a reference focus position (RFP). For example, a passive autofocus procedure may include an image autofocus (IAF) procedure. The IAF procedure adjusts the positions of the object and the lens to select the best-focused image from among multiple images acquired. The IAF method searches for a focal plane based on image data actually input to the camera, so it is possible to more accurately search for the optimal focal plane than laser autofocus (LAF) and perform a precise autofocus procedure. However, the IAF method requires a long LAF comparison time. Therefore, performing the IAF autofocus procedure at all points may be inefficient.

[0154] In one embodiment, the first point may be a point in the ROI where a sample is present. For example, the slide scanning device 2000 may determine the center of the ROI or the centroid of the sample as the first point. If a sample is not present at the center of the ROI or the centroid of the sample, the slide scanning device may determine another point where a sample is present as the first point. This will be described in more detail below with reference to FIG. 17b.

[0155] In one embodiment, the slide scanning device 2000 can search for a focus position based on image data input to a real camera and determine a reference focus position (RFP) corresponding to the searched focus position. Here, the reference focus position (RFP) generally refers to a focus position that serves as a reference when performing LAF, and is a focus position that is searched for by measuring the intensity level or peak of a laser reflected from an interface through an LAF laser module. The reference focus position (RFP) will be described in more detail below with reference to Figures 7a and 7b.

[0156] In step 650, the slide scanning device 2000 may perform an active autofocus procedure (e.g., LAF) using a reference focal position (RFP) as a reference. In one embodiment, the slide scanning device 2000 may perform LAF using the reference focal position (RFP) determined as a first point. For example, once the RFP is determined at the first point, the slide scanning device 2000 may be moved to a second point, and an LAF may be performed at the second point using the RFP as a reference to acquire an image.

[0157] In step 670, the slide scanning device 2000 repeats step 650 to repeatedly perform LAF for each point of the entire ROI of the first slide and obtain a scanned image for the ROI. According to one embodiment, the slide scanning device 2000 can perform a more precise focus adjustment process than by performing only an active autofocus procedure based on having performed a passive autofocus procedure at the first point, and can perform an active autofocus procedure based on a previously determined RFP for areas other than the first point or all areas including the first point, thereby enabling faster scanning than by performing only a passive autofocus procedure.

[0158] FIG. 17a is a diagram illustrating a method for determining a first point for performing passive autofocus according to one embodiment of the present disclosure.

[0159] 17a, slide scanning device 2000 can determine the center of an ROI region or the centroid of a sample to determine the first point at which to perform a passive autofocus procedure. If a sample is present at the center of an ROI region or the centroid of a sample, as shown in FIG. 17a, slide scanning device 2000 can determine the point as the first point and perform a passive autofocus procedure at the first point.

[0160] Taking the example of Figure 17a, the slide scanning device 2000, e.g., the camera module 2800, identifies the centroid of the sample in the ROI. If it is determined that a sample is present at the centroid, it can determine the centroid as the first point for performing IAF. However, if no sample is present at the centroid, focal plane evaluation is not possible, and passive autofocusing, e.g., IAF, cannot be performed. Therefore, a method for determining the first point when no sample is present at the centroid or central region of the ROI will be described in detail below with reference to Figure 17b.

[0161] FIG. 17b is a diagram illustrating a method for determining a first point for performing passive autofocus according to one embodiment of the present disclosure.

[0162] Referring to FIG. 17b, if no sample is present at the sample centroid or the center of the ROI, or if the detected sample presence area is partial, the coordinates where the actual tissue is located cannot be found using simple coordinates such as the center coordinates or centroid coordinates of the ROI. Therefore, the slide scanning device 2000, e.g., the camera module 2800, can search for the location coordinates where the sample is located closest to the center coordinates or centroid coordinates of the ROI. For example, the slide scanning device 2000 can identify white pixel areas in a binary image as locations where the sample is located. In one embodiment, the slide scanning device 2000 can convert the location coordinates where the sample is located from image-based coordinates to feed-based coordinates and perform a passive autofocus procedure, such as IAF, at the corresponding coordinates.

[0163] That is, in one embodiment, slide scanning device 2000, e.g., camera module 2800, can identify the centroid of the sample, determine whether a sample is present at the centroid, and if a sample is present, determine that point as the first point; if a sample is not present, determine the point closest to the centroid where a sample is present as the first point.

[0164] In another embodiment, the slide scanning device 2000, e.g., the camera module 2800, can identify the coordinates of the center point of the ROI, determine whether a sample is present at the center point of the ROI, and if a sample is present, determine that point as the first point; if a sample is not present, determine the point where a sample is present that is closest to the center point of the ROI as the first point.

[0165] The above description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that the present disclosure can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. Therefore, the above-described embodiments should be understood to be illustrative in all respects and not limiting. For example, each component described as a single component may be implemented in a distributed form, and similarly, components described as distributed may be implemented in a combined form.

[0166] The scope of the present disclosure is indicated by the claims that follow rather than by the above detailed description, and all modifications and variations that fall within the meaning and scope of the claims and their equivalents should be interpreted as being included within the scope of the present disclosure.

Claims

1. a slide tray slot for receiving one or more slide trays; a fork for carrying the slide tray; a preview camera for capturing a preview image of the slide tray; and an optical device for acquiring a scanned image of one or more slides placed on the slide tray.

2. The fork is 2. The slide scanning device of claim 1, wherein the slide tray accommodated in the slide tray slot is extracted and moved to at least one of a position where the preview image can be acquired and a position where the scan image can be acquired.

3. The scanned images for the one or more slides include:

2. The slide scanning device of claim 1, wherein the preview image is acquired after the preview image is acquired.

4. The slide scanning device is a shuttle disposed at a position corresponding to the optical device; The shuttle 2. The slide scanning device of claim 1, wherein the slide scanning device moves in an xy plane to acquire scan images for the one or more slides.

5. The optical device comprises: a scan camera, a lens barrel, a z-axis transport unit, and an objective lens; The objective lens is 2. The slide scanning device of claim 1, wherein the z-axis transport unit moves in the z-axis according to an autofocus algorithm.

6. The slide scanning device is The display and a memory for storing one or more instructions; at least one processor to execute the one or more instructions stored in the memory; The at least one processor executes the one or more instructions to: The slide scanning device of claim 1 , further comprising: a display configured to output an image for at least one of the preview image and the scanned image of the one or more slides.

7. The display includes:

7. The slide scanning device according to claim 6, wherein the slide scanning device is provided on a door of the slide scanning device.

8. The door is 8. The slide scanning device according to claim 7, which is slidably installed.

9. A slide scanning method for the slide scanning device according to any one of claims 1 to 8, comprising: obtaining a scan request for a first slide tray; the fork transporting the first slide tray accommodated in the slide tray slot to a position where a preview image can be acquired; the preview camera capturing a preview image of the first slide tray; the fork transporting the first slide tray to a position where a scan image can be acquired; and wherein the optical device acquires a scanned image of one or more slides disposed in the first slide tray.

10. The step of the fork transporting the first slide tray to a position where a scan image can be acquired comprises: the fork transferring the first slide tray to a shuttle.

11. The step of the optical device acquiring a scan image of one or more slides placed in the first slide tray includes: (e) extracting a region of interest (ROI) of the first slide; (f) performing image autofocusing (IAF) at a first point of the ROI to determine a reference focus position (RFP); (g) performing laser autofocusing (LAF) at a second point of the ROI based on the determined RFP; 10. The method of claim 9, further comprising: (h) repeating step (c) for the entire ROI of the first slide to obtain a scan image for the ROI of the first slide.

12. In a slide scanning device, Memory and at least one processor that executes one or more instructions stored in the memory; The at least one processor: (a) extracting a region of interest (ROI) from the first slide; (b) performing image autofocusing (IAF) at a first point of the ROI to determine a reference focus position (RFP); (c) performing laser autofocusing (LAF) at a second point of the ROI based on the determined RFP; (d) A slide scanning device that repeats step (c) for the entire ROI of the first slide to obtain a scan image for the ROI of the first slide.

13. A computer-readable program stored on a recording medium for causing a computer to perform the method according to any one of claims 9 to 11.

Images