Autoloader Axis Stall Detection

The stall detection system in digital pathology devices addresses the issue of slide damage by monitoring load resistance and stopping movement when thresholds are exceeded, ensuring safe operation and protecting fragile glass slides.

JP7579259B2Active Publication Date: 2024-11-07APERIO TECHNOLOGIES INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2021538319
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-08-06
Filing Date
2020-08-06
Publication Date
2024-11-07
Estimated Expiration
2040-08-06

AI Technical Summary

Technical Problem

Digital pathology glass slides are fragile and expensive, often getting stuck or damaged during movement between processing stations in automated equipment due to improper positioning, leading to potential breakage and operational resistance.

Method used

A stall detection system for digital pathology devices that monitors load resistance values during automated processes, comparing them to predetermined thresholds to prevent damage by stopping slide movement when excessive force is detected, and includes recovery routines to safely resume operations.

Benefits of technology

Prevents glass slide damage by detecting potential obstructions and stalls, enhancing the reliability and longevity of digital pathology equipment while protecting both the slides and mechanical components.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579259000001
    Figure 0007579259000001
  • Figure 0007579259000002
    Figure 0007579259000002
  • Figure 0007579259000003
    Figure 0007579259000003
Patent Text Reader

Abstract

A stall detection system is provided that determines whether a glass slide moving during an automated process is at risk of damage and halts movement if an unacceptable risk of damage occurs. The system includes one or more motors configured to move the glass slides (directly or indirectly). The motors are configured to generate a load resistance value. The system includes one or more processors that monitor the load resistance value of the motors during movement and compare the load resistance value to a predetermined threshold resistance value to determine the risk of damage to the glass slide. The predetermined threshold resistance value can correspond to the risk of slide breakage in response to force applied to any side of the slide, or the risk of losing control grip on a slide rack, or the risk of the motor skipping a motor step.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application No. 62 / 883,581, filed August 6, 2019, the entire disclosure of which is incorporated herein by reference as if fully set forth. Additionally, this application is related to the following applications, the entire disclosures of each of which are incorporated herein by reference as if fully set forth: International application PCT / US2016 / 053581 filed on September 23, 2016 International application PCT / US2017 / 028532 filed on April 20, 2017 International application PCT / US2018 / 063456 filed on November 30, 2018 International application PCT / US2018 / 063460 filed on November 30, 2018 International application PCT / US2018 / 063450 filed on November 30, 2018 International application PCT / US2018 / 063461 filed on November 30, 2018 International application PCT / US2018 / 062659 filed on November 27, 2018 International application PCT / US2018 / 063464 filed on November 30, 2018 International application PCT / US2018 / 054460 filed on October 4, 2018 International application PCT / US2018 / 063465 filed on November 30, 2018 International application PCT / US2018 / 054462 filed on October 4, 2018 International application PCT / US2018 / 063469 filed on November 30, 2018 International application PCT / US2018 / 054464 filed on October 4, 2018 International application PCT / US2018 / 046944 filed on August 17, 2018 International application PCT / US2018 / 054470 filed on October 4, 2018 International application PCT / US2018 / 053632 filed on September 28, 2018 International application PCT / US2018 / 053629 filed on September 28, 2018 International application PCT / US2018 / 053637 filed on September 28, 2018 International application PCT / US2018 / 062905 filed on November 28, 2018 International application PCT / US2018 / 063163 filed on November 29, 2018 International application PCT / US2017 / 068963 filed on December 29, 2017 International application PCT / US2019 / 020411 filed on March 1, 2019 U.S. Patent Application No. 29 / 631,492, filed December 29, 2017 U.S. Patent Application No. 29 / 631,495, filed December 29, 2017 U.S. Patent Application No. 29 / 631,499, filed December 29, 2017 U.S. Patent Application No. 29 / 631,501, filed December 29, 2017.

[0002] FIELD OF THEINVENTION The present invention relates generally to digital pathology machines, and more particularly to the automated processing of individual glass slides within a digital pathology machine. [Background technology]

[0003] Digital pathology is an image-based information environment enabled by computer technology that allows for the management of information generated from physical glass slides. Part of digital pathology is enabled by virtual microscopy, which involves preparing the specimen, placing it on a physical glass slide, and then scanning the specimen on the physical glass slide to create a digital slide image that can be stored, viewed, managed, and analyzed on a computer monitor. With the ability to image the entire glass slide, the field of digital pathology has exploded and is now considered one of diagnostic medicine's most promising avenues for achieving better, earlier, and cheaper diagnosis and prognosis of cancer and other important diseases.

[0004] Glass slides processed by digital pathology devices are very fragile and expensive. These glass slides need to be protected in automated digital pathology devices. In some cases, glass slides moving between a first processing station and a second processing station in the digital pathology device may be improperly positioned, jam, collide with some structure, or otherwise encounter resistance during operation, which may cause the glass slide to be damaged or broken. Therefore, what is needed is a system and method that overcomes these significant challenges found in conventional systems such as those described above. Summary of the Invention [Problem to be solved by the invention]

[0005] Thus, described herein is a stall detection system for use with a digital pathology device that is configured to determine whether a glass slide is at risk of being damaged and then disable movement within the digital pathology device to prevent damage to the glass slide.

[0006] In one embodiment, the digital slide scanning device includes a motor configured to move the glass slide during an automated process and generate a load resistance value when moving the glass slide. The digital slide scanning device also includes one or more processors configured to set a predetermined threshold resistance value, control the motor to move the glass slide during the automated process, and monitor the load resistance value during the automated process. The one or more processors are also configured to compare the load resistance value to the predetermined threshold resistance value and control the motor to stop moving the glass slide when the load resistance value exceeds the predetermined threshold resistance value.

[0007] In one embodiment, a method performed by the digital slide scanning device includes controlling a motor to move a glass slide during an automated process and determining a load resistance value of the motor while the glass slide is moving during the automated process. The method also includes comparing the load resistance value to a predetermined threshold resistance value and stopping the movement of the glass slide when the load resistance value exceeds the predetermined threshold resistance value. Other features and advantages of the present invention will become even more readily apparent to those of ordinary skill in the art after reviewing the following detailed description and accompanying drawings.

[0008] The structure and operation of the present invention can be understood from a review of the following detailed description and the accompanying drawings, in which like reference characters refer to like parts. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates a perspective view of an exemplary glass slide according to one embodiment of the present invention. [Figure 2A] FIG. 4 is a graph illustrating an exemplary stall detection threshold according to one embodiment of the present invention. [Figure 2B]1 is a flowchart illustrating an exemplary process for detecting potential obstructions in a digital pathology device, according to an embodiment of the present invention. [Figure 3A] FIG. 2 is a perspective view illustrating an exemplary motor for driving a carousel apparatus for transporting glass slides according to one embodiment of the present invention. [Figure 3B] FIG. 2 is a perspective view illustrating an exemplary motor for driving a carousel apparatus for transporting glass slides according to one embodiment of the present invention. [Figure 3C] FIG. 2 is a perspective view illustrating an exemplary motor for driving a carousel apparatus for transporting glass slides according to one embodiment of the present invention. [Figure 4A] FIG. 2 is a perspective view illustrating an exemplary motor for driving a gripper apparatus for transporting glass slides in accordance with one embodiment of the present invention. [Figure 4B] FIG. 2 is a perspective view illustrating an exemplary motor for driving a gripper apparatus for transporting glass slides in accordance with one embodiment of the present invention. [Figure 4C] FIG. 2 is a perspective view illustrating an exemplary motor for driving a gripper apparatus for transporting glass slides in accordance with one embodiment of the present invention. [Diagram 5] FIG. 2 is a perspective view illustrating an exemplary motor for driving a lift device for transporting glass slides, according to one embodiment of the present invention. [Figure 6A] FIG. 2 is a perspective view illustrating an exemplary motor driving a push-pull device for transporting glass slides, in accordance with one embodiment of the present invention. [Figure 6B] FIG. 2 is a perspective view illustrating an exemplary motor driving a push-pull device for transporting glass slides, in accordance with one embodiment of the present invention. [Figure 7] FIG. 2 is a top view illustrating an exemplary XY motor that drives a stage assembly that transports a glass slide, in accordance with one embodiment of the present invention. [Figure 8] 1 is a perspective rear view illustrating an exemplary Z motor for driving an objective lens arrangement, in accordance with one embodiment of the present invention. [Figure 9]FIG. 2 is a perspective front view illustrating an exemplary objective lens arrangement driven by a Z motor, according to an embodiment of the present invention. [Figure 10A] 5 is a block diagram illustrating an example processor-enabled device 550 that may be used in connection with various embodiments described herein. [Figure 10B] FIG. 1 is a block diagram illustrating an example line scan camera having a single linear array. [Figure 10C] FIG. 1 is a block diagram illustrating an example line scan camera having three linear arrays. [Figure 10D] FIG. 1 is a block diagram illustrating an example line scan camera having multiple linear arrays. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The embodiments disclosed herein provide a digital pathology device configured to transport a glass slide from a first point to a second point under the power of a motor, with stall detection monitoring to identify when the glass slide may potentially be damaged. After reading this description, it will be clear to one skilled in the art how the present invention can be implemented in various alternative embodiments and applications. However, while various embodiments of the present invention are described herein, it will be understood that these embodiments are presented by way of example only, and not limitation. As such, this detailed description of various alternative embodiments should not be construed as limiting the scope or breadth of the present invention, as set forth in the appended claims.

[0011] 1 is a perspective view of an exemplary glass slide 10 according to one embodiment of the present invention. In the illustrated embodiment, slide 10 includes four edges, two end surfaces 20, two side surfaces 25, and a top surface and a bottom surface 35. Glass slides such as slide 10 are very fragile and expensive. Glass slides with one or more specimens disposed thereon are very expensive.

[0012] The nature of the glass slide 10 is such that it is easily damaged or broken. In particular, application of a first force to the slide 10 from the direction of the edge 20 may damage or break the slide 10. Similarly, application of a second force to the slide 10 from the direction of the side 25 may damage or break the slide 10, and further, application of a third force to the slide 10 from the direction of the top surface 30 or bottom surface 35 may damage or break the slide 10. Importantly, the amounts of the first, second, and third forces required to damage or break the slide 10 are not equal.

[0013] FIG. 2A is a graph illustrating an exemplary stall detection threshold 50 according to one embodiment of the present invention. In the illustrated embodiment, a processor in the digital pathology device monitors signals from a motor in the digital pathology device operating to move a glass slide. The signals from the motor are analyzed to identify the occurrence of a stall situation and additionally determine the amount of force being applied by the motor in the stall situation. When the amount of force applied by the motor reaches or exceeds a threshold 50, the processor is configured to control the motor to stop applying force, thereby stopping the attempt to move the glass slide. Advantageously, the threshold is set depending on the surface of the slide to which the force is applied. Thus, the threshold for force applied to the top or bottom surface of the slide may be less than the threshold for force applied to the side of the slide, which in turn may be less than the threshold for force applied to the edge surface of the slide.

[0014] In the event that the processor controls the motor to stop applying force, a recovery routine may be employed to attempt to reset to a known state and resume movement, or the operator may be notified to intervene. In this manner, the glass slide is protected from damage or breakage, and additionally, the operator, the slide rack, as well as the motors and other moving parts within the digital pathology device are also protected in stall situations.

[0015] Advantageously, the features described above and herein enhance reliability, resilience, and safety for the operator, glass slide, specimen, and mechanical components of any digital pathology device configured to transport the glass slide from a first point to a second point under the power of a motor. The ability of a digital pathology device to identify stall conditions before a critical error occurs and then forestall a critical situation is very expensive. Furthermore, configuring a mechanical device to detect stall conditions and recover from such stall conditions to a safe and known state / position to avoid damaging or breaking expensive glass slides streamlines the workflow of the digital pathology device and enhances the reliability and life of the mechanical axes and other components.

[0016] In the illustrated embodiment, the thresholds are set with an appropriate margin to identify stall conditions before critical errors occur. Stall condition events may include a slide colliding with the stage during loading, a slide rack dislodging from the gripper fingers during transport, a user intervening in the carousel during rotation, or many other situations that potentially damage the glass slide. The thresholds for each potential stall condition are calculated by experimental force measurements that result in undesirable failures (e.g., slide breakage) during the application of force from the motor during normal operation. Setting appropriate thresholds for various movements within the digital pathology device allows for detection of stall conditions before critical errors occur.

[0017] In one embodiment, the threshold value may be an average threshold value calculated based on a number of tests and evaluations performed across a number of digital pathology devices and a number of motors. In an alternative embodiment, the threshold value may be specific to each machine and each motor. For example, individual motors, even if they are the same type of motor (e.g., same part number), may have different friction or other impediments to the operation of the motor, causing different stall condition thresholds before a critical error occurs. Thus, in one embodiment, the digital pathology device is configured to determine a stall condition threshold for each of multiple motors in the device that drive movements that may damage the glass slide.

[0018] In the illustrated embodiment, the motion profile of the object movement by the motor along a particular axis is important for the detection of a stall condition. For example, at low and high speeds, it is difficult to measure the load resistance feedback value from the motor. During acceleration and / or deceleration, the load resistance feedback value from the motor is not as reliable as at constant speed. Therefore, the thresholds for the various axis motions are optimized to successfully detect stall conditions with a sufficient margin and ensure that there are no false stops that would slow down the process or false continues that would damage or destroy the glass slide.

[0019] Additionally, stall detection may not be appropriate or desirable for all possible movements in the digital pathology device due to the mechanical design of the axis and / or due to potential collision interactions. For example, the probability of identifying a false stall condition may be higher than the probability of a critical error occurring, or higher than the probability of identifying a true stall condition. One such example is the lift axis of the digital pathology device, which has high mechanical loads and transports slides up and down while the slides in the rack are horizontal. The force required to break a slide that is horizontally placed in the rack is small compared to the mechanical loads and fluctuations of the lift axis. Therefore, in one embodiment, detection of stall conditions may not be enabled in the lift system.

[0020] Additionally, once a stall condition is identified, the next steps performed by the digital pathology device may also be important for the safe and reliable operation of the digital pathology device. For example, the digital pathology device may detect a stall condition and signal a critical error that requires operator intervention to recover. In an alternative example, the digital pathology device may detect a stall condition and automatically recover by retrying moves and resetting element positions, or performing various combinations of moves, or executing a programmed routine to perform any combination of these, as well as other possible remedial actions that allow the digital pathology device to safely recover from the detected stall condition and proceed to the next operation without operator intervention.

[0021] 2B is a flow chart illustrating an exemplary process for detecting potential obstructions in a digital pathology device, according to one embodiment of the present invention. In one embodiment, the process can be implemented in a digital pathology device, such as the device described below in connection with FIGS. 10A-10D, that includes individual motor assemblies, each including a motor and a microprocessor that drives the motor under the control of a digital pathology device processor or other controller. First, in step 95, a threshold is set. As described above, the threshold may be set according to a grand average across multiple motors and multiple devices. Alternatively, the threshold may be set for each motor of each device.

[0022] Next, in step 100, the processor of the digital pathology device controls a motor to initiate movement of an element in the digital pathology device configured to transport slides directly (e.g., if the element is a stage) or indirectly (e.g., if the element is a slide rack carousel). In one embodiment, the processor of the digital pathology device can instruct a secondary processor (e.g., a microprocessor in a motor assembly) to control the motor to initiate driving the movement. Exemplary elements configured to transport slides include, but are not limited to, a slide rack carousel device, a slide rack gripper device, a slide rack lift device, a slide push-pull device, and a slide stage device, to name just a few. An exemplary element configured to move in the presence of a glass slide and thus may damage the glass slide is an objective lens. In various embodiments, the digital pathology device can include any of a tissue processor, a tissue embedder, a microtomer, a slide stainer, a cover slipper, and a digital slide scanner.

[0023] Next, in step 105, feedback from the motor being controlled is received and analyzed by the processor. In one embodiment, the feedback analyzed is a load resistance feedback value (also referred to herein as a load resistance value) from the motor. For example, if there is a difference between the actual position of the stepper motor and the position of the stepper motor calculated by the processor, in one embodiment, some load resistance is present. In one embodiment, the motor assembly includes a microcontroller that monitors the load resistance and determines the amount of load resistance present. For example, in one embodiment, the steps shown in box 150 are performed by this microcontroller. Thus, in step 105, this microcontroller or another processor analyzes the amount of load resistance present and compares the amount of load resistance to a threshold, and in step 110 determines whether the load resistance value exceeds a predetermined threshold. Advantageously, the predetermined threshold is set slightly lower than the amount of force corresponding to the load resistance value required to damage or break the glass slide. In one embodiment, the amount of force required to damage or break the glass slide is determined in relation to the surface of the glass slide to which the force is being applied, e.g., the top surface, the bottom surface, the edge surface, or the side surface. If the load resistance value does not exceed the predetermined threshold, the processor continues to analyze the motor feedback and compare the load resistance value to the predetermined threshold.

[0024] Next, in step 115, if the load resistance value exceeds a predetermined threshold, the microcontroller or another processor identifies a stall condition, and then in step 120, the microcontroller or another processor controls the motor to stop. This advantageously protects the glass slide from damage or breakage due to excessive force applied to the glass slide. Next, in step 125, the microcontroller or another processor can optionally execute a recovery routine to attempt to alleviate the stall condition. The recovery routine may include reversing the movement of the mechanical element, attempting to start over from a known position. Additional and alternative recovery routines may be employed. Additionally, before, after, or in parallel with optional step 125, the processor can optionally notify an operator of the stall condition in step 130, so that the operator can alleviate the stall condition.

[0025] 3A-3C are perspective views of an exemplary motor 200 driving a carousel 210 apparatus transporting a glass slide 220, according to one embodiment of the present invention. In the illustrated embodiment, the carousel 210 rotates in a circular manner, and the load resistance feedback from the motor is determined by the load resistance to the circular rotation of the carousel 210. The threshold is set slightly lower than the force required to damage or break the glass slide if applied to the side of the glass slide. A recovery routine may employ reversing the circular motion of the carousel 210 and then attempting to rotate the carousel 210 in the original direction again. In one embodiment, an increasing and variable reversal distance may be employed in multiple attempts of the recovery routine. An alternative recovery routine may employ simply stopping and then retrying movement in the original direction.

[0026] 4A-4C are perspective views illustrating exemplary motors 250, 260 driving a gripper 270 device that transports glass slides 220 in a slide rack 280, according to one embodiment of the present invention. In the illustrated embodiment, the gripper 270 extends outward to grip the side of the slide rack 280 that contains the glass slides 220. When gripping the slide rack 280, the direction of the force applied by the motor 250 is toward the side of the glass slides in the slide rack 280. Once the slide rack 280 is secured to the gripper of the gripper 270, the gripper 270 removes the slide rack from the carousel or inserts the slide rack into the carousel. When removing or replacing the slide rack 280, the direction of the force applied by the motor 260 is toward the edge of the glass slides 220 in the slide rack 280.

[0027] Thus, when gripping the slide rack 280, the load resistance feedback value of the motor 250 is determined by the load resistance of the linear movement of the gripper fingers towards the slide rack 280 and towards each other. The threshold is set just below the force required to damage or break the glass slide when applied to the side of the glass slide. A recovery routine may be employed to reverse the linear motion of the gripper fingers and then retry gripping the side rack 280. Alternatively, no recovery routine may be employed.

[0028] Similarly, when slide rack 280 is removed or replaced, the load resistance feedback value from motor 260 is determined by the load resistance of the linear movement of gripper 270 apparatus toward or away from the carousel. The threshold is set slightly lower than the force required to pull the slide rack off the gripper fingers when the gripper is holding the slide rack. An optional recovery routine may employ any combination of moving gripper 270 toward or away from the carousel, moving the carousel left or right, moving gripper fingers toward or away from each other, and moving the lift up or down.

[0029] FIG. 5 is a perspective view showing an exemplary motor 300 driving a lift 310 device transporting a glass slide 220 according to an embodiment of the present invention. In the illustrated embodiment, a slide rack 280 transports the glass slide 220, and a lift 310 transports the slide 220 in the slide rack 280 to the level of the scanning stage. The load resistance feedback value of the motor 300 is determined by the load resistance of the linear movement of the lift 310. The threshold is set slightly lower than the force required to damage or break the glass slide 220 when applied to the top or bottom surface of the glass slide. A recovery routine may be employed to reverse the linear movement of the lift 310 and then retry transporting the slide rack 280 in the original direction. Alternatively, a recovery routine may be employed to move the slide rack in a direction toward the carousel.

[0030] 6A-6B are perspective views illustrating an exemplary motor 350 driving a push-pull 360 device that removes and replaces the glass slide 220 between the slide rack 280 and the scanning stage 370, according to one embodiment of the present invention. In one embodiment, placing the glass slide 220 on the scanning stage 370 and returning the glass slide 220 to the slide rack 280 is the most dangerous environment for a glass slide in a digital slide scanner type digital pathology device. In the illustrated embodiment, the slide rack 280 is positioned adjacent to the scanning stage 370, and the push-pull 360 pushes the first slide into the scanning stage 370. The push-pull 360 then pulls the first slide from the scanning stage 370 back to the slide rack 280. The load resistance feedback value of the motor 350 is determined by the load resistance to the linear movement of the push-pull 360. The threshold is set slightly lower than the force required to damage or break the glass slide 220 when applied to the edge of the glass slide. In one embodiment, the load resistance feedback value of the motor 350 is closely monitored and compared to a threshold value within a predetermined distance from the start of movement (e.g., determined by motor step count or time) since the likelihood of a stall condition increases within this predetermined distance. The recovery routine may employ any combination of pulling the glass slide 220 back into the slide rack, pushing the glass slide 220 back into the stage 370, moving the stage 370 back and forth or side to side, or moving the slide rack 280 up and down.

[0031] 7 is a top view of an exemplary XY motor 400 driving a stage 370 apparatus carrying a glass slide 220, according to one embodiment of the present invention. In the illustrated embodiment, the glass slide 220 is positioned on the stage 370, which moves in the X and Y directions as it receives, scans, and replaces the slide 220 in a slide rack. The load resistance feedback value of the motor 400 is determined by the load resistance to the linear motion of the stage 370 in the X or Y direction. The first threshold is set slightly lower than the force required to damage or break the glass slide 220 when applied to the side of the glass slide 220 while moving in the X or Y direction, and the second threshold is set slightly lower than the force required to damage or break the glass slide when applied to the end of the glass slide 220 while moving in the other X or Y direction. The recovery routine may employ any combination of pulling the glass slide 220 back into the slide rack, pushing the glass slide 220 back into the stage 370, moving the stage 370 back and forth or side to side, or moving the slide rack 280 up and down.

[0032] FIG. 8 is a perspective rear view of an exemplary Z motor 450 for driving an objective lens arrangement according to an embodiment of the present invention. In operation, a glass slide is positioned on the stage below an objective lens used for magnification in scanning a specimen on the glass slide. In the illustrated embodiment, the Z motor 450 is positioned on the rear of the mount 455 and is configured to move the objective lens up and down in the Z direction, toward and away from the glass slide on the stage. The load resistance feedback value of the motor 450 is determined by the load resistance to the linear motion of the objective lens 470. The threshold is set slightly lower than the force required to damage or break the glass slide when applied to the top surface of the glass slide. The recovery routine may employ any combination of moving the objective lens up and down in the Z axis or moving the stage back and forth or left and right.

[0033] FIG. 9 is a perspective front view of an exemplary objective lens arrangement 460 driven by a Z motor, according to an embodiment of the present invention. In operation, a glass slide is positioned on the stage below an objective lens 470 that is used for magnification in scanning a specimen on the glass slide. In the illustrated embodiment, the objective lens arrangement 460 is fixed to the side of the mount opposite the Z motor 450. The objective lens arrangement 460 includes an objective lens 470, a bracket 480, and an encoder 490. The bracket 480 is configured to secure the objective lens 470 in a fixed position and to be moved in the Z direction by the Z motor 450. The position encoder 490 is configured to determine the position of the objective lens. As described above, the Z motor 450 is configured to move the objective lens toward or away from the glass slide on the stage. The load resistance feedback value of the motor 450 is determined by the load resistance to the linear motion of the objective lens 470. The threshold is set just below the force required to damage or break the glass slide when applied to the top surface of the glass slide. The recovery routine may employ any combination of moving the objective lens up and down in the Z axis, or moving the stage back and forth or side to side.

[0034] Exemplary embodiments In one embodiment, the digital pathology device includes a motor configured to move the glass slide during an automated process and generate a load resistance feedback value when moving the glass slide. The device also includes one or more processors configured to control the motor to move the glass slide during the automated process, receive the load resistance feedback value after initiation of the automated process, compare the load resistance feedback value to a predetermined threshold, and control the motor to stop moving the glass slide in response to determining that the load resistance feedback value exceeds the predetermined threshold.

[0035] In this embodiment, the automated process may be one of the following steps: moving a glass slide from a slide rack onto a scanning stage, moving the glass slide from the scanning stage to the slide rack, rotating a carousel including one or more slide racks storing one or more glass slides, extracting the slide rack from the slide rack carousel, inserting the slide rack into the slide rack carousel, lifting the slide rack to the scanning stage level, gripping the slide rack, and scanning the glass slide.

[0036] In this embodiment, the predetermined threshold may correspond to a pressure lower than a pressure that would break the glass slide, which may correspond to a pressure applied to a top or bottom surface or to an edge surface, where the edge surface is a short edge surface (end surface) or the edge surface is a long edge surface (side surface).

[0037] In this embodiment, the predetermined threshold may correspond to a force less than the force required to pull the slide rack out of the gripping portions of a pair of gripper fingers.

[0038] In this embodiment, the motor may be a step motor and the predetermined threshold may correspond to a force less than the force required to cause the motor to skip a step.

[0039] In one embodiment, a method includes using one or more processors to control a motor to move a glass slide during an automated process; using the one or more processors to determine a load resistance value from the motor during movement of the glass slide; using the one or more processors to compare the load resistance value to a predetermined threshold; and using the one or more processors to control the motor to stop movement of the glass slide in response to determining that the load resistance value exceeds the predetermined threshold.

[0040] In this method, the automated process may be one of the following steps: moving a glass slide from a slide rack onto a scanning stage; moving the glass slide from the scanning stage to the slide rack; rotating a carousel including one or more slide racks storing one or more glass slides; removing the slide rack from the slide rack carousel; replacing the slide rack in the slide rack carousel; lifting the slide rack to the scanning stage level; gripping the slide rack; and scanning the glass slide.

[0041] In this method, the predetermined threshold may correspond to a pressure lower than a pressure that would break the glass slide, which may correspond to a pressure applied to a top or bottom surface or to an edge surface, where the edge surface is a short edge surface (end surface) or the edge surface is a long edge surface (side surface).

[0042] In this manner, the predetermined threshold may correspond to a force less than the force required to pull the slide rack out of the grip of a pair of gripper fingers.

[0043] In this method, the motor may be a step motor and the predetermined threshold may correspond to a force less than that required to cause the motor to skip a step.

[0044] In one embodiment, a digital slide scanning device includes a plurality of motors, each motor configured to drive movement of one or more parts during an automated process and generate a load resistance value when driving the movement. The device also includes one or more processors configured to set a predetermined threshold resistance value for each of the plurality of motors, where at least two of the predetermined resistance values ​​are not equal. The one or more processors are also configured to control a first motor of the plurality of motors to drive the movement during a first automated process, monitor a first load resistance value generated by the first motor after initiation of the first automated process, compare the first load resistance value to a first predetermined threshold resistance value corresponding to the first motor, and control the first motor to stop driving the movement in response to determining that the first load resistance value exceeds the first predetermined threshold resistance value. The one or more processors are further configured to control a second motor of the plurality of motors to drive the movement during a second automated process, monitor a second load resistance value generated by the second motor after initiation of the second automated process, compare the second load resistance value to a second predetermined threshold resistance value corresponding to the second motor, and control the second motor to stop driving the movement in response to a determination that the second load resistance value exceeds the second predetermined threshold resistance value.

[0045] 10A is a block diagram illustrating an example processor-enabled device 550 that may be used in connection with various embodiments described herein. Alternative forms of this device 550 may be used as will be understood by those skilled in the art. In the illustrated embodiment, the device 550 includes one or more processors 555, one or more memories 565, one or more motion controllers 570, one or more interface systems 575, one or more movable stages 580 each supporting one or more glass slides 585 having one or more samples 590, one or more illumination systems 595 for illuminating the samples, one or more objectives 600 each defining an optical path 605 traveling along an optical axis, one or more objective positioners 630, one or more optional epi-illumination systems 635 (e.g., included in a fluorescent scanner system), one or more focusing optics 610, one or more line scan cameras 615, and / or one or more area scan cameras 620, each presenting a digital imaging device (also referred to herein as a scanner system or scanning system) that defines a separate field of view 625 on the sample 590 and / or the glass slide 585. The various elements of the scanner system 550 are communicatively coupled via one or more communication buses 560. Although there may be one or more of each of the various elements of the scanner system 550, for simplicity in the following description, these elements will be described in the singular unless a plural description is necessary for proper communication.

[0046] The one or more processors 555 may include, for example, a central processing unit ("CPU") and a separate graphics processing unit ("GPU") capable of parallel processing of instructions, or the one or more processors 555 may include a multi-core processor capable of parallel processing of instructions. Additionally, separate processors may be provided to control specific components or to perform specific functions, such as image processing. For example, the additional processors may include auxiliary processors to manage data input, auxiliary processors to perform mathematical floating point operations, dedicated processors (e.g., digital signal processors) having an architecture suitable for fast execution of signal processing algorithms, slave processors (e.g., back-end processors) subordinate to the main processor, and additional processors to control the line scan camera 615, the stage 580, the objective lens 600, and / or the display (not shown). Such additional processors may be separate, discrete processors or may be integrated with the processor 555. In one embodiment, the processor is configured to control the movement of the scanning stage and to control the activation of the sensor pairs. The processor is also configured to receive and analyze signals from the sensor pairs to determine the presence or absence of a glass slide or stage, as appropriate for the circumstances. In one embodiment, the processor is configured to control the stage and stop movement if an improper position of the glass slide is determined.

[0047] The memory 565 provides storage of data and instructions for programs executable by the processor 555. The memory 565 may include one or more volatile and persistent computer-readable storage media for storing data and instructions, such as random access memory, read-only memory, hard disk drives, removable storage drives, etc. The processor 555 is configured to execute the instructions stored in the memory 565 and to communicate with various elements of the scanner system 550 via the communication bus 560 to perform the overall functionality of the scanner system 550.

[0048] The one or more communication buses 560 may include communication buses 560 configured to communicate analog electrical signals as well as communication buses 560 configured to communicate digital data. Thus, communications from the processor 555, motion controller 570, and / or interface system 575 via the one or more communication buses 560 may include both electrical signals and digital data. The processor 555, motion controller 570, and / or interface system 575 may be further configured to communicate with one or more of the various elements of the scanning system 550 via wireless communication links.

[0049] Motion control system 570 is configured to precisely control and coordinate the XYZ movement of stage 580 and objective 600 (e.g., via objective positioner 630). Motion control system 570 is also configured to control the movement of any other moving parts in scanner system 550. For example, in a fluorescent scanner embodiment, motion control system 570 is configured to coordinate the movement of optical filters, etc. in epi-illumination system 635.

[0050] The interface system 575 allows the scanner system 550 to interface with other systems and operators. For example, the interface system 575 may include a user interface that provides information directly to an operator and / or allows direct input from the operator. The interface system 575 is also configured to facilitate communication and data transfer between the scanning system 550 and one or more external devices (e.g., printers, removable storage media) connected directly or via a network (not shown) to the scanner system 550, such as an image server system, an operator station, a user station, and a management server system.

[0051] The illumination system 595 is configured to illuminate a portion of the sample 590. The illumination system may include, for example, a light source and illumination optics. The light source may be a variable intensity halogen light source with a concave reflective mirror to maximize light output and a KG-1 filter to suppress heat. The light source may be any type of arc lamp, laser, or other light source. In one embodiment, the illumination system 595 illuminates the sample 590 in a transmission mode, whereby the line scan camera 615 and / or area scan camera 620 sense the light energy transmitted through the sample 590. Alternatively, or in combination, the illumination system 595 may be configured to illuminate the sample 590 in a reflection mode, whereby the line scan camera 615 and / or area scan camera 620 sense the light energy reflected from the sample 590. The illumination system 595 is configured to be suitable for examining the microscope sample 590 in any known mode of optical microscopy.

[0052] In one embodiment, the scanner system 550 optionally includes an epi-illumination system 635 that optimizes the scanner system 550 for fluorescence scanning. Fluorescence scanning is the scanning of a sample 590 that contains fluorescent molecules, which are photon-sensitive molecules that can absorb light at a particular wavelength (excitation). These photon-sensitive molecules emit light at a higher wavelength (emission). Because the efficiency of this photoluminescence phenomenon is very low, the amount of emitted light is often very small. This small amount of emitted light typically thwarts conventional techniques for scanning and digitizing the sample 590 (e.g., transmission mode microscopy). Advantageously, in an optional fluorescence scanner system embodiment of the scanner system 550, the use of a line scan camera 615 that includes multiple linear sensor arrays (e.g., a time-delay integration ("TDI") line scan camera) increases the sensitivity of the line scan camera to light by exposing the same area of ​​the sample 590 to each of the multiple linear sensor arrays of the line scan camera 615. This is especially useful when scanning small fluorescent samples with small amounts of emitted light.

[0053] Thus, in an embodiment of the fluorescent scanner system, the line scan camera 615 is preferably a monochrome TDI line scan camera. Advantageously, monochrome images are ideal in fluorescent microscopy because they provide a more accurate representation of the actual signals from the various channels present on the sample. As will be appreciated by those skilled in the art, the fluorescent sample 590 can be labeled with multiple fluorescent dyes that emit light at different wavelengths, also referred to as "channels."

[0054] Additionally, because the low and high end signal levels of various fluorescent samples present a broad wavelength spectrum for the line scan camera 615 to sense, it is desirable that the low and high end signal levels that the line scan camera 615 can sense are similarly broad. Thus, in the fluorescent scanner embodiment, the line scan camera 615 used in the fluorescent scanning system 550 is a monochrome 10-bit 64 linear array TDI line scan camera. It should be noted that a variety of bit depths for the line scan camera 615 can be employed for use with the fluorescent scanner embodiment of the scanning system 550.

[0055] The movable stage 580 is configured for precise XY movement under the control of the processor 555 or the motion controller 570. The movable stage may be configured for Z movement under the control of the processor 555 or the motion controller 570. The movable stage is configured to position the sample at a desired location during capture of image data by the line scan camera 615 and / or the area scan camera. The movable stage is also configured to accelerate the sample 590 to a substantially constant velocity in the scan direction and then maintain the substantially constant velocity during capture of image data by the line scan camera 615. In one embodiment, the scanner system 550 can employ a highly accurate and tightly aligned XY grid that aids in positioning the sample 590 on the movable stage 580. In one embodiment, the movable stage 580 is an XY stage based on linear motors with high precision encoders employed in both the X and Y axes. For example, highly accurate nanometer encoders can be used on the axis in the scan direction and on the axis in the same plane as the scan direction and perpendicular to the scan direction. The stage is also configured to support a glass slide 585 on which a sample 590 is placed.

[0056] The sample 590 can be anything that may be examined by optical microscopy. For example, glass microscope slides 585 are frequently used as viewing substrates for specimens including tissues and cells, chromosomes, DNA, proteins, blood, bone marrow, urine, bacteria, air bubbles, biopsies, or any other type of biological material, dead or alive, stained or unstained, labeled or unlabeled. The sample 590 may be an array of any type of DNA or DNA-related material, such as cDNA or RNA or protein, arranged on any type of slide or other substrate, including any and all samples commonly known as microarrays. The sample 590 may be a microtiter plate, (e.g., a 96-well plate). Other examples of the sample 590 include integrated circuit boards, electrophoretic records, petri dishes, films, semiconductor materials, forensic materials, or machined parts.

[0057] The objective lens 600 is mounted on an objective lens positioner 630, which in one embodiment may employ highly accurate linear motors that move the objective lens 600 along an optical axis defined by the objective lens 600. For example, the linear motors of the objective lens positioner 630 may include 50 nanometer encoders. The relative positions of the stage 580 and the objective lens 600 in the X, Y, and Z axes are adjusted and controlled in a closed-loop manner using a motion controller 570 under the control of a processor 555 that employs a memory 565 for storing information and instructions including computer-executable programmed steps for the overall operation of the scanning system 550.

[0058] In one embodiment, the objective 600 is a planar apochromatic ("APO") infinity corrected objective with a numerical aperture corresponding to the highest spatial resolution desired, where the objective 600 is suitable for transmitted mode illumination microscopy, reflected mode illumination microscopy, and / or epi-illumination mode fluorescence microscopy (e.g., Olympus 40X, 0.75NA or 20X, 0.75NA). Advantageously, the objective 600 is capable of correction for chromatic and spherical aberrations. Because the objective 600 is infinity corrected, focusing optics 610 can be positioned in the optical path 605 above the objective 600, where the light beam transmitted through the objective is a parallel light beam. The focusing optics 610 focuses the optical signals captured by the objective 600 onto the photoresponsive elements of the line scan camera 615 and / or area scan camera 620, and can include optical components such as filters, variable magnification lenses, etc. The objective 600 in combination with the focusing optics 610 provides the total magnification for the scanning system 550. In one embodiment, the focusing optics 610 can include a tube lens and an optional 2X magnification converter. Advantageously, this 2X magnification converter allows the originally 20X objective 600 to scan the sample 590 at a magnification of 40X.

[0059] The line scan camera 615 includes at least one linear array of image elements ("pixels"). Line scan cameras can be monochrome or color. Color line scan cameras typically have at least three linear arrays, while monochrome line scan cameras can have a single linear array or multiple linear arrays. Any type of single or multiple linear arrays can also be used, whether packaged as part of the camera or custom integrated into the imaging electronics module. For example, a three linear array ("red-green-blue" or "RGB") color line scan camera or a 96 linear array monochrome TDI may be used. TDI line scan cameras typically provide a substantially better signal-to-noise ratio ("SNR") in the output signal by summing intensity data from previously imaged sample areas, resulting in an increase in SNR proportional to the square root of the number of integration stages. TDI line scan cameras include multiple linear arrays, for example, TDI line scan cameras with 24, 32, 48, 64, 96, or more linear arrays are available. Scanner system 550 also supports linear arrays manufactured in a variety of formats, including those having 512 pixels, those having 1024 pixels, and others having as many as 4096 pixels. Similarly, linear arrays having a variety of pixel sizes can also be used in scanner system 550. The primary requirement for selecting any type of line scan camera 615 is that the movement of stage 580 can be synchronized with the line rate of line scan camera 615, so that stage 580 can be moved relative to line scan camera 615 during capture of a digital image of sample 590.

[0060] The image data generated by the line scan camera 615 is stored in a portion of the memory 565 and processed by the processor 555 to generate successive digital images of at least a portion of the sample 590. The successive digital images may be further processed by the processor 555 and the revised successive digital images may also be stored in the memory 565.

[0061] In an embodiment having two or more line scan cameras 615, at least one of the line scan cameras 615 can be configured to function as a focusing sensor operating in combination with at least one of the line scan cameras 615 configured to function as an imaging sensor. The focusing sensor can be logically positioned on the same optical axis as the imaging sensor, or the focusing sensor may be logically positioned upstream or downstream of the imaging sensor with respect to the scanning direction of the scanner system 550. In such an embodiment having at least one line scan camera 615 functioning as a focusing sensor, image data generated by the focusing sensor is stored in a portion of the memory 565 and processed by one or more processors 555 to generate focusing information that enables the scanner system 550 to adjust the relative distance between the sample 590 and the objective lens 600 to maintain focus on the sample during scanning. Additionally, in one embodiment, the at least one line scan camera 615 functioning as a focusing sensor can be oriented such that each of a plurality of individual pixels of the focusing sensor is positioned at a different logical height along the optical path 605.

[0062] In operation, the various components of the scanner system 550 and the programmed modules stored in the memory 565 enable the automated scanning and digitization of a sample 590 disposed on a glass slide 585. The glass slide 585 is fixedly positioned on a movable stage 580 of the scanner system 550 for scanning the sample 590. Under the control of the processor 555, the movable stage 580 accelerates the sample 590 to a substantially constant velocity for sensing by the line scan camera 615, where the stage velocity is synchronized with the line rate of the line scan camera 615. After scanning a stripe of image data, the movable stage 580 decelerates the sample to a substantially complete stop. The movable stage 580 then moves orthogonally to the scan direction to position the sample 590 for scanning a subsequent stripe of image data, e.g., an adjacent stripe. Additional stripes are then scanned until an entire portion of the sample 590 or the entire sample 590 has been scanned.

[0063] For example, during digital scanning of the sample 590, successive digital images of the sample 590 are acquired as multiple successive fields of view that are combined together to form an image stripe. Multiple adjacent image stripes are similarly combined together to form a continuous digital image of a portion or the entire sample 590. Scanning the sample 590 can include acquiring vertical image stripes or horizontal image stripes. Scanning the sample 590 can be either from top to bottom, bottom to top, or both (bidirectional) and can start from any point on the sample. Alternatively, scanning the sample 590 can be either from left to right, right to left, or both (bidirectional) and can start from any point on the sample. Additionally, the image stripes need not be acquired in a contiguous or consecutive manner. Furthermore, the resulting image of the sample 590 can be an image of the entire sample 590 or an image of only a portion of the sample 590.

[0064] In one embodiment, computer-executable instructions (e.g., programming modules and software) are stored in memory 565 and, when executed, enable scanning system 550 to perform various functions described herein. As used herein, the term "computer-readable storage medium" is used to refer to any medium used to store and provide computer-executable instructions to scanning system 550 for execution by processor 555. Examples of these media include memory 565 and any removable or external storage medium (not shown) communicatively coupled to scanning system 550 either directly or indirectly, for example, via a network (not shown).

[0065] 10B illustrates a line scan camera having a single linear array 640, which may be implemented as a charge-coupled device ("CCD") array. The single linear array 640 includes a plurality of individual pixels 645. In the illustrated embodiment, the single linear array 640 has 4096 pixels. In alternative embodiments, the linear array 640 can have more or fewer pixels. For example, common format linear arrays include 512, 1024, and 4096 pixels. The pixels 645 are arranged in a line to define a field of view 625 for the linear array 640. The size of the field of view varies according to the magnification of the scanner system 550.

[0066] 10C shows a line scan camera having three linear arrays, each of which may be implemented as a CCD array. The three linear arrays are combined to form a color array 650. In one embodiment, each individual linear array in color array 650 detects a different color intensity, for example, red, green, or blue. The color image data from each individual linear array in color array 650 is combined to form a single field of view 625 of color image data.

[0067] 10D shows a line scan camera with multiple linear arrays, each of which may be implemented as a CCD array. The multiple linear arrays are combined to form a TDI array 655. Advantageously, a TDI line scan camera can provide a substantially better SNR in its output signal by summing intensity data from previously imaged sample areas, resulting in an increase in SNR proportional to the square root of the number of linear arrays (also referred to as integration stages). TDI line scan cameras can include many more linear arrays, for example, common format TDI line scan cameras include 24, 32, 48, 64, 96, 120, and more linear arrays.

[0068] The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles described herein may be applied to other embodiments without departing from the spirit or scope of the present invention. It is therefore to be understood that the description and drawings presented herein represent the presently preferred embodiments of the present invention, and thus represent the inventive features broadly construed by the present invention. It is further to be understood that the scope of the present invention fully encompasses other embodiments that are obvious to those skilled in the art and therefore do not limit the scope of the present invention.

Claims

1. 1. A digital slide scanning device, comprising: a motor configured to generate a resistive load when moving the glass slide during the process; one or more hardware processors; the one or more hardware processors include monitoring the load resistance during the process; comparing the load resistance to a predetermined threshold resistance value corresponding to a pressure below that which would cause the glass slide to break; responsive to determining that the load resistance value exceeds the predetermined threshold resistance value, controlling the motor to stop movement of the glass slide. It is configured as follows: Digital slide scanning device.

2. The process comprises: moving the glass slide from a slide rack onto a scanning stage; moving the glass slide from the scanning stage to the slide rack; rotating a carousel including one or more slide racks storing one or more glass slides; One of the 2. The digital slide scanning device of claim 1.

3. The pressure that breaks the glass slide corresponds to pressure applied to the top or bottom surface of the slide.

2. The digital slide scanning device of claim 1.

4. The pressure that breaks the glass slide corresponds to a pressure applied to the edge surface of the slide.

2. The digital slide scanning device of claim 1.

5. The edge surface is an end surface.

5. The digital slide scanning device of claim 4.

6. The edge surface is a side surface.

5. The digital slide scanning device of claim 4.

7. The process comprises: removing the slide rack from the carousel; inserting a slide rack into the carousel; One of the 2. The digital slide scanning device of claim 1.

8. the predetermined threshold resistance value corresponds to a force that is less than a force required to pull the slide rack out of the gripping portions of the pair of gripper fingers; 2. The digital slide scanning device of claim 1.

9. The process includes the steps of: gripping a slide rack; 2. The digital slide scanning device of claim 1.

10. the motor is a step motor, and the predetermined threshold resistance value corresponds to a force less than that required to cause the motor to skip a step.

9. The digital slide scanning device of claim 8.

11. 1. A non-transitory computer readable medium for controlling a slide staining apparatus for staining cell and tissue samples on slides, comprising: The non-transitory computer readable medium may be configured to cause a hardware processor to perform the following steps: monitoring the load resistance of the motor during the process; comparing the load resistance value to a predetermined threshold resistance value, the predetermined threshold resistance value corresponding to a pressure below that which would cause a glass slide to break; in response to determining that the load resistance value exceeds the predetermined threshold resistance value, controlling the motor to stop movement of the glass slide; having program instructions for carrying out a method comprising: Non-transitory computer-readable medium.

12. The process comprises: moving the glass slide from a slide rack onto a scanning stage; moving the glass slide from the scanning stage to the slide rack; rotating a carousel including one or more slide racks storing one or more glass slides; One of the 12. The computer-readable medium of claim 11.

13. The pressure that breaks the glass slide corresponds to pressure applied to the top or bottom surface of the slide.

12. The computer-readable medium of claim 11.

14. The pressure that breaks the glass slide corresponds to a pressure applied to the edge surface of the slide.

12. The computer-readable medium of claim 11.

15. The process comprises: removing the slide rack from the carousel; inserting a slide rack into the carousel; One of the 12. The computer-readable medium of claim 11.

16. the motor is a step motor, and the predetermined threshold resistance value corresponds to a force less than that required to cause the motor to skip a step.

12. The computer-readable medium of claim 11.

17. 1. A method of controlling a slide staining apparatus for staining cell and tissue samples on slides, comprising: The method comprises the following steps: monitoring the load resistance of the motor during the process; comparing the load resistance value to a predetermined threshold resistance value, the predetermined threshold resistance value corresponding to a pressure below that which would cause a glass slide to break; in response to determining that the load resistance value exceeds the predetermined threshold resistance value, controlling the motor to stop movement of the glass slide; The method includes:

18. The process comprises: moving the glass slide from a slide rack onto a scanning stage; moving the glass slide from the scanning stage to the slide rack; rotating a carousel including one or more slide racks storing one or more glass slides; One of the 20. The method of claim 17.

19. The pressure that breaks the glass slide corresponds to pressure applied to the top or bottom surface of the slide.

20. The method of claim 17.

20. The pressure that breaks the glass slide corresponds to a pressure applied to the edge surface of the slide.

20. The method of claim 17.

21. the motor is a step motor, and the predetermined threshold resistance value corresponds to a force less than that required to cause the motor to skip a step.

20. The method of claim 17.

22. A threshold force applied to the top or bottom surface of the slide is less than a threshold force applied to a side surface of the slide; The threshold force applied to the side of the slide is less than the threshold force applied to the end of the slide.

2. The digital slide scanning device of claim 1.

23. A threshold force applied to the top or bottom surface of the slide is less than a threshold force applied to a side surface of the slide; The threshold force applied to the side of the slide is less than the threshold force applied to the end of the slide.

12. The computer-readable medium of claim 11.

24. A threshold force applied to the top or bottom surface of the slide is less than a threshold force applied to a side surface of the slide; The threshold force applied to the side of the slide is less than the threshold force applied to the end of the slide.

20. The method of claim 17.

Citation Information

Patent Citations

  • Automatic sample sealing system

    JP1984157535A

  • Target electric switching device

    JP1994054016U

  • Controller of stepping motor

    JP2004208401A

  • Slide glass storage device, conveyance device and microscope system

    JP2012013953A

  • Automatic microscope

    JP2012108242A