Microscope system, operation method, and program
The microscope system addresses collisions by identifying lens and container types to set safety zones, preventing collisions and minimizing damage through controlled stage movement.
Patent Information
- Application Number
- JP2022051393
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-28
- Publication Date
- 2025-09-26
- Estimated Expiration
- 2042-03-28
AI Technical Summary
Existing microscope technologies fail to account for the possibility of collisions between the objective lens and the sample due to the working distance and three-dimensional shape of the sample, leading to potential damage during stage movement.
A microscope system with a detection unit to identify objective lens and container types, determining collision areas and controlling stage movement to avoid collisions by setting safety, prohibited, and restricted zones based on acquired area information.
Effectively prevents collisions by restricting stage movement into high-risk areas, allowing precise control and minimizing damage to the objective lens and sample.
Smart Images

Figure 0007744864000001 
Figure 0007744864000002 
Figure 0007744864000003
Abstract
Description
[Technical Field]
[0001] The disclosure of the present specification relates to a microscope system, an operating method, and a program. [Background technology]
[0002] In a microscope, any position on a sample can be observed by moving the stage to change the relative position of the objective lens with respect to the sample. However, depending on the positional relationship between the sample and the objective lens, the objective lens may collide with the sample. Technology related to this issue is described, for example, in Patent Document 1. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-197307 Summary of the Invention [Problem to be solved by the invention]
[0004] Patent Document 1 discloses a technology for calculating the driveable range of a stage where the objective lens and the stage opening do not collide, using the size of the objective lens and the size of the stage opening. In Patent Document 1, the driveable range is calculated taking into account the physical size of the objective lens, but does not take into account the possibility that the objective lens will collide with a sample placed inside the opening of the stage.
[0005] Whether or not the objective lens and sample collide when the stage is moved depends on the working distance of the objective lens and the three-dimensional shape of the sample, so it is difficult to avoid collisions between the objective lens and the sample using the technology described in Patent Document 1.
[0006] In view of the above circumstances, an object of one aspect of the present invention is to provide a technique for dealing with the possibility of collision of objective lenses that occurs as the stage moves. [Means for solving the problem]
[0007] A microscope system according to one aspect of the present invention includes a detection unit that detects lens type information that identifies the type of an objective lens arranged on an observation light path of the microscope system and container type information that identifies the type of a container placed on a stage of the microscope system, and a microscope system that detects whether the objective lens is On the periphery of the container Possible collision areas a safety area where the objective lens is unlikely to collide with the periphery of the container; and a control unit that outputs control information related to control of at least one of the output device and the stage based on the area information acquired by the acquisition unit. The collision area includes a prohibited area where the possibility of collision with the peripheral part where movement of the stage is prohibited is high, and a restricted area where the possibility of collision with the peripheral part is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral part of the container, and the control unit controls the stage so as to prohibit movement of the stage into the prohibited area when it detects a movement instruction for the stage specifying a movement destination within the prohibited area. do.
[0008] A method for operating a microscope system according to one aspect of the present invention includes detecting lens type information that identifies the type of an objective lens arranged on an observation optical path of the microscope system and container type information that identifies the type of a container placed on a stage of the microscope system, and determining whether the objective lens is On the periphery of the container Possible collision areas a safety area where the objective lens is unlikely to collide with the periphery of the container; and outputting control information relating to control of at least one of the output device and the stage based on the acquired area information. The collision area includes a prohibited area where the possibility of collision with the peripheral part where movement of the stage is prohibited is high, and a restricted area where the possibility of collision with the peripheral part is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral part of the container, and when a movement instruction of the stage specifying a movement destination within the prohibited area is detected, the stage is controlled so as to prohibit movement of the stage into the prohibited area. do.
[0009] A program according to one aspect of the present invention is a program for causing a computer of a microscope system to detect lens type information for identifying the type of an objective lens arranged on an observation light path of the microscope system and container type information for identifying the type of a container placed on a stage of the microscope system, and to determine whether the objective lens is On the periphery of the container Possible collision areas a safety area where the objective lens is unlikely to collide with the periphery of the container; and outputting control information relating to control of at least one of the output device and the stage based on the acquired area information. The collision area includes a prohibited area where the possibility of collision with the peripheral part where movement of the stage is prohibited is high, and a restricted area where the possibility of collision with the peripheral part is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral part of the container, and when a movement instruction of the stage specifying a movement destination within the prohibited area is detected, the stage is controlled so as to prohibit movement of the stage into the prohibited area. The process is executed. [Effects of the Invention]
[0010] According to the above aspect, it is possible to deal with the possibility of collision of the objective lens that occurs as the stage moves. [Brief explanation of the drawings]
[0011] [Figure 1] FIG. 1 illustrates a microscope system according to an embodiment of the present invention. [Figure 2] 2 is a block diagram showing the functional configuration of a control device according to an embodiment of the present invention; FIG. [Figure 3] 4 is a flowchart of a process performed by a control device according to an embodiment of the present invention. [Figure 4] 10 is a diagram illustrating an example of the configuration of a region information table in which region information is stored. FIG. [Figure 5] FIG. 10 is a diagram showing an example of the relationship between a safety area and a collision area. [Figure 6] FIG. 10 is a diagram showing another example of the relationship between the safety area and the collision area. [Figure 7] FIG. 10 is a diagram showing an example of an application screen displayed on a display device. [Figure 8] FIG. 4 is a flowchart showing an operation control process according to the first embodiment. [Figure 9] FIG. 3 is a diagram showing an example of the configuration of a region information table according to the first embodiment. [Figure 10] FIG. 4 is a diagram for explaining an example of the relationship between an opening and a collision region in the first embodiment. [Figure 11] FIG. 10 is a diagram showing another example of the configuration of the area information table according to the first embodiment. [Figure 12] 10A and 10B are diagrams for explaining another example of the relationship between the opening and the collision region in the first embodiment. [Figure 13] FIG. 10 is a diagram for explaining differences in objective lens positions due to the material of the microplate. [Figure 14] FIG. 10 is a diagram showing another example of the configuration of the material information table according to the first embodiment. [Figure 15] FIG. 10 is a flowchart showing an operation control process according to the second embodiment. [Figure 16] FIG. 10 is a diagram showing an example of a display of a stage navigator according to the second embodiment. [Figure 17] FIG. 10 is a diagram showing another example of the display of the stage navigator according to the second embodiment. [Figure 18] FIG. 11 is a flowchart showing an operation control process according to the third embodiment. [Figure 19] FIG. 11 is a diagram showing an example of a warning window according to the third embodiment. [Figure 20] FIG. 10 is a flowchart showing an operation control process according to a fourth embodiment. [Figure 21] FIG. 13 is a flowchart showing an operation control process according to the fifth embodiment. [Figure 22] FIG. 13 is a flowchart showing an operation control process according to the sixth embodiment. [Figure 23] FIG. 13 is a flowchart showing an operation control process according to the seventh embodiment. [Figure 24] FIG. 20 is a flowchart showing an operation control process according to the eighth embodiment. [Figure 25] FIG. 13 is a flowchart showing an operation control process according to the ninth embodiment. [Figure 26] FIG. 23 is a diagram illustrating an example of the relationship between an opening and a restriction area in the ninth embodiment. [Figure 27] FIG. 13 is a diagram illustrating another example of the relationship between the opening and the restriction area in the ninth embodiment. [Figure 28] FIG. 23 is a flowchart showing an operation control process according to the tenth embodiment. [Figure 29] FIG. 23 is a diagram showing an example of a display of a stage navigator according to the tenth embodiment. [Figure 30] FIG. 20 is a diagram showing another example of the display of the stage navigator according to the tenth embodiment. [Figure 31]FIG. 23 is a diagram showing yet another example of the display of the stage navigator according to the tenth embodiment. [Figure 32] FIG. 23 is a flowchart showing an operation control process according to the eleventh embodiment. [Figure 33] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer for realizing a control device. [Figure 34] 10A and 10B are diagrams for explaining changes in the display of the stage navigator when objective lenses are switched. [Figure 35] FIG. 10 is a diagram illustrating display settings of a stage navigator. [Figure 36] FIG. 10 is a diagram for explaining differences in observation height due to the type of microplate. [Figure 37] FIG. 10 is a diagram showing an example of the configuration of a region information table including a container type column. [Figure 38] FIG. 10 is a diagram for explaining an example of container setting. [Figure 39] FIG. 10 is a diagram for explaining another example of container setting. DETAILED DESCRIPTION OF THE INVENTION
[0012] Fig. 1 is a diagram illustrating a microscope system according to an embodiment of the present invention. As shown in Fig. 1, the microscope system 1 includes a microscope 100, a control device 10, a microscope controller 20, an output device 30, and an input device 40.
[0013] The microscope 100 is a microscope equipped with a digital camera 105, and is, for example, a box-type inverted microscope. The microscope 100 forms an optical image of a sample S placed on a stage 101 on the digital camera 105 using an objective lens 103 provided below the stage 101. The sample S merely means an object to be imaged, and is distinguished from a specimen that is primarily observed by a user. The sample S may include a specimen and a container (such as a petri dish or a microplate) that contains the specimen.
[0014] The stage 101 is an electric stage having a motor and an origin sensor (not shown). The stage 101 includes at least an XY stage that moves in a direction perpendicular to the optical axis of the objective lens 103. The stage 101 is controlled by the microscope controller 20 in accordance with commands from the control device 10. More specifically, the microscope controller 20 controls the motor based on an origin in the X and Y directions detected by the origin sensor, thereby moving the stage 101 to a specified X and Y position. The microscope controller 20 outputs position information of the stage 101 to the control device 10 as appropriate or upon request.
[0015] The light source 102 is, for example, a lamp light source such as a xenon lamp, or a light emitting diode (LED). The amount of illumination light emitted from the light source 102 is controlled by the microscope controller 20 in accordance with a command from the control device 10.
[0016] 1 illustrates an example of a configuration for epi-illumination in which a light source 102 provided below a stage 101 irradiates illumination light onto a sample S via an objective lens 103. However, the illumination method employed by the microscope 100 is not limited to epi-illumination, and other illumination methods such as transmitted illumination may also be used.
[0017] The objective lens 103 is attached to a revolver 104. A plurality of objective lenses with different specifications may be attached to the revolver 104. The plurality of objective lenses attached to the revolver 104 may be objective lenses with different magnifications or objective lenses corresponding to different observation methods. The objective lens 103 arranged on the optical axis can be electrically switched, for example, by the microscope controller 20 controlling the rotation of the revolver 104 according to a command from the control device 10.
[0018] The nosepiece 104 switches between objective lenses arranged on the optical axis. The nosepiece 104 also functions as a focusing device. The nosepiece 104 has a motor and an origin sensor (not shown). The nosepiece 104 moves in the optical axis direction (Z direction) of the objective lens 103 as the motor rotates. The nosepiece 104 is controlled by the microscope controller 20 in accordance with commands from the control device 10. More specifically, the microscope controller 20 controls the motor based on the origin in the Z direction detected by the origin sensor, so that the nosepiece 104 moves in the optical axis direction together with the objective lens 103. This makes it possible to adjust the focus. The microscope controller 20 outputs position information of the nosepiece 104 to the control device 10 as appropriate or upon request.
[0019] Although an example has been given in which the revolver 104 functions as a focusing device that moves in the Z direction, the stage 101 may move in the optical axis direction instead of the revolver 104. That is, the stage 101 may include a Z stage in addition to an XY stage.
[0020] The digital camera 105 has an imaging element such as a CCD image sensor or a CMOS image sensor. The digital camera 105 converts an optical image formed on the imaging surface of the digital camera 105 by the optical system of the microscope 100 into a digital image (hereinafter simply referred to as an image). The image is output from the digital camera 105 to the control device 10.
[0021] The imaging operation and the like performed by the digital camera 105 are controlled by the control device 10. The control device 10 may control the digital camera 105 to, for example, switch automatic gain control on / off, set gain, switch automatic exposure control on / off, set exposure time, set edge emphasis level, set gamma correction, and the like.
[0022] The control device 10 controls the microscope 100 and the microscope controller 20, thereby controlling the entire microscope system 1. The control device 10 is a computer that realizes the functional configuration shown in FIG. 2, which will be described later, in relation to the operation control of the stage 101. The control device 10 may be realized by a general-purpose computer such as a workstation or a personal computer, or may be realized by a dedicated computer.
[0023] The microscope controller 20 is a device that controls the microscope 100, and operates, for example, according to commands from the control device 10. More specifically, the microscope controller 20 controls the operations of the stage 101, the light source 102, the revolver 104, etc., according to commands from the control device 10.
[0024] The output device 30 is a device that outputs information to a user of the microscope system 1 using control information from the control device 10. The output device 30 includes a display device 31. The display device 31 is, for example, a liquid crystal display device, an organic electro-luminescence (OLE) display device, or a cathode ray tube (CRT) display device. The display device 31 may include a touch panel sensor, in which case it also functions as the input device 40.
[0025] In addition to the display device 31, the output device 30 may include other output devices that use sound, light, vibration, or the like to convey information to the user of the microscope system 1. The output device 30 may include, for example, a speaker that outputs sound, a light-emitting device that outputs light, a vibrator that outputs vibration, or the like.
[0026] The input device 40 is a device that detects operations by a user of the microscope system 1 and inputs operation signals to the control device 10. The input device 40 is, for example, a keyboard, a mouse, a foot switch, a touchpad, a handle, a joystick, various switches, etc.
[0027] In the microscope system 1 configured as above, control is executed in relation to the movement of the stage 101 according to the possibility of collision of the objective lens 103.
[0028] Fig. 2 is a block diagram showing the functional configuration of a control device according to one embodiment of the present invention. Fig. 3 is a flowchart of processing performed by a control device according to one embodiment of the present invention. Fig. 4 is a diagram illustrating the configuration of a region information table in which region information is stored. Figs. 5 and 6 are diagrams illustrating the relationship between a safety region and a collision region. Hereinafter, with reference to Figs. 2 to 6, a control process according to the possibility of collision of the objective lens 103 performed in the microscope system 1 will be described.
[0029] 2, the control device 10 includes a detection unit 11, a storage unit 12, an acquisition unit 13, and a control unit 14 as components related to control in response to the possibility of collision of the objective lens 103 with the movement of the stage 101. In the microscope system 1, the control device 10 having the functional configuration shown in FIG. 2 executes the processing shown in FIG. 3 to deal with the possibility of collision of the objective lens 103 with the movement of the stage 101.
[0030] First, the detection unit 11 detects lens type information that identifies the type of objective lens 103 placed on the observation light path of the microscope system 1, and container type information that identifies the type of container placed on the stage 101 of the microscope system 1 (step S1).
[0031] Next, the acquisition unit 13 acquires area information that identifies the collision area based on the lens type information and container type information detected by the detection unit 11 (step S2).
[0032] The collision area refers to an area where an objective lens arranged on the observation light path may collide with a container or the like placed on the stage 101. The collision probability between the objective lens and the container calculated to determine the collision area is calculated based on at least three-dimensional shape information of the objective lens, three-dimensional shape information of the container, and the working distance (WD) of the objective lens. That is, the collision probability is calculated using information in the Z direction in addition to information in the X and Y directions. The three-dimensional shape information used to calculate the collision probability needs only to include information sufficient to calculate the collision probability, which differs depending on the position of the objective lens in the Z direction. For example, it may be detailed design information created using CAD software, or it may be somewhat simplified information.
[0033] In step S2, the acquisition unit 13 may read out area information corresponding to the combination of lens type information and container type information detected in step S1 from the storage unit 12. The area information may be stored in the storage unit 12 in association with the combination of lens type information and container type information, as in table T1 shown in Fig. 4, for example.
[0034] FIG. 4 shows an example in which region information is stored in a region column in association with lens type information stored in a lens type column and container types stored in a container type column. The region information may be information that identifies a collision region, and the method of identification is not particularly limited. The region information may be information that represents the collision region itself. Furthermore, the region information may be information that represents a safe region in which there is no possibility of collision between the stage 101 and the sample S, sample holder, or the like, or may be information that identifies other regions as collision regions by representing the safe region. FIG. 4 shows an example in which region information represents a safe region and identifies other regions as collision regions.
[0035] The region information K1 stored in association with the combination of lens type information indicating "objective lens X" and container type information indicating "container A" included in the table T1 shown in Fig. 4 indicates the XY coordinates of two points. As shown in Fig. 5, these two XY coordinates represent the upper left coordinates (X1, Y1) and lower right coordinates (X2, Y2) of the rectangular safety region Rs. This region information K1 identifies the collision region Rc as the region outside the safety region Rs represented by these two points.
[0036] Furthermore, the region information K2 stored in association with the combination of lens type information indicating "objective lens X" and container type information indicating "container C" included in table T1 shown in FIG. 4 indicates the distance from the origin (0, 0). This distance represents the radius (R1) of the circular safety region Rs, as shown in FIG. 6. This region information K2 identifies the collision region Rc as the region outside the safety region Rs represented by this radius.
[0037] The above describes a case where a collision region is determined based on a pre-calculated collision probability, and further, information specifying the determined collision region is stored in the storage unit 12 as region information. However, in step S2, the acquisition unit 13 may dynamically generate and acquire region information based on a combination of lens type information and container type information, instead of reading and acquiring region information pre-stored in the storage unit 12. That is, the collision probability may be dynamically calculated based on three-dimensional shape information of the objective lens, three-dimensional shape information of the container, and the working distance (WD) of the objective lens, which are identified from the lens type information and container type information, and the region information may be dynamically generated based on the calculated collision probability.
[0038] The control unit 14 outputs control information related to the control of at least one of the output device 30 and the stage 101 based on the area information acquired by the acquisition unit 13 (step S3).
[0039] The control information may be, for example, display control information output to the display device 31, and the display device 31 may display an image of the collision area based on the display control information. This allows the user to visually recognize the possibility of a collision according to the observation position, and the microscope system 1 can urge the user to avoid moving the stage 101 where there is a possibility of a collision. Furthermore, the control information may be, for example, stage control information output to the microscope controller 20, and the microscope controller 20 can restrict the movement of the stage 101 to the area where there is a possibility of a collision based on the stage control information.
[0040] As described above, according to the microscope system 1, the control processing shown in Figure 4 is performed, so that the possibility of a collision of the objective lens 103 due to movement of the stage 101 can be addressed by collision avoidance operations by the microscope system 1 based on area information, or by voluntary collision avoidance actions by the user based on area information.
[0041] Furthermore, in the microscope system 1, control is performed according to the type of container in addition to the type of objective lens. Therefore, it is possible to deal with the possibility of collision between the container and the objective lens 103 in addition to the possibility of collision between the stage 101 and the objective lens 103. Furthermore, in the microscope system 1, control processing is performed using area information generated in consideration of Z-direction information such as height and WD. Therefore, it is possible to deal with the possibility of collision with higher precision than conventional technology.
[0042] Specific examples of the control process will be described below in each embodiment. (First embodiment) FIG. 7 is a diagram showing an example of an application screen displayed on a display device. FIG. 8 is a diagram showing a flowchart of operation control processing according to this embodiment. FIG. 9 is a diagram showing an example of the configuration of a region information table according to this embodiment. FIG. 10 is a diagram for explaining an example of the relationship between the opening and the collision region in this embodiment. FIG. 11 is a diagram showing another example of the configuration of the region information table according to this embodiment. FIG. 12 is a diagram for explaining another example of the relationship between the opening and the collision region in this embodiment. FIG. 13 is a diagram for explaining differences in objective lens position due to the material of the microplate. FIG. 14 is a diagram showing another example of the configuration of a material information table according to this embodiment.
[0043] When the microscope system 1 executes the program, a window W shown in Fig. 7 is displayed on the display device 31, and an application screen is displayed within the window W. Through the application screen shown in Fig. 7, the user can observe a specimen and give various setting instructions to the microscope system 1. First, the application screen will be described.
[0044] Area R1 is an area for selecting an objective lens. When the user selects an objective lens in area R1, the revolver 104 positions the selected objective lens on the optical axis. Area R2 is an area for inputting imaging instructions. Area R3 is an area where a live image is displayed.
[0045] Area R4 is an area where a macro image is displayed, and includes area R41, which displays an image of the entire vessel holder, and area R42, which displays an entire image of one of the samples placed in the vessel holder. In this example, area R41 displays an image of vessel holder H1 corresponding to a Petri dish. Area R42 displays an image of Petri dish D placed in vessel holder H1 and a mark F indicating the current field of view.
[0046] Area R42 is a GUI area that accepts instructions to move the stage 101, and is hereinafter referred to as the "stage navigator." For example, by clicking on any position on area R42, the user can input a movement instruction to the microscope system 1 that specifies the clicked position as the movement destination. In addition, by dragging mark F on area R42, the user can input a movement instruction to the microscope system 1 to the drag destination.
[0047] Area R5 is an area for selecting settings for the microscope system 1. In area R5, by selecting the "Container" tab as shown in Fig. 7, it is possible to select, for example, the container shape and container material.
[0048] The processing shown in FIG. 8 will be described below using as an example a case where the user operates the stage navigator on the application screen shown in FIG. 7 to change the observation position.
[0049] The control device 10 first detects container type information and lens type information (steps S11 and S12). Here, the detection unit 11 detects container type information by reading the settings of the “Container” tab in region R5, for example, and detects objective type information by reading the settings of region R1. The detection unit 11 may also detect objective type information of the objective lens positioned on the optical axis based on the detection results of a sensor provided in the revolver and information stored in the memory unit 12 about the objective lens attached to the revolver. Alternatively, the container and objective lens may be provided with identifiers such as barcodes or RFID tags, and the container type information and lens type information may be detected by reading them. Here, an example will be described in which the container shape “Petri dish” and the container material “glass” are detected as the container type information, and the lens type “Objective Lens A” is detected as the lens type information.
[0050] The control device 10 then acquires region information based on the container type information detected in step S11 and the lens type information detected in step S12 (step S13). Here, the acquisition unit 13 acquires region information related to the lens type "objective lens A" and the container material "glass" from table T2 shown in FIG. 9, which is stored in the memory unit 12 and is related to the container shape "Petri dish." In this example, the radius Rag is acquired as region information indicating the safe region. Note that "Plastic" and "Glass" in the container material column indicate the material used on the container bottom, which particularly affects observation.
[0051] Thereafter, when the user specifies an XY position that is an observation position on region R42, the control device 10 detects the user's selection of the XY position (step S14). The control device 10 determines whether or not a movement into the collision region has been instructed (step S15). Here, the control unit 14 determines the range of radius Rag from the origin indicated by the region information acquired in step S13 as the safety region, and further determines the region outside the safety region as the collision region. Finally, the control unit 14 determines whether or not the XY position detected in step S14 is within the collision region.
[0052] Note that boundary B1 in FIG. 10 indicates the outer edge of the safety area calculated from the area information acquired in step S13. In this embodiment, as will be described later, the stage 101 is controlled by using the safety area as the movable range of the stage 101. An opening AP shown in FIG. 10 is an opening formed in the container holder H1, and illumination light is irradiated onto the sample S through the opening AP. As shown in FIG. 10, boundary B1 of the safety area is contained within the opening AP so that the objective lens 103 does not collide with the stage 101. Furthermore, a guide G shown in FIG. 10 is a structure such as a protrusion or recess formed in the container holder H2 that positions the Petri dish.
[0053] If the XY position selected by the user is not within the collision area, that is, if it is within the boundary B1 shown in FIG. 10 (step S15 NO), the control device 10 controls the stage 101 to move to the XY position selected by the user (step S16). On the other hand, if the XY position selected by the user is within the collision area, that is, if it is outside the boundary B1 shown in FIG. 10 (step S15 YES), the control device 10 restricts the movement of the stage 101 to the XY position selected by the user (step S17). Specifically, the control device 10 controls the stage 101 to prohibit movement of the stage 101 into the collision area. Here, the control device 10 may, for example, control the stage 101 so that it moves to a position outside the collision area between its current position and the XY position selected by the user and stops there. In other words, the control device 10 may stop the stage 101 close to the selected XY position within a range where there is no possibility of collision.
[0054] As described above, in this embodiment, when the microscope system 1 detects a movement instruction for the stage 101 specifying a destination within the collision area, the microscope system 1 prohibits movement to the collision area where there is a possibility of collision by performing the processing shown in Fig. 8. This makes it possible to avoid collision of the objective lens 103. Furthermore, in this embodiment, even if a destination within the collision area is specified, the microscope system 1 can change the observation position by moving the stage 101 within a range where there is no possibility of collision.
[0055] 9 illustrates table T2 corresponding to the container shape "Petri dish," but in addition to table T2, memory unit 12 also stores table T3 shown in FIG. 11. When container holder H2 shown in FIG. 12 is placed on stage 101 instead of container holder H1, and the container shape "microplate" is selected in region R5, control device 10 may acquire container type information from table T3 shown in FIG. 11 in step S11.
[0056] Boundary B1 in FIG. 12 indicates the outer edge of the safety area calculated from area information within table T3. In this embodiment, when a microplate is used, the stage 101 is controlled using the safety area as the movable range of the stage 101, just as when a Petri dish is used. An opening AP shown in FIG. 12 is an opening formed in the container holder H2, and illumination light is irradiated onto the sample S through the opening AP. As shown in FIG. 12, boundary B1 of the safety area is contained within the opening AP so that the objective lens 103 does not collide with the stage 101. Furthermore, guide G shown in FIG. 12 is a structure such as a protrusion or recess formed in the container holder H2 that positions the microplate.
[0057] As shown in Figures 7, 9, and 11, the container identification information preferably includes at least information identifying the shape of the container and information identifying the material of the container. This point will be explained with reference to Figures 13 and 14. Figures 13(a) and 13(b) show examples of two microplates in which the bottom surface P1 and the back surface P2 of the wells are at the same height. Figure 13(a) shows a plastic microplate Mp, and Figure 13(b) shows a glass microplate Mg.
[0058] In both microplates Mp and Mg, the back surfaces P2 of the wells are located at the same height Hb from the bottom surface P1. However, the thickness of the well bottom varies depending on the material. For example, as shown in Figure 14, the bottom thickness is 0.17 mm for glass wells and 1.1 mm for plastic wells. Therefore, the height Hu of the well bottom P3, which corresponds to the height of the observation surface, differs between microplates Mp and Mg, as shown in Figures 13 and 14.
[0059] In order to focus on the specimen, it is necessary to move the objective lens tip surface P4 closer to a position that is the working distance WD of the objective lens 103 from the well bottom surface P3 (observation surface). In other words, the Z position of the objective lens is determined by the height of the well bottom surface P3 (observation surface) minus the working distance WD. When using a plastic microplate Mp with a thick well bottom, it is necessary to move the objective lens tip surface P4 closer to the well back surface P2 than when using a glass microplate Mg with a thin well bottom. This increases the possibility of collision with the microplate Mp, and therefore narrows the range in which the stage 101 can move without colliding with the microplate Mp.
[0060] As described above, the collision area may vary depending not only on the shape of the container but also on the material. Therefore, it is desirable to detect at least information identifying the shape of the container and information identifying the material of the container as container identification information and use this information to acquire the area information. Note that table T3 shown in FIG. 14 may be stored in the storage unit 12 together with the three-dimensional shape information of the container, and the acquisition unit 13 may dynamically calculate and acquire the area information using this information.
[0061] (Second embodiment) Fig. 15 is a diagram showing a flowchart of the operation control process according to this embodiment. Figs. 16 and 17 are diagrams showing an example of the display of the stage navigator according to this embodiment. This embodiment differs from the first embodiment in that a collision area is displayed. Below, the process shown in Fig. 15 will be explained using an example in which a user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0062] The control device 10 first detects container type information and lens type information (steps S21 and S22), and acquires area information based on the detected container type information and lens type information (step S23). The processes from step S21 to step S23 are the same as the processes from step S11 to step S13 in FIG. 8.
[0063] Thereafter, the control device 10 displays the collision area on the macro image (step S24). Here, the control unit 14 controls the display device 31 so that the display device 31 displays information indicating the collision area on the image of the container displayed in the GUI area (i.e., area R41, which is the stage navigator) that accepts instructions to move the stage 101.
[0064] If the container is a Petri dish, the control unit 14 controls the display device 31 so that the display device 31 displays the collision region Rc superimposed on an image of the Petri dish D, as shown in FIG. 16, for example. If the container is a microplate M, the control unit 14 controls the display device 31 so that the display device 31 displays the collision region Rc superimposed on an image of the microplate M, as shown in FIG. 17, for example. The inner boundary of the collision region Rc is a boundary B1 with the safety region, which indicates the range of movement. The outer boundary of the collision region Rc may be the outer edge of the container. However, the collision region Rc may be displayed in a shape (e.g., circle, rectangle, etc.) corresponding to the shape of the container identified from the container type information, and the outer boundary of the collision region Rc is not limited to the exact outer edge of the container.
[0065] The subsequent processing is the same as in the first embodiment. That is, the control device 10 detects the selection of an XY position by the user (step S25), and if a movement outside the collision area is instructed (step S26 NO), the control device 10 controls the stage 101 to move to the XY position selected by the user (step S27). Also, if a movement into the collision area is instructed (step S26 YES), the control device 10 restricts the movement of the stage 101 to the XY position selected by the user (step S28).
[0066] As described above, the microscope system 1 can avoid collision of the objective lens 103, similar to the first embodiment, by performing the processing shown in Fig. 15. In particular, in the processing shown in Fig. 15, the collision area is displayed in advance, so that the user can voluntarily avoid moving into the collision area.
[0067] (Third embodiment) Fig. 18 is a diagram showing a flowchart of the operation control process according to this embodiment. Fig. 19 is a diagram showing an example of a warning window according to this embodiment. This embodiment differs from the second embodiment in that, when a user instructs movement into the collision area, a warning of the possibility of a collision is issued and the user is prompted to select again whether or not to execute the movement. Below, the process shown in Fig. 18 will be described using as an example a case where a user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0068] The processes from step S31 to step S37 in Fig. 18 are the same as the processes from step S21 to step S27 in Fig. 15. When a movement into the collision region is instructed (step S36: YES), the control device 10 notifies the user of the possibility of a collision (step S38). Here, the control unit 14 controls the output device 30 so that the output device 30 notifies the user of the possibility of a collision of the objective lens 103. Specifically, when a position within the collision region Rc is selected, the control unit 14 may display a window W1 shown in Fig. 19 on the display device 31 to allow the user to select whether or not to execute the movement.
[0069] When "Perform Movement" is selected on window W1 (step S39 YES), the control device 10 restricts the movement of the stage 101 to the XY position selected by the user (step S40). That is, the stage 101 is stopped as close to the selected XY position as possible within a range where there is no risk of collision. On the other hand, when "Cancel Movement" is selected on window W1 (step S39 NO), the control device 10 returns to step S35 and waits until a new XY position is selected.
[0070] As described above, the microscope system 1 can avoid collision of the objective lens 103 by performing the processing shown in Fig. 18, similarly to the second embodiment. Furthermore, in the processing shown in Fig. 18, when an instruction to move into the collision area is given, a notification of the possibility of collision is issued. This allows the user to reconsider the selection of the observation position.
[0071] In the present embodiment, an example has been shown in which the display device 31 notifies the possibility of a collision, but any output device 30 may notify the possibility of a collision. For example, a speaker may notify the possibility of a collision by sound, or a vibrator may notify the possibility of a collision by vibration. Furthermore, a plurality of output devices 30 may notify the possibility of a collision. For example, the display device 31 and a speaker may notify the possibility of a collision, or the display device 31, a speaker, and an LED lamp may notify the possibility of a collision.
[0072] (Fourth embodiment) Fig. 20 is a diagram showing a flowchart of the operation control process according to this embodiment. In the first to third embodiments, an example was shown in which the safety area was set as the movable range and movement into the collision area was prohibited, but in this embodiment, the safety area and the collision area are set as the movable range, which is different from the first to third embodiments. Below, the process shown in Fig. 20 will be explained using an example in which the user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0073] The processes of steps S41 to S46 in Fig. 20 are the same as the processes of steps S11 to S16 in Fig. 8. When movement into the collision area is instructed (step S45 YES), the control device 10 moves the stage 101 to the selected XY position while limiting the movement speed within the collision area (step S47). Here, the control unit 14 controls the stage 101 so as to limit the movement speed of the stage 101 within the collision area to a speed lower than the movement speed in the safety area (outside the collision area).
[0074] As described above, by performing the processing shown in FIG. 20 , the microscope system 1 limits the movement speed while moving through a collision area where a collision is possible, making it possible to reduce the impact if the objective lens 103 collides with the stage 101 or a container, and to minimize damage by immediately stopping the objective lens 103, etc. Furthermore, because the collision area is movable with restrictions, the observation range is wider than when movement of the collision area is prohibited. Therefore, according to this embodiment, it is possible to minimize damage caused by the possibility of collision of the objective lens as the stage moves.
[0075] (Fifth embodiment) Fig. 21 is a diagram showing a flowchart of the operation control process according to this embodiment. This embodiment differs from the fourth embodiment in that a collision area is displayed. Below, the process shown in Fig. 21 will be explained using an example in which a user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0076] The processes of steps S51 to S53 and steps S55 to S58 in Fig. 21 are similar to the processes of steps S41 to S47 in Fig. 20. Furthermore, the process of step S54 in Fig. 21 is similar to the process of step S34 in Fig. 18, and the collision region Rc is displayed on the macro image as shown in Figs. 16 and 17, for example.
[0077] As described above, the microscope system 1 can minimize damage caused when an objective lens collides with the movement of the stage, similar to the fourth embodiment, by performing the processing shown in Fig. 21. Furthermore, in the processing shown in Fig. 21, the collision area is displayed in advance, so that the user can avoid the collision of the objective lens 103 by voluntarily avoiding movement into the collision area.
[0078] (Sixth embodiment) Fig. 22 is a diagram showing a flowchart of the operation control process according to this embodiment. This embodiment differs from the fifth embodiment in that, when a user instructs movement into the collision area, a collision possibility is notified and the user is prompted to select again whether to execute the movement. Below, the process shown in Fig. 22 will be described using as an example a case where the user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0079] The processes from step S61 to step S67 in Fig. 22 are the same as the processes from step S51 to step S57 in Fig. 21. When a movement into the collision region is instructed (step S66: YES), the control device 10 notifies the user of the possibility of a collision (step S68). Here, the control unit 14 controls the output device 30 so that the output device 30 notifies the user of the possibility of a collision of the objective lens 103. Specifically, when a position within the collision region Rc is selected, the control unit 14 may display a window W1 shown in Fig. 19 on the display device 31 to allow the user to select whether or not to execute the movement.
[0080] When "Move" is selected on the window W1 (step S69 YES), the control device 10 moves the stage 101 to the selected XY position while limiting the movement speed within the collision area (step S70). Here, the control unit 14 controls the stage 101 so as to limit the movement speed of the stage 101 within the collision area to a speed lower than that within the safety area.
[0081] As described above, the microscope system 1 can minimize damage caused when an objective lens collides with the stage as it moves, similar to the fourth and fifth embodiments, by performing the processing shown in Fig. 22. Furthermore, in the processing shown in Fig. 22, when an instruction to move into the collision area is given, a notification of the possibility of collision is issued. This allows the user to reconsider the selection of the observation position.
[0082] (Seventh embodiment) Fig. 23 is a diagram showing a flowchart of the operation control process according to this embodiment. This embodiment differs from the sixth embodiment in that, when a user instructs movement into the collision area, a warning of the possibility of a collision is given not only before the movement starts but also while the object is moving within the collision area. Below, the process shown in Fig. 23 will be described using an example in which the user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0083] The processes of steps S71 to S79 and step S81 in Fig. 23 are the same as the processes of steps S61 to S70 in Fig. 22. The control device 10 notifies the user of the possibility of a collision while the stage 101 is moving within the collision area (step S80). Here, the control unit 14 controls the output device 30 so that the output device 30 notifies the user of the possibility of a collision of the objective lens 103 while the stage 101 is moving within the collision area.
[0084] The output device 30 that notifies the driver of the possibility of a collision in step S78 and the output device 30 that notifies the driver of the possibility of a collision in step S80 may be the same device or different devices. For example, the display device 31 may notify the driver of the possibility of a collision in step S78, and a speaker or an LED lamp may notify the driver of the possibility of a collision in step S80.
[0085] As described above, the microscope system 1 can minimize damage caused by a collision of the objective lens as the stage moves, similar to the fourth to sixth embodiments, by performing the processing shown in Fig. 23. Furthermore, in the processing shown in Fig. 23, the possibility of a collision is notified while the stage is moving within the collision area, so the user can grasp the timing at which a collision may occur and can prepare in advance for a collision. Therefore, the stage 101 can be stopped immediately after a collision occurs, further minimizing damage.
[0086] (Eighth embodiment) Fig. 24 is a diagram showing a flowchart of the operation control process according to this embodiment. This embodiment differs from the fifth embodiment in that no speed limit is imposed on the stage 101 within the collision area. Below, the process shown in Fig. 24 will be explained using an example in which the user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0087] The processing from step S91 to step S95 in Fig. 24 is the same as the processing from step S51 to step S55 in Fig. 21. Furthermore, the processing from step S96 in Fig. 24 is the same as the processing from step S57 in Fig. 21, and the stage 101 is controlled regardless of the movement destination.
[0088] As described above, by performing the processing shown in Figure 22, the microscope system 1 displays the collision area in advance, as in the fifth embodiment, so that the user can avoid collision of the objective lens 103 by voluntarily avoiding moving into the collision area.
[0089] (Ninth embodiment) Fig. 25 is a diagram showing a flowchart of the operation control process according to this embodiment. Figs. 26 and 27 are diagrams for explaining an example of the relationship between the opening and the restriction area in this embodiment. In the above-described embodiment, an example was described in which the entire area outside the safety area was defined as the collision area, but the collision area may be further subdivided depending on the difference in the possibility of collision. This embodiment is similar to the above-described embodiment in that the area outside the safety area is defined as the collision area, but differs from the above-described embodiment in that the collision area includes a prohibited area where movement of the stage is prohibited and a restriction area where the movement speed of the stage is limited.
[0090] When the objective lens attempts to move outside the opening AP of the container holder (container holder H1, container holder H2) shown in Figures 26 and 27 due to movement of the stage 101, it will collide with the container holder regardless of the type of objective lens. More specifically, considering the thickness of the objective lens, the objective lens can only move from the edge of the opening AP to a position inward by the radius of the objective lens (boundary B2). For this reason, the interior of boundary B2, which is inward by the radius of the objective lens from the edge of the opening AP, is defined as the movable range of the stage 101. The area between boundary B1 with the safe area and boundary B2 indicating the movable range is defined as the restricted area of the collision area, and the area outside boundary B2 is defined as the prohibited area of the collision area.
[0091] In this case, if the container is a Petri dish as shown in FIG. 26, the region information may be two radii, one defining the inner edge of the restricted region and the other defining the outer edge of the restricted region. That is, the region information may be the radius of boundary B1 and the radius of boundary B2. Also, if the container is a microplate as shown in FIG. 27, the region information may be four coordinates, two coordinates defining the inner edge of the restricted region and two coordinates defining the outer edge of the restricted region. That is, the region information may be the coordinates of the top left and bottom right of boundary B1 and the coordinates of the top left and bottom right of boundary B2.
[0092] The processing shown in Fig. 25 will be described below using as an example a case where a user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7. The processing from step S101 to step S104 in Fig. 25 is the same as the processing from step S11 to step S14 in Fig. 8.
[0093] The control device 10 determines whether movement into the prohibited area or the restricted area has been instructed (steps S105 and S107), and controls the stage 101 according to the determination result. Specifically, when the control device 10 determines that movement into the prohibited area has been instructed, the control device 10 controls the stage 101 to limit the movement speed of the stage 101 within the restricted area to a speed lower than that outside the collision area (safety area) and to prohibit movement of the stage 101 into the prohibited area (step S106). When the control device 10 determines that movement into the restricted area has been instructed, the control device 10 controls the stage 101 to move to a selected XY position while limiting the movement speed of the stage 101 within the restricted area to a speed lower than that outside the collision area (safety area) (step S108). When the control device 10 determines that movement into the safe area has been instructed, the control device 10 controls the stage 101 to move to the selected XY position (step S109).
[0094] As described above, by performing the processing shown in Fig. 25, the microscope system 1 can prohibit movement into areas where the possibility of collision is high, while allowing movement into areas where the possibility of collision is relatively low. It can also minimize damage when the objective lens collides with the movement of the stage. Furthermore, because movement is permitted with restrictions in areas where the possibility of collision is relatively low, a wider observable range can be ensured than when movement is prohibited throughout the entire collision area where there is a possibility of collision.
[0095] (Tenth embodiment) Fig. 28 is a diagram showing a flowchart of the operation control process according to this embodiment. Figs. 29 to 31 are diagrams showing display examples of the stage navigator according to this embodiment. This embodiment differs from the ninth embodiment in that collision areas (restricted areas and prohibited areas) are displayed. Below, the process shown in Fig. 28 will be explained using an example in which a user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0096] The processes of steps S111 to S113 and steps S115 to S120 in Fig. 28 are the same as the processes of steps S101 to S109 in Fig. 25. In step S114, the control device 10 displays a restricted area Rr and a prohibited area Re on the macro image. Specifically, the control unit 14 controls the display device 31 so that the display device 31 displays the restricted area Rr and the prohibited area Re on the image of the container displayed in the GUI area that accepts instructions to move the stage 101, for example, as shown in Fig. 29.
[0097] As described above, by performing the processing shown in FIG. 28, the microscope system 1 can prohibit movement into areas with a high collision probability while allowing movement into areas with a relatively low collision probability, similar to the ninth embodiment. Furthermore, damage caused when the objective lens collides with the stage as it moves can be minimized. Furthermore, by allowing movement with restrictions in areas with a relatively low collision probability, a wider observable range can be secured than when movement is prohibited throughout the entire collision region where collision is possible. Furthermore, in the processing shown in FIG. 28, the prohibited region and the restricted region are displayed separately in advance, allowing the user to select an observation position while understanding the difference in collision probability.
[0098] 28 and 29 show examples in which both the prohibited area and the restricted area are displayed, but in step S114, only the restricted area Rr may be displayed as shown in Figures 30 and 31. By displaying the restricted area Rr, it is possible to understand that the area inside is the safe area and the area outside is the prohibited area.
[0099] (Eleventh embodiment) Fig. 32 is a diagram showing a flowchart of the operation control process according to this embodiment. This embodiment differs from the tenth embodiment in that no speed limit is imposed on the stage 101 within the restricted area. Below, the process shown in Fig. 32 will be explained using an example in which the user changes the observation position by operating the stage navigator on the application screen shown in Fig. 7.
[0100] The processing from step S121 to step S126 in FIG. 32 is the same as the processing from step S111 to step S116 in FIG. 28. When the control device 10 determines that movement into the prohibited area has been instructed, it controls the stage 101 to prohibit movement of the stage 101 into the prohibited area (step S127). The processing from step S127 is the same as the processing from step S17 in FIG. 8. On the other hand, when the control device 10 determines that movement into the prohibited area has not been instructed, that is, that movement into the safe area or restricted area has been instructed, it controls the stage 101 to move to the selected XY position (step S128). The processing from step S128 is the same as the processing from step S120 in FIG. 28.
[0101] 32, the microscope system 1 can prohibit movement into areas with a high collision probability while allowing movement into areas with a relatively low collision probability, similar to the tenth embodiment. Also, since the prohibited areas and restricted areas are displayed separately in advance, the user can select an observation position while understanding the difference in collision probability, similar to the tenth embodiment. Furthermore, since the user is allowed to move after being made aware of areas with a relatively low collision probability, a wider observable range can be ensured than when movement is prohibited throughout the entire collision area where collision is possible.
[0102] Fig. 33 is a diagram illustrating an example of the hardware configuration of a computer for realizing the control device 10 according to the above-described embodiment. The computer 200 shown in Fig. 33 includes, for example, a processor 201, a memory 202, a storage device 203, a reading device 204, a communication interface 206, and an input / output interface 207. The processor 201, the memory 202, the storage device 203, the reading device 204, the communication interface 206, and the input / output interface 207 are connected to one another via, for example, a bus 208.
[0103] The processor 201 may be, for example, a single processor, a multiprocessor, or a multi-core processor. The processor 201 reads and executes a program stored in the storage device 203, thereby executing the control processes exemplified in Figures 3, 8, 15, 18, 20 to 25, 28, 32, etc., i.e., at least some or all of the functions of the detection unit 11, acquisition unit 13, control unit 14, etc.
[0104] The memory 202 may be, for example, a semiconductor memory and may include a RAM area and a ROM area. The storage device 203 may be, for example, a semiconductor memory such as a hard disk or a flash memory, or an external storage device. At least some or all of these operate as the storage unit 12.
[0105] The reader 204 accesses the removable storage medium 205 in accordance with, for example, an instruction from the processor 201. The removable storage medium 205 is realized by, for example, a semiconductor device, a medium for inputting and outputting information by magnetic action, or a medium for inputting and outputting information by optical action. An example of a semiconductor device is a USB (Universal Serial Bus) memory. An example of a medium for inputting and outputting information by magnetic action is a magnetic disk. An example of a medium for inputting and outputting information by optical action is a CD (Compact Disc)-ROM, a DVD (Digital Versatile Disc), a Blu-ray Disc, etc. (Blu-ray is a registered trademark).
[0106] The communication interface 206 communicates with other devices (such as the microscope 100 and the microscope controller 20) according to instructions from the processor 201. The input / output interface 207 is an interface with the output device 30 and the input device 40, for example.
[0107] The program executed by the processor 201 is provided to the computer in the following form, for example. (1) It is pre-installed in the storage device 203. (2) Provided by removable storage medium 205. (3) Provided from a server such as a program server.
[0108] Note that the hardware configuration of the computer for realizing the control device described with reference to Figure 33 is an example, and the embodiment is not limited to this. For example, part of the above-described configuration may be deleted, or new configuration may be added. Furthermore, in another embodiment, for example, part or all of the functions of the above-described processing device may be implemented as hardware using electrical circuits such as an FPGA (Field Programmable Gate Array), an SoC (System-on-a-Chip), an ASIC (Application Specific Integrated Circuit), and a PLD (Programmable Logic Device).
[0109] The above-described embodiments are illustrative examples provided to facilitate understanding of the invention, and the present invention is not limited to these embodiments. Modifications and alternatives to the above-described embodiments may be included. In other words, the components of each embodiment may be modified without departing from the spirit and scope of the invention. Furthermore, new embodiments can be implemented by appropriately combining multiple components disclosed in one or more embodiments. Furthermore, some components may be deleted from or added to the components shown in each embodiment. Furthermore, the processing procedures shown in each embodiment may be performed in a different order as long as they are not inconsistent. In other words, the microscope system, microscope system operating method, and program of the present invention may be subject to various modifications and variations without departing from the scope of the claims.
[0110] As described above, the collision area varies depending on the objective lens and the container. Therefore, although not specifically mentioned in the above-described embodiment, it is desirable that the control unit 14 controls the display device 31 so that, upon detecting a change in the objective lens arranged on the observation light path or a change in the container placed on the stage 101, the display device 31 updates the information indicating the collision area displayed on the image of the container, as shown in Fig. 34. Fig. 34 shows how the collision area expands due to a change in the objective lens or a change in the container.
[0111] In the tenth embodiment, examples have been shown in which both the prohibited area and the restricted area are displayed, and examples in which only the restricted area is displayed, but the display of the prohibited area and the restricted area may be set by the user. For example, as shown in Fig. 35, the setting may be possible in area R5 of the application screen.
[0112] In the above-described embodiment, an example was shown in which the container type information included information on the container shape and information on the container material, but the container type information may also include information that identifies the container in more detail. This is because even if the container shape and container material are identified (for example, even if the container is identified as a plastic microplate), the height of the well bottom surface P3, which corresponds to the observation surface, can vary depending on the type of container, as shown in Figure 34.
[0113] The microplate Mg shown in Fig. 36(b) has an observation surface (well bottom surface P3) at a different height than the microplate Mp shown in Fig. 36(a) due to differences in the thickness of the well bottom caused by the material. The microplate Mp1 shown in Fig. 36(c) and the microplate Mp2 shown in Fig. 36(d) have observation surfaces (well bottom surfaces P3) at a different height than the microplate Mp shown in Fig. 36(a) due to differences in the type of container.
[0114] For this reason, the container type information may include information on the type of container (e.g., product number, etc.), as shown in Fig. 37. In this case, too, the container type may be set in area R5 of the application screen, as shown in Fig. 38, and the detection unit 11 may detect the container type information by reading out the settings of the "Container" tab in area R5 shown in Fig. 38.
[0115] To accommodate various types of containers, a means for the user to adjust the region information may be provided instead of storing information for each type in the storage unit 12. The microscope system 1 may provide the user with, for example, an editing screen that enables editing of the region information stored in the storage unit 12. The region information may be updated to match the type of container being used by directly editing the region information on the editing screen. Instead of directly editing the region information, the editing screen may be a screen for specifying parameters such as the observation height, as shown in FIG. 39 . By changing the parameters to match the type of container being used, the region information may be recalculated and updated. Furthermore, the editing screen may be a screen for updating the region information by dragging or otherwise moving the boundary of the collision region displayed on the image of the container. By providing an editing screen and enabling adjustment of the region information as needed, collision of the objective lens 103 with any container can be avoided.
[0116] Furthermore, the editing screen for editing the region information may provide a function for adding new region information. For example, when the user purchases a new objective lens, the region information related to the combination including the new objective lens may be stored in the storage unit 12.
[0117] Furthermore, in the above-described embodiment, an example has been described in which the user specifies a live observation position, but the above control may also be applied to a case in which the user specifies an imaging position, resulting in movement of the stage 101. For example, when the user specifies an imaging area to generate a composite image, if part of the imaging area overlaps with a collision area, the microscope system 1 may stop imaging and abandon generation of the composite image.
[0118] In the above-described embodiment, the moving speed of the stage 101 within the collision area is reduced compared to the safe area, but the moving speed of the stage 101 may be changed depending on the position within the collision area. For example, the moving speed may be reduced as the position within the collision area becomes farther from the origin.
[0119] Furthermore, in the above-described embodiment, an example has been shown in which the area information is acquired from the storage unit 12 of the microscope system 1, but the area information may also be acquired from a device outside the microscope system 1, such as a cloud server. For example, the acquisition unit 13 may acquire the area information from a device outside the microscope system 1 by transmitting a request including lens type information and container type information to the device outside the microscope system 1.
[0120] In this specification, the expression "based on A" does not mean "based only on A," but also means "based at least on A," and further means "based at least partially on A." That is, "based on A" may be based on B in addition to A, or may be based on a part of A. [Explanation of symbols]
[0121] 1. Microscope system 10 Control device 11 Detection unit 12 Storage section 13 Acquisition Department 14 Control Unit 20 Microscope Controller 30 Output Devices 31 Display device 40 Input Devices 100 microscopes 101 Stages 102 Light source 103 Objective Lens 104 Nosepiece 105 Digital Camera 200 computers 201 processor 202 memory 203 Storage device 204 Reading device 205 Storage medium 206 Communication Interface 207 Input / Output Interface 208 Bus Rc collision area Re prohibited area Rr Restricted region Rs safe area
Claims
1. a detection unit that detects lens type information that identifies the type of an objective lens arranged on an observation light path of a microscope system and container type information that identifies the type of a container placed on a stage of the microscope system; an acquisition unit that acquires area information that identifies a collision area where the objective lens may collide with the peripheral part of the container and a safety area where the objective lens may not collide with the peripheral part of the container, based on the lens type information and the container type information detected by the detection unit; a control unit that outputs control information related to control of at least one of an output device and the stage based on the area information acquired by the acquisition unit, the collision area includes a prohibited area where the possibility of collision with the peripheral portion is high and movement of the stage is prohibited, and a restricted area where the possibility of collision with the peripheral portion is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral portion of the container; When the control unit detects an instruction to move the stage specifying a destination within the prohibited area, the control unit controls the stage so as to prohibit the stage from moving into the prohibited area. A microscope system comprising:
2. 2. The microscope system according to claim 1, The control unit When a movement instruction for the stage specifying a movement destination within the restricted area is detected, the stage is controlled so as to limit the movement speed of the stage within the restricted area to a speed lower than that outside the collision area; When a movement instruction for the stage specifying a movement destination within the prohibited area is detected, the stage is controlled so as to limit the movement speed of the stage within the restricted area to a speed lower than that outside the collision area, and to prohibit movement of the stage into the prohibited area. A microscope system comprising:
3. 3. The microscope system according to claim 1, When the control unit detects an instruction to move the stage specifying a destination within the collision area, the control unit controls the output device so that the output device notifies the user of a possibility of collision of the objective lens. A microscope system comprising:
4. 2. The microscope system according to claim 1, The control unit controls the output device so that the output device notifies of a possibility of collision of the objective lens while the stage is moving within the collision region. A microscope system comprising:
5. 5. The microscope system according to claim 1, the output device includes a display device; The control unit controls the display device so that the display device displays information indicating the collision region on an image of the container displayed in a GUI area that receives an instruction to move the stage. A microscope system comprising:
6. 6. The microscope system according to claim 5, When the control unit detects switching of the objective lens arranged on the observation light path or switching of the container placed on the stage, the control unit controls the display device so that the display device updates information indicating the collision region displayed on the image of the container. A microscope system comprising:
7. 7. The microscope system according to claim 5, The control unit controls the display device to display information indicating the collision area in a shape corresponding to the shape of the container identified from the container type information. A microscope system comprising:
8. 3. The microscope system according to claim 1, the output device includes a display device; The control unit controls the display device so that the display device displays information indicating the restricted area on an image of the container displayed in a GUI area that receives an instruction to move the stage. A microscope system comprising:
9. 9. The microscope system according to claim 8, When the control unit detects switching of the objective lens arranged on the observation light path or switching of the container placed on the stage, the control unit controls the display device so that the display device updates information indicating the restricted area displayed on the image of the container. A microscope system comprising:
10. 10. The microscope system according to claim 8, The control unit controls the display device to display information indicating the restricted area in a shape corresponding to the shape of the container identified from the container type information. A microscope system comprising:
11. The microscope system according to any one of claims 1 to 10, further comprising: The area information is generated using at least three-dimensional shape information of the objective lens, three-dimensional shape information of the container, and the working distance of the objective lens. A microscope system comprising:
12. The microscope system according to any one of claims 1 to 11, further comprising: a storage unit that stores the region information in association with a combination of the lens type information and the container type information, The acquisition unit acquires, from the storage unit, the region information associated with the combination of the lens type information and the container type information detected by the detection unit. A microscope system comprising:
13. 13. The microscope system according to claim 1, The container type information includes information identifying at least the shape and material of the container. A microscope system comprising:
14. 1. A method of operating a microscope system, comprising: Detecting lens type information that identifies the type of an objective lens arranged on an observation light path of the microscope system and container type information that identifies the type of a container placed on a stage of the microscope system, Based on the detected lens type information and container type information, area information is acquired that identifies a collision area where the objective lens may collide with the peripheral part of the container and a safety area where the objective lens may not collide with the peripheral part of the container; outputting control information related to control of at least one of the output device and the stage based on the acquired area information; the collision area includes a prohibited area where the possibility of collision with the peripheral portion is high and movement of the stage is prohibited, and a restricted area where the possibility of collision with the peripheral portion is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral portion of the container; When a movement instruction for the stage specifying a movement destination within the prohibited area is detected, the stage is controlled so as to prohibit movement of the stage into the prohibited area. A method of operation characterized by:
15. The microscope system computer Detecting lens type information that identifies the type of an objective lens arranged on an observation light path of the microscope system and container type information that identifies the type of a container placed on a stage of the microscope system, Based on the detected lens type information and container type information, area information is acquired that identifies a collision area where the objective lens may collide with the peripheral part of the container and a safety area where the objective lens may not collide with the peripheral part of the container; outputting control information related to control of at least one of the output device and the stage based on the acquired area information; the collision area includes a prohibited area where the possibility of collision with the peripheral portion is high and movement of the stage is prohibited, and a restricted area where the possibility of collision with the peripheral portion is lower than that of the prohibited area, the restricted area being located between the prohibited area and the safe area, and where movement of the stage is not prohibited although there is a possibility that the objective lens will collide with the peripheral portion of the container; When a movement instruction for the stage specifying a movement destination within the prohibited area is detected, the stage is controlled so as to prohibit movement of the stage into the prohibited area. A program characterized by executing a process.
Citation Information
Patent Citations
Magnifying observation device, magnifying image observation method and computer-readable recording medium
DE102014226941A1
Device and method for observation
JP2005266083A
Microscope system, control method for the microscope system, and program for the control method
JP2011197306A
Microscope system, control method for the microscope system, and program for the control method
JP2011197307A
Controller for controlling microscope, container holder, microscope system, control method, and program
JP2015082098A