IMAGING APPARATUS, IMAGING SYSTEM, AND CONTROL METHOD

Abstract

To assist in associating container identification information added to a container with the image of a material accommodated in the container.SOLUTION: A photographing device 10 is designed to observe the sample accommodated in a container 70 having had identification information 72 added thereto from below the container 70. The photographing device 10 comprises: a photographing unit 15 that includes an imaging element 19; a polarization plane 62 which is a lightguide unit for guiding light from the identification surface of the container 70 having had the identification information 72 added thereto, the surface being different from the bottom surface of the container 70, to the photographing unit 15; and a movement unit for changing the relative position of the photographing unit 15 to the container 70. The photographing unit photographs the identification surface via the lightguide unit after the movement unit has changed the relative position to a first relative position where the optical axis of the photographing unit deviates from the container, and the photographing unit photographs the sample via the bottom surface after the movement unit has changed the relative position to a second relative position where the optical axis of the photographing unit intersects the container.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The disclosure of this specification relates to an imaging device, an imaging system, and a control method. [Background technology]

[0002] In culturing biological samples such as cells, various data including images are collected during the culturing period. It is desirable to manage the data collected during the culturing period in association with various information related to the culturing (hereinafter, simply referred to as the culturing information. The culturing information includes, for example, the type of cultured cells, the type of the culturing vessel, the culturing procedure and schedule, etc.).

[0003] A typical method for associating an image of a biological sample with culture information is to use container identification information attached to the culture container. Since the container identification information is associated with the culture information in advance, the image of the biological sample can be associated with the culture information via the container identification information by acquiring the container identification information attached to the culture container containing the biological sample before or after the biological sample is photographed.

[0004] To obtain container identification information, a dedicated reading device (e.g., a barcode reader) or a dedicated camera provided separately from the imaging device that images the biological sample is generally used, but Patent Document 1 describes a technology for obtaining container identification information attached to a container by adjusting the focus of the imaging device that images the biological sample. According to the technology described in Patent Document 1, container identification information can be obtained without providing a dedicated configuration. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6295570 Summary of the Invention [Problem to be solved by the invention]

[0006] In the device described in Patent Document 1, since the container identification information and the biological sample are present on the same axis, measures have been taken to configure the container identification information with a small dot pattern so that the presence of the container identification information does not adversely affect the image of the biological sample.

[0007] However, if the container identification information is made so small that it is difficult to visually recognize it, it is inconvenient because a person cannot directly check the container identification information attached to the container. Also, since it is not possible to create the container identification information by handwriting, a dedicated device is required to attach the container identification information to the container.

[0008] In light of the above-described situation, an object of one aspect of the present invention is to provide a new technology that assists in associating container identification information attached to a container with an image of a sample contained in the container. [Means for solving the problem]

[0009] An imaging device according to one aspect of the present invention is an imaging device for observing a sample contained in a container having identification information attached thereto from below the container, and includes a imaging unit including an image sensor, a light guide unit for guiding light from an identification surface, which is a surface of the container that is different from a bottom surface of the container and has the identification information attached thereto, to the imaging unit, and a moving unit for changing a relative position of the imaging unit with respect to the container, and after the moving unit changes the relative position to a first relative position in which the optical axis of the imaging unit is deviated from the container, the imaging unit photographs the identification surface via the light guide unit. and acquiring an image of the discrimination surface. After the moving unit changes the relative position to a second relative position where the optical axis of the photographing unit intersects with the container, the photographing unit photographs the sample via the bottom surface. and an image of the sample is acquired by the above-mentioned method, the image of the discrimination surface and the image of the sample being separate images, and the light guiding unit includes a reduction optical system that reduces a projection magnification between the discrimination surface and the image pickup element to a value lower than a projection magnification between the sample and the image pickup element. .

[0010] An imaging device system according to one aspect of the present invention comprises an imaging device according to the above aspect, and a control device that controls the operation of the imaging unit and the moving unit, and the control device records the identification information in association with an image of the sample.

[0011] A control method according to one aspect of the present invention is a control method for an imaging device including an imaging unit and a moving unit for changing a relative position of the imaging unit with respect to a container containing a sample, the control method changing the relative position to a first relative position in which an optical axis of the imaging unit is deviated from the container, and photographing an identification surface, which is a surface of the container that is different from a bottom surface of the container and has identification information attached thereto, via a light guiding unit that guides light from the identification surface to the imaging unit. and acquiring an image of the discrimination surface. The relative position is changed to a second relative position where the optical axis of the photographing unit intersects with the container, and the sample is photographed via the bottom surface. and an image of the sample is acquired by the above-mentioned method, the image of the discrimination surface and the image of the sample being separate images, and the light guiding unit includes a reduction optical system that reduces a projection magnification between the discrimination surface and the image pickup element to a value lower than a projection magnification between the sample and the image pickup element. . Effect of the Invention

[0012] According to the above aspect, it is possible to provide a new technique for assisting in associating container identification information attached to a container with an image of a sample contained in the container. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a system 1. [Diagram 2] FIG. 2 is a perspective view of the imaging device 10. [Diagram 3] 1 is a diagram illustrating an example of the configuration of an imaging device 10. FIG. [Figure 4] 2 is a diagram illustrating an example of the configuration of a light source unit 14 and an imaging unit 15. FIG. [Diagram 5] 2 is a diagram illustrating an example of the configuration of a control device 30. FIG. [Figure 6] FIG. 2 is a diagram illustrating the configuration of a culture vessel. [Figure 7] 5 is a flowchart showing an example of processing according to the first embodiment performed by the system 1. [Figure 8] 2 is an example of a top view of the imaging device 10. FIG. [Figure 9] 1 is a diagram for explaining a method in which the photographing device 10 photographs an identification surface. [Figure 10]1 is a diagram for explaining a method in which the imaging device 10 images a sample. [Figure 11] FIG. 13 is a diagram illustrating the configuration of another system. [Figure 12] 2 is an example of a top view of the imaging device 10a. [Figure 13] 10 is a diagram for explaining a method in which the photographing device 10a photographs an identification surface. [Figure 14] FIG. 4 is a ray diagram of the reduction optical system 63. [Figure 15] 13 is a diagram for explaining a method in which the photographing device 10b photographs the discrimination surface. FIG. [Figure 16] 1 is an example of a top view of the imaging device 10c. [Figure 17] 10 is a diagram for explaining a method for the photographing device 10c to photograph an identification surface. [Figure 18] 13 is a diagram for explaining a method in which the photographing device 10d photographs an identification surface. FIG. [Figure 19] 1 is an example of a top view of the imaging device 10e. [Figure 20] 13 is a diagram for explaining a method in which the photographing device 10e photographs the discrimination surface. FIG. [Figure 21] 10 is a flowchart showing another example of the process performed by the system. [Figure 22] 1 is a diagram for explaining a method in which the photographing device 10 photographs an identification surface. [Diagram 23] FIG. 11 is a diagram for explaining an example of a method for creating a composite image. [Figure 24] 10 is a diagram for explaining a method for the photographing device 10f to photograph an identification surface. [Diagram 25] 2 is a diagram illustrating the configuration of a transmission plate 80. FIG. [Figure 26] FIG. 11 is a diagram for explaining another example of a method for creating a composite image. [Figure 27] 1 is a diagram for explaining a method in which the imaging device 10 scans an identification surface. [Figure 28] 13 is a diagram for explaining a use area 19b of the photographing unit 15. FIG. [Figure 29]FIG. 13 is a diagram showing an example of a time intensity distribution obtained by scanning a discrimination surface. [Diagram 30] 10 is a diagram for explaining a method in which the photographing device 10g photographs the discrimination surface. FIG. [Diagram 31] 11 is a diagram showing an example of an image of a discrimination surface captured by a photographing device 10g. [Diagram 32] 10A and 10B are diagrams for explaining a method in which the photographing device 10h photographs an identification surface. [Diagram 33] FIG. 13 is a diagram showing an example of a screen for registering container identification information. [Diagram 34] FIG. 13 is a diagram for explaining an example of a configuration of culture information. [Diagram 35] 10 is a flowchart showing yet another example of the process performed by the system. [Diagram 36] 11 is a diagram for explaining a method in which the microscope 200 captures an image of an identification surface. FIG. [Figure 37] 13 is a diagram for explaining the function of a prism 213. FIG. [Figure 38] 11 is a diagram for explaining a method in which the microscope 300 captures an image of an identification surface. FIG. [Figure 39] 11 is a diagram for explaining a method in which the photographing device 10i photographs an identification surface. FIG. [Diagram 40] 13 is a diagram for explaining a method in which the photographing device 10j photographs an identification surface. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] [First embodiment] FIG. 1 is a diagram illustrating an example of the configuration of the system 1. FIG. 2 is a perspective view of the photographing device 10. FIG. 3 is a diagram illustrating an example of the configuration of the photographing device 10. FIG. 4 is a diagram illustrating an example of the configuration of the light source unit 14 and the photographing unit 15. FIG. 5 is a diagram illustrating an example of the configuration of the control device 30. The configuration of the system 1 will be described below with reference to FIGS. 1 to 5.

[0015] 1 is an imaging system that images a sample contained in a container 70 while culturing the sample. The system 1 includes one or more imaging devices 10 that images the sample contained in the container 70 from below the container 70, and a control device 30 that controls the imaging devices 10.

[0016] Each of the image capturing devices 10 and the control device 30 only need to be able to exchange data with each other. Therefore, each of the image capturing devices 10 and the control device 30 may be connected to each other so as to be able to communicate with each other via a wire or wirelessly. The sample to be observed is any cultured cell, and the container 70 that contains the sample is, for example, a flask. However, the container 70 is not limited to a flask, and may be other culture containers such as a dish or a well plate.

[0017] In order to photograph the sample without removing it from the incubator 20, the imaging device 10 is used while being placed in the incubator 20, for example, as shown in FIG. 1. More specifically, as shown in FIGS. 1 and 2, the imaging device 10 is placed in the incubator 20 with a container 70 placed on a transmission window 11 of the imaging device 10, and an image of the sample in the container 70 is acquired according to an instruction from a control device 30. The transmission window 11 is a transparent top plate that constitutes the upper surface of a housing 12 of the imaging device 10, and constitutes a mounting surface on which a container is placed. The transmission window 11 is made of, for example, glass or transparent resin.

[0018] 2, the imaging device 10 includes a box-shaped housing 12 having a transparent transmission window 11 on the upper surface in which a container 70 is placed, and a positioning member 60 that positions the container 70 at a predetermined position on the transmission window 11 (mounting surface). The positioning member 60 is fixed to the housing 12. However, the positioning member 60 can be removed as necessary, and may be replaced with another positioning member having a different shape depending on the container to be used.

[0019] 3 and 4, the imaging device 10 further includes a stage 13 that moves within the housing 12, a pair of light source units 14 that illuminate the sample, and an imaging unit 15 that captures an image of the sample. The stage 13, the light source unit 14, and the imaging unit 15 are housed within the housing 12. The light source unit 14 and the imaging unit 15 are installed on the stage 13, and move relative to the container 70 as the stage 13 moves within the housing 12.

[0020] The stage 13 is an example of a moving unit of the imaging device 10, and is a change device that changes the relative position of the imaging unit 15 with respect to the container 70. The stage 13 is movable in the X direction and the Y direction that are parallel to the transmission window 11 (mounting surface) and perpendicular to each other. However, the stage 13 may also move in the Z direction that is perpendicular to both the X direction and the Y direction.

[0021] 3 and 4 show an example in which the light source unit 14 and the photographing unit 15 are installed on the stage 13 and move together within the housing 12, but the light source unit 14 and the photographing unit 15 may move independently within the housing 12. Also, while an example in which a pair of light source units 14 are arranged on the left and right sides of the photographing unit 15 is shown in FIG. 3 and FIG. 4, the arrangement and number of the light source units 14 are not limited to this example. For example, three or more light source units 14 may be provided on the stage 13, or only one light source unit 14 may be provided.

[0022] 4, the light source unit 14 includes a light source 16 and a diffusion plate 17. The light source 16 includes, for example, a light emitting diode (LED). The light source 16 may include a white LED, or may include a plurality of LEDs that emit light of a plurality of different wavelengths, such as R (red), G (green), and B (blue). The light emitted from the light source 16 is incident on the diffusion plate 17.

[0023] The diffusion plate 17 diffuses the light emitted from the light source 16. The diffusion plate 17 is not particularly limited, but may be, for example, a frosted diffusion plate having an uneven surface. However, the diffusion plate 17 may be an opal diffusion plate having a coated surface, or may be another type of diffusion plate. Furthermore, a mask 17a may be formed on the diffusion plate 17 to limit the emission area of ​​the diffused light. The light emitted from the diffusion plate 17 travels in various directions.

[0024] As shown in FIG. 4, the photographing unit 15 includes an optical system 18 and an image sensor 19. The optical system 18 collects light that has passed through the transmission window 11 and entered the housing 12. The optical system 18 is not particularly limited, but may be, for example, a finite correction type objective lens that forms an image at a finite position. However, the optical system 18 may include an infinity correction type objective lens, and the optical system 18 as a whole may constitute a finite correction optical system. The optical system 18 focuses on the bottom surface of the container 70 in which the sample is present, and collects the light that has entered the housing 12 onto the image sensor 19, forming an optical image of the sample on the image sensor 19.

[0025] The imaging element 19 is an optical sensor that converts detected light into an electrical signal. The imaging element 19 is specifically an image sensor, and is not particularly limited, but may be, for example, a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor.

[0026] In the imaging device 10 configured as above, oblique illumination is adopted to visualize the sample in the container 70, which is a phase object. Specifically, the light emitted by the light source 16 is diffused by the diffusion plate 17 and emitted outside the housing 12 without passing through the optical system 18. That is, the light source unit 14 emits light traveling in various directions toward the outside of the housing 12 without passing through the optical system 18. Then, a part of the light emitted outside the housing 12 is reflected, for example, by the upper surface of the container 70, and is deflected above the sample. Furthermore, a part of the light deflected above the sample is irradiated on the sample and enters the housing 12 by passing through the sample and the transmission window 11. Then, a part of the light entering the housing 12 is collected by the optical system 18 to form an image of the sample on the image sensor 19. That is, the optical system 18 collects light that has passed through the transmission window 11 and entered the housing 12, in order to form an image of the sample in the container 70 placed on the transmission window 11 on the image sensor 19. Finally, the photographing device 10 generates an image of the sample based on the electrical signal output from the image sensor 19, and outputs the image to the control device 30.

[0027] The control device 30 is a device that controls the photographing device 10. Specifically, the control device 30 controls at least the photographing unit 15 and the stage 13, which is a moving unit, and may further control the light source unit 14. Note that the control device 30 may include one or more processors and one or more non-transitory computer-readable media, and may be, for example, a general computer.

[0028] More specifically, the control device 30 may include, for example, one or more processors 31, one or more memory devices 32, an input device 33, a display device 34, and a communication device 35, as shown in FIG. 5, which may be connected via a bus 36.

[0029] Each of the one or more processors 31 is hardware including, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), etc., and performs programmed processing by executing a program 32a stored in one or more storage devices 32. Furthermore, the one or more processors 31 may include an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc.

[0030] Each of the one or more storage devices 32 may include, for example, one or more arbitrary semiconductor memories and may further include one or more other storage devices. The semiconductor memories may include, for example, volatile memories such as RAM (Random Access Memory) and non-volatile memories such as ROM (Read Only Memory), programmable ROM, and flash memory. The RAM may include, for example, DRAM (Dynamic Random Access Memory), SRAM (Static Random Access Memory), and the like. The other storage devices may include, for example, magnetic storage devices including magnetic disks, optical storage devices including optical disks, and the like.

[0031] The one or more storage devices 32 are non-transitory computer-readable media and are an example of a storage unit of the system 1. At least one of the storage devices 32 stores an image of a sample captured by the image capture device 10.

[0032] The input device 33 is a device that is directly operated by a user, and is, for example, a keyboard, a mouse, a touch panel, etc. The display device 34 is, for example, a liquid crystal display, an organic EL display, a CRT (Cathode Ray Tube) display, etc. The display may have a built-in touch panel. The communication device 35 may be a wired communication module or a wireless communication module.

[0033] 5 is an example of a hardware configuration of the control device 30, and the control device 30 is not limited to this configuration. The control device 30 is not limited to a general-purpose device, and may be a dedicated device.

[0034] The control device 30 configured as described above transmits an image acquisition instruction to the image capturing device 10 placed in the incubator 20, and receives images captured by the image capturing device 10. The control device 30 may display images captured by the image capturing device 10 on a display device 34 included in the control device 30, and the system 1 may function as an observation system for a user to observe a sample being cultured. The control device 30 may communicate with the client terminals (client terminal 40, client terminal 50) shown in FIG. 1, and may display images captured by the image capturing device 10 on a display device included in the client terminal.

[0035] Fig. 6 is a diagram illustrating a configuration of an incubation container. Fig. 7 is a flowchart showing an example of a process according to the first embodiment performed by the system 1. Fig. 8 is an example of a top view of the imaging device 10. Fig. 9 is a diagram for explaining a method in which the imaging device 10 images an identification surface. Fig. 10 is a diagram for explaining a method in which the imaging device 10 images a sample.

[0036] As described above, the imaging device 10 acquires an image of the sample according to instructions from the control device 30. In the system 1, the imaging device 10 further acquires an image of the identification surface of the container 70 to which identification information is attached according to instructions from the control device 30. The control device 30 records the image of the sample acquired from the imaging device 10 in association with the identification information 72 attached to the identification surface. This makes it possible to manage which culture container the image is an image of the sample in.

[0037] The identification surface of the container 70 is a surface of the container 70 to which identification information 72 for uniquely identifying the container 70 is attached, as shown in FIG. 6. The identification information 72 is, for example, a one-dimensional code such as a barcode (registered trademark) shown in FIG. 6, but is not limited to a one-dimensional code. For example, it may be a two-dimensional code such as a QR code (registered trademark). It may also be a combination of numbers, letters, and other symbols. The identification information 72 may be printed information or handwritten information. It may also be handwritten information printed on paper. The identification surface is a surface different from the bottom surface of the container 70 to prevent the identification information 72 from adversely affecting an image obtained by photographing the sample. In this example, the identification surface is a side surface 71 of the container 70. Recording in association with the identification information does not only include recording in association with the identification information itself, but also includes recording in association with analysis information obtained by analyzing the identification information (for example, text information obtained by analyzing a barcode).

[0038] Hereinafter, a method for acquiring an image of a sample and an image of an identification surface, and recording the image of the sample in association with the identification information will be specifically described with reference to Figs.

[0039] First, as shown in Fig. 8, the container 70 is positioned at a predetermined position on the transmission window 11 by abutting the side surface bearing the identification information 72 against the abutment surface 61 of the positioning member 60. That is, the side surface of the container 70 bearing the identification information 72 faces the positioning member 60. In this state, when the user instructs the system 1 to photograph the sample using the input device 33 or the like, the program stored in the storage device 32 is executed by the processor 31 in the system 1, and the process shown in Fig. 7 is performed.

[0040] 7 is started, the system 1 first changes the relative position to a first relative position (step S1). Here, the relative position refers to the relative position of the photographing unit 15 with respect to the container 70. That is, it refers to the position of the photographing unit 15 when the container 70 is used as a reference. Moreover, the first relative position refers to a relative position that at least satisfies the condition that the optical axis of the photographing unit 15 is deviated from the container 70.

[0041] In step S1, the control device 30 controls the operation of the stage 13, whereby the stage 13 moves, and as a result, the relative position is changed to a first relative position by the stage 13. Specifically, as shown in Fig. 9, the stage 13 moves so that the optical axis of the photographing unit 15 is positioned directly below the positioning member 60 rather than directly below the container 70, thereby changing the relative position to the first relative position where the optical axis of the photographing unit 15 is deviated from the container 70. More specifically, the positioning member 60 is provided with a deflection surface 62 for deflecting light in the vicinity of the abutment surface 61, and the stage 13 moves to a position where the optical axis of the photographing unit 15 intersects with the deflection surface 62, thereby changing the relative position to the first relative position.

[0042] As described later, the deflection surface 62 is a light guide unit that guides light from the side surface 71 (identification surface) to which the identification information 72 is attached to the photographing unit 15. Specifically, the deflection surface 62 is a part of the surface of the positioning member 60, and is an inclined surface inclined with respect to the optical axis. More specifically, the deflection surface 62 may be, for example, a metal thin film or a dielectric multilayer film formed on the surface of the positioning member 60. The deflection surface 62 may be, for example, a reflective optical element attached to the base material of the positioning member 60. The reflective optical element may be a flat plate made of glass, resin, or the like, coated with a metal thin film or a dielectric multilayer film, or may be a metal surface polished to achieve high reflectance. That is, the positioning member 60 includes a light guide unit.

[0043] 9, when the relative position is changed to the first relative position, the system 1 photographs the side surface 71 (identification surface) to which the identification information 72 is attached (step S2). Here, the control device 30 controls the operations of the light source unit 14 and the photographing unit 15, so that after the stage 13 changes its relative position to the first relative position, the photographing unit 15 photographs the identification surface via the deflection surface 62. Note that photographing the identification surface via the deflection surface 62 means photographing the identification surface using light incident on the photographing unit 15 via the deflection surface 62.

[0044] Specifically, the control device 30 controls the light emission of the light source unit 14, and as shown in FIG. 9, the photographing device 10 irradiates the light emitted from the light source unit 14 (dotted line in FIG. 9) onto the discrimination surface (side surface 71). Then, the light reflected from the discrimination surface (solid line in FIG. 9) is deflected by the deflection surface 62 and enters the photographing unit 15. The control device 30 controls the exposure of the photographing device 10, and the photographing device 10 generates an image of the discrimination surface based on the light from the discrimination surface that is incident on the photographing unit 15. The generated image is output to the control device 30.

[0045] When the photographing of the identification surface is completed, the system 1 changes the relative position to a second relative position (step S3). Here, the second relative position is a relative position that at least satisfies the condition that the optical axis of the photographing unit 15 intersects with the container 70.

[0046] In step S3, the control device 30 controls the operation of the stage 13, thereby moving the stage 13, and as a result, the relative position is changed to the second relative position by the stage 13. Specifically, as shown in Fig. 10, the stage 13 moves so that the optical axis of the photographing unit 15 is located directly below the container 70, thereby changing the relative position to the second relative position where the optical axis of the photographing unit 15 intersects with the container 70.

[0047] When the relative position is changed to the second relative position as shown in Fig. 10, the system 1 photographs the sample (step S4). Here, the control device 30 controls the operations of the light source unit 14 and the photographing unit 15, so that after the stage 13 changes its relative position to the second relative position, the photographing unit 15 photographs the sample via the bottom surface of the container 70. Note that photographing the sample via the bottom surface here means photographing the sample using light incident on the photographing unit 15 via the bottom surface, and more specifically, means photographing the sample using light that has passed through the bottom surface and entered the photographing unit 15.

[0048] Specifically, the control device 30 controls the light emission of the light source unit 14 and the exposure of the photographing unit 15, so that the light emitted from the light source unit 14 illuminates the sample, passes through the sample and the transmission window 11, and enters the photographing unit 15, as shown in Fig. 10. The photographing device 10 generates an image of the sample based on the light from the sample that has entered the photographing unit 15. The generated image is output to the control device 30.

[0049] When the photographing of the sample is completed, the system 1 records the identification information and the image of the sample in association with each other (step S5). Here, the control device 30 identifies the identification information from the image of the identification surface photographed by the photographing device 10 in step S2. The control device 30 further associates the identified identification information with the image of the sample photographed in step S4 and stores them in the storage device 32.

[0050] As described above, in the imaging device 10 and the system 1 according to the present embodiment, the identification information can be acquired by photographing the identification surface with the identification information using the imaging unit 15 that photographs the sample. That is, it is possible to acquire the identification information without providing a dedicated camera for photographing the identification surface. In addition, in the imaging device 10 and the system 1, by using a light guide unit, it is possible to acquire the identification information attached to a surface other than the bottom surface of the container on which the sample is placed. Therefore, it is possible to avoid the presence of the identification information having a negative effect on the photographing of the sample. Therefore, the imaging device 10 can assist in associating the identification information attached to the container 70 with the image of the sample contained in the container 70. In addition, the system 1 can record the identification information attached to the container 70 with the image of the sample contained in the container 70 in association with each other.

[0051] Furthermore, in the photographing device 10 and the system 1, since the positioning member 60 includes a light guide unit, the light guide unit is placed at an appropriate position with respect to the container 70 simply by placing the container 70 against the positioning member 60 and positioning it. Therefore, the user can install the light guide unit at an appropriate position simply by performing the procedure as before, and it becomes possible to obtain identification information in addition to an image of the sample. In particular, since the positioning member 60 includes the light guide unit, the position of the light guide unit with respect to the container 70 is accurately determined, so that the optical path length from the photographing unit 15 to the identification surface does not deviate significantly from the expected optical path length, and focus adjustment can be easily performed.

[0052] 7 shows an example in which the sample is photographed after the discrimination surface is photographed, but the order in which the discrimination surface and the sample are photographed is not particularly limited to this example. As long as the discrimination information and the image of the sample can be recorded in association with each other, the discrimination surface may be photographed after the sample.

[0053] FIG. 11 is a diagram illustrating the configuration of another system. In the above embodiment, an example in which each photographing device 10 is controlled by the control device 30 has been shown, but the control function of the control device 30 may be built into each photographing device 10. In that case, the control device 30 may be omitted, and each photographing device 10 may function as an IOT device that controls photographing in response to a command received via the Internet. That is, as shown in FIG. 11, the client terminals 40 and 50 may control the photographing operation of the photographing device 10 via the cloud server by transmitting and receiving commands to and from the cloud server 2. The image data and identification information acquired by the photographing device 10 are received by the cloud server periodically or irregularly. Furthermore, the image data and identification information may be appropriately displayed on a display device provided in the client terminals 40 and 50 in response to a request from the client terminals 40 and 50.

[0054] [Second embodiment] Fig. 12 is an example of a top view of the photographing device 10a. Fig. 13 is a diagram for explaining a method in which the photographing device 10a photographs an identification surface. Fig. 14 is a light ray diagram of the reduction optical system 63. The system according to this embodiment is similar to the system 1 except that it includes the photographing device 10a shown in Figs. 12 and 13 instead of the photographing device 10. Hereinafter, the photographing device 10a will be described with reference to Figs. 12 to 14.

[0055] The photographing device 10a is similar to the photographing device 10 in that it obtains an image of the sample and an image of the identification surface in order to record the image of the sample and the identification information in association with each other. The photographing magnification of the photographing unit 15 is set to a relatively high magnification suitable for good observation of the sample, which is a cultured cell. For this reason, if both the sample and the identification surface are photographed with the same photographing unit 15, only a narrow range of the identification surface with the identification information attached thereto can be photographed, and the identification information may not fit in the field of view. Therefore, in the photographing device 10a according to this embodiment, the light guide unit includes a reduction optical system 63. The reduction optical system 63 is an optical system that reduces the projection magnification between the identification surface with the identification information 72 attached thereto and the image sensor 19 included in the photographing unit 15. By including the reduction optical system 63, the photographing device 10a can fit the entire identification information in one image.

[0056] 12 and 13, the photographing device 10a differs from the photographing device 10 in that it includes a positioning member 60a instead of the positioning member 60. The positioning member 60a includes a light guiding unit that guides light from an identification surface bearing identification information 72 to the photographing unit 15. Specifically, as shown in FIG. 13, the positioning member 60a includes a plurality of deflection surfaces (three in this example) that deflect light from the identification surface, and a reduction optical system 63, which constitute the light guiding unit.

[0057] 14, the reduction optical system 63 is a relay optical system that forms an intermediate image of an identification surface having identification information 72 attached thereto, and forms the intermediate image near the upper surface of the transmission window 11. That is, the intermediate image is formed at the same height as the bottom surface of the container 70. The three deflection surfaces are arranged to form an optical path that rotates in the height direction (Z direction) in order to increase the optical path length between the identification information 72 and the imaging element 19.

[0058] 7, the imaging device 10a and the system according to the present embodiment including the imaging device 10a can record the identification information attached to the container 70 in association with the image of the sample contained in the container 70, similarly to the imaging device 10 and system 1 according to the first embodiment. Also, similarly, it is possible to obtain the identification information without providing a dedicated camera or the like for photographing the identification surface, it is possible to prevent the presence of the identification information from adversely affecting the photographing of the sample, and the user can install the light guide unit in an appropriate position simply by performing the work in the same procedure as before.

[0059] Furthermore, according to the imaging device 10a and system of this embodiment, an image can be acquired at a lower magnification at the first relative position than at the second relative position, so that the entire identification information can be acquired in one image acquisition while imaging the cultured cells at an appropriate magnification. Furthermore, since the reduction optical system 63 is configured as a relay optical system, aberration can be corrected well, so that an image of the identification surface having sufficient image quality for analyzing the identification information 72 can be acquired. Therefore, the identification information and the image of the sample can be efficiently acquired and recorded in association with each other.

[0060] Fig. 15 is a diagram for explaining a method in which the photographing device 10b photographs the identification surface. The photographing device 10b shown in Fig. 15 is a modified example of the photographing device 10a according to the second embodiment. The system according to this embodiment may include the photographing device 10b instead of the photographing device 10a.

[0061] The photographing device 10b differs from the photographing device 10a in that it includes a positioning member 60b instead of the positioning member 60a. The positioning member 60b is similar to the positioning member 60a in that it includes a reduction optical system 63, but differs from the positioning member 60a in that it includes two deflection surfaces that deflect light from the identification surface. The two deflection surfaces form an optical path that rotates in the height direction (Z direction) to increase the optical path length between the identification information 72 and the image sensor 19.

[0062] The photographing device 10b and the system including the photographing device 10b can also provide the same effects as the photographing device 10a and the system according to the second embodiment. Furthermore, the photographing device 10b can guide the light from the discrimination surface to the photographing unit 15 via a smaller number of deflection surfaces than the photographing device 10a, so that a brighter image can be obtained by suppressing the loss of light quantity that occurs on the deflection surfaces.

[0063] Fig. 16 is an example of a top view of the photographing device 10c. Fig. 17 is a diagram for explaining a method in which the photographing device 10c photographs an identification surface. The photographing device 10c shown in Figs. 16 and 17 is another modified example of the photographing device 10a according to the second embodiment. The system according to this embodiment may include the photographing device 10c instead of the photographing device 10a.

[0064] The photographing device 10c differs from the photographing device 10a in that it includes a positioning member 60c instead of the positioning member 60a. The positioning member 60c is similar to the positioning member 60a in that it includes a reduction optical system 63, but differs from the positioning member 60a in that it further includes a pair of mirrors 64 and a prism 65. The reduction optical system 63, the pair of mirrors 64, and the prism 65 constitute a light guide unit. The pair of mirrors 64 are arranged to form an optical path that rotates in the horizontal direction (X direction and Y direction) in order to increase the optical path length between the identification information 72 and the image sensor 19. The prism 65 totally reflects the light that has entered via the mirror 64 and the reduction optical system 63 and deflects it toward the photographing unit 15.

[0065] The photographing device 10c and the system including the photographing device 10c can also provide the same effects as the photographing device 10a and the system according to the second embodiment. Furthermore, in the photographing device 10c and the system including the photographing device 10c, the optical paths are rotated in the horizontal direction, so that the optical paths can be prevented from overlapping in the height direction. Therefore, there is no need to consider the overlapping of the optical paths, and the field of view can be easily ensured in the height direction.

[0066] Fig. 18 is a diagram for explaining a method in which the photographing device 10d photographs the discrimination surface. The photographing device 10d shown in Fig. 18 is yet another modified example of the photographing device 10a according to the second embodiment, and is also a modified example of the photographing device 10c. The system according to this embodiment may include the photographing device 10d instead of the photographing device 10a.

[0067] The photographing device 10d is different from the photographing device 10c in that it includes a positioning member 60d instead of the positioning member 60c. The positioning member 60d includes a light guide unit including a reduction optical system 63, a mirror 66, and a prism 65, and the reduction optical system 63 and the mirror 66 form a horizontally rotating optical path between the identification surface and the photographing unit 15, similar to the positioning member 60c. In the photographing device 10c, as a result of the horizontally rotating optical path being formed, the identification surface is farther away from the light source unit 14 than the photographing devices 10a and 10b, and the illumination efficiency is reduced. In consideration of this point, the photographing device 10d further includes a prism 67 and a diffusion plate 68. The light emitted from the light source unit 14 is deflected by the prism 67 toward the diffusion plate 68 and diffused by the diffusion plate 68. The diffused light is then reflected by the mirror 66 and guided to the identification surface to which the identification information 72 is attached. As a result, the photographing device 10d can improve the illumination efficiency compared to the photographing device 10c in which the identification surface is illuminated with light directly incident from the light source unit .

[0068] The photographing device 10d and the system including the photographing device 10d can also provide the same effects as the photographing device 10a and the system according to the second embodiment. Furthermore, in the photographing device 10d and the system including the photographing device 10d, the optical path is rotated horizontally, so that the field of view in the height direction can be easily secured and the decrease in illumination efficiency can be suppressed.

[0069] Fig. 19 is an example of a top view of the photographing device 10e. Fig. 20 is a diagram for explaining a method in which the photographing device 10e photographs an identification surface. The photographing device 10e shown in Figs. 19 and 20 is yet another modified example of the photographing device 10a according to the second embodiment. The system according to this embodiment may include the photographing device 10e instead of the photographing device 10a.

[0070] The photographing device 10e differs from the photographing device 10a in that it includes a positioning member 60e instead of the positioning member 60a, and in that it includes a reduction optical system 69. The positioning member 60e may be the same as the positioning member 60 included in the photographing device 10 according to the first embodiment, for example. That is, as shown in Fig. 19, the positioning member 60e includes a deflection surface 62 that is an inclined surface inclined with respect to the optical axis and that constitutes a light guide unit.

[0071] The reduction optical system 69 constitutes a light guide unit together with the deflection surface 62. That is, the positioning member 60e includes a part of the light guide unit. The reduction optical system 69 is a lens having negative power, and may be, for example, a plano-concave lens as shown in FIG. 20. The reduction optical system 69 is provided on the optical path between the deflection surface 62 and the photographing unit 15 at the second relative position, and specifically, for example, may be bonded to the lower surface of the transmission window 11 as shown in FIG. 20.

[0072] The photographing device 10e and a system including the photographing device 10e can also provide the same effects as the photographing device 10a and the system according to the second embodiment. Although an example in which the reduction optical system 69 is provided inside the housing 12 is shown in Figs. 19 and 20, a reduction optical system having negative power may be provided on the transmission window 11. Moreover, the deflection surface 62 may be formed as a convex surface to have negative power. In this case, the deflection surface having negative power can also serve as the reduction optical system.

[0073] [Third embodiment] FIG. 21 is a flowchart showing another example of the processing performed by the system. FIG. 22 is a diagram for explaining a method in which the photographing device 10 photographs the discrimination surface. FIG. 23 is a diagram for explaining an example of a method for creating a composite image. In the system according to the second embodiment, the discrimination surface is photographed at a different magnification from that of the sample to obtain an image of the entire discrimination information in one photograph. In the system according to the present embodiment, the discrimination surface is photographed multiple times to obtain the entire discrimination information while photographing the discrimination surface at the same magnification as that of the sample. Hereinafter, with reference to FIG. 21 to FIG. 23, a method of recording the image of the sample in association with the discrimination information while photographing the sample and the discrimination surface at the same magnification will be specifically described. Note that the system according to the present embodiment includes the photographing device 10 and the control device 30, similar to the system 1.

[0074] In the system according to this embodiment, a program stored in the storage device 32 is executed by the processor 31, and the process shown in FIG. 21 is performed. When the process shown in FIG. 21 is started, the system 1 first changes the relative position to one of a plurality of first relative positions (step S11). Here, the plurality of first relative positions are relative positions that at least satisfy the condition that the optical axis of the photographing unit 15 is deviated from the container 70. More specifically, the first relative positions are relative positions that are different from each other at least in a direction parallel to the identification surface, and are set so that the fields of view of the photographing units 15 overlap each other partially between adjacent first relative positions. Note that FIG. 22 shows the arrangement of the photographing units 15 at three relative positions.

[0075] When the relative position is changed to the first relative position, the system captures an image of the identification surface to which the identification information 72 is attached (step S12). This process is similar to the process of step S2 in FIG.

[0076] When the discrimination surface is photographed, the system judges whether or not the discrimination surface has been moved to all of the first relative positions (step S13), and if it is judged that the discrimination surface has not been moved to all of the first relative positions (step S13 NO), the process of steps S11 and S12 is repeated. That is, the control device 30 causes the photographing device 10 to photograph the discrimination surface at a plurality of different first relative positions.

[0077] Thereafter, when it is determined that the identification information 72 has been moved to all of the first relative positions (YES in step S13), the system synthesizes the images of the identification surfaces (step S14). Here, the control device 30 synthesizes the images of the identification surfaces captured at the first relative positions to generate a composite image in which the entire identification information 72 is captured.

[0078] Specifically, as shown in Fig. 23, the control device 30 synthesizes images P1 to P3 of the discrimination surface captured at a plurality of first relative positions using coordinate information of the stage 13 at the plurality of first relative positions to generate a composite image P4. The generated composite image P4 is output to the control device 30. Note that instead of using coordinate information, the synthesis position may be determined by pattern matching of overlapping portions of the images to generate the composite image.

[0079] After the composite image is generated, the system changes the relative position to a second relative position (step S15) and captures an image of the sample (step S16). These processes are similar to the processes in steps S3 and S4 in FIG.

[0080] When the photographing of the sample is completed, the system records the identification information and the image of the sample in association with each other (step S17). Here, the control device 30 specifies the identification information based on the composite image generated in step S14, and stores the specified identification information and the image of the sample photographed in step S16 in the storage device 32 in association with each other.

[0081] The photographing device 10 and system according to this embodiment can also perform the processing shown in FIG. 21 to identify identification information without changing the photographing magnification, thereby achieving the same effect as the photographing device and system according to the second embodiment.

[0082] FIG. 24 is a diagram for explaining a method in which the photographing device 10f photographs the discrimination surface. FIG. 25 is a diagram illustrating a configuration of a transparent plate 80. FIG. 26 is a diagram for explaining another example of a method for creating a composite image. The photographing device 10f shown in FIG. 24 is a modified example of the photographing device according to the third embodiment. The system according to this embodiment may include the photographing device 10f instead of the photographing device 10.

[0083] The photographing device 10f differs from the photographing device 10 in that it includes a positioning member 60f instead of the positioning member 60. The positioning member 60f differs from the positioning member 60 in that it includes a transparent plate 80. As shown in FIG. 24, the transparent plate 80 is provided on the positioning member 60f so as to be located between the identification surface on which the identification information 72 is provided and the deflection surface 62 when the container 70 is positioned by the positioning member 60f. The transparent plate 80 is a transparent flat plate on which a reference position marker 81 is printed as shown in FIG. 25. The reference position marker 81 is a collection of marks (squares in this example) of a predetermined size aligned at regular intervals in a fixed direction. Note that this fixed direction is preferably the same direction as the direction in which the multiple first relative positions are aligned.

[0084] The photographing device 10f photographs the identification surface having the identification information 72 attached thereto through the transparent plate 80, and the control device 30 acquires images P11 to P13 of the identification surface photographed at the multiple first relative positions, as shown in Fig. 26. Since the reference position marker 81 appears in the multiple identification surface images (images P11, P12, and P13), a composite image P14 can be easily obtained by determining the composite position of these images so that the reference position marker 81 is accurately superimposed.

[0085] The photographing device 10f and the system including the photographing device 10f can also provide the same effects as those of the photographing device and system according to the third embodiment.

[0086] Fig. 27 is a diagram for explaining a method in which the photographing device 10 scans the discrimination surface. Fig. 28 is a diagram for explaining the use area 19b of the photographing unit 15. Fig. 29 is a diagram showing an example of a time intensity distribution obtained by scanning the discrimination surface.

[0087] In the above-described embodiment, an example was shown in which a two-dimensional image of the identification surface was obtained using the image sensor 19, but when the identification information is a one-dimensional code such as a barcode (registered trademark), for example, as shown in Fig. 27, the photographing unit 15 may be moved in a certain direction while the signal intensity from a predetermined use area 19b of the pixel array 19a of the image sensor 19, as shown in Fig. 28, may be graphed as shown in Fig. 29. In this way, the one-dimensional code, which is the identification information, may be identified by scanning the identification surface in a certain direction and analyzing the signal from a predetermined pixel of the image sensor 19, and the identified identification information may be recorded in association with an image of the sample.

[0088] Fig. 30 is a diagram for explaining a method in which the photographing device 10g photographs the discrimination surface. Fig. 31 is a diagram showing an example of an image of the discrimination surface photographed by the photographing device 10g. The photographing device 10g shown in Fig. 30 is another modified example of the photographing device according to the third embodiment. The system according to this embodiment may include the photographing device 10g instead of the photographing device 10.

[0089] As described above, when the identification information is a one-dimensional code, it may be possible to identify the identification information without photographing the entire identification information. For this reason, when the identification information is a one-dimensional code, the identification surface may be photographed using an imaging device 10g in which a positioning member 60g has a wedge prism 82 as shown in FIG.

[0090] When the identification surface is photographed via the wedge prism 82, the entire identification surface is not in focus, but a part of the identification surface (a part at a certain height) is in focus. Therefore, an image P21 can be obtained in which a part of the one-dimensional code is visualized, as shown in FIG. 31. The one-dimensional code, which is the identification information, may be identified by analyzing the image P21. The identification information thus identified may be associated with the image of the sample and recorded.

[0091] Fig. 32 is a diagram for explaining a method in which the photographing device 10h photographs the discrimination surface. The photographing device 10h shown in Fig. 32 is yet another modified example of the photographing device according to the third embodiment. The system according to this embodiment may include the photographing device 10h instead of the photographing device 10.

[0092] The photographing device 10h differs from the photographing device 10g in that it includes a positioning member 60h instead of the positioning member 60g, and in that a wedge prism 83 is provided on the lower surface of the transmission window 11. The positioning member 60h differs from the positioning member 60g in that it does not include a wedge prism 82, and the photographing device 10h includes a wedge prism 83 instead of the wedge prism 82.

[0093] The wedge prism 83 bonded to the lower surface of the transmission window 11 acts in the same manner as the wedge prism 82 provided on the upper surface of the transmission window 11. Therefore, the photographing device 10h and the system including the photographing device 10h can also obtain the same effects as the photographing device 10g and the system including the photographing device 10g.

[0094] [Fourth embodiment] FIG. 33 is a diagram showing an example of a screen for registering container identification information. FIG. 34 is a diagram for explaining an example of the configuration of culture information. FIG. 35 is a flowchart showing yet another example of processing performed by the system. In the system according to the above-mentioned embodiment, an example in which identification information and an image of a sample are associated and recorded is shown, but the system according to this embodiment is different from the system according to the above-mentioned embodiment in that the setting of the imaging device when the sample is photographed based on the identification information is changed. Hereinafter, with reference to FIG. 33 to FIG. 35, a method for changing the setting when the sample is photographed according to the identification information will be specifically described. Note that the system according to this embodiment includes an imaging device 10 and a control device 30, similar to the system 1.

[0095] The system according to this embodiment is an imaging system that images a sample contained in a container 70 while culturing it, similar to system 1. The system according to this embodiment is also an identification information issuing and managing system that issues and manages identification information for the container, and further, a culture project management system that manages cell culture projects.

[0096] In the system according to the present embodiment that functions as an identification information issuing and managing system, the control device 30 may display an identification information registration screen shown in FIG. 33 on the display device 34. When a user inputs information of, for example, 12 characters or less in the registration identification code field, the control device 30 generates and registers identification information such as a barcode in which the information is coded. The generated identification information is registered in association with the culture information described below. Furthermore, the control device 30 may print the identification information on a sticker that can be attached to the container 70, for example, by a printing device connected to the control device 30. The user can attach the identification information to the container 70 by attaching the printed sticker to the container 70.

[0097] Furthermore, in the system according to the present embodiment that functions as a culture project management system, the control device 30 may store in the storage device 32 culture information 100 shown in FIG. 34, which is information about a cell culture project. More specifically, the culture information 100 (culture information 101, culture information 102, culture information 103, etc.) is created for each cell culture project. As shown in FIG. 34, the culture information 100 includes information about cultured cells (cell information), other information, and information about each culture process in advance, in association with a project ID that identifies the project. The information about each culture process includes, for example, information about the type of container used (container type information), information about the imaging conditions when imaging the cultured cells as a sample (imaging condition information), information about the schedule for imaging the cultured cells (imaging schedule information), and information for identifying the culture container used for imaging (container identification information, also simply referred to as identification information). The imaging condition information and the imaging schedule information are collectively referred to as imaging information. In other words, the information about each culture process includes, for example, container type information, imaging information, and container identification information. Here, the container identification information is a registered identification code registered on the identification information registration screen shown in Fig. 33 or information obtained by coding the registered identification code. In the system according to this embodiment, when a sample is photographed, the image of the sample is recorded as part of the culture information 100 in association with the container identification information, as shown in Fig. 34.

[0098] In the system according to this embodiment, a program stored in the storage device 32 is executed by the processor 31, and the process shown in Fig. 35 is performed. When the process shown in Fig. 35 is started, the system first changes the relative position to a first relative position (step S21), and captures an image of the identification surface to which the identification information is attached (step S22). These processes are similar to the processes in steps S1 and S2 in Fig. 7.

[0099] Next, the system determines whether or not the image of the identification surface captured in step S22 contains identification information (step S23), and if the identification information is not contained (step S23 NO), the system waits for a certain period of time (step S24), and then repeats the processing of steps S22 and S23. Note that a situation in which the identification information is not contained may be, for example, a situation in which the culture vessel is removed from the incubator 20 and work such as culture medium replacement is being performed. By repeating the processing while waiting for a certain period of time, it is possible to capture an image of the culture vessel that has been placed back in the incubator 20 after the work is completed, and therefore it is possible to detect the identification information in step S23.

[0100] If it is determined that the identification information is included (YES in step S23), the system identifies the identification information (step S25). Here, the control device 30 analyzes the image of the identification surface captured in step S22, and identifies the identification information included in the image.

[0101] Furthermore, the system reads out imaging information indicating the settings of the imaging device (step S26). Here, the control device 30 reads out imaging information associated with the identification information specified in step S25 from the culture information 100 stored in the storage device 32. Note that the imaging information refers to all information used by the imaging device 10 to image the sample, and includes, for example, imaging condition information and imaging schedule information stored in the storage device 32 in association with the identification information, as shown in FIG.

[0102] When the shooting information is read, the system changes the relative position to the second relative position (step S27). This process is similar to the process in step S3 in FIG.

[0103] Thereafter, the system photographs the sample with settings according to the photographing information (step S28). Here, the control device 30 changes the settings of the photographing device 10 according to the photographing information read out in step S26. Specifically, the control device 30 may change the photographing coordinates, switch the light source unit 14 to be used, or change the illumination intensity, for example, according to the photographing condition information included in the photographing information. In addition, the control device 30 may change settings such as the photographing time and the number of photographs, for example, according to the photographing schedule information included in the photographing information. After the settings are changed, the control device 30 then transmits a photographing instruction to the photographing device 10, and causes the photographing device 10 to photograph the sample with settings according to the photographing information.

[0104] When the photographing of the sample is completed, the system associates the identification information with the image of the sample and records them (step S29). Here, the control device 30 associates the image of the sample generated in step S28 with the identification information specified in step S25 and stores them in the storage device 32.

[0105] 35, the imaging device and system according to this embodiment can record the identification information attached to the container 70 in association with the image of the sample contained in the container 70, similarly to the imaging device 10 and system 1 according to the first embodiment. Also, similarly, it is possible to obtain the identification information without providing a dedicated camera or the like for photographing the identification surface, it is possible to prevent the presence of the identification information from adversely affecting the photographing of the sample, and the user can install the light-guiding unit in an appropriate position simply by performing the work in the same procedure as before.

[0106] According to the imaging device and system of the present embodiment, it is possible to image a sample according to imaging information that is stored in advance as culture information in association with the identification information based on the identification information. Also, an image generated by imaging is recorded as culture information in association with the identification information. Therefore, it is possible to easily realize unified management of various information in cell culture and automatic imaging of cultured cells in accordance with the managed information.

[0107] [Fifth embodiment] FIG. 36 is a diagram for explaining a method in which the microscope 200 photographs the identification surface. FIG. 37 is a diagram for explaining the action of the prism 213. In the system according to the embodiment described above, an example in which the photographing device used in the incubator 20 is included as the photographing device has been shown, but the photographing device included in the system is not limited to the photographing device used in the incubator 20. The system according to the embodiment differs from the system according to the embodiment described above in that an inverted microscope is included as the photographing device for photographing the sample. Hereinafter, the microscope 200 included in the system according to the embodiment will be specifically described with reference to FIG. 36 and FIG. 37.

[0108] The microscope 200 is an inverted microscope including an eyepiece 204, and is also an imaging device that supports not only visual observation but also imaging. The microscope 200 includes an imaging element (not shown) and images the sample from below the container 70. More specifically, as shown in FIG. 36, the microscope 200 includes a stage 201, a light source 202 for transmitted illumination, an objective lens 203, the eyepiece 204, and an imaging element (not shown). In the microscope 200, the imaging element and the objective lens 203 constitute an imaging unit. The stage 201 is an electric stage that moves according to instructions from the control device 30, and is a moving unit that changes the relative position of the imaging unit with respect to the container 70.

[0109] In the microscope 200, when the sample is to be photographed, the stage 201 moves the relative position to a second relative position where the optical axis of the objective lens 203 intersects with the container 70. Then, the microscope 200 photographs an image of the sample through the bottom surface of the container 70.

[0110] The microscope 200 further includes an auxiliary optical system 210 that is placed on the stage 201 together with the container 70, a support member 220 that supports the auxiliary optical system 210, and a prism 213. The prism 213 is a light guiding unit that guides light from the identification surface to the photographing unit, and is a total reflection prism that totally reflects the light from the identification surface toward the objective lens 203.

[0111] As shown in FIG. 36, the auxiliary optical system 210 is made up of a plurality of prisms (prism 211, prism 212), and guides illumination light from the light source 202 of the microscope 200 to the discrimination surface via a prism 213 which is a light guide unit.

[0112] In the microscope 200, when the identification surface is photographed, the stage 201 moves its relative position to a first relative position where the optical axis of the objective lens 203 deviates from the container 70. Specifically, the stage 201 moves the prism 213, which moves together with the container 70, onto the optical axis of the photographing unit (objective lens 203) as shown in FIG. 36. Then, the microscope 200 photographs an image of the identification surface through the prism 213. Specifically, as shown in FIG. 37, illumination light L1 approximately parallel to the stage 201 enters the prism 213 through the auxiliary optical system 210, and is then refracted by the prism 213 to illuminate the identification surface to which the identification information 72 is attached. Of the light from the identification surface illuminated by the illumination light L1, light (light L2a) emitted vertically upward rather than horizontally enters the inclined surface 213a at a relatively small incident angle. Therefore, only light incident on the inclined surface 213a at an angle larger than the critical angle is reflected from the inclined surface 213a and guided to the photographing unit. On the other hand, light (light L2b) that is emitted vertically downward rather than horizontally among the light from the identification surface illuminated with the illumination light L1 is incident on the inclined surface 213a at a relatively large incident angle, and is reflected by the inclined surface 213a and enters the objective lens 203. The light that has entered the objective lens 203 in this manner forms an optical image of the identification surface on the imaging element.

[0113] The microscope 200 and the system including the microscope 200 according to this embodiment can also perform the process shown in FIG. 7 to record the identification information attached to the container 70 and the image of the sample contained in the container 70 in association with each other, as in the imaging device 10 and the system 1 according to the first embodiment. In addition, it is possible to obtain the identification information without providing a dedicated camera or the like for photographing the identification surface, it is possible to prevent the presence of the identification information from adversely affecting the photographing of the sample, and the user can install the light guide unit in an appropriate position by simply performing the work in the same procedure as before. Therefore, it is possible to obtain the same effects as the imaging device 10 and the system 1 according to the first embodiment.

[0114] Fig. 38 is a diagram for explaining a method for the microscope 300 to capture an image of an identification surface. The microscope 300 shown in Fig. 38 is a modified example of the imaging device according to the fifth embodiment. The system according to this embodiment may include the microscope 300 instead of the microscope 200.

[0115] The microscope 300 differs from the microscope 200 in that it includes an auxiliary light source 320 instead of the auxiliary optical system 210 and the support member 220. In the microscope 200, the light from the light source 202 is converted into light approximately parallel to the stage 201 using the auxiliary optical system 210, and is further irradiated onto the identification surface via a prism 213. In contrast, in the microscope 300, illumination light from the auxiliary light source 320 is directly incident on the prism 213, thereby realizing illumination similar to that of the microscope 200.

[0116] Therefore, the microscope 300 and the system including the microscope 300 can also provide the same effects as the imaging device 10 and the system 1 according to the first embodiment.

[0117] The above-mentioned embodiments are specific examples shown to facilitate understanding of the invention, and the present invention is not limited to these embodiments. Modifications of the above-mentioned embodiments and alternative forms that replace the above-mentioned embodiments may be included. That is, the components of each embodiment can be modified within the scope of the invention. In addition, new embodiments can be implemented by appropriately combining multiple components disclosed in one or more embodiments. In addition, some components may be deleted from the components shown in each embodiment, or some components may be added to the components shown in the embodiment. Furthermore, the processing procedures shown in each embodiment may be performed in a different order as long as there is no contradiction. In other words, the imaging device, imaging system, and control method of the present invention can be modified and changed in various ways within the scope of the claims.

[0118] In the above-described embodiment, an example in which the side surface of the container is flat has been shown, but the side surface of the container may be formed of a curved surface, for example, as shown in FIG. 39. In such a case, an imaging device 10i including a positioning member 60i in which the deflection surface 62i is formed of a curved surface having the same curvature as the side surface may be used. The side surface of the container used as the identification surface may be inclined. In particular, when the light guide unit includes a reduction optical system, the focal depth becomes deep, so that identification information can be sufficiently obtained even when the side surface is inclined. The identification surface is not limited to the side surface of the container, and may be, for example, the top surface of the container. In this case, the light guide unit may be configured to divert the light path so that the identification surface can be observed from above the container.

[0119] In the above-described embodiment, the optical path length is increased by rotating the optical path, but the optical path length may be increased by inserting a member having a high refractive index, such as a prism, in the optical path. For example, as shown in Fig. 40, by using an image capture device 10j having a positioning member 60j in which a prism 62a is provided immediately before a deflection surface 62, the difference in the optical path length from the image capture element 19 to the image capture object at the first relative position and the second relative position can be eliminated. [Explanation of symbols]

[0120] 1 system, 10, 10a to 10j imaging device, 11 transparent window, 12 housing, 13 stage, 14 light source unit, 15 imaging unit, 18 optical system, 19 imaging element, 20 incubator, 30 control device, 31 processor, 32 storage device, 32a program, 60, 60a to 60j positioning unit material, 61...application surface, 62...deflection surface, 63, 69...reduction optical system, 70, 400...container, 71, 401...side surface, 72, 402...identification information, 100-103...culture information, 200, 300...microscope, 201...stage, 202...light source, 203...objective lens, 210, 310...auxiliary optical system, 213...prism, 320...auxiliary light source

Claims

1. 1. An imaging device for observing a sample contained in a container having identification information attached thereto from below the container, comprising: A photographing unit including an image sensor; a light guide unit that guides light from an identification surface, which is a surface of the container that is different from a bottom surface of the container and has the identification information attached thereto, to the photographing unit; a moving unit for changing a relative position of the photographing unit with respect to the container, After the moving unit changes the relative position to a first relative position in which the optical axis of the photographing unit is deviated from the container, the photographing unit photographs the identification surface via the light guiding unit to obtain an image of the identification surface; After the moving unit changes the relative position to a second relative position in which the optical axis of the photographing unit intersects with the container, the photographing unit photographs the sample via the bottom surface to obtain an image of the sample; the image of the discrimination surface and the image of the sample are separate images; The light guide unit includes a reduction optical system that reduces a projection magnification between the discrimination surface and the image sensor to be smaller than a projection magnification between the sample and the image sensor. An imaging device characterized by:

2. 2. The imaging device according to claim 1, The reduction optical system is a relay optical system that forms an intermediate image of the discrimination surface. An imaging device characterized by:

3. The photographing device according to claim 1 or 2, further comprising: a housing having a placement surface on which the container is placed and accommodating the photographing unit and the moving unit; a positioning member fixed to the housing for positioning the container on the placement surface; The positioning member includes at least a part of the light guide unit. An imaging device characterized by:

4. 4. The photographing apparatus according to claim 3, The positioning member includes the reduction optical system that reduces a projection magnification between the identification surface and the imaging element. An imaging device characterized by:

5. 5. The imaging device according to claim 3, The identification surface is the side of the container facing the positioning member. An imaging device characterized by:

6. 3. The photographing apparatus according to claim 1, the imaging device is an inverted microscope; The moving unit moves the light guide unit, which moves together with the container, onto the optical axis of the photographing unit when changing the relative position to the first relative position. An imaging device characterized by:

7. 7. The photographing apparatus according to claim 6, further comprising: An auxiliary optical system is provided that guides illumination light from a light source of the inverted microscope to the discrimination surface via the light guide unit. An imaging device characterized by:

8. 7. The photographing apparatus according to claim 6, further comprising: An auxiliary light source that illuminates the identification surface via the light guide unit An imaging device characterized by:

9. The imaging device according to any one of claims 1 to 8, A control device for controlling the operation of the photographing unit and the moving unit, The control device records the identification information and the image of the sample in association with each other. An imaging system characterized by:

10. 10. The imaging system according to claim 9, The control device includes: a storage unit that stores the photographing information in association with the identification information; identifying the identification information from an image of the identification surface captured by the imaging device at the first relative position; reading out the photographing information associated with the specified identification information from the storage unit; The photographing device is caused to photograph the sample at the second relative position with settings corresponding to the read photographing information. An imaging system characterized by:

11. In the imaging system according to claim 9 or 10, The control device includes: the first relative position is a plurality of different positions; causing the photographing device to photograph the identification surface at a plurality of different first relative positions; generating a composite image showing the entire identification information by combining the images of the identification surface captured at the first relative position; The identification information is identified based on the composite image. An imaging system characterized by:

12. A method for controlling an imaging device including a photographing unit including an image sensor and a moving unit for changing a relative position of the photographing unit with respect to a container containing a sample, comprising: changing the relative position to a first relative position in which the optical axis of the photographing unit is deviated from the container; an identification surface, which is a surface of the container that is different from a bottom surface of the container and has identification information attached thereto, is photographed via a light guide unit that guides light from the identification surface to the photographing unit to obtain an image of the identification surface; changing the relative position to a second relative position in which an optical axis of the photographing unit intersects with the container; acquiring an image of the sample by photographing the sample via the bottom surface; the image of the discrimination surface and the image of the sample are separate images; The light guide unit includes a reduction optical system that reduces a projection magnification between the discrimination surface and the image sensor to be smaller than a projection magnification between the sample and the image sensor. A control method comprising:

13. The control method according to claim 12, further comprising: The setting of the photographing device is changed based on the identification information identified from the photographed image of the identification surface. A control method comprising:

14. The control method according to claim 12 or 13, the first relative position is a plurality of different positions; changing to the first relative position includes sequentially changing to a plurality of different first relative positions; taking an image of the identification surface includes taking an image of the identification surface at each of a plurality of different first relative positions; Furthermore, the setting of the photographing device is changed based on identification information identified from a composite image obtained by combining a plurality of images of the identification surface photographed at the first relative position. A control method comprising:

15. 15. The control method according to claim 12, further comprising: Photographing the identification surface includes: a reduction optical system included in the light guide unit forms an intermediate image of the discrimination surface by reducing the discrimination surface; and forming a projected image of the discrimination surface by enlarging the intermediate image using the photographing unit. A control method comprising:

16. 2. The photographing device according to claim 1, The photographing unit photographs the sample present on the bottom surface of the container, the light guide unit includes a plurality of deflection surfaces that rotate the optical path of the image sensor from the discrimination surface in a horizontal direction or a height direction, The reduction optical system is a relay optical system that forms an intermediate image of the identification surface at the same height as the bottom surface. An imaging device characterized by:

17. The photographing apparatus according to claim 16, a housing having a placement surface on which the container is placed and accommodating the photographing unit and the moving unit; a positioning member fixed to the housing and configured to position the container on the placement surface; the positioning member includes the light guiding unit, the identification surface is on a side of the container facing the positioning member; the plurality of deflection surfaces include a first deflection surface that deflects light from the identification surface in an upward direction, 11. An imaging device, comprising: a plurality of deflecting surfaces that form an optical path for rotating light from the discrimination surface in a height direction.

18. 18. The imaging device according to claim 17, the plurality of deflection surfaces include a deflection surface that reflects, in a horizontal direction, the light from the discrimination surface that has been deflected upward by the first deflection surface, and a deflection surface that reflects, in a downward direction, the light from the discrimination surface that has been reflected in the horizontal direction. An imaging device characterized by:

19. 20. The imaging device according to claim 18, The reduction optical system is disposed on the optical path reflected in the horizontal direction. An imaging device characterized by:

20. 18. The imaging device according to claim 17, The first deflection surface is a deflection surface that deflects the light from the identification surface in an obliquely upward direction and deflects the light from the identification surface that has been deflected in the obliquely upward direction downward toward the photographing unit. An imaging device characterized by:

21. The photographing apparatus according to claim 16, a housing having a placement surface on which the container is placed and accommodating the photographing unit and the moving unit; a positioning member fixed to the housing and configured to position the container on the placement surface; the positioning member includes the light guiding unit, the identification surface is on a side of the container facing the positioning member; the plurality of deflection surfaces deflect the light from the identification surface in a horizontal direction; the plurality of deflection surfaces form an optical path that rotates the light from the discrimination surface in a horizontal direction; The plurality of deflection surfaces further includes a deflection member that deflects the light from the identification surface that rotates in a horizontal direction downward toward the photographing unit. An imaging device characterized by:

22. 22. The imaging device according to claim 21, a light source unit that moves together with the movement of the moving unit; The light guide unit includes a deflection member that deflects the illumination light from the light source unit, a diffusion plate that diffuses the deflected illumination light, and a reflection member that reflects the diffused illumination light toward the identification surface. An imaging device characterized by:

Images