Sample observation device and sample observation method

Abstract

In a sample observation device 1, an image acquisition unit 6 acquires a plurality of pieces of XZ image data 21 of a sample S in a Y-axis direction, and an image generation unit 8 generates luminance image data 31 on the luminance of the sample S on the basis of the plurality of pieces of XZ image data 21, binarizes the luminance value of each of the plurality of pieces of XZ image data 21 to generate a plurality of pieces of binarized XZ image data 25, and generates region image data 32 on a region in which the sample S resides on the basis of the plurality of pieces of binarized XZ image data 25.

Description

[Technical field]

[0001] The present disclosure relates to a sample observation device and a sample observation method. [Background technology]

[0002] SPIM (Selective Plane Illumination Microscopy) is known as one of the techniques for observing the inside of a sample having a three-dimensional structure such as a cell. As a technique related to this technique, for example, there is a sample observation device described in Patent Document 1. This sample observation device of Patent Document 1 includes an illumination optical system that illuminates a sample with planar light in the XZ plane, a scanning unit that scans the sample in the Y-axis direction with respect to the illumination plane of the planar light, and an imaging optical system that has an observation axis inclined with respect to the illumination plane and images the observation light generated in the sample by the illumination of the planar light. In this sample observation device, multiple XZ image data of the sample are obtained in the Y-axis direction, and the X image data generated by integrating the luminance values ​​of the analysis region in the XZ image data in the Z-axis direction is combined to generate XY image data of the sample. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-184401 A Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned sample observation device makes it possible to obtain three-dimensional information of a sample while sufficiently reducing the influence of variations in the brightness value of the background light. From the three-dimensional information, various characteristics of the sample can be analyzed, and it is desirable for the sample observation device to obtain the analysis results of the sample almost simultaneously with the end of the measurement operation. Therefore, there is a demand for speeding up the processing required from obtaining the XZ image data of the sample to analyzing the sample based on that data.

[0005] The present disclosure has been made to solve the above-mentioned problems, and has an object to provide a sample observation device and a sample observation method that can speed up the processing required for analyzing a sample. [Means for solving the problem]

[0006] A sample observation device according to one aspect of the present disclosure comprises an illumination optical system that irradiates a sample with planar light in an XZ plane, a scanning unit that scans the sample in the Y-axis direction so as to pass through the illumination plane of the planar light, an imaging optical system having an observation axis inclined with respect to the illumination plane and imaging the observation light generated in the sample by the illumination of the planar light, an image acquisition unit that acquires multiple XZ image data corresponding to the optical image of the observation light combined by the imaging optical system, an image generation unit that generates observation image data of the sample based on the multiple XZ image data acquired by the image acquisition unit, and an analysis unit that extracts information about the sample based on the observation image data and performs analysis related to the sample, wherein the image acquisition unit acquires multiple XZ image data in the Y-axis direction, and the image generation unit generates luminance image data related to the luminance of the sample based on the multiple XZ image data, binarizes the luminance values ​​of each of the multiple XZ image data to generate multiple binary XZ image data, and generates regional image data related to the presence region of the sample based on the multiple binary XZ image data.

[0007] In this sample observation device, a planar light is irradiated on the XZ plane while scanning the sample in the Y axis, and multiple XZ image data corresponding to the light image of the observation light generated in the sample are obtained. Then, observation image data is generated based on the multiple XZ image data, information about the sample is extracted based on the observation image data, and analysis of the sample is performed. Here, in this sample observation device, when generating observation image data, luminance image data related to the luminance of the sample is generated based on the multiple XZ image data, and multiple binary XZ image data are generated by binarizing the luminance values ​​of each of the multiple XZ image data, and regional image data related to the presence region of the sample is generated based on the multiple binary XZ image data. In this way, by performing analysis using necessary image data from the generated luminance image data and regional image data, it is possible to significantly reduce the amount of data to be processed, and the processing required from acquisition of the XZ image data of the sample to analysis of the sample is accelerated.

[0008] The analysis unit may generate thickness X image data by integrating each value of the multiple binary XZ image data constituting the region image data in the Z-axis direction, and generate thickness XY image data related to the thickness of the sample by combining the thickness X image data in the Y-axis direction. In this case, information related to the thickness of the sample can be efficiently acquired and analyzed.

[0009] The analysis unit may extract a top pixel position in the Z-axis direction from each of the multiple binarized XZ image data constituting the area image data to generate top position X image data, and combine the top position X image data in the Y-axis direction to generate top position XY image data regarding the top position of the sample. In this case, the analysis unit may generate top brightness XY image data indicating the brightness value at the top position of the sample based on the top position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information regarding the top position of the sample.

[0010] The analysis unit may extract a bottom pixel position in the Z-axis direction from each of the multiple binary XZ image data constituting the region image data to generate bottom position X image data, and combine the bottom position X image data in the Y-axis direction to generate bottom position XY image data relating to the bottom position of the sample. In this case, the analysis unit may generate bottom brightness XY image data indicating the brightness value at the bottom position of the sample based on the bottom position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information relating to the bottom position of the sample.

[0011] The analysis unit may extract a specific pixel position in the Z-axis direction from each of the multiple binary XZ image data constituting the region image data to generate specific position X image data, and combine the specific position X image data in the Y-axis direction to generate specific position XY image data related to the specific position of the sample. In this case, the analysis unit may generate specific brightness XY image data indicating the brightness value at the specific position of the sample based on the specific position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information related to the specific position of the sample.

[0012] The analysis unit may generate integrated luminance X image data by integrating the luminance values ​​of the multiple XZ image data constituting the luminance image data in the Z-axis direction, and may combine the integrated luminance X image data in the Y-axis direction to generate integrated luminance XY image data related to the integrated luminance of the sample. In this case, the integrated luminance X image data can have a constant Z-axis component of background light contained in one pixel, so that the influence of variations in the luminance value of the background light can be reduced. Therefore, the influence of background light can be sufficiently reduced even in the integrated luminance XY image data obtained by combining the integrated luminance X image data in the Y-axis direction.

[0013] The analysis unit may extract a maximum brightness value in the Z-axis direction from each of the multiple XZ image data constituting the brightness image data to generate maximum brightness X image data, and combine the maximum brightness X image data in the Y-axis direction to generate maximum brightness XY image data regarding the maximum brightness value of the sample. In this case, information regarding the distribution of the maximum brightness value of the sample in the Z-axis direction can be efficiently acquired and analyzed.

[0014] The analysis unit may extract minimum brightness values ​​in the Z-axis direction from each of the multiple XZ image data constituting the brightness image data to generate minimum brightness X image data, and combine the minimum brightness X image data in the Y-axis direction to generate minimum brightness XY image data relating to the minimum brightness values ​​of the sample. In this case, information regarding the distribution of the minimum brightness values ​​of the sample in the Z-axis direction can be efficiently acquired and analyzed.

[0015] The image acquisition unit may acquire a plurality of XZ image data corresponding to the optical images of the observation light of the plurality of wavelengths, and the image generation unit may generate luminance image data related to the luminance of the sample based on the plurality of XZ image data corresponding to the optical image of the observation light of one of the plurality of wavelengths, and may generate a plurality of binary XZ image data by binarizing the luminance values ​​of the plurality of XZ image data corresponding to the optical image of the observation light of another of the plurality of wavelengths, and may generate regional image data related to the presence region of the sample based on the plurality of binary XZ image data. In this case, for example, by generating regional image data using observation light of a wavelength at which it is easy to obtain an optical image, and generating regional image data related to the presence region of the sample, it becomes possible to apply information obtained from the regional image data to an analysis when an observation light of a wavelength at which it is difficult to obtain an optical image is used.

[0016] The image acquisition unit may acquire a plurality of XZ image data corresponding to the optical images of the observation light of the plurality of wavelengths, and the image generation unit may generate a plurality of first binarized XZ image data obtained by binarizing the luminance value of each of the plurality of XZ image data corresponding to the optical image of the observation light of one of the plurality of wavelengths, generate luminance image data related to the luminance of the sample based on the first binarized XZ image data, generate a plurality of second binarized XZ image data obtained by binarizing the luminance value of each of the plurality of XZ image data for the optical image of the observation light of another wavelength of the plurality of wavelengths, and generate regional image data related to the presence region of the sample based on the plurality of second binarized XZ image data. In this case, for example, by generating regional image data using observation light of a wavelength at which it is easy to obtain an optical image, and generating regional image data related to the presence region of the sample, it is possible to apply information obtained from the regional image data to an analysis when using observation light of a wavelength at which it is difficult to obtain an optical image.

[0017] A sample observation method according to one aspect of the present disclosure includes an irradiation step of irradiating a sample with planar light in an XZ plane, a scanning step of scanning the sample in a Y-axis direction so as to pass through the irradiation plane of the planar light, an imaging step of imaging the observation light generated in the sample by the irradiation of the planar light using an imaging optical system having an observation axis inclined with respect to the irradiation plane, an image acquisition step of acquiring a plurality of XZ image data corresponding to the optical image of the observation light imaged by the imaging optical system, an image generation step of generating observation image data of the sample based on the plurality of XZ image data, and an analysis step of extracting information about the sample based on the observation image data and performing an analysis related to the sample, wherein in the image acquisition step, a plurality of XZ image data are acquired in the Y-axis direction, and in the image generation step, luminance image data related to the luminance of the sample is generated based on the plurality of XZ image data, and each luminance value of the plurality of XZ image data is binarized to generate a plurality of binarized XZ image data, and regional image data related to the presence region of the sample is generated based on the plurality of binarized XZ image data.

[0018] In this sample observation method, the sample is irradiated with planar light in the XZ plane while scanning the sample in the Y axis, and multiple XZ image data corresponding to the light image of the observation light generated in the sample are obtained. Then, observation image data is generated based on the multiple XZ image data, information about the sample is extracted based on the observation image data, and analysis of the sample is performed. Here, in this sample observation method, when generating observation image data, luminance image data related to the luminance of the sample is generated based on the multiple XZ image data, and multiple binary XZ image data are generated by binarizing the luminance values ​​of each of the multiple XZ image data, and regional image data related to the presence region of the sample is generated based on the multiple binary XZ image data. In this way, by performing analysis using necessary image data from the generated luminance image data and regional image data, it is possible to significantly reduce the amount of data to be processed, and the processing required from obtaining the XZ image data of the sample to analyzing the sample is accelerated.

[0019] In the analysis step, the values ​​of the multiple binary XZ image data constituting the region image data may be integrated in the Z-axis direction to generate thickness X image data, and the thickness X image data may be combined in the Y-axis direction to generate thickness XY image data relating to the thickness of the sample. In this case, information regarding the thickness of the sample can be efficiently acquired and analyzed.

[0020] In the analysis step, a top pixel position in the Z-axis direction may be extracted from each of the multiple binarized XZ image data constituting the area image data to generate top position X image data, and the top position X image data may be combined in the Y-axis direction to generate top position XY image data relating to the top position of the sample. In this case, in the analysis step, top brightness XY image data indicating the brightness value at the top position of the sample may be generated based on the top position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information regarding the top position of the sample.

[0021] The analyzing step may extract a bottom pixel position in the Z-axis direction from each of the multiple binarized XZ image data constituting the region image data to generate bottom position X image data, and combine the bottom position X image data in the Y-axis direction to generate bottom position XY image data relating to the bottom position of the sample. In this case, the analyzing step may generate bottom brightness XY image data indicating the brightness value at the bottom position of the sample based on the bottom position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information related to the bottom position of the sample.

[0022] In the analysis step, a specific pixel position in the Z-axis direction may be extracted from each of the multiple binary XZ image data constituting the region image data to generate specific position X image data, and the specific position X image data may be combined in the Y-axis direction to generate specific position XY image data related to the specific position of the sample. In this case, in the analysis step, specific brightness XY image data indicating the brightness value at the specific position of the sample may be generated based on the specific position XY image data and the brightness image data. This makes it possible to efficiently acquire and analyze information related to the specific position of the sample.

[0023] In the analysis step, the luminance values ​​of the multiple XZ image data constituting the luminance image data may be integrated in the Z-axis direction to generate integrated luminance X image data, and the integrated luminance X image data may be combined in the Y-axis direction to generate integrated luminance XY image data relating to the integrated luminance of the sample. In this case, the integrated luminance X image data can have a constant Z-axis component of background light contained in one pixel, so that the influence of variations in the luminance value of the background light can be reduced. Therefore, the influence of background light can be sufficiently reduced in the integrated luminance XY image data obtained by combining the integrated luminance X image data in the Y-axis direction.

[0024] In the analysis step, the maximum brightness value in the Z-axis direction may be extracted from each of the multiple XZ image data constituting the brightness image data to generate maximum brightness X image data, and the maximum brightness X image data may be combined in the Y-axis direction to generate maximum brightness XY image data relating to the maximum brightness value of the sample. In this case, information regarding the distribution of the maximum brightness value of the sample in the Z-axis direction can be efficiently acquired and analyzed.

[0025] In the analysis step, the minimum brightness value in the Z-axis direction may be extracted from each of the multiple XZ image data constituting the brightness image data to generate minimum brightness X image data, and the minimum brightness X image data may be combined in the Y-axis direction to generate minimum brightness XY image data relating to the minimum brightness value of the sample. In this case, information regarding the distribution of the minimum brightness value of the sample in the Z-axis direction can be efficiently acquired and analyzed.

[0026] In the image acquisition step, a plurality of XZ image data corresponding to the optical images of the observation light of the plurality of wavelengths are acquired, and in the image generation step, luminance image data relating to the luminance of the sample is generated based on the plurality of XZ image data corresponding to the optical image of the observation light of one of the plurality of wavelengths, and the luminance values ​​of the plurality of XZ image data corresponding to the optical image of the observation light of another of the plurality of wavelengths are binarized to generate a plurality of binarized XZ image data, and regional image data relating to the presence region of the sample may be generated based on the plurality of binarized XZ image data. In this case, for example, by generating regional image data using an observation light of a wavelength at which an optical image is easily obtained, and generating regional image data relating to the presence region of the sample, it becomes possible to apply information obtained from the regional image data to an analysis when an observation light of a wavelength at which an optical image is difficult to obtain is used.

[0027] In the image acquisition step, a plurality of XZ image data corresponding to the optical images of the observation light of the plurality of wavelengths are acquired, and in the image generation step, a plurality of first binarized XZ image data obtained by binarizing the luminance values ​​of the plurality of XZ image data corresponding to the optical image of the observation light of one of the plurality of wavelengths are generated, and luminance image data relating to the luminance of the sample is generated based on the first binarized XZ image data, and a plurality of second binarized XZ image data obtained by binarizing the luminance values ​​of the plurality of XZ image data for the optical image of the observation light of another wavelength of the plurality of wavelengths are generated, and regional image data relating to the presence region of the sample may be generated based on the plurality of second binarized XZ image data. In this case, for example, by generating regional image data using observation light of a wavelength at which it is easy to obtain an optical image, and generating regional image data relating to the presence region of the sample, it is possible to apply information obtained from the regional image data to an analysis when using observation light of a wavelength at which it is difficult to obtain an optical image. Effect of the Invention

[0028] According to the present disclosure, it is possible to speed up the processing required for sample analysis. [Brief description of the drawings]

[0029] [Figure 1] 1 is a schematic configuration diagram showing an embodiment of a sample observation device. [Diagram 2] FIG. 2 is an enlarged view of a main portion showing the vicinity of a sample. [Diagram 3] FIG. 4 is a schematic diagram showing how luminance image data is generated. [Figure 4] FIG. 4 is a schematic diagram showing how regional image data is generated. [Diagram 5] FIG. 11 is a schematic diagram showing how thickness XY image data is generated. [Figure 6] 11 is a schematic diagram showing how top position XY image data and top luminance XY image data are generated. FIG. [Figure 7] 10A and 10B are schematic diagrams showing how bottom position XY image data and bottom luminance XY image data are generated. [Figure 8]10A and 10B are schematic diagrams showing how specific position XY image data and specific luminance XY image data are generated. [Figure 9] 10 is a schematic diagram showing how integrated luminance XY image data is generated. FIG. [Figure 10] FIG. 11 is a schematic diagram showing how maximum brightness XY image data is generated. [Figure 11] 10 is a schematic diagram showing how minimum luminance XY image data is generated. FIG. [Figure 12] 1 is a flowchart showing an example of a sample observation method. [Figure 13] FIG. 2 is a diagram showing details of an analysis step. [Figure 14] 10 is a schematic diagram showing an example of generation of observed image data based on XZ image data. FIG. [Figure 15] 11 is a schematic diagram showing another example of generation of observed image data based on XZ image data. FIG. [Figure 16] 13 is a schematic diagram showing yet another example of generation of observed image data based on XZ image data. FIG. [Figure 17] 13 is a schematic diagram showing yet another example of generation of observed image data based on XZ image data. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0030] Hereinafter, preferred embodiments of a sample observation device and a sample observation method according to one aspect of the present disclosure will be described in detail with reference to the drawings.

[0031] Fig. 1 is a schematic diagram showing an embodiment of a sample observation device. This sample observation device 1 is a device that irradiates a sample S with planar light L2 and forms an image of observation light (e.g., fluorescence or scattered light) generated inside the sample S on an imaging plane to obtain observation image data of the inside of the sample S. Examples of this type of sample observation device 1 include a slide scanner that obtains and displays an image of the sample S held on a slide glass, and a plate reader that obtains image data of the sample S held on a microplate and analyzes the image data. As shown in Fig. 1, the sample observation device 1 is configured to include a light source 2, an irradiation optical system 3, a scanning unit 4, an imaging optical system 5, an image obtaining unit 6, and a computer 7.

[0032] Examples of the sample S to be observed include human or animal cells, tissues, and organs, animals or plants themselves, and plant cells and tissues. These samples S are stained with fluorescent materials such as fluorescein-dextran (excitation wavelength: 494 nm / fluorescence wavelength: 521 nm) and tetramethylrhodamine (excitation wavelength: 555 nm / fluorescence wavelength: 580 nm). The sample S may be stained with multiple fluorescent substances. The sample S may also be contained in a solution, a gel, or a substance with a refractive index different from that of the sample S.

[0033] The light source 2 is a light source that outputs light L1 to be irradiated onto the sample S. Examples of the light source 2 include laser light sources such as laser diodes and solid-state laser light sources. The light source 2 may also be a light-emitting diode, a superluminescent diode, or a lamp-based light source. The light L1 output from the light source 2 is guided to the irradiation optical system 3.

[0034] The irradiation optical system 3 is an optical system that shapes the light L1 output from the light source 2 into planar light L2 and irradiates the sample S with the shaped planar light L2 along the optical axis P1. In the following description, the optical axis P1 of the irradiation optical system 3 may be referred to as the optical axis of the planar light L2. The irradiation optical system 3 includes a light shaping element such as a cylindrical lens, an axicon lens, or a spatial light modulator, and is optically coupled to the light source 2. The irradiation optical system 3 may include an objective lens. The planar light L2 formed by the irradiation optical system 3 is irradiated onto the sample S. In the sample S irradiated with the planar light L2, an observation light L3 is generated at the irradiation surface R of the planar light L2. The observation light L3 is, for example, fluorescence excited by the planar light L2, scattered light of the planar light L2, or diffuse reflection light of the planar light L2.

[0035] When observing the sample S in the thickness direction, it is preferable that the planar light L2 is a thin planar light having a thickness of 2 mm or less, taking into consideration the resolution. Furthermore, when the thickness of the sample S is very small, that is, when observing a sample S having a thickness equal to or less than the Z-direction resolution described later, the thickness of the planar light L2 does not affect the resolution. Therefore, a planar light L2 having a thickness exceeding 2 mm may be used.

[0036] The scanning unit 4 is a mechanism for scanning the sample S across the irradiation surface R of the planar light L2. In this embodiment, the scanning unit 4 is configured with a moving stage 12 for moving a sample container 11 that holds the sample S. The sample container 11 is, for example, a microplate, a slide glass, a petri dish, or the like, and is transparent to the planar light L2 and the observation light L3. In this embodiment, a microplate is exemplified. As shown in FIG. 2, the sample container 11 has a plate-shaped main body 14 in which a plurality of wells 13 in which the samples S are placed are arranged in a straight line (or in a matrix), and a plate-shaped transparent member 15 provided on one side of the main body 14 so as to cover one end of the wells 13.

[0037] When the sample S is placed in the well 13, the well 13 is filled with a solution such as a culture medium, a fluorescent indicator, or a buffer together with the sample S. Autofluorescence is emitted from the solution. The transparent member 15 has an input surface 15a of the planar light L2 for the sample S placed in the well 13. The material of the transparent member 15 is not particularly limited as long as it is a member that is transparent to the planar light L2, and is, for example, glass, quartz, or synthetic resin. The sample container 11 is placed relative to the moving stage 12 so that the input surface 15a is perpendicular to the optical axis P1 of the planar light L2. The other end side of the well 13 is open to the outside. The sample container 11 may be fixed to the moving stage 12.

[0038] As shown in Fig. 1, the moving stage 12 scans the sample container 11 in a preset direction in accordance with a control signal from the computer 7. In this embodiment, the moving stage 12 scans the sample container 11 in one direction in a plane perpendicular to the optical axis P1 of the planar light L2. In the following description, the direction of the optical axis P1 of the planar light L2 is referred to as the Z axis, the scanning direction of the sample container 11 by the moving stage 12 is referred to as the Y axis, and the direction perpendicular to the Y axis in the plane perpendicular to the optical axis P1 of the planar light L2 is referred to as the X axis. The irradiation surface R of the sample S with the planar light L2 is a surface in the XZ plane.

[0039] The imaging optical system 5 is an optical system that forms an image of the observation light L3 generated on the sample S by irradiation with the planar light L2. As shown in FIG. 2, the imaging optical system 5 includes, for example, an objective lens 16. The optical axis of the imaging optical system 5 is the observation axis P2 of the observation light L3. The observation axis P2 of the imaging optical system 5 is inclined at an inclination angle θ with respect to the irradiation surface R of the sample S with the planar light L2. The inclination angle θ also coincides with the angle formed by the optical axis P1 of the planar light L2 toward the sample S and the observation axis P2. The inclination angle θ is, for example, 10° to 80°. From the viewpoint of improving the resolution of the observation image, the inclination angle θ is preferably 20° to 70°. Moreover, from the viewpoint of improving the resolution of the observation image and the stability of the field of view, the inclination angle θ is more preferably 30° to 65°.

[0040] As shown in FIG. 1, the image acquisition unit 6 is a part that acquires a plurality of XZ image data corresponding to the optical image formed by the observation light L3 by the imaging optical system 5. The image acquisition unit 6 is configured to include, for example, an imaging device that captures the optical image by the observation light L3. Examples of the imaging device include area image sensors such as a CMOS image sensor and a CCD image sensor. These area image sensors are disposed on the imaging plane formed by the imaging optical system 5, and capture the optical image by, for example, a global shutter or a rolling shutter. The area image sensor acquires a plurality of XZ image data 21 (see FIG. 3), which is data of a two-dimensional image of the sample S, in the Y-axis direction, and outputs it to the computer 7.

[0041] The computer 7 is physically configured to include memories such as RAM and ROM, a processor (arithmetic circuit) such as a CPU, a communication interface, a storage unit such as a hard disk, and a display unit such as a display. Examples of such a computer 7 include a personal computer, a cloud server, and a smart device (a smartphone, a tablet terminal, etc.). The computer 7 executes a program stored in the memory on the CPU of the computer system, thereby functioning as a controller that controls the operation of the light source 2 and the moving stage 12, an image generation unit 8 that generates observed image data of the sample S, and an analysis unit 10 that analyzes the sample S based on the observed image data.

[0042] The computer 7 as a controller receives an input of a measurement start operation by a user and synchronously drives the light source 2, the moving stage 12, and the image acquisition unit 6. In this case, the computer 7 may control the light source 2 so that the light source 2 continuously outputs the light L1 while the sample S is being moved by the moving stage 12, or may control the ON / OFF of the output of the light L1 by the light source 2 in accordance with the image capture by the image acquisition unit 6. Furthermore, if the irradiation optical system 3 is equipped with an optical shutter (not shown), the computer 7 may turn ON / OFF the irradiation of the planar light L2 onto the sample S by controlling the optical shutter.

[0043] Moreover, the computer 7 serving as the image generating unit 8 generates observation image data of the sample S based on the multiple XZ image data 21 generated by the image acquiring unit 6. Specifically, when the image generating unit 8 receives the multiple XZ image data 21 output from the image acquiring unit 6, the image generating unit 8 generates two types of data, namely, brightness image data 31 and area image data 32, as observation image data 23 of the sample S based on the multiple XZ image data 21.

[0044] 3, the image generating unit 8 generates the luminance image data 31 by combining a plurality of XZ image data 21 into one set. The luminance image data 31 has three-dimensional luminance distribution information of the sample S. The image generating unit 8 outputs the generated luminance image data 31 to the analyzing unit 10.

[0045] When generating the luminance image data 31, the image generating unit 8 may execute a process of removing the luminance value of the background light (here, the luminance value due to the solution in the well 13 in which the sample S is placed). In this case, the image generating unit 8 identifies a luminance region corresponding to the sample S in each of the XZ image data 21, and removes the luminance value of the background light by setting the values ​​of pixels constituting regions other than the identified luminance region to 0. Also, the image generating unit 8 may execute a process of subtracting the luminance value of the background light when generating the luminance image data 31. In this case, the luminance value of the background light is subtracted from the values ​​of pixels constituting regions other than the luminance region in each of the XZ image data 21. When executing a process of removing or subtracting the influence of the background light, it becomes possible to measure the observation light L3 from the sample S with high reproducibility.

[0046] In generating the regional image data 32, the image generating unit 8 binarizes the luminance values ​​of the multiple XZ image data 21 as shown in FIG. 4 to generate multiple binarized XZ image data 25. In the binarization of the luminance values, the image generating unit 8 holds a luminance value threshold value for each type of sample S in advance, and generates the binarized XZ image data 25 by setting the pixel value of a pixel having a pixel value equal to or greater than the threshold value to 1 and the pixel value of a pixel having a pixel value less than the threshold value to 0. By binarizing the luminance values ​​in this way, the binarized XZ image data 25 becomes data indicating that the sample S is present in an area where the pixel value of the pixel is 1, and indicating that the sample S is not present in an area where the pixel value of the pixel is 0. The image generating unit 8 generates regional image data 32 by using these multiple binarized XZ image data 25 as a set. This regional image data 32 has information about the three-dimensional existence area of ​​the sample S. The image generating unit 8 outputs the generated regional image data 32 to the analyzing unit 10. In generating the regional image data 32, the luminance values ​​of the multiple XZ image data 21 may be multi-valued to generate multiple binary XZ image data 25.

[0047] The computer 7 as the analysis unit 10 executes an analysis of the sample S based on the observation image data 23 generated by the image generation unit 8, and generates an analysis result. Specifically, the analysis unit 10 extracts region information and luminance information of the sample S based on the luminance image data 31 and / or region image data 32 received from the image generation unit 8. Here, when extracting the region information and luminance information, the analysis unit 10 extracts information including at least one of the thickness of the sample S in the Z-axis direction, the top position / luminance at the top position in the Z-axis direction, the bottom position / luminance at the bottom position in the Z-axis direction, the specific position / luminance at the specific position in the Z-axis direction, and the integrated luminance / maximum luminance / minimum luminance in the Z-axis direction based on the luminance image data 31 and / or region image data 32.

[0048] When extracting information about the thickness of the sample S in the Z-axis direction, the analysis unit 10 first generates thickness X image data 41 by integrating each pixel value of the multiple binarized XZ image data 25 in the Z-axis direction, as shown in Fig. 5(a). Each pixel of this thickness X image data 41 contains an integrated value of the pixel values ​​in the Z-axis direction, as shown in Fig. 5(b). In the example of Fig. 5, each pixel of the thickness X image data 41 has an integrated value, such that the central pixel value in the X-axis direction is 10, the pixel values ​​on both sides of it are 9, and so on.

[0049] In the binarized XZ image data 25, the pixel value at the position where the sample S exists is 1, and the pixel value at the position where the sample S does not exist is 0. Therefore, the integrated value of each pixel in the thickness X image data 41 indicates the presence area of ​​the sample S in the Z-axis direction at the X-axis coordinate of that pixel (i.e., the thickness of the sample S in the Z-axis direction). If actual thickness information per pixel is obtained, the thickness of the sample S in the Z-axis direction can be obtained by multiplying the integrated value of each pixel by the thickness per pixel. In the thickness XY image data 42 obtained by combining these thickness X image data 41 in the Y-axis direction, information on the thickness of the sample S in each XY plane is expressed as a pixel value, so that the thickness of the sample S in the Z-axis direction is expressed like a contour line.

[0050] When extracting information about the top position of the sample S in the Z-axis direction, the analysis unit 10 first refers to multiple binarized XZ image data 25 as shown in FIG. 6(a), and extracts the coordinate value (top pixel position) of the pixel with the largest coordinate value in the Z-axis direction among the pixels with a pixel value of 1 as the top position of the sample S in the Z-axis direction. In the example of FIG. 6(a), the binarized XZ image data 25 has 1024 pixels in the Z-axis direction, and coordinate values ​​from 1 to 1024 are assigned to the pixels from the bottom. The analysis unit 10 detects pixel values ​​in the Z-axis direction at each coordinate in the X-axis direction of the binarized XZ image data 25. Then, the coordinate value of the pixel with the largest coordinate value among the pixels with a pixel value of 1 or more is extracted to generate top position X image data 43.

[0051] When the luminance values ​​of each of the multiple XZ image data 21 are multi-valued to obtain multiple binary XZ image data 25, pixels among the multiple binary XZ image data 25 that have a pixel value of 1 or more indicate pixels in which the sample S is present. Therefore, among the pixels with a pixel value of 1 or more, the coordinate value (top pixel position) of the pixel with the largest coordinate value in the Z axis direction may be extracted as the top position of the sample S in the Z axis direction.

[0052] As shown in Fig. 6(b), each pixel of this top position X image data 43 includes the coordinate value of the pixel with the largest coordinate value among pixels with a pixel value of 1 or more. In the example of Fig. 6(b), each pixel of the top position X image data 43 has a coordinate value such that the central pixel value in the X-axis direction is 858, the adjacent pixels on both sides have values ​​of 857, and so on. The analysis unit 10 generates top position X image data 43 for each of the binarized XZ image data 25, and combines these in the Y-axis direction to generate top position XY image data 44 as shown in Fig. 6(a).

[0053] The analysis unit 10 may generate top luminance XY image data 44A indicating the luminance value at the top position of the sample S as shown in FIG. 6(c) based on the top position XY image data 44 and the luminance image data 31 (see FIG. 3). In this case, the analysis unit 10 extracts the luminance value corresponding to the pixel value (coordinate value) of the top position XY image data 44 from the luminance value included in each pixel of the luminance image data 31, and generates the top luminance XY image data 44A. In addition, when generating the top luminance XY image data 44A, the analysis unit 10 may first extract the luminance value corresponding to the pixel value (coordinate value) of the top position X image data 43 from the luminance value included in each pixel of the luminance image data 31, and generate the top luminance X image data 43A (see FIG. 6(c)). In this case, the top luminance XY image data 44A can be generated by combining the top luminance X image data 43A in the Y-axis direction. The analysis unit 10 extracts the luminance of the top position / top position in the Z-axis direction of the sample S by analyzing the top position XY image data 44 or the top luminance XY image data 44A.

[0054] When extracting information about the bottom position of the sample S in the Z-axis direction, the analysis unit 10 first refers to a plurality of binarized XZ image data 25 as shown in FIG. 7(a), and extracts the coordinate value (bottom pixel position) of the pixel with the smallest coordinate value in the Z-axis direction among the pixels with a pixel value of 1 as the bottom position of the sample S in the Z-axis direction. In the example of FIG. 7(a), similar to FIG. 6(a), the binarized XZ image data 25 has 1024 pixels in the Z-axis direction, and coordinate values ​​from 1 to 1024 are assigned to the pixels from the bottom. The analysis unit 10 detects pixel values ​​in the Z-axis direction at each coordinate in the X-axis direction of the binarized XZ image data 25. Then, the coordinate value of the pixel with the smallest coordinate value among the pixels with a pixel value of 1 or more is extracted to generate bottom position X image data 45.

[0055] When the luminance values ​​of each of the multiple XZ image data 21 are multi-valued to obtain multiple binary XZ image data 25, pixels among the multiple binary XZ image data 25 that have a pixel value of 1 or more indicate pixels in which the sample S is present. Therefore, among the pixels with a pixel value of 1 or more, the coordinate value (bottom pixel position) of the pixel with the smallest coordinate value in the Z axis direction may be extracted as the bottom position in the Z axis direction of the sample S.

[0056] As shown in Fig. 7(b), each pixel of the bottom position X image data 45 includes the coordinate value of the pixel with the smallest coordinate value among pixels with a pixel value of 1 or more. In the example of Fig. 7(b), each pixel of the bottom position X image data 45 has coordinate values ​​such that the central pixel in the X-axis direction has a value of 252, the adjacent pixels on both sides have values ​​of 253, and so on. The analysis unit 10 generates bottom position X image data 45 for each of the binarized XZ image data 25, and combines these in the Y-axis direction to generate bottom position XY image data 46 as shown in Fig. 7(a).

[0057] The analysis unit 10 may generate bottom luminance XY image data 46A indicating the luminance value at the bottom position of the sample S as shown in FIG. 7(c) based on the bottom position XY image data 46 and the luminance image data 31 (see FIG. 3). In this case, the analysis unit 10 extracts the luminance value corresponding to the pixel value (coordinate value) of the bottom position XY image data 46 from the luminance value included in each pixel of the luminance image data 31, and generates the bottom luminance XY image data 46A. In addition, when generating the bottom luminance XY image data 46A, the analysis unit 10 may first extract the luminance value corresponding to the pixel value (coordinate value) of the bottom position X image data 45 from the luminance value included in each pixel of the luminance image data 31, and generate the bottom luminance X image data 45A (see FIG. 7(c)). In this case, the bottom luminance XY image data 46A can be generated by combining the bottom luminance X image data 45A in the Y-axis direction. The analysis unit 10 extracts the luminance of the bottom position / bottom position in the Z-axis direction of the sample S by analyzing the bottom position XY image data 46 or the bottom luminance XY image data 46A.

[0058] When extracting information about a specific position in the Z-axis direction of the sample S, the analysis unit 10 first refers to multiple binarized XZ image data 25 and extracts the coordinate value (pixel position) of a specific pixel in the Z-axis direction as the specific position in the Z-axis direction of the sample S, as shown in FIG. 8(a). Here, the position of the 200th pixel from the bottom position toward the top position is set as the specific position. The analysis unit 10 detects pixel values ​​in the Z-axis direction at each coordinate in the X-axis direction of the binarized XZ image data 25. Then, the coordinate value of the pixel that is the 200th pixel from the bottom position is extracted to generate specific position X image data 47.

[0059] Each pixel of the specific position X image data 47 includes the coordinate value of the 200th pixel from the bottom position toward the top position, as shown in Fig. 8(b). In the example of Fig. 8(b), each pixel of the specific position X image data 47 has coordinate values ​​such that the central pixel value in the X-axis direction is 452, the adjacent pixels on both sides are 453, and so on. The analysis unit 10 generates specific position X image data 47 for each of the binarized XZ image data 25, and combines them in the Y-axis direction to generate specific position XY image data 48, as shown in Fig. 8(a).

[0060] The analysis unit 10 may generate specific luminance XY image data 48A indicating the luminance value at the specific position of the sample S as shown in FIG. 8(c) based on the specific position XY image data 48 and the luminance image data 31 (see FIG. 3). In this case, the analysis unit 10 extracts the luminance value corresponding to the pixel value (coordinate value) of the specific position XY image data 48 from the luminance value included in each pixel of the luminance image data 31, and generates the specific luminance XY image data 48A. In addition, when generating the specific luminance XY image data 48A, the analysis unit 10 may first extract the luminance value corresponding to the pixel value (coordinate value) of the specific position X image data 47 from the luminance value included in each pixel of the luminance image data 31, and generate the specific luminance X image data 47A (see FIG. 8(c)). In this case, the specific luminance XY image data 48A can be generated by combining the specific luminance X image data 47A in the Y-axis direction. The analysis unit 10 extracts the luminance of the specific position / specific position in the Z-axis direction of the sample S by analyzing the specific position XY image data 48 or the specific luminance XY image data 48A.

[0061] There is no particular restriction on the setting of the specific position, and it is not limited to the setting based on the bottom position described above, but may be a setting based on the top position or a setting based on a position that is the center between the top and bottom positions (thickness center). The same coordinate in the Z-axis direction may be set as the specific position. Furthermore, the position of a pixel that is separated in the Z-axis direction from a reference such as the top position, bottom position, or thickness center by a number of pixels equivalent to a predetermined ratio of the thickness may be set as the specific position. When setting the specific position, image data obtained under other measurement conditions (for example, measurement with excitation light of a different excitation wavelength) may be used as a reference.

[0062] When extracting information about the integrated luminance of the sample S in the Z-axis direction, the analysis unit 10 first integrates the luminance values ​​of each of the multiple XZ image data 21 in the Z-axis direction to generate integrated luminance X image data 49, as shown in Fig. 9. Next, the generated integrated luminance X image data 49 are combined in the Y-axis direction to generate integrated luminance XY image data 50. The analysis unit 10 analyzes the integrated luminance XY image data 50 to extract the integrated luminance of the sample S in the Z-axis direction.

[0063] When extracting information regarding the maximum brightness of the sample S in the Z-axis direction, the analysis unit 10 detects brightness values ​​in the Z-axis direction at each coordinate in the X-axis direction of multiple XZ image data 21, as shown in Fig. 10, and extracts the brightness value (maximum brightness value) of the pixel with the largest brightness value in the Z-axis direction to generate maximum brightness X image data 51. Next, the generated maximum brightness X image data 51 is combined in the Y-axis direction to generate maximum brightness XY image data 52. The analysis unit 10 extracts the maximum brightness of the sample S in the Z-axis direction by analyzing the maximum brightness XY image data 52.

[0064] When extracting information regarding the minimum luminance in the Z-axis direction of the sample S, the analysis unit 10 detects the luminance value in the Z-axis direction at each coordinate in the X-axis direction of the multiple XZ image data 21, as shown in Fig. 11, and extracts the luminance value (minimum luminance value) of the pixel with the smallest luminance value in the Z-axis direction to generate minimum luminance X image data 53. Next, the generated minimum luminance X image data 53 is combined in the Y-axis direction to generate minimum luminance XY image data 54. The analysis unit 10 extracts the minimum luminance in the Z-axis direction of the sample S by analyzing the minimum luminance XY image data 54.

[0065] The analysis unit 10 analyzes the feature amount for each sample S based on at least one of the thickness of the sample S in the Z-axis direction, the top position / brightness at the top position in the Z-axis direction, the bottom position / brightness at the bottom position in the Z-axis direction, the specific position / brightness at the specific position in the Z-axis direction, and the integrated brightness / maximum brightness / minimum brightness in the Z-axis direction extracted as described above, and stores the analysis results, displays them on a monitor, etc. Note that the various image data generated by the analysis unit 10 do not necessarily need to be displayed on a monitor, etc., and only the analysis results of the analysis unit 10 on the feature amount for each sample S may be displayed on a monitor, etc.

[0066] Next, a sample observation method using the above-mentioned sample observation device 1 will be described. Fig. 12 is a flow chart showing an example of the sample observation method. As shown in the figure, this sample observation method includes an irradiation step (step S01), a scanning step (step S02), an imaging step (step S03), an image acquisition step (step S04), an image generation step (step S05), and an analysis step (step S06).

[0067] In the irradiation step S01, planar light L2 is irradiated onto the sample S. When a user inputs an operation to start measurement, the light source 2 is driven based on a control signal from the computer 7, and light L1 is output from the light source 2. The light L1 output from the light source 2 is shaped by the irradiation optical system 3 to become planar light L2, and is irradiated onto the sample S.

[0068] In the scanning step S02, the sample S is scanned with respect to the irradiation surface R of the planar light L2. When a user inputs an operation to start measurement, the moving stage 12 is driven in synchronization with the driving of the light source 2 based on a control signal from the computer 7. As a result, the sample container 11 is driven linearly in the Y-axis direction at a constant speed, and the sample S in the well 13 is scanned with respect to the irradiation surface R of the planar light L2.

[0069] In the imaging step S03, an imaging optical system 5 having an observation axis P2 inclined with respect to the irradiation surface R is used to image the observation light L3 generated in the sample S by irradiation with the planar light L2 onto the imaging surface of the image acquisition unit 6. In the image acquisition step S04, a plurality of XZ image data 21 corresponding to the light image formed by the observation light L3 by the imaging optical system 5 is acquired in the Y-axis direction. The plurality of XZ image data 21 are sequentially output from the image acquisition unit 6 to the image generation unit 8.

[0070] In the image generating step S05, observation image data of the sample S is generated based on the multiple XZ image data. Here, two types of data, luminance image data 31 and area image data 32, are generated as observation image data of the sample S based on the multiple XZ image data 21 obtained in the image acquiring step S04. The luminance image data 31 is generated as a set of multiple XZ image data 21 (see FIG. 3). In addition, the area image data 32 is generated as a set of multiple binary XZ image data 25 by binarizing the luminance values ​​of each of the multiple XZ image data 21, and these binary XZ image data 25 are generated as a set (see FIG. 4). The generated luminance image data 31 and area image data 32 are output from the image generating unit 8 to the analyzing unit 10.

[0071] More specifically, in the analysis step S06, as shown in FIG. 13, an analysis image generation step S06a and an analysis information extraction step S06b are executed. In the analysis image generation step S06a, various XY image data are generated based on the luminance image data 31 and the area image data 32 generated in the image generation step S05. Here, the integrated luminance XY image data 50, the maximum luminance XY image data 52, and the minimum luminance XY image data 54 are generated based on the luminance image data 31. In addition, the binarized XZ image data 25 is generated based on the area image data 32, and the top position XY image data 44, the bottom position XY image data 46, and the specific position XY image data 48 are generated based on the binarized XZ image data 25. In addition, the top luminance XY image data 44A, the bottom luminance XY image data 46A, and the specific luminance XY image data 48A are generated based on the luminance image data 31 and the area image data 32.

[0072] In the analysis information extraction step S06b, the various XY image data generated in the analysis image generation step S06a are analyzed. In the analysis information extraction step S06b, area information including at least one of the top position in the Z-axis direction, the bottom position in the Z-axis direction, and a specific position in the Z-axis direction is extracted. In addition, in the analysis information extraction step S06b, luminance information including at least one of the integrated luminance in the Z-axis direction, the maximum luminance, the minimum luminance, the luminance at the top position in the Z-axis direction, the luminance at the bottom position in the Z-axis direction, and the luminance at a specific position in the Z-axis direction is extracted. Then, based on the extracted area information and luminance information, the characteristic amount for each sample S is analyzed, and the analysis results are stored, displayed on a monitor, etc., etc. The generated various XY image data may be stored, displayed on a monitor, etc., etc.

[0073] As described above, in the sample observation device 1, the planar light L2 is irradiated on the XZ plane while scanning the sample S in the Y axis, and multiple XZ image data 21 corresponding to the light image of the observation light L3 generated in the sample S are obtained. Then, the observation image data 23 is generated based on the multiple XZ image data 21, information about the sample S is extracted based on the observation image data 23, and analysis of the sample S is performed. Here, in this sample observation device, when generating the observation image data 23, luminance image data 31 related to the luminance of the sample S is generated based on the multiple XZ image data 21, and multiple binary XZ image data 25 are generated by binarizing the luminance values ​​of each of the multiple XZ image data 21, and regional image data 32 related to the presence region of the sample S is generated based on the multiple binary XZ image data 25. In this way, by performing analysis using necessary image data from the generated luminance image data 31 and regional image data 32, it is possible to significantly reduce the amount of data to be processed, and the processing required from acquisition of the XZ image data 21 of the sample to analysis of the sample is accelerated.

[0074] For example, when observing a plurality of fluorescent light beams on the sample S, it is assumed that there are cases where it is easy to obtain an optical image of the observation light L3 and cases where it is difficult to obtain one, depending on the type of fluorescent material. In such a case, by generating regional image data 32 using the fluorescent light that is easy to obtain an optical image of the observation light L3 and extracting regional information of the sample S, it becomes possible to apply the regional information to the analysis of the sample S when using the fluorescent light that is difficult to obtain an optical image of the observation light L3.

[0075] Specifically, in the sample observation device 1, the sample S is irradiated with planar light L2 in the XZ plane while being scanned in the Y axis, and a plurality of XZ image data 21 are acquired based on the observation light L3 of one wavelength λa (e.g., a wavelength at which an optical image is easily obtained) generated in the sample S and the observation light L3 of another wavelength λb (e.g., a wavelength at which an optical image is difficult to obtain) generated in the sample S. Next, observation image data 23A is generated based on the plurality of XZ image data 21 corresponding to the observation light L3 of one wavelength λa, and information (area information and brightness information) X on the sample S is extracted based on the observation image data 23A. Then, observation image data 23B is generated based on the plurality of XZ image data 21 corresponding to the observation light L3 of another wavelength λb, and the analysis of the sample S based on the observation image data 23B is performed by using the previously extracted information X.

[0076] In the example of FIG. 14, the sample observation device 1 acquires multiple XZ image data 21a of the observation light L3a of one wavelength λa generated in the sample S, and also acquires multiple XZ image data 21b of the observation light L3b of another wavelength λb generated in the sample S. Next, each XZ image data 21b of the observation light L3b of another wavelength λb is binarized to generate multiple binarized XZ image data 25b. Then, based on the multiple binarized XZ image data 25b, regional image data 32b relating to the presence region of the sample S is generated. In the example of FIG. 14, the entirety of each binarized XZ image data 25b is used as regional image data 32b. Pixels corresponding to the regional image data 32b are extracted from each XZ image data 21a of the observation light L3a of one wavelength λa to generate the observation image data 23A.

[0077] In the example of FIG. 15, only the bottom region of each binarized XZ image data 25b obtained from the XZ image data 21b of the observation light L3b of another wavelength λb generated in the sample S is selectively set as the regional image data 32b. Pixels corresponding to the bottom region are extracted from each XZ image data 21a corresponding to the observation light L3a of one wavelength λa, and the observation image data 23A is generated. In the example of FIG. 16, an arbitrary region (here, the center region) based on each binarized XZ image data 25b obtained from the XZ image data 21b of the observation light L3b of another wavelength λb generated in the sample S is selectively set as the regional image data 32b. Pixels corresponding to the arbitrary region are extracted from each XZ image data 21a corresponding to the observation light L3a of one wavelength λa, and the observation image data 23A is generated.

[0078] In the example of FIG. 17, the sample observation device 1 acquires multiple XZ image data 21a of the observation light L3a of one wavelength λa generated in the sample S, and also acquires multiple XZ image data 21b of the observation light L3b of another wavelength λb generated in the sample S. Next, each XZ image data 21a of the observation light L3a of one wavelength λa is binarized to generate multiple first binarized XZ image data 25a as luminance image data. Also, each XZ image data 21b of the observation light L3b of the other wavelength λb is binarized to generate multiple second binarized XZ image data 25b. Then, based on the multiple second binarized XZ image data 25b, regional image data 32b regarding the presence region of the sample S is generated. In the example of FIG. 17, an arbitrary region (here, a center region) based on each second binarized XZ image data 25b is selectively set as regional image data 32b. Then, pixels corresponding to the regional image data 32b are extracted from each of the first binarized XZ image data 25a corresponding to the observation light L3a of one wavelength λa, and the observation image data 23A is generated.

[0079] Moreover, in the sample observation device 1, the values ​​of the multiple binary XZ image data 25 that make up the region image data 32 are integrated in the Z-axis direction to generate thickness X image data 41, and the thickness X image data 41 is combined in the Y-axis direction to generate thickness XY image data 42 related to the thickness of the sample. This makes it possible to efficiently acquire and analyze information related to the thickness of the sample S.

[0080] Moreover, in the sample observation device 1, a top pixel position in the Z-axis direction is extracted from each of the multiple binarized XZ image data 25 constituting the area image data 32 to generate top position X image data 43, and the top position X image data 43 is combined in the Y-axis direction to generate top position XY image data 44 regarding the top position of the sample S. Furthermore, based on the top position XY image data 44 and the luminance image data 31, top luminance XY image data 44A indicating the luminance value at the top position of the sample S is generated. This makes it possible to efficiently acquire and analyze information regarding the top position of the sample S.

[0081] Moreover, in the sample observation device 1, the bottom pixel position in the Z-axis direction is extracted from each of the multiple binarized XZ image data 25 constituting the area image data 32 to generate bottom position X image data 45, and the bottom position X image data 45 is combined in the Y-axis direction to generate bottom position XY image data 46 relating to the bottom position of the sample S. Furthermore, based on the bottom position XY image data 46 and the brightness image data 31, bottom brightness XY image data 46A indicating the brightness value at the bottom position of the sample S is generated. This makes it possible to efficiently acquire and analyze information related to the bottom position of the sample S.

[0082] Moreover, in the sample observation device 1, a specific pixel position in the Z-axis direction is extracted from each of the multiple binary XZ image data 25 constituting the region image data 32 to generate specific position X image data 47, and the specific position X image data 47 is combined in the Y-axis direction to generate specific position XY image data 48 related to the specific position of the sample S. Furthermore, specific luminance XY image data 48A indicating the luminance value at the specific position of the sample S is generated based on the specific position XY image data 48 and the luminance image data 31. This makes it possible to efficiently acquire and analyze information related to the specific position of the sample S.

[0083] Moreover, in the sample observation device 1, the luminance values ​​of each of the multiple XZ image data 21 constituting the luminance image data 31 are integrated in the Z-axis direction to generate integrated luminance X image data 49, and the integrated luminance X image data 49 are combined in the Y-axis direction to generate integrated luminance XY image data 50 relating to the integrated luminance of the sample S. In the integrated luminance X image data 49, the Z-axis direction component of the background light contained in one pixel can be made constant, so that the influence of variations in the luminance value of the background light can be reduced. Therefore, it is possible to sufficiently reduce the influence of the background light in the integrated luminance XY image data 50 obtained by combining the integrated luminance X image data 49 in the Y-axis direction.

[0084] Moreover, in the sample observation device 1, the maximum brightness value in the Z-axis direction is extracted from each of the multiple XZ image data 21 that make up the brightness image data 31 to generate maximum brightness X image data 51, and the maximum brightness X image data 51 is combined in the Y-axis direction to generate maximum brightness XY image data 52 regarding the maximum brightness value of the sample S. This makes it possible to efficiently acquire and analyze information regarding the distribution of the maximum brightness values ​​of the sample S in the Z-axis direction.

[0085] Furthermore, in this embodiment, the minimum luminance value in the Z-axis direction is extracted from each of the multiple XZ image data 21 constituting the luminance image data 31 to generate minimum luminance X image data 53, and the minimum luminance X image data 53 is combined in the Y-axis direction to generate minimum luminance XY image data 54 relating to the minimum luminance value of the sample S. This makes it possible to efficiently acquire and analyze information regarding the distribution of the minimum luminance values ​​of the sample S in the Z-axis direction.

[0086] For example, when observing a sample S with low fluorescent brightness or a sample S that does not emit fluorescence, the fluorescent brightness from the sample S may become lower than the background brightness by injecting a solution containing a fluorescent dye with high fluorescent brightness into the well 13. In such a case, by generating the minimum brightness XY image data 54, it becomes possible to observe the sample S with low fluorescent brightness or the sample S that does not emit fluorescence.

[0087] The present disclosure is not limited to the above embodiment. For example, in the above embodiment, the luminance image data 31 and the area image data 32 are generated as the observation image data 23 of the sample S, but only the area image data 32 may be generated as the observation image data. In addition, regarding the configuration of the device, for example, the optical axis P1 of the planar light L2 and the input surface 15a of the sample container 11 do not necessarily have to be perpendicular to each other, and the optical axis P1 of the planar light L2 and the scanning direction of the sample S by the scanning unit 4 do not necessarily have to be perpendicular to each other.

[0088] In addition, for example, in the above embodiment, the transparent member 15 is provided so as to cover one end side of the well 13 in the sample container 11, and the planar light L2 is input from the input surface 15a of the transparent member 15, but the planar light L2 may be input from the other end side of the well 13. In this case, the number of interfaces between media with different refractive indices is reduced, making it possible to reduce the number of times the observation light L3 is refracted. Furthermore, instead of the sample container 11, the sample S may be held in a solid material such as a gel, or the sample S may be moved by flowing a fluid such as water into a transparent container as in a flow cytometer.

[0089] Furthermore, multiple pairs of imaging optical systems 5 and image acquisition units 6 may be arranged. In this case, the observation range can be expanded and observation light L3 of multiple different wavelengths can be observed. Furthermore, multiple image acquisition units 6 may be arranged for the imaging optical system 5, or image acquisition units 6 may be arranged for multiple imaging optical systems 5. The multiple image acquisition units 6 may be combined with different types of photodetectors or imaging devices. The light source 2 may be composed of multiple light sources that output light of different wavelengths. In this case, excitation light of different wavelengths can be irradiated onto the sample S.

[0090] Also, to reduce astigmatism, a prism may be arranged in the imaging optical system 5. In this case, for example, the prism may be arranged downstream of the objective lens 16 (between the objective lens 16 and the image acquisition unit 6). To deal with defocusing, the imaging surface of the imaging device in the image acquisition unit 6 may be tilted with respect to the observation axis P2. In addition, for example, a dichroic mirror or a prism may be arranged between the imaging optical system 5 and the image acquisition unit 6 to perform wavelength separation of the observation light L3. [Explanation of symbols]

[0091] 1...sample observation device, 3...irradiation optical system, 4...scanning section, 5...imaging optical system, 6...image acquisition section, 8...image generation section, 10...analysis section, 21...XZ image data, 23...observation image data, 25...binarized XZ image data, 25a...first binarized XZ image data, 25b...second binarized XZ image data, 31...luminance image data, 32...area image data, 41...thickness X image data, 42...thickness XY image data, 43...top position X image data, 44...top position XY image data, 44A...top luminance XY image data Image data, 45...bottom position X image data, 46...bottom position XY image data, 46A...bottom brightness XY image data, 47...specific position X image data, 48...specific position XY image data, 48A...specific brightness XY image data, 49...integrated brightness X image data, 50...integrated brightness XY image data, 51...maximum brightness X image data, 52...maximum brightness XY image data, 53...minimum brightness X image data, 54...minimum brightness XY image data, L2...planar light, L3...observation light, P2...observation axis, R...irradiated surface, S...sample.

Claims

1. an illumination optical system that illuminates the sample with planar light in the XZ plane; a scanning unit that scans the sample in a Y-axis direction so as to pass through an irradiation surface of the planar light; an imaging optical system having an observation axis inclined with respect to the irradiation surface, the imaging optical system forming an image of the observation light generated in the sample by the irradiation of the planar light; an image acquisition unit that acquires a plurality of XZ image data corresponding to the optical image of the observation light combined by the imaging optical system; an image generating unit that generates observation image data of the sample based on the plurality of XZ image data acquired by the image acquiring unit; an analysis unit that extracts information about the sample based on the observation image data and performs an analysis on the sample, The image acquisition unit acquires a plurality of pieces of XZ image data in the Y-axis direction, the image generating unit generates luminance image data relating to the luminance of the sample based on the plurality of XZ image data, binarizes the luminance values ​​of each of the plurality of XZ image data to generate a plurality of binary XZ image data, and generates regional image data relating to a region where the sample is present based on the plurality of binary XZ image data; The analysis unit generates thickness X image data by accumulating each value of the plurality of binary XZ image data that constitute the region image data in the Z-axis direction, and generates thickness XY image data regarding the thickness of the sample by combining the thickness X image data in the Y-axis direction.

2. an illumination optical system that illuminates the sample with planar light in the XZ plane; a scanning unit that scans the sample in a Y-axis direction so as to pass through an irradiation surface of the planar light; an imaging optical system having an observation axis inclined with respect to the irradiation surface, the imaging optical system forming an image of the observation light generated in the sample by the irradiation of the planar light; an image acquisition unit that acquires a plurality of XZ image data corresponding to the optical image of the observation light combined by the imaging optical system; an image generating unit that generates observation image data of the sample based on the plurality of XZ image data acquired by the image acquiring unit; an analysis unit that extracts information about the sample based on the observation image data and performs an analysis on the sample, The image acquisition unit acquires a plurality of pieces of XZ image data in the Y-axis direction, the image generating unit generates luminance image data relating to the luminance of the sample based on the plurality of XZ image data, binarizes the luminance values ​​of each of the plurality of XZ image data to generate a plurality of binary XZ image data, and generates regional image data relating to a region where the sample is present based on the plurality of binary XZ image data; The analysis unit extracts coordinate values ​​of a specific pixel position in the Z-axis direction from each of the multiple binarized XZ image data that constitute the regional image data to generate specific position X image data, and combines the specific position X image data in the Y-axis direction to generate specific position XY image data regarding the specific position of the sample.

3. 3. The sample observation device according to claim 1, wherein the analysis unit extracts a top pixel position in a Z-axis direction from each of the plurality of binarized XZ image data that constitute the regional image data to generate top position X image data, and combines the top position X image data in the Y-axis direction to generate top position XY image data regarding the top position of the sample.

4. 4. A sample observation device according to claim 3, wherein the analysis section generates top luminance XY image data indicating a luminance value at the top position of the sample, based on the top position XY image data and the luminance image data.

5. 5. The sample observation device according to claim 1, wherein the analysis unit extracts a bottom pixel position in a Z-axis direction from each of the plurality of binarized XZ image data that constitute the regional image data to generate bottom position X image data, and combines the bottom position X image data in the Y-axis direction to generate bottom position XY image data regarding a bottom position of the sample.

6. 6. A sample observation device according to claim 5, wherein the analysis section generates bottom luminance XY image data indicating a luminance value at the bottom position of the sample, based on the bottom position XY image data and the luminance image data.

7. 3. A sample observation device according to claim 2, wherein the analysis section generates specific luminance XY image data indicating a luminance value at the specific position of the sample, based on the specific position XY image data and the luminance image data.

8. The sample observation device according to any one of claims 1 to 7, wherein the analysis unit generates integrated luminance X image data by integrating luminance values ​​of each of the plurality of XZ image data constituting the luminance image data in a Z-axis direction, and generates integrated luminance XY image data regarding the integrated luminance of the sample by combining the integrated luminance X image data in a Y-axis direction.

9. 9. The sample observation device according to any one of claims 1 to 8, wherein the analysis unit extracts a maximum luminance value in a Z-axis direction from each of the plurality of XZ image data that constitute the luminance image data to generate maximum luminance X image data, and combines the maximum luminance X image data in the Y-axis direction to generate maximum luminance XY image data related to a maximum luminance value of the sample.

10. 10. The sample observation device according to any one of claims 1 to 9, wherein the analysis unit extracts a minimum luminance value in a Z-axis direction from each of the plurality of XZ image data that constitute the luminance image data to generate minimum luminance X image data, and combines the minimum luminance X image data in the Y-axis direction to generate minimum luminance XY image data related to a minimum luminance value of the sample.

11. the image acquisition unit acquires a plurality of sets of XZ image data corresponding to optical images of the observation light of a plurality of wavelengths, A sample observation device as described in any one of claims 1 to 10, wherein the image generation unit generates luminance image data regarding the luminance of the sample based on the multiple XZ image data corresponding to an optical image of the observation light of one of the multiple wavelengths, generates multiple binary XZ image data obtained by binarizing each luminance value of the multiple XZ image data for an optical image of the observation light of another wavelength among the multiple wavelengths, and generates regional image data regarding the presence region of the sample based on the multiple binary XZ image data.

12. the image acquisition unit acquires a plurality of sets of XZ image data corresponding to optical images of the observation light of a plurality of wavelengths, The image generation unit generates a plurality of first binary XZ image data obtained by binarizing the brightness values ​​of each of the plurality of XZ image data corresponding to an optical image of the observation light of one of the plurality of wavelengths, generates brightness image data regarding the brightness of the sample based on the first binary XZ image data, and generates a plurality of second binary XZ image data obtained by binarizing the brightness values ​​of each of the plurality of XZ image data for an optical image of the observation light of another wavelength among the plurality of wavelengths, and generates regional image data regarding the presence region of the sample based on the plurality of second binary XZ image data.

13. an irradiation step of irradiating the sample with planar light in an XZ plane; a scanning step of scanning the sample in a Y-axis direction so as to pass through an irradiation surface of the planar light; an imaging step of imaging observation light generated in the sample by irradiation with the planar light using an imaging optical system having an observation axis inclined with respect to the irradiation surface; an image acquiring step of acquiring a plurality of XZ image data corresponding to the optical image of the observation light formed by the imaging optical system; an image generating step of generating observation image data of the sample based on the plurality of XZ image data; and an analysis step of extracting information about the sample based on the observed image data and performing an analysis on the sample, In the image acquisition step, a plurality of sets of XZ image data are acquired in the Y-axis direction; In the image generating step, luminance image data relating to the luminance of the sample is generated based on the plurality of XZ image data, and luminance values ​​of each of the plurality of XZ image data are binarized to generate a plurality of binary XZ image data, and regional image data relating to a region where the sample exists is generated based on the plurality of binary XZ image data. In the analysis step, the values ​​of each of the plurality of binary XZ image data constituting the region image data are integrated in the Z-axis direction to generate thickness X image data, and the thickness X image data is combined in the Y-axis direction to generate thickness XY image data relating to the thickness of the sample.

14. an irradiation step of irradiating the sample with planar light in an XZ plane; a scanning step of scanning the sample in a Y-axis direction so as to pass through an irradiation surface of the planar light; an imaging step of imaging observation light generated in the sample by irradiation with the planar light using an imaging optical system having an observation axis inclined with respect to the irradiation surface; an image acquiring step of acquiring a plurality of XZ image data corresponding to the optical image of the observation light formed by the imaging optical system; an image generating step of generating observation image data of the sample based on the plurality of XZ image data; and an analysis step of extracting information about the sample based on the observed image data and performing an analysis on the sample, In the image acquisition step, a plurality of sets of XZ image data are acquired in the Y-axis direction; In the image generating step, luminance image data relating to the luminance of the sample is generated based on the plurality of XZ image data, and luminance values ​​of each of the plurality of XZ image data are binarized to generate a plurality of binary XZ image data, and regional image data relating to a region where the sample exists is generated based on the plurality of binary XZ image data. In the analyzing step, pixel values ​​of specific pixel positions in the Z-axis direction are extracted from each of the plurality of binary XZ image data constituting the region image data to generate specific position X image data, and the specific position X image data is combined in the Y-axis direction to generate specific position XY image data relating to the specific position of the sample.

15. 15. A sample observation method according to claim 13, wherein in the analyzing step, a top pixel position in a Z-axis direction is extracted from each of the plurality of binarized XZ image data constituting the region image data to generate top position X image data, and the top position X image data is combined in the Y-axis direction to generate top position XY image data regarding the top position of the sample.

16. 16. A sample observation method according to claim 15, wherein in the analyzing step, top luminance XY image data indicating a luminance value at the top position of the sample is generated based on the top position XY image data and the luminance image data.

17. 17. The sample observation method according to claim 13, wherein the analyzing step extracts a bottom pixel position in a Z-axis direction from each of the plurality of binary XZ image data constituting the region image data to generate bottom position X image data, and combines the bottom position X image data in the Y-axis direction to generate bottom position XY image data regarding a bottom position of the sample.

18. 18. A sample observation method according to claim 17, wherein in the analyzing step, bottom luminance XY image data indicating a luminance value at the bottom position of the sample is generated based on the bottom position XY image data and the luminance image data.

19. 15. A sample observation method according to claim 14, wherein in the analyzing step, specific luminance XY image data indicating a luminance value at the specific position of the sample is generated based on the specific position XY image data and the luminance image data.

20. 20. The sample observation method according to claim 13, wherein in the analyzing step, the luminance values ​​of each of the plurality of XZ image data constituting the luminance image data are integrated in a Z-axis direction to generate integrated luminance X image data, and the integrated luminance X image data are combined in a Y-axis direction to generate integrated luminance XY image data relating to the integrated luminance of the sample.

21. 21. The sample observation method according to claim 13, wherein in the analyzing step, a maximum luminance value in a Z-axis direction is extracted from each of the plurality of XZ image data constituting the luminance image data to generate maximum luminance X image data, and the maximum luminance X image data is combined in the Y-axis direction to generate maximum luminance XY image data relating to a maximum luminance value of the sample.

22. 22. The sample observation method according to claim 13, wherein in the analyzing step, a minimum luminance value in a Z-axis direction is extracted from each of the plurality of XZ image data constituting the luminance image data to generate minimum luminance X image data, and the minimum luminance X image data is combined in the Y-axis direction to generate minimum luminance XY image data related to a minimum luminance value of the sample.

23. In the image acquisition step, a plurality of sets of XZ image data corresponding to optical images of the observation light of a plurality of wavelengths are acquired, A sample observation method according to any one of claims 13 to 22, wherein in the image generation step, luminance image data relating to the luminance of the sample is generated based on the multiple XZ image data corresponding to an optical image of the observation light of one of the multiple wavelengths, and luminance values ​​of each of the multiple XZ image data corresponding to an optical image of the observation light of another wavelength of the multiple wavelengths are binarized to generate multiple binary XZ image data, and regional image data relating to the presence region of the sample is generated based on the multiple binary XZ image data.

24. In the image acquisition step, a plurality of sets of XZ image data corresponding to optical images of the observation light of a plurality of wavelengths are acquired, A sample observation method according to any one of claims 13 to 22, wherein the image generation step generates a plurality of first binary XZ image data obtained by binarizing the brightness values ​​of each of the plurality of XZ image data corresponding to an optical image of the observation light of one of the plurality of wavelengths, generates brightness image data regarding the brightness of the sample based on the first binary XZ image data, and generates a plurality of second binary XZ image data obtained by binarizing the brightness values ​​of each of the plurality of XZ image data for an optical image of the observation light of another wavelength of the plurality of wavelengths, and generates regional image data regarding the presence region of the sample based on the plurality of second binary XZ image data.

Images