Imaging System

Abstract

The imaging device is equipped with a light source and an imaging sensor and generates image data including an interference fringe image by imaging a fertilized egg sown in a culture vessel. The imaging device can be taken in and out of a culture chamber provided in an incubator for fertilized eggs.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to an imaging device, an information processing device, an imaging system, and an observation method. [Background technology]

[0002] In recent years, the demand for infertility treatment has been increasing. Fertilized egg incubators are used to culture fertilized eggs that have undergone in vitro fertilization treatment. Fertilized eggs (embryos) cultured in incubators are then either transferred or frozen. An embryo is a fertilized egg that is in a dividing state.

[0003] Previously, to observe fertilized eggs during cultivation, it was necessary to remove the culture dish (also called a tray) containing the fertilized eggs from the incubator and then observe them under a microscope. However, removing the culture dish from the incubator caused stress to the fertilized eggs due to temperature changes, which was a problem.

[0004] Therefore, Japanese Patent Application Laid-Open Publication No. 2018-093795 proposes an incubator that allows for observation of fertilized eggs being cultured without removing the culture dish. The incubator described in Japanese Patent Application Laid-Open Publication No. 2018-093795 includes a culture unit that holds multiple culture dishes in a culture environment, and an imaging unit provided corresponding to the culture dishes held in the culture unit. As described in Japanese Patent Application Laid-Open Publication No. 2018-093795, an incubator that allows for observation of fertilized eggs while culturing them in the culture dishes without removing the culture dishes from the culture unit is called a time-lapse incubator.

[0005] Furthermore, the imaging unit described in JP 2018-093795 A is an optical camera with a lens, and focus adjustment is performed by moving the lens along the optical axis. Human eggs are approximately spherical, with a diameter of approximately 100 to 150 μm. It is not known where in the egg the pronucleus, which provides clues for determining whether the egg has been fertilized, is located. For this reason, the imaging unit described in JP 2018-093795 A captures multiple images with different focus positions. Summary of the Invention [Problem to be solved by the invention]

[0006] However, the time-lapse incubator described in JP 2018-093795 A is an all-in-one device with an imaging unit built into the culture unit, making it expensive. This type of time-lapse incubator presents a challenge, as it is difficult to introduce into small clinics. Furthermore, the incubator described in JP 2018-093795 A uses an optical camera as the imaging unit, which makes focus adjustment difficult.

[0007] The technology of the present disclosure aims to provide an image capturing device, an information processing device, an imaging system, and an observation method that can be used in an incubator for fertilized eggs, are inexpensive, and do not require focus adjustment. [Means for solving the problem]

[0008] In order to achieve the above-mentioned objective, the imaging device disclosed herein is an imaging device that includes a light source and an imaging sensor, and generates image data including an interference fringe image by capturing an image of a fertilized egg seeded in a culture container, and is capable of being moved in and out of a culture chamber provided in an incubator for fertilized eggs.

[0009] It is preferable to provide a height adjustment mechanism that allows the height to be adjusted.

[0010] It is preferable that a support column is provided to support the light source, and the height adjustment mechanism is capable of changing the length of the support column.

[0011] Preferably it is less than 10cm in height.

[0012] The incubator is preferably provided with a plurality of culture chambers, and the container can be moved in and out of each of the culture chambers.

[0013] It is preferable that the image data is transmitted wirelessly via a communication unit.

[0014] The information processing device of the present disclosure receives image data transmitted from the imaging device and performs reconstruction processing based on the received image data, thereby making it possible to generate a reconstructed image at any focal position.

[0015] It is preferable that the information processing device receives image data periodically transmitted from the imaging device housed in the culture chamber, performs reconstruction processing each time image data is received, and displays the reconstructed image generated by the reconstruction processing on a display.

[0016] It is preferable that the light source has a plurality of light emitting points, and the imaging device performs imaging operations a plurality of times while causing the light emitting points to emit light in sequence, thereby generating a plurality of pieces of image data.

[0017] It is preferable to generate high-resolution image data based on a plurality of image data sets, and to perform reconstruction processing based on the generated high-resolution image data.

[0018] The imaging system disclosed herein comprises an incubator equipped with an imaging device having a light source and an imaging sensor, and generating image data including an interference fringe image by imaging a fertilized egg seeded in a culture vessel, and an information processing device that performs reconstruction processing based on the image data to generate a reconstructed image at any focal position.

[0019] It is preferable that the information processing device performs reconstruction processing every time the imaging device generates image data, and displays the reconstructed image generated by the reconstruction processing on a display.

[0020] The incubator preferably has a culture chamber that houses the culture vessel and a lid for making the culture chamber airtight, and the light source is preferably provided on the lid.

[0021] The image sensor is preferably provided at the bottom of the culture chamber in which the culture vessel is placed.

[0022] It is preferable that the light source has a plurality of light emitting points, and the imaging device performs imaging operations a plurality of times while causing the light emitting points to emit light in sequence, thereby generating a plurality of pieces of image data.

[0023] It is preferable that the information processing device generates high-resolution image data based on a plurality of image data, and performs reconstruction processing based on the generated high-resolution image data.

[0024] The observation method disclosed herein is a method for observing a fertilized egg by capturing an image of a fertilized egg seeded in a culture vessel to generate image data including an interference fringe image, and then performing a reconstruction process based on the generated image data to generate a reconstructed image at an arbitrary focal position, wherein the diameter of the fertilized egg is 100 μm or more and less than 200 μm.

[0025] The fertilized eggs are suspended in the culture medium dropped into the culture vessel, and the height of the culture medium is preferably 1 mm or more and less than 20 mm. [Effects of the Invention]

[0026] According to the technology of the present disclosure, it is possible to provide an imaging device and an information processing device that can be used in an incubator for fertilized eggs, that is inexpensive, and that does not require focus adjustment. [Brief explanation of the drawings]

[0027] [Figure 1] FIG. 1 is a perspective view illustrating an example of an imaging device. [Figure 2] FIG. 2 is a side view of the imaging device on which the culture vessel is placed. [Figure 3] FIG. 2 is a diagram illustrating an example of the configuration of an image sensor. [Figure 4] 10A and 10B are diagrams showing how an interference fringe image is generated when illumination light is incident on a fertilized egg. [Figure 5] FIG. 1 is a schematic diagram illustrating an example of the configuration of a time-lapse imaging system. [Figure 6] FIG. 2 is a block diagram showing an example of the internal configuration of an imaging device and an information processing device. [Figure 7] FIG. 2 is a block diagram illustrating an example of a functional configuration of the information processing device. [Figure 8] FIG. 10 is a diagram illustrating an example of a reconstruction position. [Figure 9] 10 is a flowchart illustrating an example of the overall operation of the time-lapse imaging system. [Figure 10] FIG. 10 is a side view of an imaging device according to a modified example. [Figure 11] 10A and 10B are diagrams illustrating height adjustment of an imaging device according to a modified example. [Figure 12] 10A and 10B are schematic diagrams showing the configuration of a light emitting surface of a light source according to a modified example. [Figure 13] FIG. 10 is a schematic diagram showing the configuration of a time lapse imaging system according to a modified example. [Figure 14] FIG. 10 is a schematic diagram showing the configuration of an incubator according to a modified example. [Figure 15] FIG. 1 is a diagram illustrating the diameter of a fertilized egg and the height of a culture medium. DETAILED DESCRIPTION OF THE INVENTION

[0028] An example of an embodiment of the technology of the present disclosure will be described with reference to the accompanying drawings.

[0029] 1 shows an example of an imaging device. The imaging device 10 includes a light source 11, an imaging sensor 12, a support 13, a base 14, and a stage 15. The light source 11 is, for example, a laser diode. The imaging device 10 performs so-called lens-free imaging, which captures an image of an object to be observed without using an optical lens.

[0030] The light source 11 may be configured by combining a light emitting diode and a pinhole. The light source 11 emits radial illumination light 16 toward the stage 15. The illumination light 16 is coherent light. The wavelength of the illumination light 16 is 640 nm, 780 nm, or the like.

[0031] The light source 11 is connected to one end of a substantially L-shaped support 13. The other end of the support 13 is connected to a base 14. The base 14 is flat and has a stage 15 provided in its approximate center. The stage 15 is provided with a recessed mounting portion 15A on which a culture container 20 for culturing fertilized eggs is placed. The support 13 supports the light source 11 so that the light source 11 faces the imaging surface 12A of the image sensor 12.

[0032] Hereinafter, the direction in which light source 11 and imaging surface 12A face each other will be referred to as the Z direction. The Z direction is also the irradiation direction of illumination light 16. A direction perpendicular to the Z direction will be referred to as the X direction. A direction perpendicular to the Z direction and the X direction will be referred to as the Y direction. Imaging surface 12A is perpendicular to the Z direction and parallel to the X and Y directions.

[0033] The imaging sensor 12 is configured, for example, by a monochrome CMOS (Complementary Metal Oxide Semiconductor) image sensor. The culture vessel 20 is placed on the imaging surface 12A of the imaging sensor 12. The culture vessel 20 is a shallow cylindrical vessel, also called a culture dish. The culture vessel 20 is used together with a lid (not shown). The culture vessel 20 is transparent and allows the illumination light 16 to pass through. The diameter of the culture vessel 20 is approximately 30 to 60 mm. The thickness of the culture vessel 20 is approximately 10 to 20 mm.

[0034] Fertilized eggs 21 that have been subjected to in vitro fertilization treatment are seeded in culture container 20. In vitro fertilization treatment includes intracytoplasmic sperm injection treatment performed under a microscope and regular in vitro fertilization treatment performed by combining eggs and sperm in a specified container. The method of fertilization of fertilized eggs 21 to be cultured is not important. Fertilized eggs 21 are, for example, human fertilized eggs. Fertilized eggs 21 are approximately spherical and have a diameter of about 100 to 200 μm.

[0035] The fertilized egg 21 is suspended in a culture solution 22 that has been dropped into a culture vessel 20. The culture solution 22 is covered with oil 23 that has been filled into the culture vessel 20. The oil 23 prevents evaporation and changes in pH of the culture solution 22. The fertilized egg 21 in a dividing state is also referred to as an embryo. The fertilized egg 21 in the present disclosure includes an embryo.

[0036] The base 14 is a flat member having sides parallel to the X and Y directions. The length of the base 14 in the X direction is Xi, and the length in the Y direction is Yi. In this embodiment, the length Xi is the maximum length of the imaging device 10 in the X direction, and the length Yi is the maximum length of the imaging device 10 in the X direction.

[0037] 2 is a side view of the imaging device 10 on which the culture vessel 20 is placed. As shown in FIG. 2, the length from the bottom surface of the base 14 to the upper end of the light source 11 is designated Zi. In this embodiment, the length Zi is the maximum length of the imaging device 10 in the Z direction. Hereinafter, the length Zi will also be referred to as the height of the imaging device 10. In other words, the size of the imaging device 10 is defined by the lengths Xi, Yi, and Zi.

[0038] The imaging sensor 12 detects illumination light 16 emitted from the light source 11 and transmitted through the culture vessel 20. Specifically, the illumination light 16 enters the culture vessel 20 and is diffracted by the fertilized egg 21, generating an interference fringe image that reflects the shape and internal structure of the fertilized egg 21. The interference fringe image is also called a hologram image. The imaging sensor 12 captures the interference fringe image generated by the fertilized egg 21.

[0039] 3 shows an example of the configuration of the image sensor 12. The image sensor 12 has a plurality of pixels 12B arranged on an imaging surface 12A. The pixels 12B are photoelectric conversion elements that photoelectrically convert incident light and output pixel signals according to the amount of incident light.

[0040] The pixels 12B are arranged at equal pitches along the X and Y directions. The arrangement of the pixels 12B is a so-called square arrangement. The X direction is a direction perpendicular to the Z direction. The Y direction is a direction perpendicular to the X and Z directions. The pixels 12B are arranged at a first arrangement pitch Δx in the X direction and at a second arrangement pitch Δy in the Y direction.

[0041] The imaging sensor 12 captures an image of light incident on the imaging surface 12A, and outputs image data made up of pixel signals output from each of the pixels 12B.

[0042] 4 shows how an interference fringe image is generated when illumination light 16 is incident on a fertilized egg 21. Part of the illumination light 16 incident on the culture vessel 20 is diffracted by the fertilized egg 21. That is, the illumination light 16 is split into diffracted light 30 that is diffracted by the fertilized egg 21 and transmitted light 31 that is not diffracted by the fertilized egg 21 and passes through the culture vessel 20. The transmitted light 31 is a spherical wave or a plane wave. The diffracted light 30 and transmitted light 31 pass through the bottom surface of the culture vessel 20 and are incident on the imaging surface 12A of the image sensor 12.

[0043] The diffracted light 30 and the transmitted light 31 interfere with each other to generate an interference fringe image 33. The interference fringe image 33 is composed of bright portions 36 and dark portions 38. In FIG. 4, the interference fringe image 33 is illustrated with the bright portions 36 and dark portions 38 each having a circular shape, but the shape of the interference fringe image 33 changes depending on the shape and internal structure of the fertilized egg 21. The imaging sensor 12 captures a light image including the interference fringe image 33 formed on the imaging surface 12A, and outputs image data including the interference fringe image 33.

[0044] Fig. 5 shows an example of the configuration of a time-lapse imaging system. As shown in Fig. 5, the time-lapse imaging system 2 includes an imaging device 10, an incubator 40, and an information processing device 50. The incubator 40 is a multi-room incubator for fertilized eggs, and is also called an embryo culture device. The fertilized eggs 21 are cultured in the incubator 40 for a predetermined period (e.g., 7 days).

[0045] Unlike typical incubators for culturing cells other than fertilized eggs, the incubator 40 does not have one culture chamber, but has multiple culture chambers 41. This is because each culture chamber 41 houses an imaging device 10, allowing the fertilized eggs 21 to be managed individually to prevent them from being mistaken for other people's fertilized eggs 21. The culture chambers 41 are also referred to as culture chambers. Note that the incubator 40 shown in FIG. 5 is provided with two culture chambers 41, but the number of culture chambers 41 is not limited to this and can be changed as appropriate.

[0046] Each culture chamber 41 is provided with an openable / closable lid 42. The incubator 40 is provided with a switch 43 for opening and closing the lid 42 for each culture chamber 41. When the user operates the switch 43, the lid 42 is opened and closed by a drive mechanism (not shown). The lid 42 may also be configured to be opened and closed manually. When the lid 42 is closed, the culture chamber 41 is kept airtight.

[0047] A mixed gas of carbon dioxide (CO2) gas, nitrogen (N2) gas, and outside air is supplied from an external gas cylinder (not shown) to the culture chamber 41 via a HEPA filter (High Efficiency Particulate Air Filter). Heaters (not shown) are provided on the sides and bottom of the culture chamber 41. The culture chamber 41 maintains a constant culture environment by controlling the concentration, temperature, and humidity of the mixed gas to be constant.

[0048] The imaging device 10 is sized to be insertable into and removable from the culture chamber 41. As shown in FIG. 5, one imaging device 10 is inserted into one culture chamber 41. That is, the lid 42 can be closed with the imaging device 10 on which the culture vessel 20 is placed inserted into the culture chamber 41. Thereby, while culturing the fertilized egg 21 in the culture chamber 41, the fertilized egg 21 can be imaged by the imaging device 10 without removing the culture vessel 20 from the culture chamber 41.

[0049] For example, the culture chamber 41 is a substantially rectangular parallelepiped space. Let the length of the culture chamber 41 in the X direction be Xc, the length in the Y direction be Yc, and the length in the Z direction be Zc. Hereinafter, the length Zc is also referred to as the height of the culture chamber 41. Since the height of the culture vessel 20 used for culturing the fertilized egg 21 is usually about 10 to 20 mm, the height Zc of the culture chamber 41 is lower than the height of the culture chamber of a general incubator for culturing cells other than fertilized eggs, for example, less than 10 cm. Therefore, it is preferable that the height Zi of the imaging device 10 satisfies the relationship Zi < Zc and the relationship Zi < 10 cm.

[0050] Also, the lengths Xi and Yi of the imaging device 10 satisfy the relationships Xi < Xc and Yi < Yc. Also, the lengths Xi and Yi of the imaging device 10 are each about 10 cm.

[0051] The information processing device 50 is, for example, a desktop personal computer. A display 51, a keyboard 52, a mouse 53, etc. are connected to the information processing device 50. The keyboard 52 and the mouse 53 constitute an input device 54 for the user to input information. The input device 54 also includes a touch panel or the like.

[0052] The information processing device 50 exchanges data with the imaging devices 10 housed in each of the culture chambers 41 via wireless communication. The imaging devices 10 periodically (for example, every 5 to 15 minutes) capture images. The information processing device 50 periodically receives image data including an interference fringe image 33 (see FIG. 4) from the imaging devices 10, performs reconstruction processing based on the received image data, and displays the reconstructed image generated by the reconstruction processing. The reconstructed image is also called a tomographic image.

[0053] 6 shows an example of the internal configuration of the imaging device 10 and the information processing device 50. As shown in Fig. 6, in addition to the light source 11 and the imaging sensor 12, the imaging device 10 includes a processor 60, a storage device 61, a communication unit 62, a power supply unit 63, and a battery 64, which are interconnected via a bus line 65.

[0054] The processor 60 is, for example, a field programmable gate array (FPGA) and controls the operation of each unit within the imaging device 10. The storage device 61 is, for example, a random access memory (RAM) or a flash memory. The storage device 61 stores image data generated by the imaging device 10 and various other data.

[0055] The communication unit 62 is a communication circuit that performs wireless communication with the information processing device 50. The processor 60 transmits image data to the information processing device 50 via the communication unit 62.

[0056] The battery 64 is a secondary battery such as a lithium polymer battery. The power supply unit 63 includes a power supply circuit and a charge control circuit. The power supply unit 63 supplies power supplied from the battery 64 to the processor 60 and the like. The power supply unit 63 also controls charging of the battery 64 using power supplied from an external source. The power supply unit 63 may be configured to be able to charge the battery 64 wirelessly.

[0057] The information processing device 50 includes a processor 55, a storage device 56, and a communication unit 57, which are interconnected via a bus line 58. The bus line 58 is also connected to the display 51 and input device 54 described above.

[0058] The processor 55 is configured by, for example, a CPU (Central Processing Unit), and realizes various functions by reading out an operating program 56A and various data stored in the storage device 56 and executing the processes.

[0059] The storage device 56 includes, for example, RAM, ROM (Read Only Memory), or a storage device. The RAM is, for example, a volatile memory used as a work area, etc. The ROM is, for example, a non-volatile memory such as a flash memory that stores the operating program 56A and various data. The storage device is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage stores an OS (Operating System), application programs, image data, various data, etc.

[0060] The communication unit 57 is a communication circuit that performs wireless communication with the communication unit 62 of the imaging device 10. The processor 55 receives image data transmitted from the imaging device 10 via the communication unit 57. The processor 55 also transmits a control signal for controlling imaging to the imaging device 10 via the communication unit 57.

[0061] The display 51 displays various screens. The information processing device 50 receives input of operation instructions from the input device 54 via the various screens.

[0062] Fig. 7 shows an example of the functional configuration of the information processing device 50. The functions of the information processing device 50 are realized by the processor 55 executing processing based on the operating program 56A. As shown in Fig. 7, the processor 55 includes an imaging control unit 70, an image data acquisition unit 71, a reconstruction processing unit 72, and a display control unit 73.

[0063] The imaging control unit 70 controls the operation of the imaging device 10. Specifically, the imaging control unit 70 controls the operation of generating illumination light 16 by the light source 11 and the imaging operation of the imaging sensor 12 by transmitting a control signal to the imaging device 10. Hereinafter, the operation of generating illumination light 16 by the light source 11 and the imaging operation of the imaging sensor 12 will be collectively referred to as the imaging operation of the imaging device 10. The imaging control unit 70 causes the imaging device 10 to start the imaging operation based on an operation signal input from the input device 54.

[0064] The image data acquisition unit 71 acquires image data generated and transmitted from the imaging device 10 after the imaging device 10 captures an image of the fertilized egg 21 in the culture container 20. The image data acquisition unit 71 supplies the acquired image data to the reconstruction processing unit 72.

[0065] The reconstruction processing unit 72 generates a reconstructed image by performing calculations based on the image data. For example, as shown in Fig. 8, the reconstruction processing unit 72 changes the reconstruction position P in the Z direction by a fixed amount, and generates a reconstructed image each time the reconstruction position P is changed. The reconstruction position P is a position (so-called depth position) represented by a distance d from the imaging surface 12A of the image sensor 12 toward the light source 11. Hereinafter, the reconstruction position P will also be referred to as the focal position.

[0066] The reconstruction processing unit 72 performs reconstruction processing based on the Fresnel transformation formulas expressed by the following formulas (1) to (3), for example.

[0067]

number

[0068]

number

[0069]

number

[0070] Here, I(x, y) represents image data. x represents the coordinate of pixel 12B of image sensor 12 (see FIG. 3) in the X direction. y represents the coordinate of pixel 12B in the Y direction. Δx is the first array pitch mentioned above, and Δy is the second array pitch mentioned above (see FIG. 3). λ is the wavelength of illumination light 16.

[0071] As shown in equation (1), Γ(m,n) is a complex amplitude image obtained by Fresnel transforming the interference fringe image contained in the image data. Here, m = 1, 2, 3, . . . Nx-1 and n = 1, 2, 3, . . . Ny-1. Nx represents the number of pixels in the X direction of the image data. Ny represents the number of pixels in the Y direction of the image data.

[0072] As shown in equation (2), A0(m,n) is an intensity distribution image representing the intensity components of the complex amplitude image Γ(m,n). As shown in equation (3), φ0(m,n) is a phase distribution image representing the phase components of the complex amplitude image Γ(m,n).

[0073] The reconstruction processing unit 72 obtains a complex amplitude image Γ(m,n) based on equation (1), and obtains an intensity distribution image A0(m,n) or a phase distribution image φ0(m,n) by applying the obtained complex amplitude image Γ(m,n) to equation (2) or equation (3). The reconstruction processing unit 72 obtains either the intensity distribution image A0(m,n) or the phase distribution image φ0(m,n) and outputs it as a reconstructed image.

[0074] In this embodiment, the reconstruction processing unit 72 outputs the phase distribution image φ0(m,n) as the reconstructed image. The phase distribution image φ0(m,n) is an image that represents the refractive index distribution of the object to be observed. Since the fertilized egg 21, which is the object to be observed in this embodiment, is semitransparent, most of the illumination light 16 is not absorbed by the fertilized egg 21 but is transmitted or diffracted, and therefore almost no image appears in the intensity distribution. For this reason, in this embodiment, it is preferable to use the phase distribution image φ0(m,n) as the reconstructed image.

[0075] The reconstruction processing unit 72 is not limited to a method using the Fresnel transform formula, and may perform reconstruction processing using a Fourier iterative phase retrieval method or the like.

[0076] The display control unit 73 causes the reconstructed image generated by the reconstruction processing unit 72 to be displayed on the display 51. The reconstructed image at one focal position may be displayed on the display 51, or the reconstructed images at multiple focal positions may be displayed. Furthermore, the focal position of the reconstructed image displayed on the display 51 may be set or selected by the user operating the input device 54.

[0077] Because the fertilized egg 21 is approximately 100 to 200 μm thick and suspended in the culture solution 22, it is difficult to adjust the focal position on the pronucleus and other components inside the fertilized egg 21 using conventional microscope observation. For this reason, in the conventional technology described in JP 2018-093795 A, multiple images are captured at different focal positions. In contrast, the lens-free imaging of the present disclosure makes it possible to generate a reconstructed image at any focal position based on image data obtained in a single capture.

[0078] Next, an example of the overall operation of the time-lapse imaging system 2 will be described with reference to the flowchart shown in Fig. 9. First, the user places the culture vessel 20 on the stage 15 of the imaging device 10, and then inserts the imaging device 10 into the culture chamber 41 of the incubator 40 (step S10). Note that it is sufficient to insert the imaging device 10 into at least one of the culture chambers 41.

[0079] Next, the user closes the lid 42 of the culture chamber 41 and causes the incubator 40 to start culture (step S11). When the incubator 40 starts culture, the imaging device 10 captures an image of the fertilized egg 21 in the culture container 20 under the control of the information processing device 50 (step S12). The imaging device 10 wirelessly transmits image data generated by performing the imaging operation to the information processing device 50 (step S13).

[0080] The information processing device 50 receives the image data transmitted from the imaging device 10 (step S14). The reconstruction processing unit 72 of the information processing device 50 performs reconstruction processing based on the image data to generate at least one reconstructed image (step S15). The display control unit 73 causes the display 51 to display the reconstructed image generated by the reconstruction processing unit 72 (step S16).

[0081] Next, the information processing device 50 determines whether the culture in the incubator 40 has finished (step S17). The culture is carried out for, for example, up to seven days from the start of the culture. The information processing device 50 determines whether the culture has finished based on, for example, the time elapsed since the start of the culture. If the information processing device 50 determines that the culture has not finished (step S17: NO), it determines whether a certain time (for example, 10 minutes) has passed since the previous image capture (step S18).

[0082] If the information processing device 50 determines that a certain time has passed since the previous image capture (step S18: YES), the process returns to step S12. The processes of steps S12 to S18 are repeatedly executed until the determination in step S17 is affirmative. After the information processing device 50 determines in step S17 that the culture in the incubator 40 has ended (step S17: YES), the user removes the imaging device 10 from the culture chamber 41 of the incubator 40 (step S19).

[0083] As described above, the imaging device 10 according to the technology of the present disclosure can be taken in and out of the culture chamber 41 of the embryo incubator 40. The embryo incubator 40 is inexpensive because it does not have an optical camera or the like integrated into it. Furthermore, the imaging device 10 according to the technology of the present disclosure captures an interference fringe image using lens-free imaging, so there is no need to adjust the focus during imaging.

[0084] [Variations] Next, a modified example of the imaging device 10 will be described. Fig. 10 shows an imaging device 10A according to the modified example. The imaging device 10A differs from the imaging device 10 according to the above embodiment in that the height Zi of the imaging device 10A is changeable. The height Zi of the imaging device 10A can be changed by changing the length of the support 13.

[0085] Specifically, the support 13 of the imaging device 10A according to this modification is separated into an upper portion 13A and a lower portion 13B. The light source 11 is connected to the upper portion 13A. The lower portion 13B is connected to a base 14. The upper portion 13A and the lower portion 13B are slidably fitted together. The upper portion 13A and the lower portion 13B are an example of a "height adjustment mechanism" according to the technology of the present disclosure.

[0086] 11, the height Zi of the imaging device 10A can be changed by sliding the upper part 13A relative to the lower part 13B. Fixing screws 17 are provided on the support 13 to fix the upper part 13A to the lower part 13B. The user adjusts the position of the upper part 13A relative to the lower part 13B, and then operates the fixing screws 17 when the height Zi of the imaging device 10A is set to a desired value, thereby fixing the upper part 13A to the lower part 13B.

[0087] The upper portion 13A may be configured to slide relative to the lower portion 13B by a drive mechanism (not shown). In this case, it is preferable to configure the upper portion 13A to move by operating a switch (not shown).

[0088] The height adjustment mechanism that enables adjustment of the height Zi of the imaging device 10A is not limited to the above-described configuration, and can be modified as appropriate.

[0089] Fertilized egg incubators 40 are sold by various manufacturers, and there is no unified standard for the height Zc of the incubation chamber 41. The imaging device 10A according to this modification is capable of changing the height Zi, and therefore can be inserted into the incubation chamber 41 of incubators 40 made by various manufacturers.

[0090] As shown in FIG. 11, by lowering the height Zi of the imaging device 10A, when the light source 11 approaches the imaging sensor 12, it is preferable that the illumination light 16 from the light source 11 be radial light so that the entire imaging surface 12A is illuminated by the illumination light 16.

[0091] Furthermore, various modifications are possible to the imaging device 10. In the above embodiment, the stage 15 having the imaging sensor 12 is provided on the base 14, but the stage 15 may be integrated with the base 14. Also, in the above embodiment, the base 14 is a rectangular flat plate, but the base 14 may be circular or other shapes.

[0092] In the above embodiment, the light source 11 is connected to the end of the support 13 , but the light source 11 may be embedded in the support 13 .

[0093] Alternatively, the light source 11 may be a laser light source in which a plurality of light-emitting points (e.g., 36 light-emitting points) are arranged in a two-dimensional array. A vertical cavity surface-emitting laser (VCSL) can be used as this laser light source. By sequentially activating the plurality of light-emitting points and synthesizing the plurality of image data obtained by the imaging sensor 12, image data including a high-resolution interference fringe image (so-called super-resolution interference fringe image) can be obtained. By reconstructing this image data, a high-quality reconstructed image can be obtained.

[0094] FIG. 12 shows the configuration of the light-emitting surface 11A of the light source 11, which has a plurality of light-emitting points 11B. The light-emitting surface 11A is disposed in a position facing the image sensor 12. A plurality of light-emitting points 11B are arranged in a two-dimensional array on the light-emitting surface 11A. The arrangement pitch of the light-emitting points 11B is approximately 10 μm to 100 μm. Each of the light-emitting points 11B is selected in turn to emit illumination light 16. The light-emitting time interval between the plurality of light-emitting points 11B is several milliseconds.

[0095] The arrangement pitch of the light-emitting points 11B only needs to be different from the arrangement pitch of the pixels 12B (first arrangement pitch Δx and second arrangement pitch Δy), and does not necessarily need to be smaller than the arrangement pitch of the pixels 12B. For example, even if a light-emitting point 11B is located directly above an adjacent pixel 12B, the arrangement pitch of the light-emitting points 11B does not need to match the arrangement pitch of the pixels 12B. In this case, the illumination light 16 is illuminated at different positions on the pixels 12B. Therefore, when combining multiple image data, different pixels 12B that are located directly below each light-emitting point 11B and illuminated by the illumination light 16 are considered to be the same pixel, and alignment with an accuracy of one pixel or less can be performed, thereby generating image data including a super-resolution interference fringe image.

[0096] 12, the light-emitting points 11B are arranged in a 6 × 6 square array, and 36 light-emitting points 11B are provided on the light-emitting surface 11A, but the number and arrangement pattern of the light-emitting points 11B are not limited to the number and arrangement pattern shown in Fig. 12. The more light-emitting points 11B there are, the higher the resolution of the interference fringe image can be, but the longer the calculation time for the synthesis process and reconstruction process. For this reason, it is preferable to optimize the number of light-emitting points 11B according to the required image quality and calculation time.

[0097] Furthermore, in the above embodiment, the imaging device 10 can be taken in and out of the culture chamber 41 of the incubator 40, but it is also possible to integrate the imaging device 10 and the incubator 40.

[0098] Fig. 13 shows a time-lapse imaging system 2A configured with an incubator 40A integrally incorporating an imaging device and an information processing device 50. Fig. 14 shows the incubator 40A integrally incorporating an imaging device. The time-lapse imaging system 2A is an example of the "imaging system" according to the technology of the present disclosure.

[0099] An incubator 40A according to this modification is provided with a plurality of culture chambers 41, similar to the incubator 40 according to the above embodiment (see FIG. 5). Each of the culture chambers 41 is provided with an openable / closable lid 42. In this modification, a light source 11 is provided in the lid 42. Specifically, the light source 11 is embedded in the inner surface of the lid 42, and emits illumination light 16 toward the inside of the culture chamber 41. The light source 11 may have a plurality of light-emitting points 11B as shown in FIG. 12.

[0100] In this modification, the imaging sensor 12 is provided on the bottom 41A of the culture chamber 41. Specifically, the imaging sensor 12 is embedded in the bottom 41A of the culture chamber 41, and the imaging surface 12A is exposed inside the culture chamber 41. The bottom 41A is part of the housing that constitutes the incubator 40A.

[0101] The light source 11 is positioned opposite the imaging sensor 12 when the lid 42 is closed. The culture vessel 20 is placed on the bottom 41A of the culture chamber 41. The illumination light 16 emitted from the light source 11 is incident on the imaging sensor 12 through the culture vessel 20. The imaging sensor 12 captures an interference fringe image generated by the fertilized egg 21. The imaging sensor 12 operates in the same manner as in the above embodiment. In this modification, the light source 11 and the imaging sensor 12 constitute an imaging device.

[0102] An incubator 40A according to this modification is provided with a processor 60, a storage device 61, and a communication unit 62, which are all included in the imaging device 10 shown in FIG. 6. The incubator 40A communicates with an information processing device 50 via wired or wireless communication. The configuration and operation of the information processing device 50 are the same as those in the above embodiment. The information processing device 50 generates reconstruction data by performing reconstruction processing every time the imaging device generates image data.

[0103] According to the time lapse imaging system 2A of this modification, the fertilized egg 21 can be observed while being cultured in the culture chamber 41. It is also preferable to incorporate the information processing device 50 into the incubator 40A, thereby making the time lapse imaging system 2A a single device.

[0104] Furthermore, in the above embodiment and the above modification, the imaging device 10 is provided with one imaging sensor 12, but the number of imaging sensors 12 is not limited to one, and may be two or more.

[0105] 15 is a diagram illustrating the diameter D of the fertilized egg 21 and the height H of the culture solution 22 in the culture vessel 20. In the observation method for observing the fertilized egg 21 using the time-lapse imaging system according to the above embodiment or the above modification, the fertilized egg 21 is suspended in the culture solution 22 as described above. The fertilized egg 21 is a human ovum and is approximately spherical. The diameter D of the fertilized egg 21 is preferably equal to or greater than 100 μm and less than 200 μm. Furthermore, the height H of the culture solution 22 is preferably 1 m or more and less than 20 mm in order to suspend the fertilized eggs 21. The height H of the culture solution 22 is the length in the Z direction from the inner bottom surface 20A of the culture vessel 20 to the top of the culture solution 22.

[0106] The time-lapse imaging system 2 according to the above embodiment relates to a technique called lens-free imaging, in which the imaging device 10 does not include an optical lens. The technique of the present disclosure is applicable to digital holography in general (for example, when a reference light is used).

[0107] Various modifications are possible to the hardware configuration of the computer that constitutes the information processing device 50. For example, the information processing device 50 can be configured with multiple computers that are separated as hardware in order to improve processing capacity and reliability.

[0108] In this way, the hardware configuration of the computer of the information processing device 50 can be changed as appropriate depending on the required performance such as processing power, safety, reliability, etc. Furthermore, not only the hardware but also application programs such as the operating program 56A can be duplicated or stored in a distributed manner across multiple storage devices in order to ensure safety and reliability.

[0109] In the above embodiment, the following various processors can be used as the hardware structure of processing units that perform various processes, such as the imaging control unit 70, the image data acquisition unit 71, the reconstruction processing unit 72, and the display control unit 73. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (operation program 56A) and functions as various processing units, as well as dedicated electrical circuits, such as a programmable logic device (PLD), a processor whose circuit configuration can be changed after manufacture, such as an FPGA, and an application specific integrated circuit (ASIC), which is a processor having a circuit configuration designed specifically for performing specific processes.

[0110] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs and / or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0111] Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units, as typified by computers such as client and server. Second, a form in which a processor is used to realize the functions of an entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0112] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0113] Furthermore, the above-described embodiment and each of the modified examples can be combined as appropriate within the scope of not causing any contradiction.

[0114] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. an incubator including an imaging device having a light source and an imaging sensor, which generates image data including an interference fringe image by imaging a fertilized egg seeded in a culture vessel, and a communication unit which wirelessly transmits the image data; an information processing device that receives the image data wirelessly transmitted from the incubator and performs reconstruction processing based on the received image data to generate a reconstructed image at an arbitrary focal position; 1. An imaging system comprising: the incubator has a culture chamber that houses the culture vessel and a lid that makes the culture chamber airtight; The light source is provided on the lid, The imaging sensor is provided at the bottom of the culture chamber on which the culture vessel is placed. Imaging system.

2. The information processing device includes: performing the reconstruction process each time the imaging device generates the image data; displaying a reconstructed image generated by the reconstruction processing on a display; The imaging system of claim 1 .

3. the light source has a plurality of light-emitting points; the imaging device performs imaging operations a plurality of times while sequentially causing the light emitting points to emit light, thereby generating a plurality of pieces of image data; 3. The imaging system according to claim 1 or claim 2.

4. The information processing device includes: generating high-resolution image data based on the plurality of image data; performing the reconstruction process based on the generated high-resolution image data; The imaging system of claim 3 .

Images