Detection device
The detection device addresses brightness inconsistencies by using a two-dimensional arrangement of point light sources and sensors, enabling accurate colony detection through controlled brightness adjustments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- JAPAN DISPLAY INC
- Filing Date
- 2024-11-25
- Publication Date
- 2026-06-04
AI Technical Summary
Existing detection devices struggle to accurately detect colonies in Petri dishes due to issues with light source brightness, leading to inconsistent brightness outputs that hinder effective colony detection.
A detection device with a two-dimensional arrangement of point light sources and sensors, controlled by a circuit to adjust brightness individually for each combination of light sources and detection regions, ensuring output levels exceed or fall below a threshold for accurate detection.
Enhances the ability to detect colonies by optimizing light source brightness, ensuring clear brightness differences for precise colony identification.
Smart Images

Figure 2026091464000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a detection device.
Background Art
[0002] There is known a device that captures an image of a Petri dish in which a medium for culturing a culture target such as bacteria is formed, and detects colonies formed by the culture target on the medium from the image (for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] As an imaging form of a Petri dish, when a light source and a photosensor arranged to face each other across the Petri dish are used, colonies are detected by utilizing the fact that a change in brightness occurs in the output of the photosensor according to whether colonies have occurred or not. However, if the light from the light source is too bright or too dim, it becomes difficult for a difference in brightness to appear in the output of the photosensor, and there are cases where colonies cannot be detected well.
[0005] The present disclosure has been made in view of the above problems, and an object thereof is to provide a detection device that can detect colonies better.
Means for Solving the Problems
[0006] A detection device according to one aspect of the present disclosure includes a light source unit in which a plurality of point light sources emitting light are arranged two-dimensionally, a planar light sensor in which a plurality of light sensors for detecting light from the light source unit are arranged two-dimensionally, a detection object installation unit provided so as to be able to install a detection object between the light source unit and the planar light sensor, and a control circuit for controlling the operation of the light source unit and the planar light sensor, wherein the planar light sensor has a plurality of detection regions corresponding to the arrangement of each of the plurality of point light sources, one of the detection regions has a plurality of light sensors, the control circuit adjusts the brightness of the plurality of point light sources, and in the brightness adjustment, when a predetermined condition is met, the brightness of the point light source before or after the brightness is changed is adjusted to the brightness, and this process is performed individually for the corresponding combination of the point light source and the detection region, the predetermined condition is that one of the two output levels of the detection region obtained before and after changing the brightness of the point light source is higher than a threshold for determining the output of each of the plurality of detection regions, and the other of the two output levels of the detection region is lower than the threshold. [Brief explanation of the drawing]
[0007] [Figure 1] Figure 1 shows the main components of the detection device. [Figure 2] Figure 2 shows an example of the configuration of the irradiated area and the wiring area. [Figure 3] Figure 3 is a circuit diagram showing the circuit configuration of the light sensor. [Figure 4] Figure 4 is a schematic diagram showing an example of a light source configuration. [Figure 5] Figure 5 is a schematic diagram illustrating an example of the detection system configuration. [Figure 6] Figure 6 is a schematic diagram showing the relationship between one detection device and the external configuration. [Figure 7] Figure 7 is a schematic diagram showing the positional relationship between the main components of the detection device 1 and the object to be detected 200. [Figure 8] Figure 8 is a plan view illustrating the concept of distinguishing the arrangement of multiple point light sources using coordinates. [Figure 9]Figure 9 is a plan view illustrating the concept of managing the relationship between the irradiated area SA1 and the arrangement of multiple point light sources using coordinates. [Figure 10] Figure 10 is a schematic plan view showing the relationship between the diffusion range of light from multiple point light sources and the detection area. [Figure 11] Figure 11 is a schematic diagram showing an example of the relationship between the detection area and the optical sensor. [Figure 12] Figure 12 is a schematic diagram illustrating an example of a process in which the intensity of light emitted from each of multiple point light sources is sequentially determined. [Figure 13] Figure 13 is a graph that schematically shows the stages of controlling the intensity of light from a point light source. [Figure 14] Figure 14 is a time chart schematically showing the process by which the brightness of the point light source 22 is gradually reduced by the automatic brightness adjustment performed in the embodiment. [Figure 15] Figure 15 is a flowchart showing the processing flow related to the operation of the detection device. [Figure 16] Figure 16 is a flowchart showing the initial processing flow. [Figure 17] Figure 17 is a flowchart showing the flow of periodic operations. [Figure 18] Figure 18 is a schematic diagram illustrating another example of a process in which the intensity of light emitted from each of multiple point light sources is sequentially determined. [Figure 19] Figure 19 is a time chart schematically showing the process by which the brightness of a point light source is gradually increased by automatic brightness adjustment, as performed in the modified example. [Modes for carrying out the invention]
[0008] Hereinafter, each embodiment of the present disclosure will be described with reference to the drawings. Note that the disclosure is merely an example, and for those that can be easily conceived by those skilled in the art with appropriate modifications while maintaining the gist of the invention, they are naturally included in the scope of the present disclosure. Also, for the purpose of making the description clearer, the drawings may schematically represent the width, thickness, shape, etc. of each part compared to the actual aspect, but this is merely an example and does not limit the interpretation of the present disclosure. Further, in this specification and each figure, elements that are the same as those described above with respect to the previously shown figures may be denoted by the same reference numerals, and detailed descriptions may be omitted as appropriate.
[0009] FIG. 1 is a diagram showing the main configuration of the detection device 1. The detection device 1 includes a planar light sensor 10, a light source panel 20, and a control circuit 30. The planar light sensor 10 and the light source panel 20 of the detection device 1 are connected to the control circuit 30.
[0010] The planar light sensor 10 has an irradiated area SA (see FIG. 2) provided on a substrate 11. Also, a reset circuit 13, a scanning circuit 14, and a wiring area VA are mounted on the substrate 11. The configuration on the irradiated area SA, the reset circuit 13, and the scanning circuit 14 are connected to a detection circuit 15 via the wiring area VA.
[0011] The light source panel 20 has a light emitting area LA that irradiates the irradiated area SA with light. The light source panel 20 has point light sources 22 provided on a substrate 21. The point light sources 22 emit light. Specifically, the point light sources 22 have light emitting elements that function as point light sources, such as LEDs (Light Emitting Diodes) for example, and are arranged within the light emitting area LA. In the example shown in FIG. 1 and FIGS. 8 to 10 described later, a plurality of point light sources 22 are arranged in a matrix on the substrate 21 along the first direction Dx and the second direction Dy. Therefore, the light source panel 20 corresponds to a light source unit in which a plurality of point light sources 22 that emit light are two-dimensionally arranged.
[0012] The light source panel 20 is provided with a light source drive circuit 23. The light source drive circuit 23 controls the lighting and non-lighting of each of the plurality of point light sources 22 and the brightness control during lighting under the control of the control circuit 30. The plurality of point light sources 22 may be provided so that their light emission can be controlled individually, or may be provided so that they emit light collectively.
[0013] The control circuit 30 performs various processes related to the operation of the detection device 1. Specifically, the control circuit 30 is a circuit capable of implementing a plurality of functions, such as an FPGA (Field Programmable Gate Array) for example. The control circuit 30 may also be in other forms such as an ASIC (Application Specific Integrated Circuit). The control circuit 30 is connected to the light source drive circuit 23 via the wiring portion 29 and performs processes related to the lighting of the point light source 22, such as determining the lighting pattern and lighting timing of the point light source 22.
[0014] Also, the control circuit 30 is connected to the detection circuit 15 via the wiring portion 19 and obtains the output from the detection circuit 15. Here, the control circuit 30 also controls the timing of obtaining the output from the detection circuit 15, that is, the timing of operating the scanning circuit 14 to apply a gate signal to the scanning line 6. Thus, the control circuit 30 controls the operations of the point light source 22 and the planar optical sensor 10. Furthermore, the control circuit 30 performs processes based on the outputs of the plurality of optical sensors WA. Such processes include a determination process for determining whether a colony has occurred, which will be described later.
[0015] Although not shown in the figures, the detection device 1 includes an analog-to-digital conversion circuit, a digital-to-analog conversion circuit, and the like. The analog-to-digital conversion circuit is a circuit that enables the output from the optical sensor WA (see Figure 2), transmitted via the detection circuit 15, to be processed by the control circuit 30. The digital-to-analog conversion circuit is a circuit that enables the digital signal generated by the control circuit 30's processing to be used for controlling the operation of the planar optical sensor 10 and the light source panel 20. These circuits may, for example, be partially or entirely included in the detection circuit 15. Alternatively, these circuits may function as circuits mounted on flexible printed circuit boards (FPCs) provided as wiring sections 19 and 29. Furthermore, these circuits may be implemented in the detection device 1 by other means.
[0016] Figure 2 shows an example configuration of the irradiated area SA and the wiring area VA. Multiple optical sensors WA (see Figure 3) are arranged two-dimensionally in the irradiated area SA of the planar optical sensor 10. In this embodiment, as shown in Figure 2, multiple optical sensors WA are arranged in a matrix along the first direction Dx and the second direction Dy. The first direction Dx and the second direction Dy are orthogonal. Furthermore, when the third direction Dz is mentioned in the following description, it refers to the direction orthogonal to the first direction Dx and the second direction Dy.
[0017] The reset circuit 13 is connected to the reset signal transmission lines 51, 52, ..., 5n. Hereafter, when reset signal transmission line 5 is mentioned, it refers to any of the reset signal transmission lines 51, 52, ..., 5n. The reset signal transmission line 5 is a wiring along the first direction Dx. In the example shown in Figure 2, n reset signal transmission lines 5 are arranged in the second direction Dy. n is a natural number greater than or equal to 2. These n reset signal transmission lines 5 are connected to the reset circuit 13 at one end of the first direction Dx.
[0018] The scanning circuit 14 is connected to scan lines 61, 62, ..., 6n. Hereafter, when scan line 6 is mentioned, it refers to any of scan lines 61, 62, ..., 6n. Scan line 6 is a wiring along the first direction Dx. In the example shown in Figure 2, n scan lines 6 are aligned in the second direction Dy. These n scan lines 6 are connected to the scanning circuit 14 at the other end of the first direction Dx.
[0019] As shown in Figure 2, the reset signal transmission line 5 and the scan line 6 are arranged alternately in the second direction Dy within the irradiated area SA. Although the reset circuit 13 and scan circuit 14 exemplified in Figures 1 and 2 are positioned opposite each other across the irradiated area SA, the layout of the reset circuit 13 and scan circuit 14 is not limited to this and can be changed as appropriate.
[0020] Furthermore, signal lines 71, 72, ..., 7m are provided within the irradiated area SA. Hereafter, when signal line 7 is mentioned, it refers to one of signal lines 71, 72, ..., 7m. Signal line 7 is a wiring that runs along the second direction Dy.
[0021] In the example shown in Figure 2, m signal lines 7 are arranged in the first direction Dx, where m is a natural number greater than or equal to 2. Each of these m signal lines 7 is connected at one end in the second direction Dy to one of the multiple switches (for example, switch SW1, switch SW2, switch SW3, or switch SW4) of the multiplexer 40.
[0022] The multiplexer 40 is installed within the wiring area VA. The multiplexer 40 has multiple switches. In the example shown in Figure 2, these multiple switches are shown as switches SW1, SW2, SW3, and SW4. The multiple switches of one multiplexer 40 each turn ON (conductive) at different timings. While one of the multiple switches of one multiplexer 40 is ON (conductive), the other switches are OFF (non-conductive). The number of multiplexers 40 depends on the number (m) of signal lines 7. If the number of switches is p, then the number of multiplexers 40 should be m / p. If there are multiple multiplexers 40, each of the multiple multiplexers 40 is connected to the detection circuit 15 via individual wiring 401, 402, ..., 40p.
[0023] Note that the connection of the signal line 7 to the detection circuit 15 via the multiplexer 40 is merely an example and is not limited to this; the signal line 7 may also be individually directly connected to the detection circuit 15 within the wiring area VA. Within the wiring area VA, the reset circuit 13 is connected to the detection circuit 15 via wiring 131. Within the wiring area VA, the scanning circuit 14 is connected to the detection circuit 15 via wiring 149.
[0024] The detection circuit 15 is involved in detecting light using the PD82 (see Figure 3) provided on the optical sensor WA, and outputs signals to control the operating timing of the reset circuit 13 and the scanning circuit 14 under the control of the control circuit 30. The detection circuit 15 also receives the output from the optical sensor WA as input. The detection circuit 15 converts the signal input from the optical sensor WA into data that can be interpreted by the control circuit 30 and outputs it to the control circuit 30. In this embodiment, the detection circuit 15 is an MCU (Micro Controller Unit).
[0025] Figure 3 is a circuit diagram showing the circuit configuration of the optical sensor WA. Note that the first direction Dx and the second direction Dy in Figure 3 merely correspond to the directions of the reset signal transmission line 5, scan line 6, and signal line 7, and do not strictly represent the relative positional relationship of the circuit configuration within the optical sensor WA.
[0026] As shown in Figure 3, the optical sensor WA is equipped with switching element 81, PD82, transistor element 83, and switching element 85. PD82 is a photodiode (PD). Switching elements 81, 85 and the transistor element are MOSFETs (Metal Oxide Semiconductor Field Effect Transistors).
[0027] The gate of the switching element 81 is connected to the reset signal transmission line 5. A reset potential VReset is applied to either the source or drain of the switching element 81. The cathode of PD82 and the gate of transistor element 83 are connected to the other source or drain of the switching element 81. Hereinafter, when the connection part CP is mentioned, it refers to the other part, the location where the cathode of PD82 and the gate of transistor element 83 are connected. A reference potential VCOM is also applied from the anode side of PD82. The potential difference between the reset potential VReset and the reference potential VCOM is predetermined, but the potentials of the reset potential VReset and the reference potential VCOM may be variable. Note that the reset potential VReset is at a higher potential than the reference potential VCOM.
[0028] The drain of transistor element 83, which functions as a source follower, is supplied with the output source potential VPP2. The source of transistor element 83 is connected to either the source or the drain of switching element 85. The other source or drain of switching element 85 is connected to signal line 7. The gate of switching element 85 is connected to scan line 6.
[0029] The reset potential VReset, the reference potential VCOM, and the output source potential VPP2 are supplied by the detection circuit 15 to the optical sensor WA based on power supplied, for example, via a power supply circuit (not shown) connected to the detection circuit 15. The output form of these potentials is not limited to this and can be changed as appropriate.
[0030] The output source potential VPP2 is predetermined. Furthermore, the source potential of transistor element 83 is lower than the output potential of PD82 by the gate-source voltage (Vth) of transistor element 83. In this case, the source potential of transistor element 83 depends on the reset potential VReset and the reference potential VCOM. The output potential of PD82 depends on the photovoltaic power generated by PD82 in response to the light detected by PD82 during the exposure period.
[0031] When the gate of the switching element 85 is turned ON by the gate signal provided from the scanning circuit 14 via the scanning line 6, the source-drain of the switching element 85 becomes conductive. As a result, the signal (potential) transmitted to the switching element 85 via the transistor element 83 is transmitted to the signal line 7 through the switching element 85. In this way, an output is generated from the optical sensor WA. Hereafter, when referred to as the gate signal, it refers to the signal (potential) provided from the scanning circuit 14 via the scanning line 6. The scanning circuit 14 is a circuit that outputs the gate signal. As explained with reference to Figures 2 and 3, multiple optical sensors WA connected to the scanning line 6 and the signal line 7 are arranged in a matrix in the irradiated area SA of the planar optical sensor 10. Here, the scanning line 6 is provided along the first direction Dx and is configured to transmit the gate signal that generates an output from the optical sensor WA. The signal line 7 is configured to transmit the output of the optical sensor WA along the second direction Dy.
[0032] The output of one PD82 provided on a single light sensor WA corresponds to the intensity of light detected by the PD82 within a predetermined exposure period. The output of the PD82 is reset in response to a signal provided by the reset circuit 13 via the reset signal transmission line 5. When the gate of the switching element 81 is turned ON by this signal, the source-drain connection of the switching element 81 becomes conductive. This resets the potential of the connection CP to the reset potential VReset.
[0033] Figure 4 is a schematic diagram showing an example configuration of a point light source 22. As shown in Figure 4, the point light source 22 has a first light source 22R, a second light source 22G, and a third light source 22B. The first light source 22R, the second light source 22G, and the third light source 22B are each point light sources (e.g., LEDs) that emit light of different colors. In this embodiment, the first light source 22R emits red (R) light. The second light source 22G emits green (G) light. The third light source 22B emits blue (B) light.
[0034] As shown in the "First Example" in Figure 4, the light source 22 has, for example, a light-emitting region 2202 and a frame region 2201. In the light-emitting region 2202, a first light source 22R, a second light source 22G, and a third light source 22B, which are square in shape from a planar viewpoint, are arranged along the second direction Dy. The frame region 2201 is a frame-shaped region that borders the light-emitting region 2202. The width D1 of the light-emitting region 2202 in the first direction Dx is smaller than the width D2 of the frame region 2201 in the first direction Dx. The height H1 of the light-emitting region 2202 in the second direction Dy is smaller than the height H2 of the frame region 2201 in the second direction Dx. The spacing H3, which is the distance between the first light source 22R and the second light source 22G, and the distance between the second light source 22G and the third light source 22B, is less than half of the height H1. In the "First Example" of Figure 4, the width D1 and height H1 are equal, and the width D2 and height H2 are equal, but at least one of these may be different. Also, the light source 22 may be replaced with a different form, such as the light source 22A shown in the "Second Example" of Figure 4. In light source 22A, the longitudinal directions of the first light source 22R, the second light source 22G, and the third light source 22B are aligned with the second direction Dy, and they are arranged in the order of first light source 22R, second light source 22G, and third light source 22B from one side to the other in the first direction Dx. The first and second examples of Figure 4 are examples of the forms of light sources according to this disclosure and are not limited thereto. For example, the shapes of the first light source 22R, second light source 22G, and third light source 22B in the point light source 22 in a planar viewpoint and the positional relationship of the first light source 22R, second light source 22G, and third light source 22B can be changed as appropriate. A planar viewpoint is a viewpoint that directly views the plane (Dx-Dy plane) along which the first direction Dx and the second direction Dy lie.
[0035] Figure 5 is a schematic diagram illustrating an example configuration of a detection system 100, which includes a detection device 1. As shown in Figure 5, the detection system 100 includes a plurality of detection devices 1, a host IC 70, and a connection circuit 125. The plurality of detection devices 1 are electrically connected to a common host IC 70 via the connection circuit 125. The host IC 70 may be located inside the incubator 120.
[0036] The incubator 120 shown in Figure 5 is maintained in an environment (temperature, humidity, etc.) suitable for culturing the substance to be detected 200 with its door closed. Multiple detection devices 1 are placed inside the incubator 120.
[0037] Figure 6 is a schematic diagram showing the relationship between one detection device 1 and the external configuration. As shown in Figure 6, the connection between the detection device 1 and the connection circuit 125 is made by the connection between the control circuit 30 and the connection circuit 125. Also, as shown in Figure 6 and Figure 7 described later, the planar light sensor 10 and the light source panel 20 face each other. Furthermore, the object to be detected 200 can be placed between the planar light sensor 10 and the light source panel 20.
[0038] Note that Figure 6 only provides a general overview of the relationship between the planar light sensor 10, the light source panel 20, and the object to be detected 200. The specific structure for installing the object to be detected 200 between the planar light sensor 10 and the light source panel 20 will be explained with reference to Figure 7.
[0039] Figure 7 is a schematic diagram showing the positional relationship between the main components of the detection device 1 and the object to be detected 200. When the object to be detected 200 is placed between the planar light sensor 10 and the light source panel 20, for example, as shown in Figure 7, the object to be detected 200 is placed on the member 60. The member 60 functions as an object to be detected mounting section, which is provided to allow the object to be detected 200 to be installed so that it is interposed between the irradiated area SA and the light source panel 20.
[0040] In this embodiment, the planar light sensor 10 is located below the object to be detected 200, and the light source panel 20 is located above the object to be detected. The member 60 of this embodiment also functions as an optical member that limits the light emitted from the point light source 22 of the light source panel 20 to reach the planar light sensor 10. Specifically, the member 60 has one of the following: a plate-shaped louver, a cylindrical aperture, or a microlens. The plate-shaped louver consists of multiple parallel plate-shaped structures whose plate surfaces are aligned with the third direction Dz. It is desirable that the structure be made of a material with strong light-absorbing properties. The cylindrical aperture is a cylindrical opening that penetrates the base of the member 60, which is aligned with a plane perpendicular to the third direction Dz (Dx-Dy plane), in the third direction Dz. It is desirable that the base be made of a material with strong light-absorbing properties. The microlens is a tiny lens whose optical axis is aligned with the third direction Dz. It is desirable that the base of the member 60 supporting the microlens be made of a material with strong light-absorbing properties. The optical component 60 is provided with the purpose of limiting the direction of propagation of light emitted from the point light source 22 and reaching the planar light sensor 10 to the third direction Dz or a direction with a shallower inclination angle with respect to the third direction Dz.
[0041] In this embodiment, member 60 functions as both a member on which the object to be detected 200 can be installed and an optical member. However, the member on which the object to be detected 200 can be installed and the optical member may be provided separately. For example, the member on which the object to be detected 200 can be installed may be a plate-shaped member with a hole in which the object to be detected 200 can be housed. Also, the arrangement of the light source panel 20 and the planar light sensor 10 may be reversed. In that case, member 60 may be positioned, for example, above the object to be detected 200 and interposed between the object to be detected 200 and the planar light sensor 10.
[0042] The object to be detected 200 is a culture medium contained in a container dish. Specifically, the dish is a Petri dish. The culture medium is a medium on which colonies can be cultured. Hereafter, when simply referred to as a colony, it refers to a colony formed in the culture medium on the object to be detected 200 by a target organism that has been cultured in the culture medium. The target organism is a biological tissue, microorganism, or other organism that is expected to be cultured in a culture medium. The culture medium exhibits a degree of light transmission such that the degree of light transmission changes depending on the presence or absence of colonies and the thickness of the colonies. A translucent lid covering the dish may also be provided.
[0043] The following describes the process for controlling the intensity of light emitted from the point light source 22. As a prerequisite for this explanation, the relationship between the point light source 22 located in the light-emitting region LA and the irradiated region SA will be explained with reference to Figures 8 to 11.
[0044] Figure 8 is a plan view illustrating the concept of distinguishing the arrangement of multiple point light sources 22 using coordinates. The light-emitting region LA1 shown in Figure 8 is, for example, a part of the light-emitting region LA, but it could also be the entire light-emitting region LA. In the light-emitting region LA1 shown in Figure 8, there are three rows of point light sources 22 arranged in the first direction Dx, and three rows of point light sources 22 arranged in the second direction Dy. That is, there are 3 × 3 = 9 point light sources 22 arranged in the light-emitting region LA1.
[0045] In Figure 8, the subregions within the light-emitting area LA1 where the three point light sources 22 aligned in the first direction Dx are each positioned are assigned different coordinates in the first direction Dx. The coordinates in the first direction Dx can be expressed in the form (X=α), such as (X=1), (X=2), and (X=3). Also in Figure 8, the subregions within the light-emitting area LA1 where the three point light sources 22 aligned in the second direction Dy are each positioned are assigned different coordinates in the second direction Dy. The coordinates in the second direction Dy can be expressed in the form (X=β), such as (Y=1), (Y=2), and (Y=3). In other words, the nine point light sources 22 shown in Figure 8 can be represented in the form (X,Y)=(α,β) by combining the coordinates in the first direction Dx and the coordinates in the second direction Dy. For example, the coordinates of the central point light source 22 among the nine point light sources 22 shown in Figure 8 can be expressed as (X,Y)=(2,2).
[0046] Figure 9 is a plan view illustrating the concept of managing the relationship between the irradiated area SA1 and the arrangement of multiple point light sources 22 using coordinates. The irradiated area SA1 shown in Figure 9 is the part of the irradiated area SA that overlaps with the light-emitting area LA1 (see Figure 8) from a planar viewpoint. Each detection area PA within the irradiated area SA1, which primarily receives light from each of the multiple point light sources 22 as explained with reference to Figure 8, can be represented by a combination of the coordinates of the first direction Dx and the coordinates of the second direction Dy as explained with reference to Figure 8. More specifically, by dividing the irradiated area SA1 with a median line that bisects the distance between adjacent point light sources 22, each part of the irradiated area SA1 can be represented in the form (X,Y)=(α,β) as shown in Figure 9. For example, the detection area PA (X,Y)=(2,2) shown in Figure 9 is a part of the irradiated area SA1 and overlaps with the point light source 22 (X,Y)=(2,2) shown in Figure 8.
[0047] Figure 10 is a schematic plan view showing the relationship between the diffusion range of light from multiple point light sources 22 and the detection area PA. In Figure 10, the diffusion range of light when light from one point light source 22 reaches the irradiated area SA1 is shown by one range LC centered on that point light source 22. Therefore, Figure 10 shows nine range LCs corresponding to nine point light sources 22.
[0048] A single range LC, which represents the diffusion range of light from a single point light source 22 positioned at (X,Y)=(α,β), covers the detection region PA at (X,Y)=(α,β) in a planar viewpoint. Furthermore, this single range LC extends to a portion of other detection regions PA adjacent to the detection region PA. In other words, the intensity of light illuminating each detection region PA is influenced by multiple point light sources 22.
[0049] Here, the number of point light sources 22 that affect the intensity of light irradiated to each detection region PA varies depending on the position of the detection region PA. Specifically, the more detection regions PA adjacent to the first direction Dx or the second direction Dy, the more light from point light sources 22 the detection region PA is affected by.
[0050] For example, the detection region PA at (X,Y)=(2,2) is adjacent to a total of four detection regions PA at (X,Y)=(1,2), (2,1), (2,3), and (3,2). Therefore, the intensity of light illuminating the detection region PA at (X,Y)=(2,2) is affected not only by the light from the point light source 22 at (X,Y)=(2,2) but also by the light from the four point light sources 22 at (X,Y)=(1,2), (2,1), (2,3), and (3,2).
[0051] Furthermore, the detection region PA at (1,2) is adjacent to a total of three detection regions PA at (X,Y)=(1,1), (1,3), and (2,2). Therefore, the intensity of light illuminating the detection region PA at (X,Y)=(1,2) is affected by the light from the point light source 22 at (X,Y)=(2,2) as well as the light from the three point light sources 22 at (X,Y)=(1,1), (1,3), and (2,2). Similarly, the detection regions PA at (X,Y)=(2,1), (2,3), and (3,2) are affected by the light from the point light source 22 at the same coordinate as well as the light from the three point light sources 22 at coordinates adjacent to that coordinate.
[0052] Furthermore, the detection region PA at (1,1) is adjacent to two other detection regions PA at (X,Y)=(1,2) and (2,1). Therefore, the intensity of light illuminating the detection region PA at (X,Y)=(1,1) is affected not only by the light from the point light source 22 at (X,Y)=(1,1) but also by the light from the two point light sources 22 at (X,Y)=(1,2) and (2,1). Similarly, the detection regions PA at (X,Y)=(1,3),(3,1), and(3,3) are affected not only by the light from the point light source 22 at the same coordinate but also by the light from the two point light sources 22 at coordinates adjacent to that coordinate.
[0053] Furthermore, light from point light sources 22 at coordinates adjacent to a given detection area PA in an oblique direction intersecting the first direction Dx and the second direction Dy may also affect that detection area PA. The number of such obliquely adjacent point light sources 22 is greater for detection areas PA with a larger number of adjacent detection areas PA in the first direction Dx or the second direction Dy. Therefore, the intensity of light illuminating a detection area PA with four adjacent detection areas PA in the first direction Dx or the second direction Dy is stronger than the intensity of light illuminating a detection area PA with three or fewer adjacent detection areas PA in the first direction Dx or the second direction Dy. Also, the intensity of light illuminating a detection area PA with three adjacent detection areas PA in the first direction Dx or the second direction Dy is stronger than the intensity of light illuminating a detection area PA with two adjacent detection areas PA in the first direction Dx or the second direction Dy.
[0054] In this embodiment, multiple light sensors WA are arranged in a single detection area PA. The intensity of light irradiated onto a single detection area PA is the average of the light intensities detected by each of the multiple light sensors WA arranged in that detection area PA.
[0055] Figure 11 is a schematic diagram showing an example of the relationship between the detection region PA and the optical sensor WA. In Figure 11, the detection region PA at (X,Y)=(3,3) is shown in an enlarged view as an example, but the detection region PA at other coordinates is similar to the detection region PA at (X,Y)=(3,3).
[0056] In this embodiment, multiple optical sensors WA are arranged in a single detection region PA. In the detection region PA shown in Figure 11, there are eight rows of optical sensors WA arranged in the first direction Dx, and eight rows of optical sensors WA arranged in the second direction Dy. That is, 8 × 8 = 64 optical sensors WA are arranged in the detection region PA. This is merely an example, and the number of optical sensors WA arranged in a single detection region PA is not limited to this. The number of optical sensors WA arranged in a single detection region PA may be changed as appropriate.
[0057] Figures 8 to 11, and later Figures 12 and 18, illustrate an example of an illuminating region LA1 with nine point light sources 22 and an irradiated region SA1 containing nine detection regions PA. However, the values of α and β in (X,Y)=(α,β) are not limited to natural numbers from 1 to 3. For example, if the point light sources 22 and the light sensors WA are arranged in a 1:1 relationship, α may be any natural number from 1 to m (see Figure 2). β may be any natural number from 1 to n (see Figure 2). Also, if the point light sources 22 and the light sensors WA are arranged in a 1:q relationship... 2 When arranged in this relationship, α can be any natural number from 1 to m / q. β can be any natural number from 1 to n / q.
[0058] Next, the process for controlling the intensity of light emitted from the point light source 22 in the embodiment will be described with reference to Figures 12 to 14. Each of the multiple point light sources 22 has its emitted light intensity controlled individually.
[0059] Figure 12 is a schematic diagram showing an example of a process in which the intensity of light emitted from each of the multiple point light sources 22 is sequentially determined. In Figure 12, "Light Intensity" schematically represents the intensity of light emitted from each of the multiple point light sources 22. In Figure 12, "Image (Rawdata)" individually shows the pass / fail status of the light intensity based on the output of the irradiated area SA1 for each of the multiple detection areas PA. Here, "image" refers to a collection of multiple pixels, where the output of one optical sensor WA is considered as one pixel, and the pixels are arranged to correspond to the arrangement of optical sensors WA in the irradiated area SA. Hereafter, unless otherwise specified, "image" refers to the collection of outputs of the multiple optical sensors WA. Also, unless otherwise specified, "pixel" refers to the output of an optical sensor WA. In practice, however, processing such as analog / digital conversion is performed to treat the output of the optical sensors WA as a pixel. In this embodiment, such processing is performed by the detection circuit 15 as described above, but it may also be performed by the control circuit 30.
[0060] Furthermore, the planar light sensor 10 is configured to output data that reflects the intensity of light emitted from a point light source 22, passing through the object to be detected 200 and reaching multiple light sensors WA. The data referred to here is based on the set of outputs from multiple light sensors WA and can be considered as image data. In addition, the notation "Rawdata" indicates the output of the detection area PA in its unprocessed state without any special image processing.
[0061] The first state St_1 shown in Figure 12 is a state in which all of the point light sources 22 are lit at their maximum brightness. Note that the maximum brightness referred to here may be the maximum brightness that the point light sources 22 can achieve according to their specifications, but this is not mandatory. For example, it may be the maximum brightness within the "adjustable brightness range of the point light sources 22" that is set in advance in the operation of the detection device 1, and this maximum brightness may be less than the maximum brightness that the point light sources 22 can achieve according to their specifications. In Figure 12, and in Figures 13 and 14 described later, the maximum brightness of the point light sources 22 is indicated by the light intensity corresponding to the brightness of "Br_Ma". Also, the dot pattern circles labeled with the symbol "Br_Ma" in Figure 12 are range LC as explained with reference to Figure 10. The dot pattern circles labeled with any of the symbols "Br_A", "Br_B", "Br_C", "Br_Min", "Br_D", "Br_E", or "Br_F" described later are also range LC as explained with reference to Figure 10. In other words, in Figure 12 and Figure 18 (described later), the symbols attached to the circles in the dot pattern indicating the range LC indicate the intensity of light emitted from the point light source 22.
[0062] As explained with reference to Figure 7, in this embodiment, the object to be detected 200 is placed between the planar light sensor 10 and the light source panel 20. In this state, the point light source 22 of the light source panel 20 emits light, and the planar light sensor 10 detects the light that has passed through the object to be detected 200 and the component 60, thereby obtaining image data. Here, it is desirable that there be a difference in brightness in the light intensity shown by Rawdata depending on whether or not colonies have formed in the culture medium of the object to be detected 200. This is because the degree of light transmission differs between a culture medium without colonies and a culture medium with colonies. In other words, the detection device 1 is designed to determine whether or not colonies have formed by utilizing this difference in brightness. However, if the light from the point light source 22 is too strong, this difference in brightness may not appear in the image data.
[0063] Figure 13 is a graph that schematically shows the control stages of the intensity of light from the point light source 22. The horizontal axis of the graph in Figure 13 represents the intensity of light from each of the multiple point light sources 22. The vertical axis of the graph in Figure 13 represents the height of the Rawdata output level, which is the intensity of light detected by each of the multiple detection areas PA. Therefore, each bar in Figure 13 represents the output level of the Rawdata output according to the intensity of light emitted from the point light source 22. Note that the height of the bar in Figure 13 is shown ignoring the upper limit due to the dynamic range, which will be discussed later.
[0064] Each detection region PA is affected by the intensity of light emitted from one point light source 22 located at the same coordinates as the detection region PA, and the intensity of light emitted from another point light source 22 located at the coordinates of an adjacent detection region PA. In other words, the output level of the RawData reflects the intensity of light emitted from one point light source 22 located at the same coordinates as the detection region PA, and the intensity of light emitted from another point light source 22 located at the coordinates of an adjacent detection region PA.
[0065] In Figure 13, the output level of the RawData obtained from a detection region PA, which is determined by the intensity of light emitted from one point light source 22 located at the same coordinates as the detection region PA, is shown as "Br_Base". Also in Figure 13, the output level of the RawData obtained from a detection region PA, which is determined by the intensity of light emitted from another point light source 22 located at the coordinates of an adjacent detection region PA, is also shown as "Br_Base". Here, as explained with reference to Figure 10, the output level that appears as "Br_Add" can change depending on the number of adjacent detection regions PA. However, Figure 13 only provides a general explanation of how "Br_Add" occurs and omits showing the difference depending on the number of adjacent detection regions PA. In the following explanation, "Br_Add" in Figure 13 is assumed to represent the detection region PA with (X,Y)=(1,1),(1,3),(3,1),(3,3). In other words, the "Br_Add" in the detection region PA (X,Y)=(1,2),(2,1),(2,2),(2,3),(3,2) is stronger than that shown in Figure 13.
[0066] The output of the optical sensor WA is subject to dynamic range constraints. Dynamic range here refers to the range of output between the upper and lower limits of the optical sensor WA's output. That is, the output of the optical sensor WA cannot exceed the upper limit, nor can it fall below the lower limit. In Figure 13, the upper limit of the optical sensor WA's output is indicated by the upper limit DR.
[0067] In contrast to limitations imposed by dynamic range, such as the upper limit DR, the intensity of light from the point light source 22 can reach an intensity that exceeds the upper limit of the output of the photosensor WA. For example, in the first state St_1, as explained with reference to Figure 12, the point light source 22 emits light with an intensity corresponding to the luminance of "Br_Ma". As shown in Figure 13, the light with an intensity corresponding to the luminance of "Br_Ma" has enough intensity to produce an output of the photosensor WA that exceeds the upper limit DR.
[0068] In Figure 13, not only the light intensity corresponding to the brightness of "Br_Ma", but also the light intensity corresponding to the brightness of "Br_(Ma-1)" and "Br_(Ma-2)" respectively, have sufficient intensity to produce an output from the photosensor WA that exceeds the upper limit DR. "Br_(Ma-1)" corresponds to light that is weaker than "Br_Ma", stronger than "Br_(Ma-2)", and strong enough to produce an output from the photosensor WA that exceeds the upper limit DR. "Br_Ma" and "Br_(Ma-1)" exceed the upper limit DR with "Br_Base" alone. "Br_(Ma-2)" corresponds to light that is weaker than "Br_Ma" and "Br_(Ma-1)", and strong enough to produce an output from the photosensor WA that exceeds the upper limit DR. "Br_(Ma-2)" does not exceed the upper limit DR with "Br_Base" alone, but it does exceed the upper limit DR when "Br_Add" is added. On the other hand, the output from the photosensor WA caps out at the upper limit indicated by the upper limit DR. Therefore, regardless of whether the light intensity from the point light source 22 is "Br_Ma", "Br_(Ma-1)", or "Br_(Ma-2)", the output of the light sensor WA will plateau at the upper limit DR, and no difference due to the light intensity from the point light source 22 will be observed. This state, where the output of the light sensor WA plateaus at the upper limit DR and no difference due to the light intensity from the point light source 22 is observed, is described as "output saturation".
[0069] When output saturation occurs, the presence or absence of colonies may not be reflected in the output of the optical sensor WA. As mentioned above, determining whether colonies have formed utilizes the difference in brightness between a culture medium without colonies and one with colonies, due to the difference in the degree of light transmission. However, when output saturation occurs, this difference in brightness may fall within a range exceeding the upper limit DR, and the difference in brightness related to the output of the optical sensor WA may no longer be reflected. Thus, images obtained when output saturation occurs may not show the effects of colony formation. This condition is undesirable for determining whether colonies have formed.
[0070] Therefore, in this embodiment, control is performed to light up the point light source 22 at a brightness level such that the output of the light sensor WA is less than the upper limit DR. Specifically, automatic brightness adjustment is performed. Automatic brightness adjustment involves data acquisition processing and a first brightness check processing. Data acquisition processing is the process of obtaining image data at a predetermined brightness level of the point light source 22. The first brightness check processing is the process of lowering the brightness of the point light source 22 at the same coordinates as the detection area PA that produced an output exceeding threshold Tr1, if the output strength (Rawdata) of the detection area PA included in the image data obtained in the latest data acquisition processing exceeds threshold Tr1. In automatic brightness adjustment, as long as there is a detection area PA whose output strength (Rawdata) exceeds threshold Tr1, the data acquisition processing and the first brightness check processing are repeated. However, the "predetermined brightness level of the point light source 22" in the data acquisition processing performed after the first brightness check processing is the brightness level of the point light source 22 after it has been lowered by the latest first brightness check processing. Furthermore, in this embodiment, the "predetermined brightness of the point light source 22" in the initial data acquisition process before the first brightness check process is performed is the highest brightness, i.e., the brightness of "Br_Ma". As mentioned above, the brightness of "Br_Ma" may be the maximum brightness that the point light source 22 can achieve according to its specifications, or it may be the highest brightness within the pre-set "adjustable brightness range of the point light source 22".
[0071] Figure 14 is a time chart schematically showing the process by which the brightness of the point light source 22 is gradually reduced by automatic brightness adjustment performed in the embodiment. In Figure 14, the brightness of the point light source 22 that is reduced as the automatic brightness adjustment progresses is schematically shown by the height of the rising edge of the rectangular wave. Note that among the output OP in "Output of the light sensor" in Figure 14 and Figure 19 described later, those in "Automatic brightness adjustment" of "Process" indicate the output of the light sensor WA generated during the data acquisition process.
[0072] Referring to Figures 13 and 14, the image obtained from the point light source 22 lit at a brightness of "Br_Ma," i.e., the output (Rawdata) of the detection region PA, exceeds the threshold Tr1. Therefore, the brightness of the point light source 22 is reduced from "Br_Ma" to "Br_(Ma-1)" by the first brightness check process. However, the Rawdata obtained from the point light source 22 lit at a brightness of "Br_(Ma-1)" also exceeds the threshold Tr1. Therefore, the brightness of the point light source 22 is reduced from "Br_(Ma-1)" to "Br_(Ma-2)" by the first brightness check process. In this way, in this embodiment, the brightness of the point light source 22 is gradually reduced by automatic brightness adjustment.
[0073] The threshold Tr1 is a predetermined threshold for the output of the detection area PA. The threshold Tr1 is lower than the upper limit DR. In addition to the threshold Tr1 being lower than the upper limit DR, it is desirable that at least one of the following first and second conditions be considered, and it is even more desirable if both are considered. The first condition is that a margin is provided in the output level that takes into account the variation in brightness due to various conditions, such as the state of the culture medium not being perfectly uniform. That is, the first condition is that even with such variation in brightness, the output level setting based on the threshold Tr1 has a margin in the dynamic range such that it is suitable for the intended operation of the detection device 1. The second condition is that the output level should be as high as possible within the dynamic range, close to the upper limit DR. As a result, it becomes possible to obtain a better image of the detected object 200 in a brighter environment after automatic brightness adjustment, and it becomes easier to make the difference in brightness in the image used to determine whether colonies have formed clearer.
[0074] The second state St_2 shown in Figure 12 is a state that follows the first state St_1 in automatic brightness adjustment, and is a state in which all of the multiple point light sources 22 are lit at a brightness lower than that of the first state St_1. In the second state St_2 in Figures 12 and 14, the brightness of the point light sources 22 is shown in terms of the light intensity corresponding to the brightness of "Br_A". Here, as mentioned above, "Br_Add" in Figure 13 refers to the detection region PA at (X,Y)=(1,1),(1,3),(3,1),(3,3). As shown in Figure 13, the Rawdata obtained from the point light source 22 lit at the brightness of "Br_A" is below the threshold Tr1. Also, the Rawdata obtained from the detection region PA with the light of the point light source 22 lit at the brightness of "Br_(A+1)", which is one level stronger than "Br_A", is above the threshold Tr1. Therefore, the process up to the point light source 22 in the light emission region LA shown in Figure 8, where the brightness of the point light source 22 is reduced from "Br_(A+1)" to "Br_A" in the first brightness check process, is applied to all point light sources 22 within the light emission region LA. After that, for the detection region PA at (X,Y)=(1,1),(1,3),(3,1),(3,3), the Rawdata obtained from the point light source 22 that lights up with a brightness of "Br_A" falls below the threshold Tr1. As a result, the brightness of the point light sources 22 located at the same coordinates as these detection region PAs will no longer decrease. The dashed line Bo1 in Figure 14 indicates that the brightness of the point light sources 22 at (X,Y)=(1,1),(1,3),(3,1),(3,3) will no longer decrease below "Br_A".
[0075] As explained with reference to Figure 11, in this embodiment, each detection region PA includes multiple optical sensors WA. Therefore, whether the Rawdata of each detection region PA falls below the threshold Tr1 is determined by whether the average of the outputs of each of the multiple optical sensors WA included in each detection region PA falls below the threshold Tr1. In other words, the output of each detection region PA is the average of the outputs of each of the multiple optical sensors WA included in each detection region PA. In the "Image" column of Figure 12, the detection regions PA marked "OK" indicate detection regions PA in which the Rawdata falls below the threshold Tr1.
[0076] On the other hand, the "Br_Add" values in the detection regions PA at (X,Y)=(1,2),(2,1),(2,2),(2,3),(3,2) are stronger than those shown in Figure 13. Therefore, for these detection regions PA, the Rawdata obtained from the point light source 22 lit with a brightness of "Br_A" exceeds the threshold Tr1. Consequently, the brightness of the point light source 22 located at the same coordinates as these detection regions PA is further reduced by the first check process, changing from "Br_A" to "Br_(A-1)". In the "Image" column of Figure 12, the detection regions PA marked with "NG1" indicate detection regions PA where the Rawdata exceeds the threshold Tr1.
[0077] Thus, threshold Tr1 functions as a threshold for determining the output of each of the multiple detection regions PA. Information indicating thresholds such as threshold Tr1 is pre-set in the control circuit 30. Specifically, for example, this information is stored in a register provided in the control circuit 30. Furthermore, the first brightness check process included in automatic brightness adjustment corresponds to the process of setting the brightness of the point light source 22 after the brightness change to the adjusted brightness if predetermined conditions are met. Here, the predetermined conditions are that one of the two output levels of the detection region PA obtained before and after the brightness change of the point light source 22 is higher than threshold Tr1, and the other is lower than threshold Tr1. Note that before and after the brightness change is, for example, the brightness change from "Br_(A+1)" to "Br_A" as described above. Furthermore, this process is performed individually for each corresponding combination of point light source 22 and detection region PA. Here, a corresponding combination of point light source 22 and detection region PA refers to, for example, a combination of point light source 22 and detection region PA whose coordinates are the same and can be expressed in the form (X,Y)=(α,β) in the embodiment.
[0078] The third state St_3 shown in Figure 12 is a state that follows the second state St_2 in automatic brightness adjustment, and is a state in which the point light sources 22 at (X,Y)=(1,2),(2,1),(2,2),(2,3),(3,2) are lit at a lower brightness than in the second state St_2. In the third state St_3 in Figures 12 and 14, the brightness of the point light sources 22 at (X,Y)=(1,2),(2,1),(2,2),(2,3),(3,2) is shown in terms of the light intensity corresponding to the brightness of "Br_B". Here, for the detection region PA at (X,Y)=(1,2),(2,1),(2,3),(3,2), the Rawdata obtained from the detection region PA with the light of the point light sources 22 lit at the brightness of "Br_B" is assumed to be below the threshold Tr1. As a result, as shown in Figure 14, the brightness of the point light sources 22 located at the same coordinates as these detection regions PA will not decrease. The dashed line Bo2 in Figure 14 indicates that the brightness of the point light source 22 at (X,Y)=(1,2),(2,1),(2,3),(3,2) will no longer fall below "Br_B".
[0079] On the other hand, the "Br_Add" in the detection region PA at (X,Y)=(2,2) is stronger than the "Br_Add" in the detection regions PA at (X,Y)=(1,2),(2,1),(2,3), and(3,2). Therefore, for the detection region PA at (X,Y)=(2,2), the Rawdata obtained from the point light source 22 that lights up with a brightness of "Br_B" exceeds the threshold Tr1. Consequently, the brightness of the point light source 22 located at the same coordinates as the detection region PA at (X,Y)=(2,2) is further reduced by the first check process, changing from "Br_B" to "Br_(B-1)".
[0080] The fourth state St_4 shown in Figure 12 is a state that follows the third state St_3 in automatic brightness adjustment, and is a state in which the point light source 22 at (X,Y)=(2,2) is lit at a lower brightness than in the third state St_3. Here, for the detection region PA at (X,Y)=(2,2), the Rawdata obtained from the detection region PA with the light from the point light source 22 lit at a brightness of "Br_C" is assumed to be below the threshold Tr1. As a result, as shown in Figure 14, the brightness of the point light source 22 located at the same coordinates as these detection regions PA will not decrease. The dashed line Bo3 in Figure 14 indicates that the brightness of the point light source 22 at (X,Y)=(2,2) will not decrease below "Br_C".
[0081] Automatic brightness adjustment controls the brightness of multiple point light sources 22 so that the Rawdata of all detection areas PA falls below the threshold Tr1. As described above regarding automatic brightness adjustment, in this embodiment, the brightness of the point light sources 22 at the start of automatic brightness adjustment is the maximum brightness ("Br_Ma"). Also, the brightness of the point light sources 22 after the brightness change is lower than the brightness before the change.
[0082] By acquiring image data after automatic brightness adjustment, it becomes possible to obtain image data that more clearly shows the difference in brightness depending on whether or not colonies have formed. In Figure 14 and Figure 19 described later, the process related to acquiring image data performed after automatic brightness adjustment is shown in the output OP of "Scan" in "Process". In this embodiment, automatic brightness adjustment and acquisition of image data after automatic brightness adjustment are performed individually by the first light source 22R, the second light source 22G, and the third light source 22B.
[0083] Furthermore, in the explanations referring to Figures 12 and 14, and Figures 18 and 19 described later, The brightness of the point light sources 22 at (X,Y)=(1,1),(1,3),(3,1), and(3,3) is determined simultaneously. In this explanation, the brightness of the point light sources 22 at (X,Y)=(1,2),(2,1),(2,3), and(3,2) is also determined simultaneously. The simultaneous determination of the brightness of multiple point light sources 22, as described above, is merely an example and does not limit the behavior of the detection device 1 to this. Brightness adjustment of the point light sources 22 is performed individually for each combination of the corresponding point light source 22 and the detection area PA. Therefore, for example, due to individual differences in LEDs or variations in the sensitivity of the light sensor WA, it is assumed that the predetermined conditions are not met in some parts of the detection area PA at (X,Y)=(1,1),(1,3),(3,1), and(3,3), and that the predetermined conditions are not met in other parts. Under these assumed conditions, the brightness of the point light source 22 corresponding to the detection area PA where the predetermined conditions are met is determined and does not change, while the brightness of the point light source 22 corresponding to the detection area PA where the predetermined conditions are not met is not determined. In other words, the brightness of the point light source 22 corresponding to the detection area PA where the predetermined conditions are not met continues to change due to the brightness change caused by the first brightness check process included in automatic brightness adjustment.
[0084] Next, the processing flow related to the operation of the detection device 1 will be explained with reference to the flowcharts in Figures 15 to 17. Unless otherwise noted, in this embodiment, the control circuit 30 is the main control unit for the processing of each step shown in the flowcharts in Figures 15 to 17.
[0085] Figure 15 is a flowchart showing the processing flow related to the operation of the detection device 1. First, the initial operation is performed (step S1). At the time of the initial processing, it is assumed that the object to be detected 200 has just been placed in the detection device 1. In other words, at the time of the initial processing, it is assumed that no colonies have formed in the culture medium.
[0086] Figure 16 is a flowchart showing the initial processing flow. First, the brightness of the first light source 22R is automatically adjusted (step S11). The automatic brightness adjustment in step S11, as well as in steps S15 and S19 described later, is the same automatic brightness adjustment explained with reference to Figures 12 to 14.
[0087] In step S11, as well as in steps S15 and S19 described later, the control circuit 30 operates the planar light sensor 10 and the light source panel 20 to perform automatic brightness adjustment.
[0088] By replacing the first light source 22R with the second light source 22G in the explanation of the process in step S11, the explanation of the process in step S15 will be described later. Also, by replacing the first light source 22R with the third light source 22B in the explanation of the process in step S11, the explanation of the process in step S19 will be described later.
[0089] After the processing in step S11, a scanning process is performed using light from the first light source 22R (step S12). Specifically, the control circuit 30 operates the planar light sensor 10 and the light source panel 20 to perform the scanning process. In the process of step S12, the light source that lights up due to the operation of the light source panel 20 is the first light source 22R. In the process of step S12, the second light source 22G and the third light source 22B do not light up. As a result, the control circuit 30 obtains an image corresponding to the output of multiple light sensors WA that detected light from the first light source 22R that has passed through the object to be detected 200. Upon completion of the process in step S12, the first light source 22R turns off (step S13).
[0090] In step S16, which will be described later, the light source that is illuminated is the second light source 22G instead of the first light source 22R. Also, in step S20, which will be described later, the light source that is illuminated is the third light source 22B instead of the first light source 22R. After the processing in steps S12 and S13, the first data is output (step S14). The first data is the image data obtained by the light from the first light source 22R. Specifically, the control circuit 30 uses the image data that reflects the output of the light sensor WA obtained in step S12 as the first data.
[0091] After the processing in step S14, the brightness of the second light source 22G is automatically adjusted (step S15). After the processing in step S15, a scanning process is performed using light from the second light source 22G (step S16). Specifically, the scanning process is performed by the control circuit 30 operating the planar light sensor 10 and the light source panel 20. In the processing of step S16, the light source that lights up due to the operation of the light source panel 20 is the second light source 22G. In the processing of step S16, the first light source 22R and the third light source 22B do not light up. As a result, the control circuit 30 obtains an image corresponding to the output of multiple light sensors WA that have detected light from the second light source 22G that has passed through the object to be detected 200. Upon completion of the processing in step S16, the second light source 22G is turned off (step S17).
[0092] After the processing in step S16 and step S17, the second data is output (step S18). The second data is the image data obtained from the light from the second light source 22G. Specifically, the control circuit 30 uses the image data that reflects the output of the light sensor WA obtained in the processing of step S16 as the second data.
[0093] After the processing in step S18, the brightness of the third light source 22B is automatically adjusted (step S19). After the processing in step S19, a scanning process is performed using light from the third light source 22B (step S20). Specifically, the scanning process is performed by the control circuit 30 operating the planar light sensor 10 and the light source panel 20. In the processing of step S20, the light source that lights up due to the operation of the light source panel 20 is the third light source 22B. In the processing of step S20, the first light source 22R and the second light source 22G do not light up. As a result, the control circuit 30 obtains an image corresponding to the output of multiple light sensors WA that have detected light from the third light source 22B that has passed through the object to be detected 200. Upon completion of the processing in step S20, the third light source 22B is turned off (step S21).
[0094] After the processing in step S20 and step S21, the second data is output (step S22). The second data is the image data obtained by the light from the third light source 22B. The control circuit 30 uses the image data that reflects the output of the light sensor WA obtained in the processing of step S20 as the third data.
[0095] The initial operation ends upon completion of the first step S22. As shown in Figure 15, after the initial operation, which is the process of step S1, timing by a timer begins (step S2). The process of step S2 may be carried out by, for example, a timer circuit provided in the control circuit 30, or by setting a variable that functions as a counter and updating the counter based on the operating clock of the control circuit 30, or by any other method.
[0096] After the start of timing by the process in step S2, a check is performed to see if a predetermined time has elapsed (step S3). The control circuit 30 waits without performing the next process until the predetermined time has elapsed (step S3; No). The predetermined time is, for example, 5 minutes, but is not limited to this. The predetermined time may be appropriately determined according to the period (time interval) for which it is necessary to determine whether a colony has formed. After the process in step S2, once the predetermined time has elapsed (step S3; Yes), a periodic operation is performed (step S4).
[0097] Figure 17 is a flowchart showing the flow of a periodic operation. A periodic operation is an operation in which the processes in steps S11, S15, and S19 of the various processes included in the initial operation, as explained with reference to Figure 16, are omitted. In a periodic operation, the processes are carried out in the following order: steps S12, S13, S14, S16, S17, S18, S20, S21, and S22.
[0098] The first light source 22R, the second light source 22G, and the third light source 22B are each illuminated at different timings. Furthermore, while one of the first light source 22R, the second light source 22G, or the third light source 22B is illuminated, the other two remain unlit. These light sources are also illuminated periodically in the order of the first light source 22R, the second light source 22G, and the third light source 22B. These are demonstrated in the processing of steps S12, S13, S16, S17, S20, and S21 during the initial operation and periodic operation.
[0099] The brightness of the first light source 22R, which lights up during periodic operation, is the brightness adjusted by the automatic brightness adjustment process in step S11 of the initial operation. The brightness of the second light source 22G, which lights up during periodic operation, is the brightness adjusted by the automatic brightness adjustment process in step S15 of the initial operation. The brightness of the third light source 22B, which lights up during periodic operation, is the brightness adjusted by the automatic brightness adjustment process in step S19 of the initial operation.
[0100] The periodic operation ends upon completion of the second and subsequent steps of step S22. As shown in Figure 15, after the periodic operation in step S4, the timer is reset (step S5). That is, the timer, which was started in step S2, is reset in step S5.
[0101] Furthermore, the control circuit 30 determines whether a colony has formed based on the change in brightness between the data obtained in the initial operation and the data obtained in the periodic operation (step S6). Specifically, the control circuit 30 compares the t-th data obtained in the initial operation with the t-th data obtained in the periodic operation. If the control circuit 30 finds a dark area in the t-th data obtained in the periodic operation that is not present in the t-th data obtained in the initial operation, it determines that the dark area is due to a colony. Here, t in the t-th data is one of 1, 2, or 3. To illustrate the case where t is 1, "The control circuit 30 compares the first data obtained in the initial operation with the first data obtained in the periodic operation. If the control circuit 30 finds a dark area in the first data obtained in the periodic operation that is not present in the first data obtained in the initial operation, it determines that the dark area is due to a colony." The same interpretation applies to the cases of t=2 or t=3. The control circuit 30 determines the cases of t=1, t=2, and t=3 individually. The size threshold at which a dark area is treated as a colony is predetermined and can be adjusted as needed depending on the size of the colony targeted for notification by the notification process described later.
[0102] Furthermore, in this embodiment, if a dark area that can be identified as a colony is present in one or more of the cases t=1, t=2, and t=3, it is treated as if a colony has been determined to have occurred in step S6. However, the specific conditions for such determination are not limited to these. If a dark area that can be identified as a colony is present in two or more or all three of the cases t=1, t=2, and t=3, it may be determined in step S6 that a colony has been determined to have occurred. Step S6 corresponds to a process that determines whether a colony has occurred based on a comparison of multiple images obtained at different timings.
[0103] If it is determined in step S6 that a colony has been formed (step S6; Yes), a notification process is performed (step S7). In the notification process, notification is performed using a predetermined notification method. In this embodiment, the execution of the notification process sends an email indicating that a colony has been formed to the email address of the administrator of the detected object 200. The email and the text sent in the email are predetermined. In this embodiment, for example, the control circuit 30 functions as the entity that sends the email, but it is not limited to this. As another example, the control circuit 30 may output a signal to an external information processing device that functions as a command to send an email, or it may be done by other means. Also, the form of notification performed in the notification process is not limited to sending an email. For example, an audio output device such as a speaker may be operated to output a predetermined "sound to notify that a colony has been formed," or it may be a notification in another form. The process in step S7 corresponds to the process of outputting an indication that a colony has been formed when it is determined that a colony has been formed.
[0104] If it is determined in step S6 that no colonies have formed (step S6; No), the process proceeds to step S2 unless the operation of the detection device 1 has finished (step S8; No). That is, the timer starts again, and each time a predetermined amount of time has elapsed, periodic operation, timer reset, and determination of whether colonies have formed are performed. If the operation of the detection device 1 finishes in step S8 (step S8; Yes) and after the execution of step S7, the process related to the operation of the detection device 1 ends.
[0105] As described above, according to the embodiment, the detection device 1 comprises a light source unit (light source panel 20) in which point light sources (point light sources 22) that emit light are arranged in two dimensions, a planar light sensor (planar light sensor 10) in which a plurality of light sensors (light sensors WA) that detect light from the light source unit are arranged in two dimensions, a detectable object installation unit (member 60) provided so that a detectable object (detectable object 200) can be installed between the light source and the planar light sensor, and a control circuit (control circuit 30) that controls the operation of the light source unit and the planar light sensor. The planar light sensor has a plurality of detection regions (detection region PA) corresponding to the arrangement of each of the plurality of point light sources. One of the detection regions has a plurality of light sensors. The control circuit adjusts the brightness of the plurality of point light sources (for example, the automatic brightness adjustment described above). In this brightness adjustment, if predetermined conditions are met, the brightness of the point light source before or after (for example, after) the brightness change is adjusted to the adjusted brightness, and this process is performed individually for each combination of the point light source and the detection area. The predetermined conditions are that one of the two output levels of the detection area obtained before and after changing the brightness of the point light source is higher than a threshold for determining the output of each of the multiple detection areas, and the other of the two output levels of the detection area is lower than the threshold. The threshold is, for example, threshold Tr1. As a result, the brightness of the point light source is adjusted to a brightness that is neither too bright nor too dark from the standpoint of light detection by the light sensor. Therefore, according to this embodiment, colonies can be detected more effectively.
[0106] Furthermore, at the start of the brightness adjustment of the point light source (point light source 22) by the automatic brightness adjustment described above, the brightness of the point light source is at its maximum brightness ("Br_Ma"). In addition, during the brightness adjustment of the point light source, if the brightness after the brightness adjustment of the point light source is lower than the brightness before the brightness adjustment, and a predetermined condition is met, the brightness of the point light source after the brightness adjustment is set to the adjusted brightness. This process is performed individually for each combination of the corresponding point light source and the detection area (detection area PA). This makes it possible to adjust the brightness of the point light source to a brightness that is not too bright from the perspective of light detection by the light sensor with higher precision.
[0107] Furthermore, the point light source (point light source 22) includes a first light source (first light source 22R) that emits red light, a second light source (second light source 22G) that emits green light, and a third light source (third light source 22B) that emits blue light. In addition, the brightness adjustment of the point light source by the automatic brightness adjustment described above is performed individually for the first light source, the second light source, and the third light source. This makes it possible to obtain the output of the planar light sensor (planar light sensor 10) corresponding to the three colors of light that constitute the so-called RGB image data. Therefore, it becomes easier to more reliably capture the optical effects that colonies produce on the culture medium.
[0108] Furthermore, the system includes an optical element (member 60) provided between the object to be detected (object 200) and the planar light sensor (planar light sensor 10), and the optical element (member 60) has either a plate-shaped louver, a cylindrical aperture, or a microlens. This makes it easier to limit the range through which the light detected by each of the multiple light sensors (light sensors WA) passes to the range facing each light sensor.
[0109] (modified version) Hereinafter, modified examples of the embodiments described above, which differ in some aspects from the original embodiment, will be explained with reference to Figures 18 and 19. In the explanation of the modified examples, components similar to those in the embodiment will be denoted by the same reference numerals and their descriptions will be omitted.
[0110] Figure 18 is a schematic diagram showing another example of the process in which the intensity of light emitted from each of the multiple point light sources 22 is sequentially determined. In the modified example, the first brightness check process in the embodiment is replaced by a second brightness check process. In the second brightness check process, if the output intensity (Rawdata) of a detected region PA included in the image data obtained in the latest data acquisition process falls below a predetermined threshold, the brightness of the point light source 22 at the same coordinates as the detected region PA that produced the output below the threshold is increased. In the automatic brightness adjustment of the modified example, the data acquisition process and the second brightness check process are repeated as long as there is a detected region PA whose output intensity (Rawdata) falls below the threshold. However, the "predetermined brightness of point light source 22" in the data acquisition process performed after the second brightness check process is the brightness of point light source 22 after it has been increased by the latest second brightness check process. Also, in the modified example, the "predetermined brightness of point light source 22" in the first data acquisition process before the second brightness check process is performed is the brightness corresponding to the lowest brightness. In Figure 13, the minimum luminance is shown as "Br_Mi". The point light source 22 in the fifth state St_5 shown in Figure 18 emits light with an intensity corresponding to the luminance of "Br_Mi".
[0111] Furthermore, in the automatic brightness adjustment related to the modified image, a brightness restoration process is performed. In the brightness restoration process, if the output strength (Rawdata) of the detection region PA included in the image data obtained in the latest data acquisition process exceeds a predetermined threshold for the modified image, the brightness of the point light source 22 at the same coordinates as the detection region PA that produced the output exceeding the threshold is reduced. The degree to which the brightness of the point light source 22 is reduced in the brightness restoration process is such that it "cancels out the last brightness increase applied to the brightness of the point light source 22."
[0112] Figure 19 is a time chart schematically showing the process by which the brightness of the point light source 22 is gradually increased by automatic brightness adjustment performed in the modified example. In Figure 19, the brightness of the point light source 22 that is increased as the automatic brightness adjustment progresses is schematically shown by the height of the rising edge of the rectangular wave.
[0113] Referring to Figures 18 and 19, the image obtained from the point light source 22 lit at a brightness of "Br_Mi," i.e., the output (Rawdata) of the detection region PA, falls below the threshold in the modified example. Therefore, the brightness of the point light source 22 is increased from "Br_Mi" to "Br_(Ma+1)" by the second brightness check process. However, the Rawdata obtained from the point light source 22 lit at a brightness of "Br_(Ma+1)" also falls below the threshold. Therefore, the brightness of the point light source 22 is increased again by the second brightness check process. In this way, in the modified example, the brightness of the point light source 22 is gradually increased by automatic brightness adjustment. This threshold is lower than the upper limit DR, similar to the threshold Tr1.
[0114] The sixth state, St_6, shown in Figure 18, is a later state than the fifth state, St_5, and is a state in which all of the multiple point light sources 22 are lit at a higher brightness than in the fifth state, St_5. In the sixth state, St_6, shown in Figures 18 and 19, the brightness of the point light sources 22 is shown in terms of the light intensity corresponding to the brightness of "Br_D". Here, for the detection region PA at (X,Y)=(2,2), the Rawdata obtained from the detection region PA with the light from the point light sources 22 lit at a brightness of "Br_D" is assumed to exceed the threshold of the modified example. As a result, as shown in Figure 19, the brightness of the point light sources 22 located at the same coordinates as the detection region PA at (X,Y)=(2,2) will not increase. Furthermore, the brightness reset process described above resets the brightness of the point light sources 22 at (X,Y)=(2,2) from "Br_D" to "Br_(D-1)". The dashed line Bo4 in Figure 19 indicates that the brightness of the point light source 22 at (X,Y)=(2,2) will not increase beyond "Br_(D-1)" after the brightness restoration process. In the "Image" column of Figure 18, the detection region PA marked "OK" indicates the detection region PA where the Rawdata exceeds the threshold.
[0115] Thus, the second brightness check process included in the modified automatic brightness adjustment corresponds to the process of setting the brightness of the point light source 22 before the brightness change to the adjusted brightness if predetermined conditions are met. Here, "before and after the brightness change" refers to, for example, the brightness change from "Br_(D-1)" to "Br_D" as described above.
[0116] On the other hand, for the detection regions PA at (X,Y)=(1,1),(1,2),(1,3),(2,1),(2,3),(3,1),(3,2),(3,3), the Rawdata obtained from the point light source 22 lit with a brightness of "Br_D" falls below the threshold for the modified example. Therefore, the brightness of the point light source 22 located at the same coordinates as these detection regions PA is further increased by the second check process, changing from "Br_D" to "Br_(D+1)". In the "Image" column of Figure 18, the detection regions PA labeled "NG2" indicate the detection regions PA whose Rawdata falls below the threshold.
[0117] The seventh state, St_7, shown in Figure 18, is a later state than the sixth state, St_6. In the seventh state, the point light sources 22 at (X,Y)=(1,1),(1,2),(1,3),(2,1),(2,3),(3,1),(3,2),(3,3) are lit with a higher brightness than in the sixth state, St_6. In the seventh state, St_7, shown in Figures 18 and 19, the brightness of the point light sources 22 at (X,Y)=(1,1),(1,2),(1,3),(2,1),(2,3),(3,1),(3,2),(3,3) is shown in terms of the light intensity corresponding to the brightness of "Br_E". Here, for the detection region PA at (X,Y)=(1,2),(2,1),(2,3),(3,2), it is assumed that the Rawdata obtained from the detection region PA with the light from the point light sources 22 lit with a brightness of "Br_E" exceeds the threshold of the modified example. As a result, as shown in Figure 19, the brightness of the point light sources 22 located at the same coordinates as these detection regions PA will not increase. Furthermore, the brightness reset process described above resets the brightness of the point light sources 22 at (X,Y)=(1,2),(2,1),(2,3),(3,2) from "Br_E" to "Br_(E-1)". The dashed line Bo5 in Figure 19 indicates that the brightness of the point light sources 22 at (X,Y)=(1,2),(2,1),(2,3),(3,2) will not increase from "Br_E-1".
[0118] On the other hand, for the detection region PA (X,Y)=(1,1),(1,3),(3,1),(3,3), the Rawdata obtained from the point light source 22 lit with a brightness of "Br_E" falls below the threshold for the modified example. Therefore, the brightness of the point light source 22 located at the same coordinates as these detection region PAs is further increased by the second check process, changing from "Br_E" to "Br_(E+1)".
[0119] The eighth state St_8 shown in Figure 18 is a later state than the seventh state St_7, and the point light sources 22 at (X,Y)=(1,1),(1,3),(3,1),(3,3) are lit with a higher brightness than in the seventh state St_7. Here, for the detection region PA at (X,Y)=(1,1),(1,3),(3,1),(3,3), the Rawdata obtained from the detection region PA with the light from the point light sources 22 lit with a brightness of "Br_F" exceeds the threshold of the modified example. As a result, as shown in Figure 19, the brightness of the point light sources 22 located at the same coordinates as these detection regions PA will not increase. Furthermore, the brightness reset process described above resets the brightness of the point light sources 22 at (X,Y)=(1,1),(1,3),(3,1),(3,3) from "Br_F" to "Br_(F-1)". The dashed line Bo6 in Figure 19 indicates that the brightness of the point light source 22 at (X,Y)=(1,1),(1,3),(3,1),(3,3) will not rise above "Br_(F-1)".
[0120] In the modified version, the brightness of multiple point light sources 22 is controlled so that the raw data of all detection areas PA exceeds the threshold of the modified version through automatic brightness adjustment. After automatic brightness adjustment, image data is obtained that more clearly shows the difference in brightness depending on whether or not a colony has formed. In the modified version, for example, even after the brightness of the point light source 22 at coordinate (2,2) stops rising above "Br_D", the brightness of the point light source 22 at adjacent coordinates increases, causing the output of the detection area PA at that coordinate to rise slightly further. The threshold of the modified version is determined to take into account the effect of the increase in brightness of the point light sources 22 at such adjacent coordinates, so as not to cause output saturation due to the increase in brightness. Except for the points specifically noted above, the modified version is the same as the embodiment.
[0121] In the modified version, the brightness of the point light source (point light source 22) at the start of the brightness adjustment by the automatic brightness adjustment described above is at the minimum brightness ("Br_Mi"). Furthermore, in the brightness adjustment of the point light source, if the brightness after the brightness adjustment of the point light source is higher than the brightness before the brightness adjustment, and a predetermined condition is met, the brightness of the point light source before the brightness adjustment is set to the brightness after the adjustment. This process is performed individually for each combination of the corresponding point light source and detection area (detection area PA). This makes it possible to adjust the brightness of the point light source to a brightness that is not too dark from the standpoint of light detection by the light sensor with higher precision.
[0122] In this embodiment, a point light source 22 having a first light source 22R, a second light source 22G, and a third light source 22B is used as the light source, but the light sources that can be used in the form of this disclosure are not limited to this. For example, a light source corresponding to four or more colors of light may be used, or a light source corresponding to one or two colors of light may be used. In addition, light of a composite color obtained by simultaneously lighting some or all of multiple types of light sources that emit light of different colors may be used. For example, when the first light source 22R, the second light source 22G, and the third light source 22B are lit simultaneously, white light can be obtained.
[0123] Furthermore, the relative vertical relationship between the planar light sensor 10 and the light source panel 20 is not limited to the example shown in Figure 7, and may be the reverse of that. Also, in this embodiment, member 60 is an optical member provided between the object to be detected 200 and the planar light sensor 10, and also serves as the object to be detected mounting section, but this configuration is merely an example and is not limited to this. For example, a configuration that functions as such an optical member and a configuration that functions as the object to be detected mounting section may be provided separately.
[0124] Furthermore, any other effects and advantages brought about by the embodiments described herein that are obvious from this specification or that can be appropriately conceived by those skilled in the art are naturally provided by this disclosure. [Explanation of symbols]
[0125] 1. Detection device 10 Planar light sensor 20 Light Source Panels 22 point light source 22B 3rd light source 22G 2nd light source 22R 1st light source 30 Control circuits 60 components PA detection area Tr1 threshold WA Optical Sensor
Claims
1. A light source unit in which multiple point light sources emitting light are arranged in two dimensions, A planar light sensor in which multiple light sensors for detecting light from the light source are arranged in a two-dimensional manner, A detection object installation unit is provided so as to be able to install the detection object between the light source unit and the planar light sensor, A control circuit for controlling the operation of the light source unit and the planar light sensor, Equipped with, The planar light sensor has a plurality of detection regions corresponding to the arrangement of each of the plurality of point light sources, One of the detection regions has multiple optical sensors, The control circuit adjusts the brightness of the plurality of point light sources, In the aforementioned brightness adjustment, When predetermined conditions are met, the process of adjusting the brightness of the point light source before or after changing its brightness to the adjusted brightness is performed individually for each corresponding combination of the point light source and the detection area. The predetermined condition is that one of the two output levels of the detection region obtained before and after changing the brightness of the point light source is higher than the threshold for determining the output of each of the plurality of detection regions, and the other of the two output levels of the detection region is lower than the threshold. Detection device.
2. At the start of the brightness adjustment, the brightness of the point light source is at its maximum brightness. In the aforementioned brightness adjustment, The brightness of the point light source is lower after the brightness of the point light source is changed than before the brightness of the point light source is changed. When the predetermined conditions are met, the process of adjusting the brightness of the point light source after changing its brightness is performed individually for each corresponding combination of the point light source and the detection area. The detection device according to claim 1.
3. At the start of the brightness adjustment, the brightness of the point light source is the minimum brightness. In the aforementioned brightness adjustment, The brightness of the point light source is higher after the brightness of the point light source is changed than before the brightness of the point light source is changed. When the predetermined conditions are met, the process of adjusting the brightness of the point light source to the brightness before the brightness change is performed individually for each corresponding combination of the point light source and the detection area. The detection device according to claim 1.
4. The point light source includes a first light source that emits red light, a second light source that emits green light, and a third light source that emits blue light. The brightness adjustment is performed individually for the first light source, the second light source, and the third light source. The detection device according to any one of claims 1 to 3.
5. The optical member provided between the object to be detected and the planar light sensor, The optical member has one of the following: a plate-shaped louver, a cylindrical aperture, or a microlens. The detection device according to any one of claims 1 to 3.