Detection device

The detection device addresses noise amplification in lensless imaging by using a planar arrangement and adaptive thresholding to suppress noise, ensuring accurate microbial colony detection.

JP2024168726APending Publication Date: 2024-12-05JAPAN DISPLAY INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023085628
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

In lensless imaging systems for microorganism detection, the intensity of light received by detection elements varies based on their relative positional relationship with the light source, leading to amplified system-derived noise components and erroneous detection.

Method used

A detection device with a planar arrangement of photodetection elements, a translucent mounting substrate, and a control circuit that determines the presence of a detected object based on consecutive determinations exceeding a threshold value set according to received light intensity, thereby suppressing noise components.

Benefits of technology

The solution effectively reduces erroneous detections by adjusting thresholds and correction coefficients based on light intensity variations, ensuring accurate imaging of microbial colonies.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168726000001_ABST
    Figure 2024168726000001_ABST
Patent Text Reader

Abstract

To provide a detection device capable of reducing the effects of system-derived noise components.SOLUTION: A detection device includes: a planar detection device comprising multiple photodiodes arranged in a planar configuration; a light source device disposed to face the planar detection device; and a light-transmitting mounting substrate which is disposed between the planar detection device and the light source device and on which multiple objects to be detected are mounted. The planar detection device comprises: a detection area in which multiple sensor pixels comprising the photodiodes are arranged in a first direction and a second direction Dy orthogonal to the first direction; a detection circuit configured to acquire a sensor value Raw(p) of each of the sensor pixels; and a control circuit configured to, when the number of times a value calculated based on the sensor value Raw(p) is consecutively equal to or higher than a determination threshold is equal to or higher than a consecutive determination count threshold that has been set according to received light intensity for each of the sensor pixels, determine that an object to be detected is present in a position on the detection area corresponding to the sensor pixel.SELECTED DRAWING: Figure 10
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a detection device. [Background technology]

[0002] A method for identifying microorganisms using a lensless imaging system that uses a photosensor has been disclosed (for example, Patent Document 1). In the lensless imaging system of Patent Document 1, light irradiated from a point light source passes through a culture medium in a culture vessel and a colony (subject to be detected) of microorganisms such as bacteria on the culture medium, and is incident on the photosensor. The photosensor acquires an image of the microbial colony formation (scattered light pattern) as pixel data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-033430 A Summary of the Invention [Problem to be solved by the invention]

[0004] In such a lensless imaging system, the intensity of the light received by each detection element (hereinafter also referred to as "received light intensity") varies depending on the relative positional relationship with the point light source. For this reason, it is possible to correct the pixel data according to the received light intensity, but this may amplify noise components originating from the system contained in the pixel data, resulting in false detection.

[0005] An object of the present invention is to provide a detection device capable of suppressing the influence of noise components originating from the system. [Means for solving the problem]

[0006] A detection device according to one embodiment of the present invention has a planar detection device including a plurality of light detection elements arranged in a planar shape, a light source device arranged opposite the planar detection device, and a translucent mounting substrate arranged between the planar detection device and the light source device and carrying a plurality of objects to be detected, wherein the planar detection device includes a detection area in which a plurality of sensor pixels including the light detection elements are arranged in a first direction and a second direction perpendicular to the first direction, a detection circuit that acquires a sensor value for each of the sensor pixels, and a control circuit that determines that a detectable object is present at a position on the detection area corresponding to the sensor pixel when the number of times a value calculated based on the sensor value consecutively becomes equal to or greater than a judgment threshold is equal to or greater than a consecutive judgment count threshold set according to the received light intensity for each of the sensor pixels.

[0007] A detection device according to one embodiment of the present invention has a planar detection device including a plurality of light detection elements arranged in a planar shape, a light source device arranged opposite the planar detection device, and a translucent mounting substrate arranged between the planar detection device and the light source device and carrying a plurality of objects to be detected, wherein the planar detection device includes a detection area in which a plurality of sensor pixels including the light detection elements are arranged in a first direction and a second direction perpendicular to the first direction, a detection circuit that acquires a sensor value for each of the sensor pixels, and a control circuit that determines that a detectable object is present at a position on the detection area corresponding to the sensor pixel when a value calculated based on the sensor value becomes equal to or greater than a judgment threshold set according to the received light intensity for each of the sensor pixels. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a plan view illustrating a detection device according to an embodiment. [Diagram 2] FIG. 2 is a schematic cross-sectional view of the detection device according to the embodiment. [Diagram 3] FIG. 3 is a circuit diagram illustrating an optical sensor according to the embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of the configuration of a detection circuit according to the embodiment. [Diagram 5]FIG. 5 is a block diagram showing an example of the configuration of a control circuit according to the embodiment. [Figure 6A] FIG. 6A is an image diagram showing the received light intensity in the detection region in a heat map. [Figure 6B] FIG. 6B is an image diagram showing the correction coefficient for each sensor element in a heat map. [Figure 7] FIG. 7 is a flowchart showing a specific example of the detection process according to the first embodiment. [Figure 8] FIG. 8 is a sub-flowchart illustrating an example of the first process according to the first embodiment. [Figure 9A] FIG. 9A is a diagram showing the relationship between the received light intensity and the threshold value for the number of consecutive colony determinations. [Figure 9B] FIG. 9B is an image diagram showing the colony successive determination count threshold value for each sensor element in a heat map. [Figure 10] FIG. 10 is a sub-flowchart illustrating an example of the second process according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a binarized colony formation image. [Figure 12] FIG. 12 is a diagram showing a first example of colony determination timing in the detection process according to the first embodiment. [Figure 13] FIG. 13 is a diagram showing a second example of colony determination timing in the detection process according to the first embodiment. [Figure 14] FIG. 14 is a flowchart showing a specific example of the detection process according to the second embodiment. [Figure 15] FIG. 15 is a sub-flowchart illustrating an example of the first process according to the second embodiment. [Figure 16A] FIG. 16A is a diagram showing the relationship between the received light intensity and the detection threshold. [Figure 16B] FIG. 16B is an image diagram showing the detection threshold for each sensor element in a heat map. [Figure 17] FIG. 17 is a sub-flowchart illustrating an example of the second process according to the second embodiment. [Figure 18]FIG. 18 is a diagram showing a first example of colony determination timing in the detection process according to the second embodiment. [Figure 19] FIG. 19 is a diagram showing a second example of colony determination timing in the detection process according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The form (embodiment) for carrying out the present invention will be described in detail with reference to the drawings. The present disclosure is not limited by the contents described in the following embodiments. The components described below include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the components described below can be appropriately combined. Note that the disclosure is merely an example, and those that a person skilled in the art can easily imagine appropriate modifications while maintaining the gist of the present disclosure are naturally included in the scope of the present disclosure. In addition, in order to make the explanation clearer, the drawings may be schematic in terms of the width, thickness, shape, etc. of each part compared to the actual embodiment, but they are merely examples and do not limit the interpretation of the present disclosure. In addition, in this disclosure and each figure, elements similar to those described above with respect to the previously mentioned figures may be given the same reference numerals, and detailed explanations may be omitted as appropriate.

[0010] In this specification and the claims, when expressing an aspect of arranging another structure on top of a certain structure, the term "on top" is used, unless otherwise specified, to include both a case in which another structure is arranged directly on top of a certain structure so as to be in contact with the certain structure, and a case in which another structure is arranged above a certain structure via yet another structure.

[0011] Fig. 1 is a plan view showing a detection device according to an embodiment. Fig. 2 is a schematic cross-sectional view of the detection device according to an embodiment. In the present disclosure, the detection device 1 is a so-called biosensor that detects a minute object such as bacteria as a detection target 100. The detection device 1 includes an optical sensor 10, a detection circuit 11, a control circuit 70, and a light source device 80.

[0012] The optical sensor 10 is a planar detection device including a plurality of photodiodes (photodetection elements) 30 arranged in a planar shape. The optical sensor 10 has a detection area AA in which a plurality of sensor pixels 3 are provided on an array substrate 2 formed using a substrate 21 as a base. In the present disclosure, the planar detection device includes the optical sensor 10, a detection circuit 11, and a control circuit 70.

[0013] The first direction Dx is a direction in a plane parallel to the substrate 21. The second direction Dy is a direction in a plane parallel to the substrate 21, and is a direction perpendicular to the first direction Dx. The third direction Dz is a direction perpendicular to the first direction Dx and the second direction Dy, and is a normal direction to the main surface of the substrate 21. In addition, "planar view" refers to the positional relationship when viewed from a direction perpendicular to the substrate 21.

[0014] The optical sensor 10 is a planar detection device including a plurality of photodiodes (photodetection elements) 30 arranged in a planar shape. Specifically, the plurality of sensor pixels 3 are arranged in a matrix shape aligned in the first direction Dx and the second direction Dy. However, the present invention is not limited to this, and the plurality of sensor pixels 3 may be arranged in a staggered shape in the detection area AA.

[0015] Each of the sensor pixels 3 is an optical sensor having a photodiode 30 as a light detection element. The photodiode 30 outputs an electric signal (electric potential) according to the light irradiated thereon. More specifically, the photodiode 30 is an OPD (Organic Photodiode) or a PIN (Positive Intrinsic Negative) photodiode using an organic semiconductor.

[0016] The light source device 80 has light emitting elements 82 provided on a light source substrate 81 that is provided facing the array substrate 2 of the optical sensor 10 in the third direction Dz. The light emitting elements 82 are formed of, for example, light emitting diodes (LEDs). Fig. 2 illustrates an example in which a plurality of light emitting elements 82 are provided in an area corresponding to the detection area AA of the optical sensor 10.

[0017] In the present disclosure, the detection device 1 includes a mounting substrate 101 and a cover member 103 for mounting the detection object 100. The mounting substrate 101 and the cover member 103 are light-transmitting plate-like members made of, for example, glass. Specifically, the mounting substrate 101 and the cover member 103 are, for example, petri dishes.

[0018] The object to be detected 100 is cultured in a culture medium 102 provided on a mounting substrate 101. The object to be detected 100 is disposed between the optical sensor 10 and the light source device 80, with a cover member 103 provided on the mounting substrate 101. More specifically, the detection device 1 is disposed above the optical sensor 10, with the mounting substrate 101, the cover member 103 (object to be detected 100), and the light source device 80 being disposed in this order.

[0019] Light L emitted from the light emitting element 82 is transmitted through the mounting substrate 101, the culture medium 102, and the cover member 103, and is irradiated onto the detection area AA. The intensity of light received by the sensor pixels 3 (hereinafter also referred to as "received light intensity") differs between the area overlapping with the detectable object 100 and the area not overlapping with the detectable object 100. The optical sensor 10 can capture an image of the colony (detectable object 100) on the culture medium 102 due to the difference in the received light intensity that differs for each sensor pixel 3.

[0020] In a peripheral area GA outside the detection area AA of the substrate 21, first gate line driving circuits 15AA and 15AB, second gate line driving circuits 15BA and 15BB, and a signal line selection circuit 16 are provided.

[0021] The first gate line driving circuits 15AA, 15AB are arranged to sandwich the detection area AA in the first direction Dx. The second gate line driving circuits 15BA, 15BB are arranged to sandwich the detection area AA in the first direction Dx. The signal line selection circuit 16 is provided between the detection area AA and the detection circuit 11 along a side of the detection area AA extending in the first direction Dx. The arrangement of the first gate line driving circuits 15AA, 15AB, the second gate line driving circuits 15BA, 15BB, and the signal line selection circuit 16 is not limited to this. Specifically, for example, the first gate line driving circuits 15AA, 15AB and the second gate line driving circuits 15BA, 15BB may be configured as one first gate line driving circuit and one second gate line driving circuit, respectively, and the first gate line driving circuit and the second gate line driving circuit may be arranged to sandwich the detection area AA in the first direction Dx.

[0022] Fig. 3 is a circuit diagram showing an optical sensor according to an embodiment. As shown in Fig. 3, the sensor pixel 3 has a photodiode 30, a reset transistor Mrst, a readout transistor Mrd, and a source follower transistor Msf. The sensor pixel 3 is also provided with a first gate line (reset control scanning line GLrst), a second gate line (readout control scanning line GLrd), and a signal line SL.

[0023] The first gate line (reset control scanning line GLrst), the second gate line (readout control scanning line GLrd), and the signal line SL are each connected to a plurality of sensor pixels 3 in the detection area AA. Specifically, the first gate line (reset control scanning line GLrst) and the second gate line (readout control scanning line GLrd) extend in a first direction Dx and are connected to a plurality of sensor pixels 3 arranged in the first direction Dx. Moreover, the signal line SL extends in a second direction Dy and is connected to a plurality of sensor pixels 3 arranged in the second direction Dy. The signal line SL is a wiring through which signals from a plurality of transistors (readout transistor Mrd and source follower transistor Msf) are output.

[0024] The reset transistor Mrst, the readout transistor Mrd, and the source follower transistor Msf are provided corresponding to one photodiode 30. Each of the multiple transistors in the sensor pixel 3 is configured with an n-type TFT (Thin Film Transistor). However, without being limited thereto, each transistor may be configured with a p-type TFT.

[0025] A reference potential Vcom is applied to the anode of the photodiode 30. The cathode of the photodiode 30 is connected to one of the source or drain of the reset transistor Mrst and the gate of the source follower transistor Msf.

[0026] The gate of the reset transistor Mrst is connected to a first gate line (reset control scanning line GLrst). A reset potential Vrst is supplied to the other of the source or drain of the reset transistor Mrst. When the reset transistor Mrst is turned on (conductive state), the cathode potential of the photodiode 30 is reset to the reset potential Vrst. The reference potential Vcom has a potential lower than the reset potential Vrst, and the photodiode 30 is reverse bias driven.

[0027] The source follower transistor Msf is connected between a terminal to which a power supply potential Vsf is supplied and the readout transistor Mrd. The gate of the source follower transistor Msf is connected to the cathode of the photodiode 30. A voltage corresponding to the intensity of light received by the photodiode 30 is supplied to the gate of the source follower transistor Msf. As a result, the source follower transistor Msf outputs an electric signal (electric potential) corresponding to the intensity of light received by the photodiode 30 to the readout transistor Mrd.

[0028] The readout transistor Mrd is connected between the source of the source follower transistor Msf and the signal line SL. The gate of the readout transistor Mrd is connected to a second gate line (readout control scanning line GLrd). When the readout transistor Mrd is turned on, a signal output from the source follower transistor Msf, i.e., an electric signal (electric potential) according to the light receiving intensity of the photodiode 30, is output to the output signal line SL as a detection signal Vdet.

[0029] 3, the reset transistor Mrst and the readout transistor Mrd each have a single gate structure, but the reset transistor Mrst and the readout transistor Mrd may each have a so-called double gate structure in which two transistors are connected in series, or may have a structure in which three or more transistors are connected in series. Also, the circuit of one sensor pixel 3 is not limited to a structure having three transistors, namely, the reset transistor Mrst, the source follower transistor Msf, and the readout transistor Mrd. The sensor pixel 3 may have two transistors, or may have four or more transistors.

[0030] The first gate line driving circuits 15AA and 15AB are circuits that drive a plurality of first gate lines (reset control scanning lines GLrst) in the detection area AA. The first gate line driving circuits 15AA and 15AB are, for example, shift register circuits.

[0031] In the present disclosure, the first gate line driving circuits 15AA and 15AB sequentially select the first gate lines (reset control scanning lines GLrst) based on various control signals such as a start pulse signal STV and a clock pulse signal supplied from the detection circuit 11, and supply a first gate driving signal (reset control signal) to the selected first gate line (reset control scanning line GLrsto). In other words, the first gate line driving circuits 15AA and 15AB simultaneously supply the first gate driving signal (reset control signal) to the sensor pixels 3 aligned in the first direction Dx, and sequentially supply the first gate driving signal (reset control signal) to the sensor pixels 3 aligned in the second direction Dy. This resets the potentials of the photodiodes 30 of the multiple sensor pixels 3 connected to the first gate lines (reset control scanning lines GLrsto) selected by the first gate line driving circuits 15AA and 15AB of the sensor pixels 3.

[0032] The second gate line driving circuits 15BA and 15BB are circuits that drive a plurality of second gate lines (read control scanning lines GLrd) in the detection area AA. The second gate line driving circuits 15BA and 15BB are, for example, shift register circuits.

[0033] In the present disclosure, the second gate line driving circuits 15BA and 15BB sequentially select the second gate lines (read control scanning lines GLrd) based on various control signals such as a start pulse signal STV and a clock pulse signal supplied from the detection circuit 11, and supply the second gate driving signal (read control signal) to the selected second gate line (read control scanning line GLrd). In other words, the second gate line driving circuits 15BA and 15BB simultaneously supply the second gate driving signal (read control signal) to the sensor pixels 3 aligned in the first direction Dx, and sequentially supply the second gate driving signal (read control signal) to the sensor pixels 3 aligned in the second direction Dy. As a result, the electric signals (electric potentials) of the multiple sensor pixels 3 connected to the second gate line (read control scanning line GLrd) selected by the second gate line driving circuits 15BA and 15BB are read out as the detection signal Vdet.

[0034] The signal line selection circuit 16 is a switch circuit that selects one of the multiple signal lines SL and connects it to the detection circuit 11. The signal line selection circuit 16 is, for example, a multiplexer.

[0035] 4 is a block diagram showing an example of the configuration of a detection circuit according to an embodiment. The detection circuit 11 generates a sensor value Raw, which is a detection value of each sensor pixel 3, based on a detection signal Vdet output from the optical sensor 10. The detection circuit 11 is, for example, a ROIC (Read Out Integrated Circuit) including an analog front-end circuit (AFE: Analog Front End).

[0036] As shown in FIG. 4, the detection circuit 11 includes a detection signal amplitude adjustment circuit 41, an A / D conversion circuit 42, a signal processing circuit 43, a buffer circuit 44, and a detection timing control circuit 45.

[0037] The detection signal amplitude adjustment circuit 41 is a circuit that adjusts the amplitude of the detection signal Vdet output from the optical sensor 10, and is configured to include, for example, an amplifier. The A / D conversion circuit 42 converts the analog signal output from the detection signal amplitude adjustment circuit 41 into a digital signal. The signal processing circuit 43 processes the digital signal from the A / D conversion circuit 42, and stores the sensor value Raw for each sensor pixel 3 in a buffer circuit 44. More specifically, the signal processing circuit 43 sets the difference value between the detection value acquired during the reset period of the sensor pixel 3 and the detection value acquired during the readout period as the sensor value Raw for each sensor pixel 3.

[0038] The detection timing control circuit 45 controls the detection signal amplitude adjustment circuit 41, the A / D conversion circuit 42, the signal processing circuit 43, and the buffer circuit 44 to operate in synchronization based on various control signals supplied from the control circuit 70 (see FIG. 5). The sensor value Raw of each sensor pixel 3 stored in the buffer circuit 44 is transmitted to the control circuit 70 based on a read control signal from the control circuit 70.

[0039] The detection timing control circuit 45 is a circuit that supplies control signals to the first gate line driving circuits 15AA, 15AB, the second gate line driving circuits 15BA, 15BB, and the signal line selection circuit 16, respectively, and controls their operations to perform detection operations in the detection area AA. The detection timing control circuit 45 supplies various control signals, such as a start pulse signal and a clock pulse signal, to the first gate line driving circuits 15AA, 15AB and the second gate line driving circuits 15BA, 15BB. The detection timing control circuit 45 also supplies a signal line selection signal to the signal line selection circuit 16.

[0040] 5 is a block diagram showing an example of the configuration of a control circuit according to an embodiment. The control circuit 70 synchronously controls the detection operation of the detection circuit 11 for the object 100 to be detected and the lighting operation of the light emitting element 82 in the light source device 80. The control circuit 70 is composed of, for example, an MCU (Micro Control Unit), RAM, EEPROM, ROM, etc.

[0041] Signal transmission between the control circuit 70 and the detection circuit 11 and the light source device 80 is performed, for example, by SPI (Serial Peripheral Interface), which is a clock-synchronized serial interface. The present disclosure is not limited by the signal transmission method between the control circuit 70 and the optical sensor 10 and the light source device 80.

[0042] As shown in FIG. 5, the control circuit 70 includes a data acquisition circuit 71, a data storage circuit 72, a data processing circuit 73, an image generation circuit 74, and a light source control circuit 75.

[0043] The data acquisition circuit 71 transmits a read control signal to the detection circuit 11, acquires a raw sensor value for each sensor pixel 3, and stores the raw sensor value in a data storage circuit 72 in association with position information of the sensor pixel 3 in the detection area AA. The data processing circuit 73 performs a correction process on the raw sensor value for each sensor pixel 3 stored in the data storage circuit 72. The image generation circuit 74 binarizes the corrected value after the correction process and generates an image of colony formation on the culture medium 102.

[0044] The light source control circuit 75 controls the lighting operation of the light emitting elements 82 in synchronization with the detection operation in the detection circuit 11. Specifically, when the light source device 80 has a plurality of light emitting elements 82, the light source control circuit 75 stores information on the lighting pattern of the plurality of light emitting elements 85, that is, on (lighted) and off (not lit), and transmits to the light source device 80 a light emission control signal corresponding to the lighting pattern information.

[0045] The intensity of the amount of light received by the sensor pixels 3 in the detection area AA (hereinafter also referred to as "received light intensity") varies depending on the relative positional relationship with the light-emitting element 82. Specifically, the received light intensity of the sensor pixels 3 located away from the light-emitting element 82 is relatively small compared to the received light intensity of the sensor pixels 3 located directly below the light-emitting element 82.

[0046] Fig. 6A is an image diagram showing the received light intensity in the detection area in a heat map. Fig. 6A illustrates an embodiment in which one light emitting element 82 is provided at a position on a light source substrate 81 corresponding to the center of the detection area AA, and shows an example in which a sensor value Raw(p) (p is an integer from 1 to P, P is the total number of sensor pixels 3 in the detection area AA (in the example shown in Fig. 6A, P = 11 × 11 = 121)) corresponding to the sensor pixel 3 in the detection area AA is normalized by the maximum value of the sensor value Raw in the detection area AA (for example, the sensor value of the sensor pixel located at the center of the detection area AA) Raw_max, and the received light intensity Li(p) of each sensor pixel 3 is set. In this case, the received light intensity Li is large at the center of the detection area AA, and is small at the periphery of the detection area AA.

[0047] The reciprocal Raw(p) of the sensor value Raw(p) for each sensor pixel 3 acquired in the initial state where no colonies are formed on the medium 102 -1 is stored as the correction coefficient Cf(p) for each sensor pixel 3 (Cf(p)=Raw(p) -1 ), and a colony formation image may be generated by applying a correction value Cor(p) (=Raw(p)×Cf(p)) obtained by multiplying the correction coefficient Cf(p) by the sensor value Raw(p).

[0048] Fig. 6B is an image diagram showing the correction coefficient for each sensor pixel in a heat map. The correction coefficient Cf(p) for each sensor pixel 3 shown in Fig. 6B illustrates the reciprocal of the received light intensity Li(p) (∝Raw(p)) of each sensor pixel 3 shown in Fig. 6A.

[0049] Here, the sensor value of the sensor pixel 3 with a low light receiving intensity has a relatively large ratio of noise components derived from the system that do not depend on the light receiving intensity. Also, the correction coefficient multiplied by the sensor value of the sensor pixel 3 with a low light receiving intensity is relatively large. Therefore, the noise components derived from the system are amplified, which may cause erroneous detection.

[0050] Hereinafter, a specific example of the detection process of each embodiment capable of suppressing noise components originating from the system in the detection device 1 having the above-described configuration will be described.

[0051] (Embodiment 1) Fig. 7 is a flowchart showing a specific example of the detection process according to the first embodiment. Fig. 8 is a sub-flowchart showing an example of the first process according to the first embodiment. Fig. 9A is a diagram showing the relationship between the received light intensity and the consecutive colony determination count threshold. Fig. 9B is an image diagram showing the consecutive colony determination count threshold for each sensor element in a heat map. Fig. 10 is a sub-flowchart showing an example of the second process according to the first embodiment.

[0052] In the first embodiment, when a judgment value (Diff(p) shown in FIG. 10) corresponding to the correction value Cor(p) of the sensor pixel 3 exceeds a judgment threshold (Diff_th shown in FIG. 10) several times in succession, the position on the culture medium 102 corresponding to the sensor pixel 3 is judged as a colony, and an embodiment is described in which the influence of noise components derived from the system can be suppressed by varying a consecutive colony judgment count threshold (CEC_th shown in FIG. 9A) according to the received light intensity Li.

[0053] In the first embodiment, the relationship between the received light intensity Li and the consecutive colony determination count threshold CEC_th shown in Fig. 9A is stored in advance as, for example, a conversion table in the data storage circuit 72. Fig. 9A illustrates an example in which the consecutive colony determination count threshold CEC_th is set to "1" for the sensor pixel 3 with the received light intensity Li in the range of "0.8 to 1", and the consecutive colony determination count threshold CEC_th is set to "10" for the sensor pixel 3 with the received light intensity Li of "0.6" shown in Fig. 6A (see Fig. 9B).

[0054] The optimal value of the consecutive colony determination count threshold CEC_th varies depending on the noise level derived from the system and the range of the light receiving intensity Li in the detection area AA. Specifically, the consecutive colony determination count threshold CEC_th may be set to be smaller for a sensor pixel 3 having a larger light receiving intensity Li and to be larger for a sensor pixel 3 having a smaller light receiving intensity Li.

[0055] 7, the detection device 1 executes the process of acquiring the raw sensor value at intervals of, for example, 5 minutes. In other words, the period for acquiring the sensor value for one frame in the detection device 1 is, for example, 5 minutes (300 s).

[0056] 7 (step S100) is a process that is executed in a state where no colony is formed on the culture medium 102. More specifically, in the first process, a correction coefficient and a colony consecutive determination count threshold are set for each sensor pixel 3 based on the sensor value acquired in the sensor value acquisition process of the first frame in the detection process according to the first embodiment.

[0057] In the first process shown in FIG. 8, the detection circuit 11 acquires the sensor value Raw(p) of each sensor pixel 3 (step S101).

[0058] The data processing circuit 73 performs an inverse calculation process on the sensor value Raw(p) to calculate the correction coefficient Cf(p) for each sensor pixel 3 (step S102).

[0059] Next, the data processing circuit 73 normalizes the sensor value Raw(p) by the maximum value Raw_max of the sensor values ​​within the detection area AA (Li(p)=Raw(p) / Raw_max) to calculate the received light intensity Li(p) of each sensor pixel 3 (step S103), reads out the consecutive colony determination count threshold CEC_th corresponding to the calculated received light intensity Li(p) from the conversion table shown in FIG. 9A, and sets it as the consecutive colony determination count threshold CEC_th(p) for each sensor pixel 3 (step S104).

[0060] The second process (step S200) shown in Fig. 7 is a process executed in the colony formation process. Specifically, in the second process, after the first process shown in Fig. 8, the correction coefficient Cf(p) and the colony continuous determination count threshold CEC_th(p) for each sensor pixel 3 set in the first process are applied to the sensor values ​​acquired in the sensor value acquisition process for the second frame and thereafter to generate a colony formation image on the culture medium 102.

[0061] In the second process shown in FIG. 10, the detection circuit 11 acquires the sensor value Raw(p) of each sensor pixel 3 (step S201).

[0062] The data processing circuit 73 executes a correction process for the sensor value Raw(p) (step S202). Specifically, the data processing circuit 73 multiplies the sensor value Raw(p) by a correction coefficient Cf(p) to calculate a correction value Cor(p) for each sensor pixel 3.

[0063] Next, the data processing circuit 73 subtracts the correction value Cor(p) from 1 to calculate a judgment value Diff(p) for each sensor pixel 3 (step S203), and performs threshold judgment processing between the judgment value Diff(p) for each sensor pixel 3 and the judgment threshold Diff_th (step S204).

[0064] When the determination value Diff(p) is greater than or equal to the determination threshold Diff_th (Diff(p) ≥ Diff_th, step S204; Yes), the data processing circuit 73 increments the colony continuous determination count CEC(p) (CEC(p) = CEC(p) + 1, step S205) and performs a threshold determination process (step S207) between the colony continuous determination count CEC(p) and the colony continuous determination count threshold CEC_th(p) for each sensor pixel 3.

[0065] When the determination value Diff(p) is less than the determination threshold Diff_th (Diff(p) < Diff_th, step S204; No), the data processing circuit 73 resets the colony continuous determination count CEC(p) (CEC(p) = 0, step S206) and performs a threshold determination process (step S207) between the colony continuous determination count CEC(p) and the colony continuous determination count threshold CEC_th(p) for each sensor pixel 3.

[0066] When the colony continuous determination count CEC(p) is greater than or equal to the colony continuous determination count threshold CEC_th(p) (CEC(p) ≥ CEC_th(p), step S207; Yes), the data processing circuit 73 sets the binarized data Dbin(p) for each sensor pixel 3 to "1" (Dbin(p) = 1, step S208) and stores it in the data storage circuit 72.

[0067] When the colony continuous determination count CEC(p) is less than the colony continuous determination count threshold CEC_th(p) (CEC(p) < CEC_th(p), step S207; No), the data processing circuit 73 sets the binarized data Dbin(p) for each sensor pixel 3 to "0" (Dbin(p) = 0, step S209) and stores it in the data storage circuit 72.

[0068] In this embodiment, the determination threshold Diff_th is stored in the data storage circuit 72 in advance. Specifically, taking the determination value Diff_sat in the state where colony formation is saturated as "0.65", the determination threshold Diff_th is, for example, set to "0.15".

[0069] The image generating circuit 74 reads out the binarized data Dbin(p) for each sensor pixel 3 stored in the data storage circuit 72, and generates a binarized colony formation image (step S210).

[0070] After generating the colony formation image (step S210), the detection device 1 returns to step S201 and repeatedly executes the second process shown in Fig. 10. This makes it possible to obtain the colony formation process on the medium 102 as an image.

[0071] Fig. 11 is a diagram showing an example of a binarized colony formation image, in which a position on the medium 102 corresponding to a sensor pixel 3 with binarized data Dbin(p) of "1" is determined to be a colony.

[0072] Fig. 12 is a diagram showing a first example of colony determination timing by the detection process according to embodiment 1. Fig. 13 is a diagram showing a second example of colony determination timing by the detection process according to embodiment 1.

[0073] Fig. 12 shows the change in the determination value of the sensor pixel 3 in the center of the detection area AA shown in Fig. 6A. Fig. 13 shows the change in the determination value of the sensor pixel 3 in the peripheral part of the detection area AA shown in Fig. 6A.

[0074] In the sensor pixel 3 at the center of the detection area AA where the received light intensity Li is large, the consecutive colony determination count threshold CEC_th(p) is set to 1. Fig. 12 shows an example in which the determination value Diff(p) is equal to or larger than the determination threshold Diff_th in frame A (Diff(p) ≥ Diff_th, step S204; Yes), and further, the consecutive colony determination count CEC(p) is equal to or larger than the consecutive colony determination count threshold CEC_th(p) (CEC(p) ≥ CEC_th(p), step S207; Yes).

[0075] The consecutive colony determination count threshold CEC_th(p) of the sensor pixels 3 in the peripheral portion of the detection area AA where the received light intensity Li is small is set to a value larger than the consecutive colony determination count threshold CEC_th(p) (=1) of the sensor pixels 3 in the center of the detection area AA where the received light intensity Li is large. Fig. 12 shows an example in which the determination value Diff(p) is equal to or larger than the determination threshold Diff_th in frame B (Diff(p) ≥ Diff_th, step S204; Yes), and the determination value Diff(p) is equal to or larger than the determination threshold Diff_th continuously from frame B to frame C (CEC(p) ≥ CEC_th(p, step S207; Yes).

[0076] In the sensor pixels 3 in the peripheral portion of the detection area AA where the received light intensity Li is small, the correction coefficient Cf(p) by which the sensor value Raw(p) is multiplied in the correction process of step S202 becomes large. As a result, the noise components derived from the system become large in the correction value Cor(p) after the correction process. Therefore, if the same colony continuous determination count threshold CEC_th(p) (=1) as that of the sensor pixel 3 in the center of the detection area AA where the received light intensity Li is large is set, there is a possibility that the position on the medium 102 corresponding to the sensor pixel 3 in question will be erroneously determined as a colony.

[0077] In the detection process according to the above-described first embodiment, by setting an appropriate colony consecutive determination count threshold CEC_th(p) according to the received light intensity Li, it is possible to prevent noise components originating from the system from being erroneously determined as a colony.

[0078] (Embodiment 2) Fig. 14 is a flowchart showing a specific example of the detection process according to the second embodiment. Fig. 15 is a sub-flowchart showing an example of the first process according to the second embodiment. Fig. 16A is a diagram showing the relationship between the received light intensity and the detection threshold. Fig. 16B is an image diagram showing the detection threshold for each sensor element in a heat map. Fig. 17 is a sub-flowchart showing an example of the second process according to the second embodiment.

[0079] In the second embodiment, when a judgment value (Diff(p) shown in FIG. 17) corresponding to the correction value Cor(p) of the sensor pixel 3 exceeds a judgment threshold (Diff_th(p) shown in FIG. 17) set for each sensor pixel 3, the position on the culture medium 102 corresponding to the sensor pixel 3 is judged to be a colony, and an embodiment is described in which the influence of noise components derived from the system can be suppressed by varying the judgment threshold (Diff_th shown in FIG. 16A) according to the received light intensity Li.

[0080] In the second embodiment, the relationship between the received light intensity Li and the determination threshold Diff_th shown in Fig. 16A is stored in advance as, for example, a conversion table in the data storage circuit 72. Fig. 16A illustrates an example in which the determination threshold Diff_th is set to "0.15" for the sensor pixel 3 with the received light intensity Li in the range of "0.8 to 1", and the determination threshold Diff_th is set to "0.45" for the sensor pixel 3 with the received light intensity Li of "0.6" shown in Fig. 6A (see Fig. 16B).

[0081] The optimal value of the determination threshold Diff_th varies depending on the noise level caused by the system and the range of the received light intensity Li within the detection area AA. Specifically, the determination threshold Diff_th may be set to be smaller for the sensor pixel 3 having a larger received light intensity Li and to be larger for the sensor pixel 3 having a smaller received light intensity Li.

[0082] 14, the detection device 1 executes the process of acquiring the raw sensor value at intervals of, for example, 5 minutes. In other words, the period for acquiring the sensor value for one frame in the detection device 1 is, for example, 5 minutes (300 s).

[0083] 14 (step S300) is a process executed in a state where no colony is formed on the culture medium 102. More specifically, in the first process, a correction coefficient and a colony consecutive determination count threshold are set for each sensor pixel 3 based on the sensor value acquired in the sensor value acquisition process of the first frame in the detection process according to the second embodiment.

[0084] In the first process shown in FIG. 15, the detection circuit 11 acquires the sensor value Raw(p) of each sensor pixel 3 (step S301).

[0085] The data processing circuit 73 performs an inverse calculation process on the sensor value Raw(p) to calculate the correction coefficient Cf(p) for each sensor pixel 3 (step S302).

[0086] Next, the data processing circuit 73 normalizes the sensor value Raw(p) by the maximum value Raw_max of the sensor value Raw in the detection area AA (Li(p)=Raw(p) / Raw_max) to calculate the light receiving intensity Li(p) of each sensor pixel 3 (step S303), reads out the judgment threshold Diff_th corresponding to the calculated light receiving intensity Li(p) from the conversion table shown in FIG. 16A, and sets it as the judgment threshold Diff_th(p) for each sensor pixel 3 (step S304).

[0087] The second process (step S400) shown in Fig. 14 is a process executed in the colony formation process. Specifically, in the second process, after the first process shown in Fig. 15, the correction coefficient Cf(p) and the judgment threshold Diff_th(p) for each sensor pixel 3 set in the first process are applied to the sensor values ​​acquired in the sensor value acquisition process for the second frame and thereafter to generate a colony formation image on the culture medium 102.

[0088] In the second process shown in FIG. 17, the detection circuit 11 acquires the sensor value Raw(p) of each sensor pixel 3 (step S401).

[0089] The data processing circuit 73 executes a correction process for the sensor value Raw(p) (step S402). Specifically, the data processing circuit 73 multiplies the sensor value Raw(p) by a correction coefficient Cf(p) to calculate a correction value Cor(p) for each sensor pixel 3.

[0090] Subsequently, the data processing circuit 73 subtracts 1 from the correction value Cor(p) to calculate the determination value Diff(p) for each sensor pixel 3 (step S403), and executes a threshold determination process between the determination value Diff(p) for each sensor pixel 3 and the determination threshold Diff_th(p) for each sensor pixel 3 (step S404).

[0091] When the determination value Diff(p) is greater than or equal to the determination threshold Diff_th(p) (Diff(p)≥Diff_th(p), step S404; Yes), the data processing circuit 73 sets the binarized data Dbin(p) for each sensor pixel 3 to "1" (Dbin(p)=1, step S405), and stores it in the data storage circuit 72.

[0092] When the determination value Diff(p) is less than the determination threshold Diff_th(p) (Diff(p)<Diff_th, step S404; No), the data processing circuit 73 sets the binarized data Dbin(p) for each sensor pixel 3 to "0" (Dbin(p)=0, step S406), and stores it in the data storage circuit 72.

[0093] The image generation circuit 74 reads out the binarized data Dbin(p) for each sensor pixel 3 stored in the data storage circuit 72, and generates a binarized colony formation image (step S407).

[0094] After generating the colony formation image (step S407), the detection device 1 returns to step S401 and repeatedly executes the second process shown in FIG. 16. Thereby, the colony formation process on the culture medium 102 can be acquired as an image.

[0095] FIG. 18 is a diagram showing a first example of colony determination timing by the detection process according to Embodiment 2. FIG. 19 is a diagram showing a second example of colony determination timing by the detection process according to Embodiment 2.

[0096] Fig. 18 shows the change in the determination value of the sensor pixel 3 in the center of the detection area AA shown in Fig. 6A. Fig. 19 shows the change in the determination value of the sensor pixel 3 in the peripheral part of the detection area AA shown in Fig. 6A.

[0097] In the sensor pixel 3 at the center of the detection area AA where the received light intensity Li is large, the judgment threshold is set to "0.15" (Diff_th(a) = 0.15). Fig. 18 shows an example where the judgment value in frame A is equal to or greater than the judgment threshold (=Diff_th(a)).

[0098] The judgment threshold Diff_th(b) of the sensor pixels 3 in the peripheral portion of the detection area AA, where the received light intensity Li is small, is set to a value larger than the judgment threshold Diff_th(a) of the sensor pixels 3 in the center of the detection area AA, where the received light intensity Li is large, as shown in Fig. 19. Fig. 19 shows an example in which the judgment value in frame B is equal to or larger than the judgment threshold (=Diff_th(b)).

[0099] In the sensor pixels 3 in the peripheral portion of the detection area AA where the received light intensity Li is small, the correction coefficient Cf(p) by which the sensor value Raw(p) is multiplied in the correction process of step S202 becomes large. As a result, the noise components derived from the system become large in the correction value Cor(p) after the correction process. Therefore, as shown in FIG. 19, if the same judgment threshold (=Diff_th(a)) is used as that of the sensor pixel 3 in the center of the detection area AA where the received light intensity Li is large, the position on the medium 102 corresponding to the sensor pixel 3 may be erroneously determined as a colony.

[0100] In the detection process according to the second embodiment, as described above, in the sensor pixels 3 in the peripheral parts of the detection area AA where the received light intensity Li is small, a judgment threshold Diff_th(b) is set that is larger than the judgment threshold Diff_th(a) of the sensor pixels 3 in the center part of the detection area AA where the received light intensity Li is large. The difference between the judgment threshold Diff_th(b) and the judgment threshold Diff_th(a) is set to be equal to or larger than the difference between the peak value of the noise component derived from the system superimposed on the judgment value Diff(b) of the sensor pixels 3 in the peripheral parts of the detection area AA where the received light intensity Li is small, and the peak value of the noise component derived from the system superimposed on the judgment value Diff(a) of the sensor pixels 3 in the center part of the detection area AA where the received light intensity Li is large. In other words, the judgment threshold Diff_th(p) is set to be a value higher than the peak value of the noise assumed in the received light intensity Li. Alternatively, the judgment threshold Diff_th(p) is set to be a value that is inflated by the amount of the noise assumed in the received light intensity Li. This makes it possible to suppress erroneous discrimination before colony generation due to the noise component derived from the system. In this way, by setting an appropriate determination threshold Diff_th(p) according to the received light intensity Li, it is possible to prevent noise components originating from the system from being erroneously determined as a colony.

[0101] It is also possible to combine the first embodiment with the second embodiment. Specifically, the determination threshold in the first embodiment may be such that a colony consecutive determination count threshold CEC_th(p) and a determination threshold Diff_th(p) are set according to the received light intensity Li(p) for each sensor pixel 3, and a colony is determined to be a colony when the consecutive colony determination count CEC(p) at which the determination value Diff(p) is equal to or greater than the determination threshold Diff_th(p) is equal to or greater than the consecutive colony determination count threshold CEC_th(p).

[0102] Although the preferred embodiment of the present invention has been described above, the present invention is not limited to such an embodiment. The contents disclosed in the embodiment are merely examples, and various modifications are possible within the scope of the present invention. Appropriate modifications made within the scope of the present invention naturally belong to the technical scope of the present invention. At least one of various omissions, substitutions, and modifications of components can be made within the scope of the gist of each of the above-mentioned embodiments and each modified example. [Explanation of symbols]

[0103] 1. Detection device 2 Array Board 3 Sensor pixels 10 Optical sensors (surface detection devices) 11 Detection circuit 15AA, 15AB First gate line driving circuit 15BA, 15BB Second gate line driving circuit 16 Signal line selection circuit 21 Substrate 30 Photodiode (light detection element) 41 Detection signal amplitude adjustment circuit 42 A / D conversion circuit 43 Signal Processing Circuit 44 Buffer circuit 45 Detection timing control circuit 70 Control circuit 71 Data Acquisition Circuit 72 Data storage circuit 73 Data Processing Circuit 74 Image Generation Circuit 75 Light source control circuit 80 Light source device 81 Light source board 82 Light emitting element 100 Object to be detected 101 Mounting board 102 Culture medium 103 Cover member AA detection area

Claims

1. a surface detection device including a plurality of light detection elements arranged in a surface; a light source device disposed opposite the planar detection device; a light-transmitting mounting substrate disposed between the planar detection device and the light source device and carrying a plurality of objects to be detected; having The planar detection device is a detection region in which a plurality of sensor pixels including the light detection elements are arranged in a first direction and a second direction perpendicular to the first direction; A detection circuit for acquiring a sensor value for each of the sensor pixels; a control circuit that determines that an object to be detected is present at a position on a detection region corresponding to a sensor pixel when the number of times that a value calculated based on the sensor value is consecutively equal to or greater than a determination threshold is equal to or greater than a consecutive determination number threshold set in accordance with the light receiving intensity for the sensor pixel; Including, Detection device.

2. The control circuit includes: calculating a correction value for each sensor pixel by multiplying a correction coefficient corresponding to the received light intensity of the sensor pixel by the sensor value for each sensor pixel, and determining whether or not a detectable object is present at a position on the detection area corresponding to the sensor pixel based on the correction value; The detection device according to claim 1 .

3. The control circuit includes: when the number of times that a value obtained by subtracting a reference value for each sensor pixel from the correction value is consecutively equal to or greater than a judgment threshold is equal to or greater than the consecutive judgment number threshold, it is judged that a detectable object is present at a position on the detection area corresponding to the sensor pixel.

3. The detection device according to claim 2.

4. The consecutive determination count threshold is set for each of the sensor pixels.

4. A detection device according to claim 1.

5. The continuous determination number threshold is smaller for a sensor pixel having a larger received light intensity, and is larger for a sensor pixel having a smaller received light intensity.

5. The detection device according to claim 4.

6. The control circuit includes: A first process of setting a correction coefficient, a consecutive determination count threshold, and a reference value for each pixel; a second process for generating an image of the detection area; having 6. The detection device according to claim 5.

7. The control circuit includes: the inverse of the sensor value for each of the sensor pixels acquired in the first process is set as the correction coefficient.

7. The detection device according to claim 6.

8. The control circuit includes: multiplying the sensor value for each of the sensor pixels acquired in the first process by a correction coefficient for each of the sensor pixels to calculate the reference value; 7. The detection device according to claim 6.

9. The control circuit includes: a sensor value for each of the sensor pixels acquired in the first process is normalized to calculate a received light intensity for each of the sensor pixels; 7. The detection device according to claim 6.

10. a surface detection device including a plurality of light detection elements arranged in a surface; a light source device disposed opposite the planar detection device; a light-transmitting mounting substrate disposed between the planar detection device and the light source device and carrying a plurality of objects to be detected; having The planar detection device is a detection region in which a plurality of sensor pixels including the light detection elements are arranged in a first direction and a second direction perpendicular to the first direction; A detection circuit for acquiring a sensor value for each of the sensor pixels; a control circuit that determines that a detection target is present at a position on a detection region corresponding to a sensor pixel when a value calculated based on the sensor value becomes equal to or greater than a determination threshold value set in accordance with the light receiving intensity of the sensor pixel; and Including, Detection device.

11. The control circuit includes: calculating a correction value for each sensor pixel by multiplying a correction coefficient corresponding to the received light intensity of the sensor pixel by the sensor value for each sensor pixel, and determining whether or not a detectable object is present at a position on the detection area corresponding to the sensor pixel based on the correction value; 11. The detection device of claim 10.

12. The control circuit includes: when a value obtained by subtracting a reference value for each of the sensor pixels from the correction value is equal to or greater than the determination threshold value, it is determined that a detectable object is present at a position on the detection area corresponding to the sensor pixel.

3. The detection device according to claim 2.

13. The determination threshold is set for each of the sensor pixels. Detector device according to any one of claims 10 to 12.

14. The judgment threshold value is smaller for a sensor pixel having a larger received light intensity, and is larger for a sensor pixel having a smaller received light intensity.

14. The detection device according to claim 13.

15. The control circuit includes: a first process for setting a correction coefficient, a judgment threshold, and a reference value for each pixel; a second process for generating an image of the detection area; having 15. The detection device of claim 14.

16. The control circuit includes: the inverse of the sensor value for each of the sensor pixels acquired in the first process is set as the correction coefficient.

16. The detection device of claim 15.

17. The control circuit includes: multiplying the sensor value for each of the sensor pixels acquired in the first process by a correction coefficient for each of the sensor pixels to calculate the reference value; 16. The detection device of claim 15.

18. The control circuit includes: a sensor value for each of the sensor pixels acquired in the first process is normalized to calculate a received light intensity for each of the sensor pixels; 16. The detection device of claim 15.

Citation Information

Patent Citations

  • Method of distinguishing microorganisms

    JP2018033430A