Detection device and detection system

Abstract

To provide a detection device or the like capable of improving color detection accuracy.SOLUTION: A detection device comprises: a sensor unit which is equipped with a photodiode that detects light and generates an output corresponding to the intensity of the detected light; a detection circuit which acquires the output of the sensor unit; and a light source which emits three colors of light in a switchable manner. The detection circuit individually acquires the first output, second output, and third output being the outputs of each period in which one of the three colors of light is emitted. The detection circuit corrects at least two or more of the first output, second output, and third output on the basis of a correction coefficient derived so as to make the fourth output, fifth output, and sixth output equal to each other. The fourth output is the output when the sensor unit is directly irradiated with the first color of light from the light source. The fifth output is the output when the sensor unit is directly irradiated with the second color of light from the light source. The sixth output is the output when the sensor unit is directly irradiated with the third color of light from the light source.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present disclosure relates to detection devices and systems. [Background technology]

[0002] 2. Description of the Related Art There is known a detection device that enables detection of the state of a culture environment for biological tissues or microorganisms by an optical sensor (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-87005 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned detection device, by providing light sources of multiple colors and performing detection for each color of light, color information can be added to the detection result. However, the luminance of the light source may vary. Therefore, if detection is performed without taking into account such luminance variation, the color caused by the luminance variation will be reflected in the detection result, reducing the detection accuracy of the color of the biological tissue or culture environment of the microorganism to be detected.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and has an object to provide a detection device and a detection system that can further improve color detection accuracy. [Means for solving the problem]

[0006] A detection device according to one aspect of the present disclosure includes a sensor unit provided with a photodiode for detecting light and generating an output according to a level of detected light, a detection circuit for acquiring the output of the sensor unit, and a light source for switchably emitting light of a first color, light of a second color, and light of a third color, the detection circuit acquiring a first output, a second output, and a third output separately, the first output being an output of the sensor unit corresponding to a period during which the light of the first color is emitted, the second output being an output of the sensor unit corresponding to a period during which the light of the second color is emitted, and the third output being an output of the sensor unit corresponding to a period during which the light of the third color is emitted. the fourth output is an output of the sensor unit corresponding to a period during which light of the first color is emitted, the detection circuit corrects at least two of the first output, the second output, and the third output based on a correction coefficient derived so that the fourth output, the fifth output, and the sixth output are the same, the fourth output is an output when the sensor unit is directly irradiated with light of the first color from the light source, the fifth output is an output when the sensor unit is directly irradiated with light of the second color from the light source, and the sixth output is an output when the sensor unit is directly irradiated with light of the third color from the light source. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing the main components of the detection system. [Diagram 2] FIG. 2 is a diagram showing an example of the configuration of a detection area and a wiring area. [Diagram 3] FIG. 3 is a circuit diagram showing the circuit configuration of the sensor unit. [Figure 4] FIG. 4 is a schematic diagram showing an operational aspect of the detection system. [Diagram 5] FIG. 5 is a schematic diagram showing an example of the configuration of a light source. [Figure 6] FIG. 6 is a schematic diagram showing a lighting pattern of a light source during a sensor scan. [Figure 7] FIG. 7 is a graph showing an example in which the luminance distributions of the first light source, the second light source, and the third light source are different from each other. [Figure 8] FIG. 8 is a graph showing an example of signal intensity correction. [Figure 9] FIG. 9 is a graph showing another example of correction of signal intensity. [Figure 10] FIG. 10 is a schematic diagram showing a lighting pattern of a light source in a sensor scan for correcting a signal intensity. [Figure 11] FIG. 11 is a chart showing an example of a flow of lighting control of the first light source, the second light source, and the third light source during a sensor scan. [Figure 12] FIG. 12 is a flowchart showing a process flow relating to a sensor scan for correcting the signal intensity. [Figure 13] FIG. 13 is a flowchart showing a process flow relating to a sensor scan for a detection target. [Figure 14] FIG. 14 is a flowchart showing a process flow relating to a sensor scan for correcting the signal intensity. [Figure 15] FIG. 15 is a flowchart showing a process flow relating to a sensor scan for a detection target. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, each embodiment of the present disclosure will be described with reference to the drawings. Note that the disclosure is merely an example, and those who are skilled in the art can easily come up with appropriate modifications while maintaining the gist of the invention are naturally included in the scope of the present disclosure. In addition, in order to make the explanation clearer, the drawings may be schematic in terms of the width, thickness, shape, etc. of each part compared to the actual embodiment, but they are merely examples and do not limit the interpretation of the present disclosure. In addition, in this specification and each figure, elements similar to those described above with respect to the previous figures may be given the same reference numerals, and detailed explanations may be omitted as appropriate.

[0009] 1 is a diagram showing the main configuration of a detection system 1. The detection system 1 includes a detection device 60 and an information processing device 30. The detection device 60 includes a sensor panel 10 and a light source panel 20. The sensor panel 10 and the light source panel 20 of the detection system 1 are connected to the information processing device 30.

[0010] The sensor panel 10 has a detection area SA (see FIG. 2) provided on a substrate 11. A reset circuit 13, a scanning circuit 14, and a wiring area VA are also mounted on the substrate 11. The configuration on the detection area SA, the reset circuit 13, and the scanning circuit 14 are connected to a detection circuit 15 via the wiring area VA.

[0011] The light source panel 20 has a light emitting area LA that irradiates light onto the detection area SA. The light source panel 20 has a light source 22 provided on a substrate 21. The light source 22 has a light emitting element such as an LED (Light Emitting Diode) and is arranged within the light emitting area LA. In the example shown in FIG. 1, a plurality of light sources 22 are arranged in a matrix on the substrate 21.

[0012] The light source panel 20 is provided with a light source drive circuit 23. The light source drive circuit 23 controls whether each of the multiple light sources 22 is turned on and the luminance when turned on under the control of the information processing device 30. The multiple light sources 22 may be provided so that their light emission can be controlled individually, or may be provided so as to emit light collectively.

[0013] The information processing device 30 performs various controls related to the operation of the detection system 1. Specifically, the information processing device 30 is, for example, an information processing device corresponding to the configuration of the detection system 1. The information processing device 30 is connected to the detection circuit 15 via a connection means such as a wired, wireless, or mixed wired and wireless communication network, or a standardized interface, and obtains an output from the detection circuit 15. The information processing device 30 is also connected to the light source drive circuit 23 via the connection means, and performs processing related to the lighting of the light source 22, such as determining the lighting pattern of the light source 22.

[0014] Fig. 2 is a diagram showing an example of the configuration of the detection area SA and wiring area VA. A plurality of sensor units WA (Fig. 3) are provided in the detection area SA. In the embodiment, as shown in Fig. 2, the plurality of sensor units WA are arranged in a matrix along the first direction Dx and the second direction Dy. The first direction Dx and the second direction Dy are orthogonal. In the following description, the third direction Dz refers to a direction orthogonal to the first direction Dx and the second direction Dy.

[0015] The reset circuit 13 is connected to the reset signal transmission lines 51, 52, ..., 5n. Hereinafter, when the reset signal transmission line 5 is described, it refers to any one of the reset signal transmission lines 51, 52, ..., 5n. The reset signal transmission line 5 is wiring along the first direction Dx. In the example shown in FIG. 2, n reset signal transmission lines 5 are arranged in the second direction Dy. n is a natural number equal to or greater than 2. The n reset signal transmission lines 5 are connected to the reset circuit 13 at one end side in the first direction Dx.

[0016] The scanning circuit 14 is connected to the scanning lines 61, 62, . . . , 6n. Hereinafter, when a scanning line 6 is described, it refers to any one of the scanning lines 61, 62, . . . , 6n. The scanning lines 6 are wirings along the first direction Dx. In the example shown in FIG. 2, n scanning lines 6 are arranged in the second direction Dy. The n reset signal transmission lines 5 are connected to the scanning circuit 14 at the other end side in the first direction Dx.

[0017] 2, the reset signal transmission lines 5 and the scanning lines 6 are arranged alternately in the second direction Dy within the detection area SA. Note that, although the reset circuit 13 and the scanning circuit 14 illustrated in Fig. 1 and Fig. 2 are arranged at positions facing each other with the detection area SA in between, the layout of the reset circuit 13 and the scanning circuit 14 is not limited to this and can be changed as appropriate.

[0018] Furthermore, signal lines 71, 72, ..., 7m are provided within the detection area SA. Hereinafter, when the signal line 7 is described, it refers to any one of the signal lines 71, 72, ..., 7m. The signal line 7 is a wiring that extends along the second direction Dy.

[0019] 2, m signal lines 7 are arranged in a first direction Dx, where m is a natural number equal to or greater than 2. Each of the m signal lines 7 is connected at one end in the second direction Dy to one of a plurality of switches (for example, switch SW1, switch SW2, switch SW3, or switch SW4) included in the selector circuit 40.

[0020] The selector circuit 40 is provided in the wiring area VA. The selector circuit 40 has a plurality of switches. In the example shown in FIG. 2, the switches SW1, SW2, SW3, and SW4 are shown as the plurality of switches. The plurality of switches in one selector circuit 40 are turned ON (connected state) at different timings. Among the plurality of switches in one selector circuit 40, while one switch is ON (connected state), the other switches are OFF (disconnected state). The number of selector circuits 40 corresponds to the number (m) of signal lines 7. If the number of switches is p, the number of selector circuits 40 needs to be m / p. When there are a plurality of selector circuits 40, the plurality of selector circuits 40 are connected to the detection circuit 15 via individual wirings 401, 402, . . . , 40p.

[0021] Note that the connection between the signal line 7 and the detection circuit 15 via the selector circuit 40 is merely an example and is not limiting, and the signal line 7 may be directly connected to the detection circuit 15 individually within the wiring area VA. Within the wiring area VA, the reset circuit 13 is connected to the detection circuit 15 via a wiring 131. Within the wiring area VA, the scanning circuit 14 is connected to the detection circuit 15 via a wiring 141.

[0022] The detection circuit 15 is related to the detection of light by the PD82 (see FIG. 3) provided in the sensor unit WA, and controls the operation timing of the reset circuit 13 and the scanning circuit 14. In addition, an output from the sensor unit WA is input to the detection circuit 15. The detection circuit 15 converts the signal input from the sensor unit WA into data that can be interpreted by the information processing device 30, and outputs the data to the information processing device 30. In this embodiment, the detection circuit 15 is an MCU (Micro Controller Unit).

[0023] Fig. 3 is a circuit diagram showing the circuit configuration of the sensor unit WA. Note that the first direction Dx and the second direction Dy in Fig. 3 merely correspond to the directions of the reset signal transmission line 5, the scanning line 6, and the signal line 7, and do not strictly indicate the relative positional relationship of the circuit configuration in the sensor unit WA.

[0024] 3, the sensor unit WA includes a switching element 81, a PD 82, a transistor element 83, and a switching element 85. The PD 82 is a photodiode (PD: PhotoDiode). The switching elements 81 and 85 and the transistor element are MOSFETs (Metal Oxide Semiconductor Field Effect Transistors).

[0025] The gate of the switching element 81 is connected to the reset signal transmission line 5. A reset potential VReset is applied to one of the source or drain of the switching element 81. The cathode of PD82 and the gate of the transistor element 83 are connected to the other of the source or drain of the switching element 81. Hereinafter, when the connection part CP is described, it refers to the point where the other, that is, the cathode of PD82 and the gate of the transistor element 83 are connected. In addition, a reference potential VCOM is applied from the anode side of PD82. The potential difference between the reset potential VReset and the reference potential VCOM is predetermined, but the potentials of the reset potential VReset and the reference potential VCOM may be variable. Incidentally, the reset potential VReset is a potential higher than the reference potential VCOM.

[0026] An output source potential VPP2 is applied to the drain of the transistor element 83 functioning as a source follower. One of the source or drain of the switching element 85 is connected to the source of the transistor element 83. The other of the source or drain of the switching element 85 is connected to the signal line 7. The gate of the switching element 85 is connected to the scanning line 6.

[0027] The reset potential VReset, the reference potential VCOM, and the output source potential VPP2 are supplied to the sensor unit WA by the detection circuit 15 based on, for example, power supplied via a power supply circuit (not shown) connected to the detection circuit 15, but are not limited to this and can be changed as appropriate.

[0028] The output source potential VPP2 is determined in advance. The potential on the source side of the transistor element 83 is a potential that is lower than the output potential of the PD82 by the gate-source voltage (Vth) of the transistor element 83. In this case, the potential on the source side of the transistor element 83 depends on the reset potential VReset and the potential of the reference potential VCOM. The potential of the output of the PD82 depends on the photoelectromotive force generated by the PD82 in response to the light detected by the PD82 during the exposure period EX described later.

[0029] When the gate of the switching element 85 is turned ON by a signal provided from the scanning circuit 14 via the scanning line 6, the source and drain of the switching element 85 are connected. As a result, the signal (electric potential) transmitted to the switching element 85 via the transistor element 83 is transmitted to the signal line 7 through the switching element 85. In this manner, an output is generated from the sensor unit WA. Hereinafter, the term "scanning signal" refers to the signal (electric potential) provided from the scanning circuit 14 via the scanning line 6. The scanning circuit 14 is a circuit that outputs the scanning signal.

[0030] The output of one PD82 provided on one sensor unit WA corresponds to the intensity of light detected by that PD82 within a predetermined exposure period. The output of the PD82 is reset in response to a signal provided from the reset circuit 13 via a reset signal transmission line 5. When the gate of the switching element 81 is turned ON by the signal, the source-drain of the switching element 81 is connected. This resets the potential of the connection point CP to the reset potential VReset.

[0031] Next, the operation of the detection system 1 will be described with reference to FIG.

[0032] 4 is a schematic diagram showing an operating state of the detection system 1. In the detection system 1, the light source panel 20 and the sensor panel 10 are provided so as to face each other in the third direction Dz with the detection object SUB in between. The detection object SUB is, for example, a petri dish on which a medium such as an agar medium is formed, but is not limited thereto and may have another configuration that transmits light from the light source panel 20.

[0033] In the embodiment, a ray limiting member 50 is interposed between the detection object SUB and the sensor panel 10. The ray limiting member 50 is a member that limits the path of light that can reach the sensor panel 10 among the light LV irradiated from the light source panel 20 toward the sensor panel 10. Specifically, the ray limiting member 50 is, for example, a plate-shaped member with a plurality of through holes in the third direction Dz. The light that can pass through the ray limiting member 50 is limited to the light that passes through the through holes. The through holes correspond to the arrangement of the light sources 22 provided in the sensor panel 10. The through holes are provided so that each PD82 does not detect light from two or more light sources 22 at the same time. That is, in the embodiment, the light detected by one PD82 is light from one light source 22. Note that the through holes are not provided individually for each PD82, but are shared by multiple PD82. Therefore, the light from one light source 22 is shared by multiple PD82. The light LV is light R1, light G1, or light B1, which will be described later.

[0034] The object to be detected SUB is placed on the ray limiting member 50 and in the detection area SA. When the light source 22 is turned on, the light source panel 20 irradiates light from above the object to be detected SUB toward the sensor panel 10. Of the light emitted from the light source 22 and traveling toward the object to be detected SUB, the light that passes through the object to be detected SUB and the ray limiting member 50 is detected by the PD 82 (see FIGS. 3 and 4) in the detection area SA. Hereinafter, when the term "sensor scan" is used, it refers to a process in which the sensor panel 10 detects light from the light source panel 20 in a state in which the positional relationship between the light source panel 20, the object to be detected (for example, the object to be detected SUB), the ray limiting member 50, and the sensor panel 10 as shown in FIG. 4 is established.

[0035] In the embodiment, when the object to be detected SUB is interposed between the sensor panel 10 and the light source panel 20, a ray limiting member 50 is further interposed between the object to be detected SUB and the sensor panel 10; however, the ray limiting member 50 is not a required configuration, and other optical members that function in the same manner as the ray limiting member 50 may be adopted, or the ray limiting member 50 may be omitted.

[0036] 4, a sensor scan is performed by detecting light from the light source 22 with the PD 82. Hereinafter, the term "sensor scan" refers to a process of detecting light irradiated from the light source panel 20 with the sensor panel 10.

[0037] Fig. 5 is a schematic diagram showing a configuration example of the light source 22. As shown in Fig. 5, the light source 22 has a first light source 22R, a second light source 22G, and a third light source 22B. The first light source 22R, the second light source 22G, and the third light source 22B are light-emitting elements (e.g., LEDs) that emit light of different colors. In the embodiment, the first light source 22R emits red (R) light. The second light source 22G emits green (G) light. The third light source 22B emits blue (B) light.

[0038] 5, the longitudinal direction of the first light source 22R, the second light source 22G, and the third light source 22B is aligned along the second direction Dy, and the first light source 22R, the second light source 22G, and the third light source 22B are arranged in this order from one side to the other side in the first direction Dx, but this is an example of the form of the light source 22 and is not limited to this. The shapes of the first light source 22R, the second light source 22G, and the third light source 22B in the light source 22 from a planar viewpoint and the positional relationship between the first light source 22R, the second light source 22G, and the third light source 22B can be changed as appropriate.

[0039] Fig. 6 is a schematic diagram showing a lighting pattern of the light source 22 in a sensor scan. As described with reference to Fig. 4, when a detectable object SUB is located between the sensor panel 10 and the light source panel 20, the light from each of the first light source 22R, the second light source 22G, and the third light source 22B that reaches the sensor panel 10 corresponds to the color of the detectable object SUB.

[0040] For example, assume that the object SUB is a medium that has been colored purple by culturing microorganisms. In this case, as shown in "Lighting Pattern 1" in FIG. 6, a part of the light R1 irradiated from the first light source 22R toward the object SUB is reflected by the object SUB and scattered as light R2. In addition, a part of the light R1 travels as light R3 to the opposite side of the first light source 22R across the object SUB and reaches the sensor panel 10. In this case, as shown in "Lighting Pattern 3", a part of the light B1 irradiated from the third light source 22B toward the object SUB is reflected by the object SUB and scattered as light B2. In addition, a part of the light B1 travels as light B3 to the opposite side of the third light source 22B across the object SUB and reaches the sensor panel 10. On the other hand, in this case, as shown in "lighting pattern 2," most of the light G1 irradiated from the second light source 22G toward the detection object SUB is absorbed by the detection object SUB because the detection object SUB is purple, and does not substantially reach the sensor panel 10. In this way, of the light from each of the first light source 22R, the second light source 22G, and the third light source 22B, the light that reaches the sensor panel 10 corresponds to the color of the detection object SUB.

[0041] In the embodiment, the PD82 of the sensor unit WA detects the intensity of light, but does not identify the color of light. Therefore, in the embodiment, a period in which the first light source 22R is turned on as in "lighting pattern 1" shown in FIG. 6, a period in which the second light source 22G is turned on as in "lighting pattern 2", and a period in which the third light source 22B is turned on as in "lighting pattern 3" are individually provided, so that a detection result of light corresponding to the color of the object to be detected SUB is obtained. That is, in the embodiment, a sensor scan is performed in each of "lighting pattern 1", "lighting pattern 2", and "lighting pattern 3". Then, by integrating the results of these sensor scans, a sensor scan output including color information corresponding to the color of the object to be detected SUB is obtained. Hereinafter, when the term "data integration" is described, this refers to the integration of the results of the sensor scan to obtain a sensor scan output including color information corresponding to the color of the object to be detected SUB. In the data integration, a correction coefficient of the signal intensity described later is reflected.

[0042] In the example shown in FIG. 6, light reaches the sensor panel 10 in "lighting pattern 1" and "lighting pattern 3", but no light reaches the sensor panel 10 in "lighting pattern 2". This is merely an example, and does not indicate that this is necessarily the case for "lighting pattern 1", "lighting pattern 2", and "lighting pattern 3".

[0043] Here, if the first output is the output of the sensor unit WA corresponding to a period during which light of a first color (e.g., red (R)) is emitted, then "lighting pattern 1" shown in FIG. 6 indicates the lighting pattern of the light source 22 by which the first output can be obtained. If the second output is the output of the sensor unit WA corresponding to a period during which light of a second color (e.g., green (G)) is emitted, then "lighting pattern 2" shown in FIG. 6 indicates the lighting pattern of the light source 22 by which the second output can be obtained. If the third output is the output of the sensor unit WA corresponding to a period during which light of a third color (e.g., blue (B)) is emitted, then "lighting pattern 3" shown in FIG. 6 indicates the lighting pattern of the light source 22 by which the third output can be obtained.

[0044] As described with reference to FIG. 1, a plurality of light sources 22 are arranged in the light-emitting area LA. Also, as described with reference to FIG. 5, the light source 22 has a first light source 22R, a second light source 22G, and a third light source 22B. Therefore, in the embodiment, a plurality of the first light source 22R, the second light source 22G, and the third light source 22B are provided. Here, the luminance of the first light source 22R, the second light source 22G, and the third light source 22B of each light source 22 is not necessarily uniform. Due to individual differences as light-emitting elements of the first light source 22R, the second light source 22G, and the third light source 22B, differences may occur in the luminance of each of them.

[0045] Fig. 7 is a graph showing an example in which the luminance distributions of the first light source 22R, the second light source 22G, and the third light source 22B are different. "E1" among the coordinates of the detection area SA shown on the horizontal axis of the graphs shown in Figs. 7 to 9 indicates one end of the detection area SA along one of the first direction Dx and the second direction Dy. "E2" indicates the other end of the detection area SA along the one of them. The signal intensity shown on the vertical axis of the graphs shown in Figs. 7 to 9 indicates the degree of strength of the signal output according to the luminance of the light detected by the sensor unit WA provided at each coordinate.

[0046] Graph RP1 shown in FIG. 7 shows an example of the luminance distribution of light from the first light source 22R detected within the range from "E1" to "E2". Graph GP1 shows an example of the luminance distribution of light from the second light source 22G detected within the range from "E1" to "E2". Graph BP1 shows an example of the luminance distribution of light from the third light source 22B detected within the range from "E1" to "E2". In the following explanation, a case will be explained in which the graphs RP1, GP1, and BP1 are obtained in the embodiment. Of course, the actual luminance distributions of the first light source 22R, the second light source 22G, and the third light source 22B are not limited to the graphs RP1, GP1, and BP1.

[0047] As in graphs RP1, GP1, and BP1, if the luminance of each color varies depending on the coordinates, the coloring caused by the luminance variation will be reflected in the sensor scan output, not the color of the object SUB. Therefore, such luminance variation affects the accuracy of color reproduction in the sensor scan output. Therefore, in the embodiment, the signal intensity is corrected so that the luminance of the light from the first light source 22R, the luminance of the light from the second light source 22G, and the luminance of the light from the third light source 22B can be considered to be substantially the same, at least when viewed in coordinate units.

[0048] Fig. 8 is a graph showing an example of signal strength correction. In the example shown in Fig. 8, the output of the sensor unit WA at each coordinate provided in the detection area SA is corrected so as to be regarded as a fixed output value. Therefore, as shown in graphs RP2, GP2, and BP2 in Fig. 8, the signal strength becomes constant regardless of the coordinate.

[0049] 8 shows the signal intensity after correction corresponding to the graph RP1 which is the luminance distribution of the light from the first light source 22R. The graph GP2 shows the signal intensity after correction corresponding to the graph GP1 which is the luminance distribution of the light from the second light source 22G. The graph BP2 shows the signal intensity after correction corresponding to the graph BP1 which is the luminance distribution of the light from the third light source 22B.

[0050] If no correction is made, the distribution of signal strength output by the sensor unit WA at each coordinate set within the range from "E1" to "E2" reflects the graphs RP1, GP1, and BP1 as they are. Here, at coordinates where a graph RP1 lower than the graph RP2 as a determined signal strength is obtained, a correction is made to increase the signal strength to the graph RP2. Also, at coordinates where a graph RP1 higher than the graph RP2 is obtained, a correction is made to decrease the signal strength to the graph RP2. As a result, a sensor scan output with a signal strength of the graph RP2 can be obtained regardless of the coordinates. By reflecting the correction according to the relationship between the graphs RP1 and RP2 described above in the relationship between the graphs GP1 and GP2 and the relationship between the graphs BP1 and BP2, a sensor scan output with signal strengths of the graphs GP2 and RP2 can be obtained.

[0051] In Fig. 8, it appears as if graph RP2 is higher than graph GP2 and graph BP2, and graph GP2 is higher than graph BP2, but in reality, they are all the same. In Fig. 8, for the sake of convenience, graphs RP2, GP2, and BP2 are simply shown with different lines. The relationship between graphs RP1, GP3, and BP3 shown in Fig. 9, which will be described later, is similar to the relationship between graphs RP2, GP2, and BP2.

[0052] The signal strengths determined as graphs RP2, GP2, and BP2 may be fixed signal strengths, or may be signal strengths corresponding to the average value of one of graphs RP1, GP1, and BP1 (for example, graph RP1). By using signal strengths corresponding to the average values, the degree of correction can be made smaller.

[0053] Here, the output before correction from the sensor unit WA located at a certain coordinate (x, y) on the Dx-Dy plane of the detection area SA is Raw. Among Raw, the output corresponding to the detection result of the light from the first light source 22R is Raw(R). Among Raw, the output corresponding to the detection result of the light from the second light source 22G is Raw(G). Among Raw, the output corresponding to the detection result of the light from the third light source 22B is Raw(B). Furthermore, the correction coefficient applied to the output from the sensor unit WA located at the coordinate (x, y) is Co. Among Co, the correction coefficient applied to the output corresponding to the detection result of the light from the first light source 22R is Co(R). Among Co, the correction coefficient applied to the output corresponding to the detection result of the light from the second light source 22G is Co(G). Among Co, the correction coefficient applied to the output corresponding to the detection result of the light from the third light source 22B is Co(B). If the average value of one of graphs RP1, GP1, and BP1 (for example, graph RP1) is Ave, Co(R) can be expressed as the following formula (1), Co(G) can be expressed as the following formula (2), and Co(B) can be expressed as the following formula (3). In signal intensity correction using a correction coefficient, Co(R) is applied to the first output described above, Co(B) is applied to the second output, and Co(B) is applied to the third output. In correction corresponding to the explanation with reference to FIG. 8, Co(R), Co(G), and Co(B) are calculated individually for each sensor unit WA. Co(R)=Ave / Raw(R)···(1) Co(G)=Ave / Raw(G)···(2) Co(B)=Ave / Raw(B) (3)

[0054] The method of correcting the signal intensity is not limited to the one described with reference to FIG.

[0055] Fig. 9 is a graph showing another example of signal strength correction. Graph GP3 shown in Fig. 9 shows the signal strength after correction in which graph GP1 is corrected to correspond to graph RP1. Graph BP3 shows the signal strength after correction in which graph BP1 is corrected to correspond to graph RP1. Note that in Fig. 8, it appears as if graph GP3 is higher than graphs RP1 and BP3, and graph RP1 is higher than graph BP3, but in reality, they are all the same.

[0056] 9, the signal intensity corresponding to the luminance of the first light source 22R detected by the sensor unit WA at each coordinate is corrected to match the signal intensity when light from light sources of other colors (the second light source 22G and the third light source 22B) is detected. Therefore, the distribution of the signal intensity within the range from "E1" to "E2" shown by the graph GP3 showing the signal intensity after correcting the graph GP1 and the graph BP3 showing the signal intensity after correcting the graph BP1 becomes the same as the luminance distribution shown by the graph GP1 within the range.

[0057] In the case of the explanation with reference to FIG. 9, Co(R) can be expressed as the following formula (4), Co(G) can be expressed as the following formula (5), and Co(B) can be expressed as the following formula (6). Co(R) = Raw(R) / Raw(R) (4) Co(G) = Raw(R) / Raw(G) (5) Co(B) = Raw(R) / Raw(B) (6)

[0058] Since Co(R) in formula (4) is always 1, the output corresponding to the detection result of light from the first light source 22R, such as the first output described above, is not corrected in the correction corresponding to the explanation given with reference to Fig. 9. Therefore, the output corresponding to the detection result of light from the second light source 22G and the output corresponding to the detection result of light from the third light source 22B, such as the second output and the third output described above, are corrected in the correction corresponding to the explanation given with reference to Fig. 9. Therefore, it is sufficient to calculate Co(G) and Co(B) individually for each sensor unit WA in the correction corresponding to the explanation given with reference to Fig. 9.

[0059] In the embodiment, the signal intensity is corrected as described with reference to Fig. 8 or Fig. 9. The sensor scan for correcting the signal intensity is performed in a state where the detection object SUB is not interposed between the sensor panel 10 and the light source panel 20.

[0060] 10 is a schematic diagram showing a lighting pattern of the light source 22 in a sensor scan for correcting the signal intensity. In the embodiment, a period in which the first light source 22R is turned on and the light source panel 20 is irradiated with light R1 as in "lighting pattern 4" shown in FIG. 10, a period in which the second light source 22G is turned on and the light source panel 20 is irradiated with light G1 as in "lighting pattern 5", and a period in which the third light source 22B is turned on and the light source panel 20 is irradiated with light B1 as in "lighting pattern 6" are separately provided. In terms of the correspondence between the graphs RP1, GP1, and BP1 shown in FIG. 7 to FIG. 9, the graph RP1 is obtained in "lighting pattern 4", the graph GP1 is obtained in "lighting pattern 5", and the graph BP1 is obtained in "lighting pattern 6".

[0061] 10, in "lighting pattern 4", "lighting pattern 5" and "lighting pattern 6", the detection object SUB is not interposed between the sensor panel 10 and the light source panel 20. Therefore, the sensor unit WA provided in the sensor panel 10 detects the light R1 irradiated from the first light source 22R in "lighting pattern 4", detects the light G1 irradiated from the second light source 22G in "lighting pattern 5", and detects the light B1 irradiated from the third light source 22B in "lighting pattern 6". By specifying the signal intensity correction coefficient according to the output of the sensor scan obtained in this manner, it becomes possible to obtain the corrected sensor scan output corresponding to the distribution of the signal intensity corresponding to the graphs RP2, GP2 and BP2 or the graphs RP1, GP3 and BP3.

[0062] Here, if the fourth output is an output when light of a first color (e.g., red (R)) is directly irradiated from a light source (e.g., the first light source 22R) to the sensor unit WA, then "lighting pattern 4" shown in FIG. 10 indicates a lighting pattern of the light source 22 that can obtain the fourth output. If the fifth output is an output when light of a second color (e.g., green (G)) is directly irradiated from a light source (e.g., the second light source 22G) to the sensor unit WA, then "lighting pattern 5" shown in FIG. 10 indicates a lighting pattern of the light source 22 that can obtain the fifth output. If the sixth output is an output when light of a third color (e.g., blue (B)) is directly irradiated from a light source (e.g., the third light source 22B) to the sensor unit WA, then "lighting pattern 6" shown in FIG. 10 indicates a lighting pattern of the light source 22 that can obtain the sixth output. As in the above-mentioned formulas (1), (2), and (3), the correction coefficient according to the explanation with reference to FIG. 8 corresponds to the average value (AVE) of the outputs of the multiple sensor units WA in the fourth output. Furthermore, as shown in the above-mentioned equations (4), (5), and (6), the correction coefficients explained with reference to Figure 9 correspond to the luminance distribution (graph RP1) of the first color light in the detection area SA when the fourth output is obtained.

[0063] It should be noted that the ray limiting member 50 merely limits the path of the light, and does not change the light itself that can reach the sensor panel 10 from the light source panel 20. Therefore, even if the ray limiting member 50 is provided, the light that reaches the sensor panel 10 from the light source panel 20 can be said to be light that is directly irradiated from the light source 22 to the sensor section WA.

[0064] In the embodiment, the output of the sensor scan when the object to be detected SUB is interposed between the sensor panel 10 and the light source panel 20 as shown in Fig. 4 and Fig. 6 is the output of the sensor scan after correction. That is, the correction of the signal intensity is reflected in the output of the sensor scan when the object to be detected SUB is interposed between the sensor panel 10 and the light source panel 20.

[0065] In a sensor scan for correcting signal intensity and in a sensor scan with a detectable object SUB interposed between the sensor panel 10 and the light source panel 20, a period during which the first light source 22R is turned on, a period during which the second light source 22G is turned on, and a period during which the third light source 22B is turned on are separately provided.

[0066] 11 is a chart showing an example of the flow of lighting control of the first light source 22R, the second light source 22G, and the third light source 22B in a sensor scan. As shown in FIG. 11, first, the first light source is turned on (phase F1), that is, a period during which the first light source 22R is turned on is provided. Then, the sensor scan (phase F2) is output. In the sensor scan output, the luminance of the light from the first light source 22R detected by the sensor unit WA during the first light source is turned on is reflected in the signal intensity. Then, data transfer (phase F3) is performed. In the data transfer, data reflecting the output of the sensor scan is transferred from the detection circuit 15 to the information processing device 30.

[0067] Thereafter, the second light source is turned on (phase F4), i.e., a period during which the second light source 22G is turned on is provided. Then, a sensor scan (phase F5) is output. In the sensor scan output, the luminance of the light from the second light source 22G detected by the sensor unit WA during the second light source turning on period is reflected in the signal intensity. Then, data transfer (phase F6) is performed. In the data transfer, data reflecting the output of the sensor scan is transferred from the detection circuit 15 to the information processing device 30.

[0068] Thereafter, the third light source is turned on (phase F7), i.e., a period during which the third light source 22B is turned on is provided. Then, a sensor scan (phase F8) is output. In the sensor scan output, the luminance of the light from the third light source 22B detected by the sensor unit WA during the period during which the second light source is turned on is reflected in the signal intensity. Then, data transfer (phase F9) is performed. In the data transfer, data reflecting the output of the sensor scan is transferred from the detection circuit 15 to the information processing device 30.

[0069] Note that the charge corresponding to the degree of light detection by the sensor unit WA is reset each time the sensor scan shown in Fig. 11 is performed. When a series of sensor scans including turning on the first light source, the second light source, and the third light source once each are performed multiple times, data transfer after turning on the third light source and pre- and post-scan processing (phase F10) are performed before turning on the first light source. Examples of pre- and post-scan processing include installation of a detection target SUB after a series of sensor scans for correcting signal intensity, and replacement of the detection target SUB for sensor scanning of multiple types of detection targets SUB. During pre- and post-scan processing, the detection system 1 is in a standby state (sleep).

[0070] Note that the signal strength correction, data integration, and processing for reflecting the signal strength correction coefficient when integrating the data are performed, for example, by the information processing device 30, but the detection circuit 15 may have a function for performing the signal strength correction, data integration, and processing for reflecting the signal strength correction coefficient when integrating the data. In that case, the data transfer in Fig. 11 can be omitted. That is, the timing of data transfer from the detection circuit 15 to the information processing device 30 corresponding to the sensor scan can be consolidated after the data integration. Also, data obtained by the output of the sensor scan performed for signal strength correction does not need to be transferred to the information processing device 30, and the signal strength correction coefficient is held by the detection circuit 15.

[0071] Of the operations of the detection system 1 in the embodiment described above, the flow of sensor scanning for correcting signal intensity and sensor scanning with the detection object SUB interposed between the sensor panel 10 and the light source panel 20 will be described with reference to Fig. 12 to Fig. 15. First, the case where signal intensity correction and data integration are performed by the information processing device 30 will be described with reference to Fig. 12 and Fig. 13.

[0072] 12 is a flowchart showing a process flow related to a sensor scan for correcting signal intensity. In this process, it is assumed that no other target introduced from outside to the detection system 1, such as the detection object SUB, has been introduced to the detection system 1 at the time when the detection system 1 is powered on (step S1).

[0073] First, a lighting control period of the light source 22 corresponding to "lighting pattern 4" shown in Fig. 10 (step S2), i.e., a lighting period of the first light source 22R, is provided. Then, a sensor scan is performed (step S3) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S2. Then, data reflecting the output of the sensor scan in step S3 is transferred from the detection circuit 15 to the information processing device 30 (step S4).

[0074] 10, a lighting control period of the light source 22 (step S5), i.e., a lighting period of the second light source 22G, is provided. After that, a sensor scan is performed (step S6) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S5. After that, data reflecting the output of the sensor scan in step S6 is transferred from the detection circuit 15 to the information processing device 30 (step S7).

[0075] 10, a lighting control period of the light source 22 (step S8), i.e., a lighting period of the third light source 22B, is provided. After that, a sensor scan is performed (step S9) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S8. After that, data reflecting the output of the sensor scan in step S9 is transferred from the detection circuit 15 to the information processing device 30 (step S10).

[0076] The information processing device 30 calculates a correction coefficient for the signal strength based on the data transferred in the processes of steps S4, S7, and S10 (step S11). For example, when a correction coefficient corresponding to the average value (Ave) is calculated as described with reference to FIG. 8, the correction coefficients (Co(R), Co(B), Co(G)) are calculated as in the above-mentioned formulas (1), (2), and (3). Also, when a correction coefficient corresponding to the graph RP1 is calculated as described with reference to FIG. 9, the correction coefficients (Co(R), Co(B), Co(G)) are calculated as in the above-mentioned formulas (4), (5), and (6).

[0077] 13 is a flowchart showing the flow of processing related to a sensor scan targeting a detection object SUB. In this processing, first, the detection object SUB is placed between the sensor panel 10 and the light source panel 20 (step S21).

[0078] Next, a lighting control period of the light source 22 corresponding to "lighting pattern 1" shown in Fig. 6 (step S22), i.e., a lighting period of the first light source 22R, is provided. After that, a sensor scan is performed (step S23) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S22. After that, data reflecting the output of the sensor scan in step S23 is transferred from the detection circuit 15 to the information processing device 30 (step S24).

[0079] 6, a lighting control period of the light source 22 (step S25), i.e., a lighting period of the second light source 22G, is provided. After that, a sensor scan is performed (step S26) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S25. After that, data reflecting the output of the sensor scan in step S26 is transferred from the detection circuit 15 to the information processing device 30 (step S27).

[0080] 6, a lighting control period of the light source 22 (step S28), i.e., a lighting period of the third light source 22B, is provided. After that, a sensor scan is performed (step S29) to generate an output of a signal indicating the degree of the intensity of the light detected during the period of step S28. After that, data reflecting the output of the sensor scan in step S29 is transferred from the detection circuit 15 to the information processing device 30 (step S30).

[0081] The information processing device 30 integrates the data transferred in the processes of steps S24, S27, and S30 (step S31). In the process of step S31, the correction coefficient of the signal strength calculated in the process of step S11 is reflected. Specifically, in the output of the sensor scan obtained in the process of step S23, Co(R) calculated individually for each sensor unit WA is applied individually to the output of each sensor unit WA. Note that, when a correction coefficient corresponding to the graph RP1 is calculated as described with reference to FIG. 9, the correction by applying Co(R) is omitted. In addition, in the output of the sensor scan obtained in the process of step S26, Co(G) calculated individually for each sensor unit WA is applied individually to the output of each sensor unit WA. In addition, in the output of the sensor scan obtained in the process of step S29, Co(B) calculated individually for each sensor unit WA is applied individually to the output of each sensor unit WA. This makes it possible to obtain data indicating the output of the sensor scan that reflects the color of the object to be detected SUB, and in which the influence of variations in luminance of the first light source 22R, the second light source 22G, and the third light source 22B is suppressed.

[0082] Next, a case where the signal intensity correction and data integration are performed by the detection circuit 15 will be described with reference to Figures 14 and 15. In the description with reference to Figures 14 and 15, differences from the description with reference to Figures 12 and 13 will be particularly noted.

[0083] Fig. 14 is a flowchart showing a flow of processing related to sensor scanning for correcting signal strength. When the signal strength is corrected by the detection circuit 15, the processing of steps S4, S7, and S10 described with reference to Fig. 12 is omitted, and the processing of step S11 is performed by the detection circuit 15 instead of the information processing device 30, and the same processing as that described with reference to Fig. 12 is performed. Therefore, in this case, as shown in Fig. 14, the processing is performed in the order of steps S1, S2, S3, S5, S6, S8, S9, and S11.

[0084] Fig. 15 is a flow chart showing the flow of processing related to a sensor scan targeting a detection object SUB. When data integration is performed by the detection circuit 15, the processing of steps S24, S27, and S30 described with reference to Fig. 13 is omitted, the processing subject of step S31 is the detection circuit 15 instead of the information processing device 30, and processing of step S32 is added, except that the processing is similar to that described with reference to Fig. 12. Therefore, in this case, as shown in Fig. 15, the processing is performed in the order of steps S21, S22, S23, S25, S26, S28, S29, S31, and S32.

[0085] In the process of step S32, the data obtained in the process of step S31 is transferred from the detection circuit 15 to the information processing device 30. That is, data indicating the output of the sensor scan reflecting the color of the object to be detected SUB is transferred from the detection circuit 15 to the information processing device 30.

[0086] As described above, according to the embodiment, the detection device (e.g., detection device 60) includes a sensor unit (e.g., sensor unit WA) that is provided with a photodiode (PD82) that detects light and generates an output according to the level of detected light, a detection circuit 15 that acquires the output of the sensor unit, and a light source (e.g., light source 22) that switchably emits light of a first color (e.g., red (R)), light of a second color (e.g., green (G)), and light of a third color (e.g., blue (B)).

[0087] In the embodiment, the detection circuit 15 separately acquires a first output, a second output, and a third output. The first output is an output of the sensor unit corresponding to a period during which light of the first color (e.g., red (R)) is emitted. The second output is an output of the sensor unit corresponding to a period during which light of the second color (e.g., green (G)) is emitted. The third output is an output of the sensor unit corresponding to a period during which light of the third color (e.g., blue (B)) is emitted. Then, the detection circuit 15 corrects at least two of the first output, the second output, and the third output based on a correction coefficient derived so that the fourth output, the fifth output, and the sixth output are the same, thereby suppressing the influence of the luminance variation among the light source emitting the first color light (e.g., the first light source 22R), the light source emitting the second color light (e.g., the second light source 22G), and the light source emitting the third color light (e.g., the third light source 22B). Therefore, the color detection accuracy can be further improved. The fourth output is an output when the sensor unit is directly irradiated with the first color light from a light source (e.g., the first light source 22R). The fifth output is an output when the sensor unit is directly irradiated with the second color light from a light source (e.g., the second light source 22G). The sixth output is an output when the sensor unit is directly irradiated with the third color light from a light source (e.g., the third light source 22B).

[0088] Also, a sensor panel (e.g., sensor panel 10) having a detection area (e.g., detection area SA) in which a plurality of sensor units (e.g., sensor units WA) are provided is provided, and the correction coefficient corresponds to the average value (AVE) of the outputs of the plurality of sensor units in a fourth output, which is the output when the sensor unit is directly irradiated with light of a first color (e.g., red (R)) from a light source (e.g., first light source 22R), and the detection circuit corrects the above-mentioned first output, second output, and third output, thereby making it possible to reduce the degree of correction of the first output, second output, and third output. Therefore, it is possible to more reliably suppress distortion of the output due to the correction.

[0089] In addition, a sensor panel (e.g., sensor panel 10) having a detection area (e.g., detection area SA) in which a plurality of sensor units (e.g., sensor units WA) are provided, and a correction coefficient corresponds to the luminance distribution (e.g., graph RP1) of light of a first color (e.g., red (R)) in the detection area when a fourth output, which is the output when the sensor unit is directly irradiated with light of the first color from a light source (e.g., first light source 22R), is obtained, and the detection circuit corrects the second output and third output described above, thereby making it possible to omit the correction of the first output described above and to further reduce the processing load related to the correction.

[0090] Also, the first color is red (R), the second color is green (G), and the third color is blue (B), so-called RGB color information can be obtained. That is, the so-called RGB color information can be obtained by a sensor unit (for example, sensor unit WA) that is not provided for each color.

[0091] Moreover, in the embodiment, the detection system 1 includes an information processing device (information processing device 30) connected to a detection device (for example, detection device 60). A detection circuit 15 of the detection device separately acquires a first output, a second output, and a third output. The first output is an output of the sensor unit corresponding to a period during which light of the first color (for example, red (R)) is emitted. The second output is an output of the sensor unit corresponding to a period during which light of the second color (for example, green (G)) is emitted. The third output is an output of the sensor unit corresponding to a period during which light of the third color (for example, blue (B)) is emitted. Then, the information processing device (information processing device 30) corrects data corresponding to at least two of the first output, the second output, and the third output based on a correction coefficient derived so that the fourth output, the fifth output, and the sixth output are the same, thereby suppressing the influence of the luminance variation among the light source emitting the first color light (e.g., the first light source 22R), the light source emitting the second color light (e.g., the second light source 22G), and the light source emitting the third color light (e.g., the third light source 22B). Therefore, the color detection accuracy can be further improved. The fourth output is an output when the sensor unit is directly irradiated with the first color light from a light source (e.g., the first light source 22R). The fifth output is an output when the sensor unit is directly irradiated with the second color light from a light source (e.g., the second light source 22G). The sixth output is an output when the sensor unit is directly irradiated with the third color light from a light source (for example, the third light source 22B).

[0092] In addition, among the specific configurations described in the embodiments, such as the specific configuration of the sensor unit WA and the specific configuration of the wiring area VA described with reference to Figure 2, configurations that are not specified in the claims may be modified as appropriate within the scope that makes it possible to realize the configurations specified in the claims.

[0093] Furthermore, other advantageous effects brought about by the aspects described in this embodiment that are obvious from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present disclosure. [Explanation of symbols]

[0094] 1. Detection System 10 Sensor Panel 15 Detection circuit 22 Light source 22R 1st light source 22G 2nd light source 22B 3rd light source 30 Information processing device 60 Detection Device 82 PD WA Sensor section

Claims

1. a sensor section provided with a photodiode for detecting light and generating an output in accordance with the level of the detected light; A detection circuit for acquiring an output of the sensor unit; a light source that switchably emits a first color light, a second color light, and a third color light; the detection circuit separately acquires the first output, the second output, and the third output; the first output is an output of the sensor unit corresponding to a period during which the first color light is emitted; the second output is an output of the sensor unit corresponding to a period during which the second color light is emitted, the third output is an output of the sensor unit corresponding to a period during which the third color light is emitted, the detection circuit corrects at least two of the first output, the second output, and the third output based on a correction coefficient derived so that a fourth output, a fifth output, and a sixth output are the same; the fourth output is an output when the sensor unit is directly irradiated with the first color light from the light source, the fifth output is an output when the sensor unit is directly irradiated with the second color light from the light source, the sixth output is an output when the sensor unit is directly irradiated with the third color light from the light source; Detection device.

2. a sensor panel having a detection area in which a plurality of the sensor units are provided, the correction coefficient corresponds to an average value of outputs of the plurality of sensor units in the fourth output, the detection circuit corrects the first output, the second output, and the third output. The detection device according to claim 1 .

3. a sensor panel having a detection area in which a plurality of the sensor units are provided, the correction coefficient corresponds to a luminance distribution of the first color light in the detection area when the fourth output is obtained, The detection circuit corrects the second output and the third output. The detection device according to claim 1 .

4. the first color is red; the second color is green; The third color is blue.

4. A detection device according to claim 1.

5. A detection system including a detection device and an information processing device connected to the detection device, The detection device includes: a sensor section provided with a photodiode for detecting light and generating an output in accordance with the level of the detected light; A detection circuit for acquiring an output of the sensor unit; a light source that switchably emits a first color light, a second color light, and a third color light; the detection circuit individually acquires the first output, the second output, and the third output, and transfers data corresponding to each output to the information processing device; the first output is an output of the sensor unit corresponding to a period during which the first color light is emitted; the second output is an output of the sensor unit corresponding to a period during which the second color light is emitted, the third output is an output of the sensor unit corresponding to a period during which the third color light is emitted, the information processing device corrects data corresponding to at least two or more of the first output, the second output, and the third output based on a correction coefficient derived such that a fourth output, a fifth output, and a sixth output are the same; the fourth output is an output when the sensor unit is directly irradiated with the first color light from the light source, the fifth output is an output when the sensor unit is directly irradiated with the second color light from the light source, the sixth output is an output when the sensor unit is directly irradiated with the third color light from the light source; Detection system.

Images