Drainage abnormality detection device, trained model generation device, drainage abnormality detection method, and trained model generation method

Abstract

To prevent drain water that is colored by a non-abnormality factor color being the color that may be erroneously recognized as an abnormality by being mixed to drain water from being erroneously detected as an abnormality and improve detection accuracy of an abnormality of drain water.SOLUTION: A drain water abnormality detection device for detecting an abnormality of drain water from a facility that appears as a hue comprises: an image acquisition unit which acquires a drain water image being a photographed image of the drain water; and a detection unit which detects an abnormality of drain water from the facility by using a learned model generated with learning using as teacher data association information that associates a plurality of simulated drain water images being the photographed images of a plurality of simulated drain waters which is obtained by mixing a component of an abnormality factor color showing an abnormality of drain water and a component of a non-abnormality factor color being the color that may be erroneously recognized as an abnormality by being mixed to drain water and in which mutually-different hues appear with an evaluation of a degree of an abnormality of each simulated drain water image with the drain water image as input and the evaluation of the degree of the abnormality as output, and outputs the result.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a trained model generation device that generates a trained model used to detect abnormalities in rainwater, a rainwater anomaly detection device that detects abnormalities in rainwater, a trained model generation method, and a rainwater detection method. [Background technology]

[0002] Conventionally, from the viewpoint of environmental conservation, rainwater discharged from various facilities is inspected for abnormalities by constant human monitoring before it leaves the premises. Since constant human monitoring of rainwater places a heavy burden on the person in charge, it is desirable to perform the inspection of rainwater automatically.

[0003] As a method for automatically inspecting water for abnormalities, for example, Patent Document 1 discloses an information processing method capable of appropriately judging the quality of water when taking water from a river. This information processing method acquires an image of water near a water intake, inputs the acquired image into a trained model that outputs a judgment result of whether the water intake is good or bad when an image of water near the water intake is input, and outputs the judgment result from the trained model. This trained model is generated by having a computer execute learning using teacher data collected by preparing water of various turbidities. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-125618 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, there is a possibility that mud may be mixed into wastewater such as rainwater discharged from a facility. Although such wastewater is not actually abnormal, the apparent turbidity of the water changes due to the coloring caused by the mud. Therefore, it is not possible to determine whether the wastewater is abnormal based only on the turbidity as in the conventional technology. For this reason, when a trained model generated using the training data collected by the above method is used, there is a possibility that wastewater that is not actually abnormal may be mistakenly determined to be abnormal.

[0006] Therefore, there is a demand for technology that can prevent wastewater colored with non-abnormal factor colors, which may be mistakenly recognized as an abnormality if mixed into wastewater, from being over-detected as an abnormality, and can improve the accuracy of detecting abnormalities in wastewater. [Means for solving the problem]

[0007] The present disclosure can be realized in the following forms. According to one embodiment of the present disclosure, there is provided a drainage abnormality detection device that detects abnormality in drainage from a facility, which appears as a color. The drainage abnormality detection device includes an image acquisition unit that acquires a drainage image, which is an image of drainage, and a detection unit that detects abnormality in drainage from the facility using a trained model that detects abnormality in drainage from the facility using a trained model that receives drainage images as input and outputs an evaluation of the degree of abnormality, and detects the abnormality in drainage from the facility using a trained model that ... According to one embodiment of the present disclosure, there is provided a trained model generation device for generating a trained model used to detect an abnormality in wastewater from a facility, which appears as a color. The trained model generation device includes a teacher data acquisition unit that acquires, as teacher data, correspondence information that associates a plurality of simulated wastewater images including captured images of a plurality of simulated wastewaters obtained by mixing an abnormality factor color component indicating an abnormality in the wastewater and a non-abnormality factor color component that is a color that may be mistakenly recognized as an abnormality when mixed into the wastewater, the simulated wastewater images each appearing in a different color due to a different concentration of the non-abnormality factor color component, with an evaluation of the degree of abnormality of each of the simulated wastewater images, and a learning unit that generates a trained model that uses the teacher data to learn and outputs an evaluation of the degree of abnormality. The present disclosure can also be realized in the following forms.

[0008] (1) According to one embodiment of the present disclosure, there is provided a drainage abnormality detection device that detects an abnormality in drainage from a facility that appears as a color. The drainage abnormality detection device includes an image acquisition unit that acquires a drainage image, which is an image of drainage, and a detection unit that detects an abnormality in drainage from the facility using a trained model that receives drainage images as input and outputs an evaluation of the degree of abnormality, and detects the abnormality in drainage from the facility using the trained model, which is generated by learning using a plurality of simulated drainage images that are imaged images of a plurality of simulated drainages each appearing in a different color, the simulated drainage images being obtained by mixing an abnormality factor color component that indicates an abnormality in the drainage and a non-abnormality factor color component that is a color that may be mistakenly recognized as an abnormality when mixed into the drainage, and a detection unit that outputs the result. According to the drainage abnormality detection device of the above-described form, it is possible to suppress overdetection of drainage colored with a non-abnormal factor color, which is a color that may be mistakenly recognized as an abnormality if mixed into water, as an abnormality, thereby improving the accuracy of detecting drainage abnormalities. (2) In the drainage abnormality detection device of the above-described embodiment, the image acquisition unit may acquire, as the drainage image, a white background image obtained by imaging drainage flowing through a flow path having a white bottom under lighting that blocks external light. According to this drainage abnormality detection device, it is possible to suppress disturbances such as external light and improve the accuracy of detecting drainage abnormalities. (3) In the drainage abnormality detection device of the above embodiment, the image acquisition unit acquires, as the drainage images, a white background image obtained by imaging drainage flowing through a flow path having a white bottom under lighting that blocks external light, and a colored background image obtained by imaging drainage flowing through a flow path having a bottom colored a color other than white, and the detection unit detects abnormalities in drainage from the facility by using, for the white background image acquired by the image acquisition unit, a trained model for white background that takes a white background image as an input and outputs an evaluation of the degree of abnormality, and by using, for the colored background image acquired by the image acquisition unit, a trained model for colored background that takes a colored background image as an input and outputs an evaluation of the degree of abnormality. With this drainage abnormality detection device, for example, if white paint is mixed into the drainage, there is a high possibility of overdetection using a white background image, so by performing detection using a colored background image, the accuracy of detecting drainage abnormalities can be improved. (4) In the drainage anomaly detection device of any of the above aspects, the drainage may be rainwater, and the non-drainage anomaly factor color may be the color of mud mixed into the rainwater. According to the drainage abnormality detection device of this embodiment, it is possible to improve the accuracy of detecting abnormalities in rainwater containing mud. (5) According to another aspect of the present disclosure, there is provided a trained model generating device for generating a trained model used to detect an abnormality in wastewater from a facility, which appears as a color. The trained model generating device includes a teacher data acquiring unit that acquires, as teacher data, correspondence information that associates a plurality of simulated wastewater images, which are captured images of a plurality of simulated wastewaters each appearing in a different color, obtained by mixing an abnormality factor color component indicating an abnormality in the wastewater and a non-abnormality factor color component that is a color that may be mistakenly recognized as an abnormality when mixed into the wastewater, with an evaluation of the degree of abnormality of each of the simulated wastewater images, and a learning unit that generates a trained model that uses the teacher data to learn and outputs an evaluation of the degree of abnormality. According to this form of trained model generation device, it is possible to generate a trained model that can suppress overdetection of wastewater colored with non-abnormal factor colors, which are colors that may be mistakenly recognized as abnormal if mixed into water, and can improve the accuracy of detecting abnormalities in wastewater.

[0009] The present disclosure can be realized in various forms, including not only the drainage anomaly detection device and trained model generation device described above, but also a drainage anomaly detection method, a trained model generation method, a program that causes a computer to execute a process for detecting drainage anomalies from a predetermined facility, and a program that causes a computer to execute a process for generating a trained model. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing a configuration example of a rainwater anomaly detection system as a drainage anomaly detection system of a first embodiment. FIG. [Diagram 2] 10 is a flowchart illustrating an example of a procedure for a rainwater abnormality detection process performed by a control unit. [Diagram 3] FIG. 1 is a schematic diagram illustrating an example of the configuration of a trained model generation device. [Figure 4] 13 is a flowchart illustrating an example of a procedure for a trained model generation process performed by a control unit. [Figure 5A]1 is a portion of a table showing an example of multiple data sets used as training data. [Figure 5B] 13 is another part of a table showing an example of multiple data sets used as training data. [Figure 6] FIG. 11 is a schematic diagram showing a configuration example of a rainwater anomaly detection system according to a second embodiment. [Figure 7] FIG. 13 is a schematic diagram showing a configuration example of a rainwater anomaly detection system according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] A. First embodiment: FIG. 1 is a schematic diagram showing a configuration example of a rainwater abnormality detection system 10 as a drainage abnormality detection system of the first embodiment. The rainwater abnormality detection system 10 is a drainage abnormality detection system that automatically detects whether there is an abnormality in rainwater, taking rainwater discharged from various facilities such as a factory as an example of drainage, before the rainwater leaves the premises of the facility. For example, in a factory, the system automatically detects whether there is an abnormal coloring in rainwater due to the inclusion of a substance such as metal that has a negative effect on the environment. In the following, as shown in FIG. 1, the rainwater that flows through the gutter flow path 22 of the rainwater gutter 20 and before flowing into the rainwater tank 24 from the inlet 26 will be described as the target of abnormality detection. In addition, in the rainwater gutter 20 shown in FIG. 1, the side wall on the front side of the gutter flow path 22 is omitted for ease of illustration, and the same applies to the figures shown below.

[0012] The rainwater anomaly detection system 10 includes a rainwater anomaly detection device 100 as a drainage anomaly detection device, and an imaging device 200. The imaging device 200 is connected to the rainwater anomaly detection device 100 so as to be controllable by the rainwater anomaly detection device 100.

[0013] The imaging device 200 can be configured with various cameras, and is a device that captures moving or still images and outputs the captured images (moving or still images) to the rainwater anomaly detection device 100. The imaging device 200 captures an image of rainwater in a flow path portion of the gutter flow path 22 that corresponds to a preset imaging area IA.

[0014] The rainwater anomaly detection device 100 can be configured with various computer devices such as a server device, a personal computer, etc. The rainwater anomaly detection device 100 acquires a rainwater image, which is a drainage image captured by an imaging device 200, and detects an abnormal state of rainwater for the input of the acquired rainwater image using a trained model 134 described later.

[0015] The rainwater abnormality detection device 100 includes a control unit 110, an interface (IF) 120, and a storage unit .

[0016] The IF 120 is an interface that enables communication between the imaging device 200 and an external computer (not shown).

[0017] The storage unit 130 has a volatile storage area such as a static random access memory (SRAM), a dynamic random access memory (DRAM), or a flash memory, and a non-volatile storage area such as an EEPROM or a hard disk. The storage unit 130 stores a program 132 and data to be referenced during processing in advance. The program 132 stored in the storage unit 130 may be a program 132 read from a recording medium (not shown) that is readable by the rainwater anomaly detection device 100. The program 132 may be downloaded from an external computer (not shown) connected to a communication network (not shown) and stored in the storage unit 130. The storage unit 130 also stores a file 134f that constitutes the trained model 134. The trained model file 134f may also be a trained model file 134f read from a recording medium that is readable by the rainwater anomaly detection device 100, like the program 132. The recording medium is created by recording the file 134f of the trained model generated in the trained model generation device 300 described later. Alternatively, the file 134f of the trained model may be downloaded from the trained model generation device 300 connected to a communication network (not shown) and stored in the storage unit 130.

[0018] The control unit 110 has one or more arithmetic processing devices such as a central processing unit (CPU), a micro-processing unit (MPU), and a graphics processing unit (GPU). The control unit 110 reads and executes a program 132 stored in the storage unit 130, and reads a file 134f of the trained model to acquire (receive) a rainwater image output from the imaging device 200 and function as various functional blocks for detecting an abnormal state of the rainwater. Specifically, the control unit 110 functions as an image acquisition unit 112 that acquires a rainwater image received from the imaging device 200 via the IF 120, a detection unit 114 that detects an abnormality in the rainwater using a trained model 134 that receives an input of the rainwater image and outputs an evaluation of the degree of the abnormality of the rainwater, and a detection result output unit 116 that outputs a detection result of the abnormality in the rainwater. The file 134f of the trained model is generated in advance by a trained model generation device 300 (see FIG. 3) described later and stored in the storage unit 130 of the rainwater anomaly detection device 100.

[0019] 2 is a flowchart showing an example of the procedure of the rainwater anomaly detection process (drainage anomaly detection method) by the control unit 110. The control unit 110 acquires a rainwater image captured by the imaging device 200 by the image acquisition unit 112 (step S110). Then, the control unit 110 inputs the acquired rainwater image to the trained model 134, detects anomaly in the rainwater by the detection unit 114 according to the evaluation of the degree of anomaly in the rainwater output by the trained model 134 (step S120), and outputs the detection result of the rainwater anomaly by the detection result output unit 116 (step S130).

[0020] As an output of the rainwater anomaly detection result, for example, the trained model 134 may output the presence or absence of rainwater anomaly as an evaluation of the degree of the rainwater anomaly, and may display the information on the presence or absence of rainwater anomaly on a display unit (not shown) to notify a supervisor monitoring the rainwater anomaly. In particular, when a rainwater anomaly is detected, in addition to the display, the supervisor may be notified by sound or light, etc., to prompt the supervisor to check the display.

[0021] The trained model 134 can be generated by a trained model generation device 300 described below. FIG. 3 is a schematic diagram showing a configuration example of the trained model generation device 300. The trained model generation device 300 can be configured with various computer devices such as a personal computer. As described below, the trained model generation device 300 acquires training data, and generates a trained model that outputs information that determines an abnormal state of rainwater in response to an input of a rainwater image that captures rainwater, by learning using the acquired training data.

[0022] The trained model generation device 300 has a control unit 310, an interface (IF) 320, and a storage unit 330.

[0023] The IF 320 is an interface that allows input of a data set used for the training data. The data set includes data of a simulated rainwater image as a simulated drainage image described later, and data of a classification as an evaluation result associated with the simulated rainwater image. The classification is data indicating whether the simulated rainwater is in a normal state or an abnormal state as an evaluation result of an abnormal state of the simulated rainwater.

[0024] The storage unit 330 has a volatile storage area and a non-volatile storage area, similar to the storage unit 130 (see FIG. 1) of the rainwater anomaly detection device 100. The storage unit 330 stores in advance a program 332 and data to be referenced during processing. The program 332 stored in the storage unit 330 may be a program 332 read from a recording medium (not shown) readable by the model generating device 300. The program 332 may be downloaded from an external computer (not shown) connected to a communication network (not shown) and stored in the storage unit 330. In addition, the storage unit 330 stores a plurality of acquired data sets as teacher data 334, as described below, and stores a file 134f constituting the generated trained model 134.

[0025] The control unit 310 has one or more arithmetic processing units such as a CPU, an MPU, a GPU, etc., similar to the control unit 110 (see FIG. 1) of the rainwater anomaly detection device 100. The control unit 310 reads and executes a program 332 stored in the storage unit 330, thereby functioning as various functional blocks that take a rainwater image captured by rainwater as an input and generate a trained model that outputs an evaluation of the degree of anomaly (presence or absence of anomaly). Specifically, the control unit 310 functions as a teacher data acquisition unit 312 that acquires a data set used for teacher data via the IF 320, and a learning unit 314 that uses the teacher data to learn and generates a trained model 134 that takes a rainwater image as an input and outputs an evaluation of the degree of anomaly in rainwater (presence or absence of anomaly).

[0026] 4 is a flowchart showing an example of the procedure of a trained model generation process (model generation method) by the control unit 310. The control unit 310 acquires a plurality of data sets input via the IF 320 by the teacher data acquisition unit 312, and stores them in the storage unit 330 as teacher data 334 (step S310). Then, the control unit 310 generates a trained model 134 constructed by learning using the teacher data 334 by the learning unit 314, and stores a file 134f constituting the trained model 134 in the storage unit 330.

[0027] The learning unit 314 performs deep learning using multiple data sets as teacher data 334, which are correspondence information that associates the simulated rainwater image with a classification (abnormal or normal) as an evaluation result of the degree of abnormality of the simulated rainwater associated with the simulated rainwater image. As a result, the learning unit 314 constructs (generates) a neural network as the trained model 134, which receives the rainwater image as an input and outputs the presence or absence of an abnormality in the rainwater shown in the rainwater image as an evaluation of the degree of abnormality. The neural network is a CNN (Convolution Neural Network). However, the trained model 134 is not limited to CNN, and may be a trained model 134 constructed with another learning algorithm, such as a neural network other than CNN.

[0028] 5A and 5B are tables showing an example of a plurality of data sets used as training data 334. The plurality of data sets can be obtained as described below.

[0029] Since it is difficult to actually prepare rainwater in an abnormal state, multiple simulated rainwater images are obtained by preparing multiple simulated rainwater images. The simulated rainwater images are obtained by capturing images of the prepared simulated rainwater using an imaging device similar to the imaging device 200 (see FIG. 1) used in the rainwater abnormality detection system 10.

[0030] The simulated rainwater is created by mixing an abnormality factor color component that indicates an abnormality in rainwater with a non-abnormality factor color component that may be mistakenly recognized as an abnormality when mixed into rainwater, in order to intentionally create a color change by coloring according to an abnormal state. The combination of the abnormality factor color, the concentration of the abnormality factor color, and the concentration of the non-abnormality factor color uses 18 types of simulated rainwater (see Figures 5A and 5B) created using an L18 orthogonal array in order to efficiently and comprehensively obtain multiple simulated rainwater images obtained by capturing multiple simulated rainwater images and their respective evaluation results. However, the present invention is not limited to this, and any combination of the abnormality factor color, the concentration of the abnormality factor color, and the concentration of the non-abnormality factor color may be used as long as it is possible to comprehensively obtain multiple simulated rainwater images obtained by capturing multiple simulated rainwater images and their respective evaluation results.

[0031] As described above, the abnormality factor color indicating an abnormality in rainwater is a color that is colored when rainwater contains substances such as metals that have a negative effect on the environment. In this example, three types of abnormality factor colors are used as examples: red, yellow, and black. The concentrations of the abnormality factor colors are used as examples of three levels of concentration: the concentration of the original solution, the concentration of a 100-fold dilution of the original solution, and the concentration of a 1000-fold dilution of the original solution. As an example, the red original solution is a colored solution in which 1 L of water is colored with 2.5 g of red coloring agent (e.g., food coloring). The same applies to the yellow original solution and the black original solution. As an example, the color of mud is used as an example, and the concentrations of the non-abnormality factor colors are determined by the amount of mud mixed in, and three levels of concentration are used as examples: no mixing, little mixing, and much mixing. As an example, the mixing of 30 g of mud in 1 L of water is called little mixing, and the mixing of 60 g of mud is called much mixing. However, the present invention is not limited to this, and it is sufficient if the densities of multiple non-abnormal factor colors can be combined with the color and density of the abnormal factor color so that multiple simulated rainwater images obtained by capturing multiple simulated rainwater samples and their respective evaluation results can be comprehensively obtained. Note that the abnormal factor colors may include colors that are not related to adverse effects on the environment and should not be shown by the rainwater to be observed, and that may be recognized as colored by many people.

[0032] The classification of the degree of abnormality of each simulated rainwater is performed, for example, by classifying the evaluation results of the simulated rainwater images captured by a predetermined number of evaluators for each type of simulated rainwater according to a predetermined scoring method according to predetermined classification conditions. The classification shown in Fig. 5A and Fig. 5B is performed as follows, as an example. 50 evaluators who manage rainwater each score three simulated rainwater images captured for each type of simulated rainwater, and the average score is obtained as the evaluation result. The scoring method is as follows: if it is judged that there is no problem, score 1; if it is judged that the trend needs to be watched, score 2; if it is judged that the site needs to be checked, score 3; and if it is judged that the item needs to be collected immediately, score 4. The classification conditions are that an average score of less than 2 is normal, and an average score of 2 or more is abnormal. However, the above scoring method and classification conditions are merely examples and are not limited to these. Any scoring method and classification conditions can be used that can score the degree of abnormality in rainwater and classify the degree of abnormality in rainwater into normal and abnormal depending on the average score.

[0033] The data sets used as the teacher data 334 may include not only the 18 types of data sets related to simulated rainwater, but also data sets related to actual rainwater that is determined to be in a normal state.

[0034] The file 134f constituting the trained model 134 generated by the trained model generation device 300 is recorded in a recording medium (not shown) in the trained model generation device 300 via a recording device (not shown), and can be stored in the memory unit 130 of the rainwater anomaly detection device 100 (see FIG. 1) via this recording medium. In addition, the file 134f may be stored in the memory unit 130 of the rainwater anomaly detection device 100 by being transmitted via a communication network to the rainwater anomaly detection device 100 connected via a communication network (not shown).

[0035] In the trained model generating device 300 described above, the trained model 134 is generated by using multiple simulated rainwater obtained by mixing anomaly factor color components indicating drainage anomalies and non-anomalous factor color components that may be mistakenly recognized as an anomaly when mixed into drainage. Specifically, the trained model 134 is generated by learning teacher data 334 based on multiple data sets as correspondence information that associates multiple simulated rainwater images obtained by capturing multiple simulated rainwater with classifications (anomalous or normal) as evaluations of the degree of anomaly of the simulated rainwater shown in each simulated rainwater image. Therefore, in the rainwater anomaly detection device 100 using this trained model 134, it is possible to suppress overdetection of rainwater colored by the inclusion of mud as an anomaly, and to improve the detection accuracy of anomalies in rainwater.

[0036] B. Second embodiment: FIG. 6 is a schematic diagram showing a configuration example of a rainwater abnormality detection system 10B of the second embodiment. In the rainwater abnormality detection system 10 of the first embodiment (see FIG. 1), the imaging conditions of the imaging device 200 may change due to the influence (disturbance) of external factors such as sunlight, which is external light, and the captured rainwater image may change. Therefore, the rainwater abnormality detection system 10B of the second embodiment is configured to cover the space surrounding the path from the imaging device 200 to the imaging area IA with a black light-shielding device 230 consisting of a light-shielding plate 232 and a light-shielding curtain 234, and to illuminate the light-shielded space area with a lighting device 240 such as an LED light, so that the illuminance of the flow path portion corresponding to the imaging area IA is constant. In addition, in order to clarify the color of the rainwater flowing in the flow path portion corresponding to the imaging area IA, for example, a white plate WB is arranged on the flow path bottom of the gutter flow path 22, so that the surface of the flow path bottom of the flow path portion corresponding to the imaging area IA is white.

[0037] The image acquisition unit 112 of the control unit 110 acquires, as a white background image, a rainwater image of rainwater flowing through the white flow path portion where the white plate WB is arranged.

[0038] The trained model 134 of the control unit 110 is a trained model 134w for white background that outputs information determining an abnormal state of rainwater in response to an input of a white background image, and the trained model file 134f stored in the memory unit 130 is a file 134wf that constitutes the trained model 134w for white background.

[0039] The trained model 134w for white background can be generated by the trained model generation device 300 (see Figure 3) described above using a simulated rainwater image captured in an environment similar to the white channel portion corresponding to the imaging area IA of the above-mentioned gutter channel 22.

[0040] In the second embodiment, it is possible to improve the accuracy of detecting anomalies in rainwater by suppressing the influence (disturbance) of external factors such as external light.

[0041] C. Third embodiment: FIG. 7 is a schematic diagram showing a configuration example of the rainwater abnormality detection system 10C of the third embodiment. In the rainwater abnormality detection system 10B of the second embodiment (see FIG. 6), an abnormality in rainwater is detected by a white background image captured against the background of a white plate WB, so it is difficult to detect an abnormality in rainwater colored white, such as rainwater mixed with white paint. Therefore, the rainwater abnormality detection system 10C of the third embodiment is configured to include a light shielding device 230, a lighting device 240, and a white plate WB arranged at the bottom of the white channel of the gutter channel 22, as in the rainwater abnormality detection system 10B of the second embodiment, and further includes a black colored plate BB arranged at the bottom of the colored channel of the gutter channel 22 adjacent to the white plate WB. As a result, the rainwater image captured by the imaging device 200 includes both a white background image with the white plate WB arranged at the white channel part at the bottom of the white channel as the background and a colored background image with the colored plate BB arranged at the colored channel part at the bottom of the colored channel as the background.

[0042] In addition, the control unit 110 of the rainwater anomaly detection device 100C reads and executes the program 132C stored in the memory unit 130, and reads the file 134wf of the trained model for white background and the file 134bf of the trained model for colored background, thereby functioning as a detection unit 114C that detects abnormalities in rainwater using the image acquisition unit 112C, the trained model for white background 134w, and the trained model for colored background 134b, and as a detection result output unit 116.

[0043] The image acquisition unit 112C acquires a rainwater image obtained by capturing rainwater in the imaging area IA from the imaging device 200, and extracts a white background image, which is a rainwater image with a white board WB as a background, and a colored background image, which is a rainwater image with a colored board BB as a background, from the acquired rainwater image. The white background image is input to the trained model 134w for white background, and the colored background image is input to the trained model 134b for colored background. The trained model 134w for white background outputs an evaluation of the degree of abnormality of the rainwater for the input of the white background image. The trained model 134b for colored background outputs an evaluation of the degree of abnormality of the rainwater for the input of the colored background image. The detection unit 114C detects abnormality in the rainwater based on the evaluation result output from the trained model 134w for white background and the evaluation result output from the trained model 134b for colored background. Specifically, if both evaluation results indicate that the condition of the rainwater is normal, the detection unit 114C detects that the condition of the rainwater is normal, and if at least one of the evaluation results indicates that the condition of the rainwater is abnormal, the detection unit 114C detects that the condition of the rainwater is abnormal.

[0044] The trained model 134w for white background and the trained model 134b for colored background can be generated by the trained model generation device 300 (see Figure 3) described above using a simulated rainwater image captured in an environment similar to the white channel portion and colored channel portion corresponding to the imaging area IA of the above-mentioned gutter channel 22, respectively.

[0045] In the third embodiment, abnormalities in rainwater colored white, which would be difficult to detect in a white background image captured against a white plate WB and would increase the risk of overdetection, can be detected in a colored background image captured against a black colored plate BB, thereby improving detection accuracy.

[0046] In the above embodiment, a black colored plate BB is described, but this is not limited to this, and a colored plate of another color, for example an achromatic color such as gray that is less bright than white, may be used as long as it can produce an image that enables detection of rainwater colored in a color that is difficult to detect in a white image with the white plate WB as the background.

[0047] D. Other embodiments: (D1) In the above embodiment, the case where the state of rainwater is detected as an abnormality is described as an example to evaluate the degree of abnormality of rainwater, but the present invention is not limited to this. The degree of abnormality of rainwater may be detected as an evaluation of the degree of abnormality of rainwater. In this case, the trained model may output the degree of abnormality of rainwater in response to the input of a rainwater image. In this case, the trained model may acquire teacher data by collecting multiple datasets including a simulated rainwater image and information on the degree of abnormality as an evaluation result associated with the simulated rainwater image, and generate the acquired teacher data by learning the data.

[0048] (D2) In the above embodiment, rainwater is used as an example of wastewater, but the present invention is not limited thereto and can be applied to various wastewater discharged from facilities, for example, each treatment tank of a wastewater treatment plant. In the above embodiment, the color of mud mixed into rainwater is used as an example of a non-abnormal factor color that may be mistakenly recognized as abnormal when mixed into wastewater, but the present invention is not limited thereto and can be applied to various non-abnormal factor colors that may be mistakenly recognized as abnormal when a substance other than mud, such as proliferated algae, is mixed into wastewater, such as green to brown in the case of algae.

[0049] The present disclosure is not limited to the above-mentioned embodiment, and can be realized in various configurations without departing from the spirit of the present disclosure. For example, the technical features of the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention can be appropriately replaced or combined to solve some or all of the above-mentioned problems or to achieve some or all of the above-mentioned effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]

[0050] 10...Rainwater abnormality detection system, 10B...Rainwater abnormality detection system, 10C...Rainwater abnormality detection system, 20...Rainwater gutter, 22...Rainwater tank, 24...Inlet, 100...Rainwater abnormality detection device, 100C...Rainwater abnormality detection device, 110...Control unit, 112...Image acquisition unit, 112C...Image acquisition unit, 114...Detection unit, 114C...Detection unit, 116...Detection result output unit, 130...Memory unit, 132...Program, 132C...Program, 134...Trained model, 134f...Trained model file, 134b...Colored background trained model for a colored background, 134bf...file of trained model for a colored background, 134w...file of trained model for a white background, 134wf...file of trained model for a white background, 200...imaging device, 230...shading device, 232...shading plate, 234...shading curtain, 240...illumination device, 300...trained model generation device, 310...control unit, 312...teaching data acquisition unit, 314...learning unit, 330...storage unit, 332...program, 334...teaching data, RW...gutter flow path, IA...imaging area, BB...colored plate, WB...white plate

Claims

1. A drainage abnormality detection device that detects abnormalities in drainage from a facility, which appear as colors, An image acquisition unit that acquires a drainage image, which is a captured image of drainage; a detection unit that detects abnormalities in the drainage from the facility using a trained model that receives an input of a drainage image and outputs an evaluation of the degree of abnormality, and generates a learning result using correspondence information that corresponds a plurality of simulated drainage images including captured images of the simulated drainage obtained by mixing an abnormality factor color component that indicates an abnormality in the drainage with a non-abnormality factor color component that is a color that may be mistakenly recognized as an abnormality when mixed into the drainage, the simulated drainage images including captured images of the simulated drainage appearing in different colors due to different concentrations of the non-abnormality factor color components, and an evaluation of the degree of abnormality of each of the simulated drainage images; and A drainage abnormality detection device comprising:

2. The drainage abnormality detection device according to claim 1, The image acquisition unit acquires, as the drainage image, a white background image obtained by imaging drainage flowing through a flow path having a white bottom under lighting that blocks external light. Drainage abnormality detection device.

3. The drainage abnormality detection device according to claim 1, The image acquisition unit acquires, as the drainage image, a white background image obtained by imaging the drainage flowing through a flow path having a white bottom under lighting that blocks external light, and a colored background image obtained by imaging the drainage flowing through a flow path having a bottom colored in a color other than white; The detection unit detects an abnormality in the wastewater from the facility by using, as the trained model, a trained model for a white background, which receives a white background image as an input and outputs an evaluation of the degree of abnormality, for the white background image acquired by the image acquisition unit, and by using, as the trained model, a trained model for a colored background, which receives a colored background image as an input and outputs an evaluation of the degree of abnormality, for the colored background image acquired by the image acquisition unit. Drainage abnormality detection device.

4. The drainage abnormality detection device according to any one of claims 1 to 3, The drainage is rainwater, The non-abnormal factor color is the color of mud mixed in the rainwater. Drainage abnormality detection device.

5. A trained model generation device that generates a trained model used to detect an abnormality in wastewater from a facility, the abnormality appearing as a color, a teacher data acquisition unit that acquires, as teacher data, correspondence information that associates a plurality of simulated drainage images including captured images of the plurality of simulated drainages obtained by mixing an abnormality factor color component that indicates an abnormality in the drainage with a non-abnormality factor color component that is a color that may be mistakenly recognized as an abnormality when mixed into the drainage, each of which appears in a different color due to a different concentration of the non-abnormality factor color component, with an evaluation of the degree of abnormality of each of the simulated drainage images; A learning unit that generates a trained model that receives a drainage image as an input and outputs an evaluation of the degree of abnormality by learning using the teacher data; A trained model generation device comprising:

6. A method for detecting an abnormality in drainage from a facility, the abnormality being manifested as a color, comprising: A drainage image is obtained, which is an image of the drainage. A plurality of simulated wastewater images including images of the simulated wastewater obtained by mixing an abnormality factor color component indicating an abnormality in the wastewater with a non-abnormality factor color component which is a color that may be mistakenly recognized as an abnormality if mixed into the wastewater, each of which appears in a different color due to a different concentration of the non-abnormality factor color component, are generated by learning using correspondence information that associates the simulated wastewater images with an evaluation of the degree of abnormality as training data, and an abnormality in the wastewater from the facility is detected using a trained model that takes the wastewater images as input and outputs an evaluation of the degree of abnormality. A method for detecting drainage abnormalities.

7. A trained model generation method for generating a trained model used to detect an abnormality in wastewater from a facility, which appears as a color, comprising: A plurality of simulated drainage images including images of the simulated drainage obtained by mixing an abnormality factor color component indicating an abnormality in the drainage with a non-abnormality factor color component which is a color that may be mistakenly recognized as an abnormality when mixed into the drainage, each of which appears in a different color due to a different concentration of the non-abnormality factor color component, are obtained as teacher data, and correspondence information that corresponds the evaluation of the degree of abnormality of each of the simulated drainage images is obtained; A trained model is generated by training using the teacher data, the trained model inputting a drainage image and outputting an evaluation of the degree of abnormality. How to generate trained models.

Images