Toilet System

Abstract

To provide a toilet system that can widely detect anomalies in a wide variety of apparatuses.SOLUTION: A toilet system includes an apparatus, an imaging part, a recognition part, and an anomaly determination part. The apparatus is installed in a toilet room. The imaging part is configured to be capable of imaging a user who uses the apparatus. The recognition part recognizes a behavior pattern of a user on the basis of captured images captured by the imaging part. The anomaly determination part determines an anomaly of the apparatus on the basis of the behavior pattern recognized by the recognition part.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The disclosed embodiments relate to a toilet system. [Background technology]

[0002] Various techniques for detecting abnormalities in devices such as toilet devices have been proposed in the past (see, for example, Patent Document 1). In the above-mentioned conventional techniques, an abnormality detection sensor such as an odor sensor is provided near the device such as the toilet device, and an abnormality in the device is detected based on the output of the sensor. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-021148 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, only specific abnormalities that can be detected by an abnormality detection sensor can be detected, and there is room for improvement. In other words, since there are a wide variety of types of abnormalities in devices, there is a risk that the above-mentioned conventional technology cannot detect the abnormalities, and there is room for improvement.

[0005] One aspect of the embodiment aims to provide a toilet system that can widely detect abnormalities in a wide range of equipment. [Means for solving the problem]

[0006] A toilet system according to one aspect of an embodiment is characterized in that it comprises an equipment provided in a toilet room, an imaging unit capable of imaging a user using the equipment, a recognition unit that recognizes a behavioral pattern of the user based on an image captured by the imaging unit, and an abnormality determination unit that determines an abnormality in the equipment based on the behavioral pattern recognized by the recognition unit.

[0007] This makes it possible to detect a wide range of abnormalities in devices. In other words, when using an abnormality detection sensor such as that in the prior art, it may be possible to detect only specific abnormalities. However, by using the user's behavior pattern recognized based on the captured image, it becomes possible to detect abnormalities such as an automatic faucet not discharging water even when the user holds out his or her hand near the water outlet, and therefore it is possible to detect a wide range of abnormalities in devices.

[0008] The device may be an automatic faucet, and the recognition unit may recognize the movement of the user's hands relative to the automatic faucet as the behavior pattern based on the captured image.

[0009] In this way, the abnormality determination unit is able to detect that an abnormality has occurred in the automatic faucet by using a behavior pattern that indicates the user's hand movements relative to the automatic faucet.

[0010] The imaging unit is capable of capturing an image of the automatic faucet's spout and the user's hands, and the recognition unit recognizes a change in the distance between the automatic faucet's spout and the user's hands over time based on the captured image as the behavioral pattern, and the abnormality determination unit determines that an abnormality has occurred in the automatic faucet if the behavioral pattern including the change in distance is a specific pattern.

[0011] In this way, by performing an abnormality determination process using a behavioral pattern that includes changes over time in the distance between the water outlet and the user's hand and a specific pattern, it becomes possible to easily and accurately detect abnormalities in an automatic faucet.

[0012] The abnormality determination unit is further characterized in that it determines that an abnormality has occurred in the automatic faucet when the behavior pattern including the change in distance is the specific pattern that indicates a periodic change.

[0013] In this way, by performing an abnormality determination process using a behavioral pattern that includes changes over time in the distance between the water spout and the user's hand, and a specific pattern that indicates periodic changes, it becomes possible to detect abnormalities in automatic faucets more easily and accurately.

[0014] The automatic faucet is further equipped with a water outlet sensor that detects the user's hand near the water outlet, and the abnormality determination unit determines an abnormality in the automatic faucet based on the behavior pattern and the detection result of the water outlet sensor.

[0015] This enables the abnormality determination unit to detect the occurrence of an abnormality in the automatic faucet and to estimate the location in the automatic faucet where the abnormality has occurred.

[0016] The device may be a urinal, and the recognition unit may recognize movement of the user's head relative to the urinal as the behavior pattern based on the captured image.

[0017] In this way, by using the movement of the user's head relative to the urinal, it is possible to widely detect a wide variety of abnormalities in the equipment (urinal).

[0018] The recognition unit may recognize a trajectory of a user's movement relative to the device as the behavior pattern based on the captured images.

[0019] In this way, by using the behavior pattern including the trajectory of the user's movement relative to the device, it becomes possible to accurately detect that an abnormality has occurred in the device. That is, for example, when the behavior pattern including the trajectory of the movement recognized by the recognition unit is a specific pattern such as, for example, immediately leaving the device and moving on, the abnormality determination unit can determine that an abnormality has occurred in the device, that is, it becomes possible to accurately detect that an abnormality has occurred in the device.

[0020] Further, the device is arranged in a multiple-line arrangement, the imaging unit is capable of capturing an image of a user's movement between the multiple simultaneous devices, and the recognition unit recognizes the user's movement between the multiple simultaneous devices and the user's usage time for the devices as the behavioral pattern based on the captured image, and the abnormality determination unit determines that an abnormality has occurred in the device when at least one of the user's movement between the multiple simultaneous devices and the user's usage time for the devices, which are included in the behavioral pattern, matches a specific pattern.

[0021] In this way, by using the movement of users between multiple devices and the amount of time the users spend using each device, it is possible to widely detect a wide range of abnormalities in the devices in a toilet system in which multiple devices are installed in series. Effect of the Invention

[0022] According to one aspect of the embodiment, abnormalities in a wide range of devices in a toilet system can be widely detected. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram illustrating an overview of a toilet system according to a first embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of the toilet system according to the first embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the specific pattern information. [Figure 4] FIG. 4 is a diagram for explaining the specific pattern information. [Diagram 5] FIG. 5 is a flowchart showing a processing procedure executed by the anomaly detection device. [Figure 6] FIG. 6 is a diagram showing an example of the configuration of a toilet system according to the second embodiment. [Figure 7] FIG. 7 is a diagram for explaining the specific pattern information according to the second embodiment. [Figure 8] FIG. 8 is a diagram showing an example of the configuration of a toilet system according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, an embodiment of the toilet system disclosed in the present application will be described in detail with reference to the attached drawings. Note that the present invention is not limited to the embodiment shown below. It should be noted that the drawings are schematic, and the dimensional relationship of each element, the ratio of each element, and the like may differ from reality. There may also be parts in which the dimensional relationship and ratio differ between the drawings.

[0025] (First embodiment) <Toilet System Overview> First, an outline of the configuration of the toilet system according to the first embodiment will be described below with reference to Fig. 1. Fig. 1 is a diagram for explaining the outline of the toilet system according to the first embodiment.

[0026] As shown in FIG. 1, the toilet system 1 according to this embodiment includes a water faucet 10, a water supply valve 14, an imaging unit 20, an appliance control device 30, and an anomaly detection device 60.

[0027] The faucet 10 is an automatic faucet that includes a water discharge sensor 11 and automatically discharges water when the hand H of a user U is detected by the water discharge sensor 11. For example, the faucet 10 is provided on a washbasin 2 in a toilet room 200. The faucet 10 is an example of a device.

[0028] In detail, the water discharge sensor 11 of the faucet 10 is a human body detection sensor, and detects, for example, the hand H of the user U. When the water discharge sensor 11 detects the hand H, it outputs a detection signal indicating the detection to the appliance control device 30. Note that the water discharge sensor 11 is disposed, for example, near the water outlet 12, but is not limited to this and can be disposed in any position.

[0029] The faucet 10 is connected to a water supply valve 14 via a water supply pipe 13. The water supply valve 14 is, for example, a solenoid valve, and is connected to a water source such as a water pipe (not shown). The water supply valve 14 is controlled to open and close by an appliance control device 30.

[0030] For example, when a detection signal indicating that a hand H or the like has been detected is input from the water discharge sensor 11, the appliance control device 30 opens the water supply valve 14. As a result, water (tap water, etc.) supplied from a water source, for example, is discharged from the water outlet 12 via the water supply valve 14 and the water supply pipe 13 toward the bowl portion 3 of the sink 2.

[0031] Incidentally, if the above-mentioned toilet 200 is, for example, a public toilet, when an abnormality occurs in the device (here, the faucet 10), it is required to detect the abnormality as early as possible and return the device to a normal state.

[0032] However, there are a wide variety of types of abnormalities in devices, and therefore, in the case of a configuration using an abnormality detection sensor as in the conventional technology, there is a risk that only specific abnormalities that can be detected by such a sensor can be detected.

[0033] Here, an example of an abnormality that may occur in the faucet 10, which is an appliance, will be described. In the faucet 10, the water discharge sensor 11 may not be able to properly detect the user U's hands H, etc., resulting in an abnormality in which water is not discharged. The cause of such an abnormality may be, for example, the surface (detection surface) of the water discharge sensor 11, which is prone to being splashed with dirty water from hand washing or soapy water, and therefore prone to adhesion of calcium components and oil contained in dirt such as dirty water. As a result, the water discharge sensor 11 is unable to properly detect the user U's hands H, etc., due to the adhesion of calcium components, etc., and as a result, an abnormality occurs in the faucet 10 in which water is not discharged. It is difficult for the faucet 10 to detect such an abnormality by itself, and a countermeasure has been called for.

[0034] Therefore, in the toilet system 1 according to this embodiment, by providing the imaging unit 20 and anomaly detection device 60 described above, it is possible to widely detect anomalies in a wide range of devices (here, the faucet 10).

[0035] The imaging unit 20 is a camera capable of capturing an image of a user U using the faucet 10. For example, the imaging unit 20 is configured to be able to capture an image of the water outlet 12 of the faucet 10 and the hands H of the user U using the faucet 10. Note that the imaging unit 20 does not need to capture an image of the water outlet 12 itself, but only needs to be able to capture an image of the vicinity of the water outlet 12 (in other words, a position equivalent to the water outlet 12).

[0036] The imaging unit 20 is installed at an appropriate position above the faucet 10 and the washbasin 2 (for example, on the ceiling of the toilet room 200). Note that, in the above description, the imaging unit 20 is installed above the faucet 10, etc., but this is not limited to this. That is, the imaging unit 20 can be installed at any position, and for example, as shown by the imaginary line in Fig. 1, the imaging unit 120 may be installed at a position to the side of the faucet 10 (for example, on the wall surface of the toilet room 200) to capture an image of a hand H, etc.

[0037] The imaging unit 20 outputs the captured image to the anomaly detection device 60. Note that the captured image is moving image data, but is not limited to this, and may be still image data or the like.

[0038] The abnormality detection device 60 can execute an abnormality detection process to detect an abnormality in the faucet 10 (apparatus). Before proceeding with the explanation of the abnormality detection process in the abnormality detection device 60, the action taken by the user U when an abnormality occurs in the faucet 10 will be explained.

[0039] For example, as described above, if there is something attached to the water discharge sensor 11 and it is unable to properly detect the hand H of the user U, causing an abnormality in which water is not discharged from the faucet 10, even if the user U holds out their hand H near the water outlet 12 (in other words, near the water discharge sensor 11), water will not be discharged from the faucet 10. At this time, the user U may perform an action that prompts the water discharge sensor 11 to make a detection, such as by moving their hand H back and forth, as shown by arrow A1.

[0040] In this embodiment, when the user U exhibits such a behavioral pattern, that is, for example, a behavioral pattern of moving the hand H in a forward and backward direction, it is determined that an abnormality has occurred in the faucet 10 (appliance), in other words, it is detected that an abnormality has occurred in the faucet 10. In this specification, expressions indicating directions such as "forward and backward directions" and "left and right directions" are used to mean "forward and backward directions" and "left and right directions" as seen by the user U when the user U is standing in front of the appliance (the faucet 10 in this case) to use it.

[0041] The abnormality detection process will now be described in detail. First, the abnormality detection device 60 acquires an image captured by the imaging unit 20 (step S1).

[0042] Next, the abnormality detection device 60 recognizes the behavior pattern of the user U based on the captured image (step S2). For example, the abnormality detection device 60 analyzes the captured image and extracts the part of the hand H of the user U in the image. Then, the abnormality detection device 60 recognizes the movement of the extracted part of the hand H as the behavior pattern of the user U.

[0043] Next, an abnormality in the faucet 10 (apparatus) is determined based on the recognized behavioral pattern of the user U (step S3). For example, the abnormality detection device 60 stores in advance in the storage unit 80 (see FIG. 2) information indicating a specific behavioral pattern (hereinafter sometimes referred to as a "specific pattern") that the user U may take when an abnormality occurs in the faucet 10, such as a behavioral pattern of moving the hand H back and forth, and compares the recognized behavioral pattern with the stored specific pattern.

[0044] Then, if the recognized behavioral pattern matches or approximately matches a specific pattern, in other words, if the behavioral pattern of user U is a specific pattern, the abnormality detection device 60 determines that an abnormality has occurred in the faucet 10, i.e., detects that an abnormality has occurred in the faucet 10.

[0045] As a result, in this embodiment, abnormalities in a wide variety of devices (here, the faucet 10) can be widely detected.

[0046] When an abnormality in the faucet 10 is detected, the abnormality detection device 60 may notify the administrator who manages the faucet 10 of information indicating that an abnormality has been detected. This allows the administrator to take action such as repairing the faucet 10 in which the abnormality has occurred, thereby enabling the faucet 10 to be quickly returned (restored) to a normal state.

[0047] <Toilet system configuration> Next, the configuration of the toilet system 1 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of the toilet system 1 according to the first embodiment. Note that in the block diagram of Fig. 2, only components necessary for explaining the features of this embodiment are shown as functional blocks, and descriptions of general components are omitted.

[0048] In other words, each component shown in the block diagram of Figure 2 is a functional concept, and does not necessarily have to be physically configured as shown in the figure. For example, the specific form of distribution and integration of each functional block is not limited to that shown in the figure, and all or part of it can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0049] As shown in FIG. 2, the toilet system 1 includes the water discharge sensor 11, the water supply valve 14, an imaging unit 20, an appliance control device 30, and an abnormality detection device 60.

[0050] The water discharge sensor 11 is a sensor that detects, for example, the hand H of the user U near the water outlet 12 (see FIG. 1). The water discharge sensor 11 can output a detection signal indicating that the hand H of the user U has been detected to the equipment control device 30. Note that the water discharge sensor 11 can be, but is not limited to, a photoelectric sensor or a radio wave sensor.

[0051] The water supply valve 14 is an electromagnetic valve that supplies or stops water to the faucet 10. For example, the water supply valve 14 opens and closes in response to a control signal input from the appliance control device 30 to supply or stop water to the faucet 10. Note that the "water" is not limited to room temperature water such as clean water (tap water), and may be, for example, hot water, a mixture of hot and cold water, cold water, etc.

[0052] The imaging unit 20 is a camera (e.g., an AI camera) capable of capturing an image of a user U using the faucet 10. The imaging unit 20 outputs the captured image to the anomaly detection device 60. Note that the imaging unit 20 includes, for example, a lens and an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), but is not limited to this.

[0053] The device control device 30 controls the faucet 10, which is an example of a device. Specifically, the device control device 30 includes a control unit 40 and a storage unit 50. The control unit 40 is realized by, for example, a central processing unit (CPU) or a micro processing unit (MPU) executing a program stored in the storage unit 50 using a random access memory (RAM) as a working area. The control unit 40 can also be realized by hardware such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The storage unit 50 has a volatile memory and a non-volatile memory, and is realized by, for example, a semiconductor memory element such as a RAM or a flash memory.

[0054] Specifically, the control unit 40 includes an acquisition unit 41 and an equipment control unit 42. The acquisition unit 41 acquires a detection signal output from the water discharge sensor 11, which indicates that the hand H of the user U or the like has been detected. When the acquisition unit 41 acquires the detection signal from the water discharge sensor 11, it outputs information indicating that the detection signal has been acquired to the equipment control unit 42 and the abnormality detection device 60. In this way, the acquisition unit 41 can output the presence or absence of a detection signal output from the water discharge sensor 11 to the equipment control unit 42 and the abnormality detection device 60 as the detection result of the water discharge sensor 11.

[0055] The appliance control unit 42 controls the opening and closing of the water supply valve 14, etc. For example, when information indicating that a detection signal from the water discharge sensor 11 has been acquired is input, the appliance control unit 42 opens the water supply valve 14. This causes water to be discharged from the water outlet 12 in the faucet 10.

[0056] The abnormality detection device 60 detects an abnormality in the faucet 10, which is an example of a device. Specifically, the abnormality detection device 60 includes a control unit 70 and a storage unit 80. The control unit 70 is realized, for example, by a CPU or MPU, executing a program stored in the storage unit 80 using a RAM as a working area. The control unit 70 can also be realized by hardware, for example, an ASIC or an FPGA. The storage unit 80 has volatile and non-volatile memory, and is realized, for example, by a semiconductor memory element, such as a RAM or a flash memory.

[0057] Specifically, the control unit 70 includes an acquisition unit 71, a recognition unit 72, an abnormality determination unit 73, and a notification unit 74. The storage unit 80 stores specific pattern information 81 and the like.

[0058] The specific pattern information 81 is information indicating a specific behavior pattern (specific pattern) that a user U may take when, for example, an abnormality occurs in a device (here, the faucet 10). Here, the specific pattern information 81 will be explained using FIG. 3. FIG. 3 is a diagram showing an example of the specific pattern information 81. As shown in FIG. 3, the specific pattern information 81 includes items such as "pattern ID" and "specific pattern," and each item is associated with each other.

[0059] The "pattern ID" is identification information for identifying a specific pattern. The "specific pattern" is information indicating a specific pattern. Note that in the example shown in FIG. 3, for convenience, the "specific pattern" is abstractly described as "specific pattern C01", but specific information is stored in "specific pattern C01".

[0060] In the example shown in FIG. 3, the data of the specific pattern identified by the pattern ID "B01" indicates that the specific pattern is "specific pattern C01."

[0061] Here, the information contained in the "specific pattern" of the specific pattern information 81 will be specifically described with reference to Fig. 4. Fig. 4 is a diagram for explaining the specific pattern information, and is a diagram of the faucet 10, user U, etc., viewed from above. Note that here, specific patterns that the user U may take when an abnormality occurs, for example, when the user U holds out his / her hand H near the water outlet 12 and water is not discharged from the faucet 10, are described, but the type of abnormality is not limited to this.

[0062] 4, if water does not come out from the faucet 10 even when the user U holds out their hand H near the water outlet 12, it is estimated that the user U may adopt a behavior pattern of moving their hand H back and forth, as indicated by the arrow A1. Therefore, such a behavior pattern is included in the "specific pattern" of the specific pattern information 81.

[0063] In this way, the "specific pattern" of the specific pattern information 81 includes information indicating the movement of the user U's hand H relative to the faucet 10 when an abnormality occurs in the faucet 10. As an example of such a movement of the hand H, the user U may adopt a behavioral pattern in which the hand H is moved back and forth multiple times (in other words, moved back and forth) when an abnormality occurs in the faucet 10. At this time, the distance L between the water outlet 12 and the hand H changes periodically over time; more specifically, the distance L becomes longer and shorter over time. Therefore, a behavioral pattern in which the change over time of the distance L between the water outlet 12 and the hand H shows a periodic change is included in the "specific pattern" of the specific pattern information 81.

[0064] In addition, Figure 4 shows an example in which the distance L is from the water outlet 12 to the tip of the hand H, but this is not limited to this, and for example, the distance from the water outlet 12 to the center of gravity of the hand H (more precisely, the center of gravity of a part of the hand H in the captured image) may also be used.

[0065] In addition, in the above, the behavioral pattern of moving the hand H in a forward and backward direction is included in the specific pattern information 81, but this is not limited to this, and other behavioral patterns may be included in the specific pattern information 81, such as a behavioral pattern of moving the hand H in a left and right direction near the water outlet 12 (see arrow A2).

[0066] Although not shown, the movement trajectory of the user U relative to the faucet 10 may be included in the specific pattern information 81. In other words, if the user U holds out his / her hand H near the water outlet 12 but water does not flow from the faucet 10, it is estimated that the user U may adopt a behavior pattern in which the user immediately moves away from the faucet 10. Therefore, the specific pattern information 81 may include a behavior pattern indicating a movement trajectory in which the user immediately moves away from the faucet 10.

[0067] Returning to the explanation of Fig. 2, the acquisition unit 71 of the control unit 70 acquires a captured image from the imaging unit 20. The acquisition unit 71 outputs the acquired captured image to the recognition unit 72. The acquisition unit 71 also acquires a detection result of the water discharge sensor 11, and outputs the acquired detection result to the abnormality determination unit 73.

[0068] The recognition unit 72 recognizes the behavioral pattern of the user U based on the captured image captured by the imaging unit 20. For example, the recognition unit 72 analyzes the captured image and extracts a part of the hand H of the user U in the image. Next, the recognition unit 72 recognizes (detects) the movement of the extracted part of the hand H over time as the behavioral pattern of the user U. Note that any analysis method can be used for the analysis of the captured image described above.

[0069] In detail, the recognition unit 72 recognizes the movement of the hand H of the user U relative to the faucet 10 as a behavior pattern based on the captured image. In this way, by the recognition unit 72 recognizing the movement of the hand H of the user U relative to the faucet 10 as a behavior pattern, it becomes possible to detect the occurrence of an abnormality in the faucet 10, as described below.

[0070] Furthermore, for example, the recognition unit 72 may recognize a change over time in the distance L (see FIG. 4) between the water outlet 12 and the hand H of the user U based on the captured images as a behavioral pattern. As one example, the recognition unit 72 may calculate the distance L between the water outlet 12 and a part of the hand H extracted by analyzing the captured images, and recognize the change over time (e.g., the amount of change or rate of change) of the calculated distance L (see FIG. 4) as a behavioral pattern.

[0071] Furthermore, the recognition unit 72 may recognize the trajectory of the user U's movement relative to the faucet 10 as a behavior pattern based on the captured image. For example, the recognition unit 72 analyzes the captured image to extract body parts of the user U in the image. The recognition unit 72 may then take the trajectory of the extracted body parts as the trajectory of the user U's movement and recognize this trajectory as the behavior pattern of the user U. In this way, by the recognition unit 72 recognizing the trajectory of the user U's movement relative to the faucet 10, which is an example of a device, as a behavior pattern, it becomes possible to accurately detect the occurrence of an abnormality in the device, as described below.

[0072] The recognition unit 72 outputs the behavior pattern recognized (detected) as described above to the abnormality determination unit 73.

[0073] The abnormality determination unit 73 determines an abnormality in the device (the faucet 10 in this case) based on the behavior pattern recognized by the recognition unit 72. For example, the abnormality determination unit 73 reads out the specific pattern information 81 from the storage unit 80, and compares the recognized behavior pattern with the specific pattern included in the specific pattern information 81.

[0074] Then, if the recognized behavior pattern matches or approximately matches a specific pattern (for example, a specific behavior pattern such as moving the hand H back and forth), in other words, if the behavior pattern of the user U is a specific pattern, the abnormality determination unit 73 determines that an abnormality has occurred in the faucet 10, i.e., detects that an abnormality has occurred in the faucet 10.

[0075] As a result, in this embodiment, it is possible to widely detect abnormalities in a wide variety of devices (faucets 10). That is, when using an abnormality detection sensor such as in the prior art, there is a risk that only specific abnormalities can be detected. However, in this embodiment, by using the behavioral pattern of the user U recognized based on the captured image, it is possible to detect abnormalities such as water not being discharged from the faucet 10 even when the user U holds out his / her hand H near the water outlet 12, and therefore it is possible to widely detect abnormalities in a wide variety of devices (faucets 10).

[0076] Furthermore, the abnormality determination unit 73 determines an abnormality in the faucet 10 based on a behavior pattern indicating the movement of the hand H of the user U relative to the faucet 10 recognized by the recognition unit 72. In this way, the abnormality determination unit 73 can detect that an abnormality has occurred in the faucet 10 by using a behavior pattern indicating the movement of the hand H of the user U relative to the faucet 10.

[0077] In addition, when a change over time in the distance L (see Figure 4) between the water outlet 12 and the hand H of the user U is recognized and input as a behavioral pattern, the abnormality determination unit 73 can determine an abnormality in the faucet 10 based on the behavioral pattern including the change in distance L.

[0078] For example, the abnormality determination unit 73 reads out the specific pattern information 81 from the memory unit 80, and compares the behavior pattern including the change in distance L with the specific pattern included in the specific pattern information 81. Then, when the behavior pattern including the change in distance L is a specific pattern, the abnormality determination unit 73 determines that an abnormality has occurred in the faucet 10.

[0079] In this way, by performing an abnormality determination process using a behavioral pattern including the change over time in the distance L between the water outlet 12 and the hand H of the user U, and a specific pattern, it becomes possible to easily and accurately detect abnormalities in the faucet 10.

[0080] Specifically, when the behavior pattern including the change in distance L is a specific pattern that indicates a periodic change, the abnormality determination unit 73 determines that an abnormality has occurred in the faucet 10. As an example, the abnormality determination unit 73 determines that an abnormality has occurred in the faucet 10 when the distance L periodically changes, for example, becoming longer or shorter over time.

[0081] In this way, by performing an abnormality determination process using a behavioral pattern that includes changes over time in the distance L between the water outlet 12 and the hand H of the user U, and a specific pattern that indicates periodic changes, it becomes possible to detect abnormalities in the faucet 10 more easily and accurately.

[0082] In addition, in this embodiment, as described above, by storing the specific pattern in advance in the storage unit 80 as the specific pattern information 81, it becomes possible to detect an abnormality in the device (the faucet 10) with a simple configuration. That is, if the behavioral patterns that the user U may take when an abnormality occurs in the faucet 10 were calculated using machine learning or the like, a large amount of teacher data would be required, which would increase the processing load and lead to a complication of the abnormality detection process. In contrast, in this embodiment, by preparing in advance a specific pattern with simple content as described above as the specific pattern information 81, it is possible to reduce the processing load in the abnormality detection process, and as a result, it becomes possible to detect an abnormality in the device (the faucet 10) with a simple configuration.

[0083] Furthermore, when the movement trajectory of the user U is recognized and input as a behavior pattern, the abnormality determination unit 73 can determine an abnormality in the device (faucet 10) based on the behavior pattern including the movement trajectory.

[0084] For example, the abnormality determination unit 73 reads out the specific pattern information 81 from the storage unit 80, and compares the behavior pattern including the trajectory of the user U's movement with the specific pattern included in the specific pattern information 81. Then, when the behavior pattern including the trajectory of the movement is, for example, a specific pattern in which the user immediately leaves the appliance (faucet 10) and moves on, the abnormality determination unit 73 determines that an abnormality has occurred in the appliance, that is, detects that an abnormality has occurred in the appliance. In this way, the abnormality determination unit 73 can accurately detect that an abnormality has occurred in the appliance by using the behavior pattern including the trajectory of the user U's movement relative to the appliance (faucet 10).

[0085] Furthermore, the abnormality determination unit 73 may determine an abnormality in the faucet 10 based on the behavioral pattern and the detection result of the water discharge sensor 11. This enables the abnormality determination unit 73 to detect the occurrence of an abnormality in the faucet 10 and to estimate the location in the faucet 10 where the abnormality has occurred.

[0086] For example, if the behavior pattern of the user U is a specific pattern of moving the hand H back and forth as described above, the abnormality determination unit 73 can determine that an abnormality has occurred in the faucet 10, i.e., detect that an abnormality has occurred in the faucet 10.

[0087] At this time, the abnormality determination unit 73 estimates the location where the abnormality has occurred in the faucet 10 based on the detection result of the water discharge sensor 11. For example, when the detection result of the water discharge sensor 11 includes information indicating that the hand H of the user U has not been detected (i.e., when no detection signal is being output from the water discharge sensor 11), this means that even though the hand H is held out near the water outlet 12 and moving back and forth, the water discharge sensor 11 is unable to detect the hand H. Therefore, when the detection result of the water discharge sensor 11 includes information indicating that the hand H has not been detected, the abnormality determination unit 73 can estimate that the location where the abnormality has occurred is the water discharge sensor 11.

[0088] On the other hand, for example, when the detection result of the water discharge sensor 11 includes information indicating that the hand H of the user U has been detected (i.e., when a detection signal is output from the water discharge sensor 11), it can be estimated that the location where the abnormality has occurred is a location other than the water discharge sensor 11. In other words, when the water discharge sensor 11 detects the hand H or the like, but the user U's behavior pattern is a specific pattern such as moving the hand H back and forth, this means that water is not being discharged due to an abnormality in a water supply side location such as the water supply valve 14 or the appliance control device 30. Therefore, when the detection result of the water discharge sensor 11 includes information indicating that the hand H or the like has been detected, the abnormality determination unit 73 can estimate that the location where the abnormality has occurred is a water supply side location such as the water supply valve 14.

[0089] In this way, by using the behavior pattern and the detection results of the water discharge sensor 11, the abnormality determination unit 73 can detect the occurrence of an abnormality in the faucet 10 and estimate the location in the faucet 10 where the abnormality has occurred.

[0090] As described above, when the abnormality determination unit 73 detects that an abnormality has occurred in the device (faucet 10), it outputs abnormality occurrence information indicating the occurrence of the abnormality to the notification unit 74. The abnormality occurrence information may include information indicating the location where the abnormality has occurred.

[0091] When abnormality information is input from the abnormality determination unit 73, the notification unit 74 notifies the manager who manages the device (faucet 10) of the information. For example, the notification unit 74 notifies a terminal device (not shown) used by the manager of the abnormality information via a communication network such as the Internet. Based on the abnormality information notified to the terminal device, the manager can take action such as repairing the device (the faucet 10 in this case) in which the abnormality is occurring, thereby enabling the faucet 10 to be quickly returned (restored) to a normal state.

[0092] <Control process of the abnormality detection device according to the first embodiment> Next, a specific processing procedure in the anomaly detection device 60 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the processing procedure executed by the anomaly detection device 60.

[0093] 5, the control unit 70 of the abnormality detection device 60 acquires a captured image from the imaging unit 20 (step S10). Next, the control unit 70 recognizes a behavior pattern of the user U based on the captured image (step S11).

[0094] Next, the control unit 70 determines whether the recognized behavior pattern is a specific pattern (step S12). If the control unit 70 determines that the recognized behavior pattern is a specific pattern (step S12, Yes), it determines that an abnormality has occurred in the device (e.g., the faucet 10) (step S13).

[0095] On the other hand, if the control unit 70 determines that the recognized behavior pattern is not a specific pattern (step S12, No), it skips the process of step S13 and ends the process.

[0096] As described above, the toilet system 1 according to the first embodiment includes a device (faucet 10), an imaging unit 20, a recognition unit 72, and an abnormality determination unit 73. The device is provided in a toilet room 200. The imaging unit 20 is configured to be able to capture an image of a user using the device. The recognition unit 72 recognizes the behavior pattern of the user based on the image captured by the imaging unit 20. The abnormality determination unit 73 determines an abnormality in the device based on the behavior pattern recognized by the recognition unit 72. This makes it possible to widely detect a wide range of abnormalities in the devices.

[0097] 2, an example has been shown in which the equipment control device 30 and the anomaly detection device 60 are separate devices, but this is merely an example and is not limiting. That is, for example, one device may have all of the functions of the equipment control device 30 and the anomaly detection device 60, or three or more devices may have the functions of the equipment control device 30 and the anomaly detection device 60 in a distributed manner.

[0098] Second embodiment Next, a second embodiment will be described. In the following description, the same reference numerals as those already described will be used to designate the same parts as those already described, and duplicated descriptions may be omitted.

[0099] Fig. 6 is a diagram showing a configuration example of the toilet system 1 according to the second embodiment. Fig. 6 is a front view of the equipment (faucet 10) and the like included in the toilet system 1 according to the second embodiment.

[0100] As shown in Fig. 6, the toilet system 1 according to the second embodiment includes a plurality of faucets 10 (three in this example), which are an example of equipment. In the following, the faucet 10a provided on the left side in Fig. 6 may be referred to as the "first faucet 10a," the faucet 10b provided in the center as the "second faucet 10b," and the faucet 10c provided on the right side as the "third faucet 10c," but when no distinction is made between them, they will be referred to as "faucet 10."

[0101] The first, second and third faucets 10a, 10b and 10c are provided in series in the left-right direction. Although Fig. 6 shows an example in which there are three faucets 10, the present invention is not limited to this and may be, for example, two or four or more faucets.

[0102] The imaging units 20 are installed at appropriate positions (for example, on the ceiling of the toilet room 200) above the first, second and third faucets 10a, 10b, 10c, respectively. Each of the multiple imaging units 20 (three in this case) is configured to be able to capture an image of the water outlet 12 of the corresponding faucet 10, and the hand H of a user U (not shown), etc.

[0103] Moreover, the imaging unit 20 according to the second embodiment is configured to be capable of capturing an image of the movement of a user U between a plurality of adjacent faucets 10.

[0104] In the above description, the imaging unit 20 is installed above the faucet 10, etc., but this is not limited to the present invention. The imaging unit 20 can be installed in any position, and for example, as shown by imaginary lines in Fig. 6, the imaging unit 220 may be installed on the wall surface of the toilet room 200 corresponding to a space between a plurality of adjacent faucets 10, or may be installed at a position to the side of the faucet 10 like the imaging unit 120 shown in Fig. 1, to capture images of the hand H of the user U and the movements of the user U.

[0105] In the toilet room 200, the mirrors 4 are provided at positions corresponding to the first, second and third water faucets 10a, 10b and 10c, respectively, but are not limited to this.

[0106] In the second embodiment, a toilet system 1 in which a plurality of devices (faucets 10) as described above are arranged in series is configured to be able to widely detect abnormalities in a wide range of devices (the faucets 10 in this case).

[0107] To explain in more detail below, in the second embodiment, when an abnormality occurs in one or more of multiple adjacently installed devices (faucets 10), a specific behavioral pattern that a user U may take is pre-set as specific pattern information 81 (see Figures 2 and 3).

[0108] Here, the information included in the "specific pattern" of the specific pattern information 81 according to the second embodiment will be specifically described with reference to Fig. 7. Fig. 7 is a diagram for explaining the specific pattern information according to the second embodiment, and is a diagram of the faucet 10, the user U, etc., as viewed from above. Note that, here, specific patterns that the user U may take when an abnormality occurs, for example, when the user U places his / her hand H near the water outlet 12 of the first faucet 10a and water is not discharged from the first faucet 10a, are illustrated and described, but the type of abnormality is not limited to this.

[0109] As shown in FIG. 7, when the user U holds out his / her hand H near the water outlet 12 of the first faucet 10a but water does not flow from the first faucet 10a, it is estimated that the user U may adopt a behavior pattern of moving to the adjacent washbasin 2 and using the second faucet 10b, as shown by the arrow A3. Therefore, such a behavior pattern is included in the "specific pattern" of the specific pattern information 81. That is, the "specific pattern" of the specific pattern information 81 according to the second embodiment is configured to include information indicating the movement of the user U between multiple simultaneous devices when an abnormality occurs in the faucet 10. In FIG. 7, the user U who moves to use the second faucet 10b is shown by a dashed line.

[0110] Furthermore, if water does not dispense from the first faucet 10a even when hand H is held out near the water outlet 12 of the first faucet 10a, it is estimated that the user U may have a behavior pattern in which the time the user U uses the first faucet 10a (more precisely, the time they stand in front of the first faucet 10a) is relatively short. For this reason, such a behavior pattern is included in the "specific pattern" of the specific pattern information 81. That is, the "specific pattern" of the specific pattern information 81 according to the second embodiment is configured to include information indicating the time the user used the device when an abnormality occurred in the faucet 10.

[0111] In the abnormality detection processing according to the second embodiment, the recognition unit 72 recognizes the movement of the user U between multiple adjacent devices (faucets 10) and the user's usage time for the devices as a behavior pattern based on the captured images captured by the imaging unit 20.

[0112] Next, if the movement of the user U between multiple connected devices (faucets 10) included in the behavioral pattern is a specific pattern, more specifically, if the movement is a specific pattern such as moving to an adjacent sink 2 and using a different faucet 10, the abnormality determination unit 73 determines that an abnormality has occurred in the device before the movement (here, the first faucet 10a).

[0113] In addition, the abnormality determination unit 73 determines that an abnormality has occurred in the appliance (here, the first faucet 10a) if the user U's usage time for the appliance, which is included in the behavior pattern, is a specific pattern, more specifically, a specific pattern that is a relatively short time.

[0114] In this way, in the second embodiment, by using the movement of the user U between multiple devices and the time the user U uses each device, it is possible to widely detect abnormalities in a wide range of devices (faucets 10) in a toilet system 1 in which multiple devices (faucets 10) are installed in series.

[0115] In the above, an example has been shown in which both the movement of the user U among a plurality of devices and the usage time of the user U for each device are used, but a configuration may be used in which either one of them is used.

[0116] (Third embodiment) Next, a third embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the configuration of a toilet system 1 according to a third embodiment. As shown in Fig. 8, in the third embodiment, the equipment provided in a toilet room 200 is a urinal 110. Note that Fig. 8 is a diagram showing the equipment (urinal 110) and the like included in the toilet system 1 according to the third embodiment as viewed from above.

[0117] As shown in Fig. 8, the toilet system 1 according to the third embodiment is equipped with a plurality of urinals 110 (three in this example), which are an example of equipment. In the following, the urinal 110 provided on the left side in Fig. 8 may be referred to as the "first urinal 110a", the urinal 110 provided in the center as the "second faucet 10b", and the urinal 110 provided on the right side as the "second urinal 110b", but when no particular distinction is made between them, they will be referred to as "urinal 110".

[0118] The first, second and third urinals 110a, 110b, 110c are provided in series in the left-right direction. Although Fig. 8 shows an example in which there are three urinals 110, the number of urinals is not limited to this, and may be, for example, two or four or more. Furthermore, the urinal 110 is equipped with, for example, a sensor that detects a user U, and can automatically discharge flushing water in response to the detection result of the sensor, but is not limited to this.

[0119] Although not shown, the imaging units 20 are installed at appropriate positions (for example, on the ceiling of the toilet room 200) above the first, second and third urinals 110a, 110b, 110c, respectively, as in the first and second embodiments. Each of the multiple imaging units 20 (three in this case) is configured to be able to image the movement of a user U using the corresponding urinal 110, the head D of the user U, etc.

[0120] In the third embodiment, in a toilet system 1 in which a plurality of devices (urinals 110) as described above are provided in series, a configuration is provided in which abnormalities in a wide range of devices (urinals 110 in this case) can be widely detected.

[0121] To explain in more detail below, in the third embodiment, when an abnormality occurs in one or more of multiple adjacently installed devices (urinals 110), a specific behavioral pattern that a user U may adopt is preset as specific pattern information 81 (see Figures 2 and 3).

[0122] In the third embodiment, the equipment abnormality is an abnormality such as clogging or excessive dirt in the urinal 110, and in the following, specific patterns that the user U may take when an abnormality such as clogging occurs in the first urinal 110a will be described as examples, but the types of abnormality are not limited to these.

[0123] As shown in Fig. 8, when the first urinal 110a is clogged, it is estimated that the user U may adopt a behavior pattern of moving to the adjacent second urinal 110b to use the second urinal 110b, as indicated by the arrow A4. Therefore, such a behavior pattern is included in the "specific pattern" of the specific pattern information 81. That is, the "specific pattern" of the specific pattern information 81 according to the third embodiment is configured to include information indicating the movement of the user U between multiple connected devices when an abnormality occurs in the urinal 110. In Fig. 8, the user U who moves to use the second urinal 110b is indicated by a dashed line.

[0124] Furthermore, if the first urinal 110a is clogged, it is estimated that the user U may adopt a behavior pattern of moving his / her head D forward and peering into the first urinal 110a, as indicated by the arrow A5. Therefore, such a behavior pattern is included in the "specific pattern" of the specific pattern information 81. That is, the "specific pattern" of the specific pattern information 81 according to the third embodiment is configured to include information indicating the movement of the head D of the user U relative to the urinal 110 when an abnormality occurs in the urinal 110. In FIG. 8, the user U who moves his / her head D forward and peers into the first urinal 110a is indicated by a two-dot chain line.

[0125] In the abnormality detection processing according to the third embodiment, the recognition unit 72 recognizes the movement of the user U between multiple adjacent devices (urinals 110) and the movement of the user U's head D relative to the urinal 110 as a behavioral pattern based on the captured images captured by the imaging unit 20.

[0126] Next, if the movement of the user U between multiple adjacent devices (urinals 110) included in the behavior pattern matches a specific pattern, more specifically, if the movement matches a specific pattern of moving to an adjacent urinal 110 and using that urinal 110, the abnormality determination unit 73 determines that an abnormality such as a blockage has occurred in the device before the movement (here, the first urinal 110a).

[0127] Furthermore, when the movement of the user U's head D relative to the urinal 110, which is included in the behavioral pattern, is a specific pattern, more specifically, when the head D is moved forward and peers into the urinal 110, the abnormality determination unit 73 determines that an abnormality has occurred in the device (here, the first urinal 110a).

[0128] In this way, in the third embodiment, by using the movement of the user U between multiple devices and the movement of the user U's head D relative to the urinal 110, it is possible to widely detect abnormalities in a wide range of devices (urinals 110) in a toilet system 1 in which multiple devices (urinals 110) are arranged in series.

[0129] In the above, an example has been shown in which both the movement of the user U between a plurality of devices and the head D of the user U relative to the urinal 110 are used, but a configuration may be used in which either one of them is used.

[0130] In the above-described embodiments, the faucet 10 and the urinal 110 are used as examples of equipment, but the equipment is not limited to these and may be other types of equipment provided in the toilet room 200, such as a hand dryer or a toilet bowl.

[0131] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0132] 1. Toilet System 10 Faucet 20 Imaging unit 72 Recognition part 73 Abnormality determination section

Claims

1. Equipment provided in the toilet room; an imaging unit capable of imaging a user who uses the device; a recognition unit that recognizes a behavior pattern of a user based on an image captured by the imaging unit; an abnormality determination unit that determines an abnormality in the device based on the behavior pattern recognized by the recognition unit; A toilet system comprising:

2. The device is an automatic faucet, The recognition unit is Recognizing the user's hand movement relative to the automatic faucet as the behavior pattern based on the captured image.

2. The toilet system according to claim 1,

3. The imaging unit includes: The image captured can include a water outlet of the automatic faucet and a user's hands, The recognition unit is Based on the captured image, a change over time in the distance between the water outlet and the user's hand is recognized as the behavior pattern; The abnormality determination unit is When the behavior pattern including the change in distance is a specific pattern, it is determined that an abnormality has occurred in the automatic faucet.

3. The toilet system according to claim 2,

4. The abnormality determination unit is When the behavior pattern including the change in distance is the specific pattern indicating a periodic change, it is determined that an abnormality has occurred in the automatic faucet.

4. The toilet system according to claim 3,

5. The automatic faucet is A water outlet sensor that detects the user's hand near the water outlet Equipped with The abnormality determination unit Determining an abnormality in the automatic faucet based on the behavior pattern and the detection result of the water discharge sensor. The toilet system according to any one of claims 2 to 4, characterized in that

6. the device is a urinal, The recognition unit is Recognizing a movement of the user's head relative to the urinal as the behavior pattern based on the captured image.

2. The toilet system according to claim 1,

7. The recognition unit is Recognizing a trajectory of a user's movement relative to the device as the behavior pattern based on the captured images. The toilet system according to any one of claims 1 to 6, characterized in that

8. The device is provided in a plurality of parallel arrangements, The imaging unit includes: A movement of a user between a plurality of the devices connected in series can be captured as the captured image, The recognition unit is Recognizing, based on the captured images, the movement of the user among the plurality of simultaneous devices and the time the user spends using the devices as the behavior pattern; The abnormality determination unit When at least one of the user's movement among the plurality of simultaneous devices and the user's usage time for the devices, which are included in the behavior pattern, matches a specific pattern, it is determined that an abnormality has occurred in the device. The toilet system according to any one of claims 1 to 7, characterized in that

Images