Water discharge control system

Abstract

To provide a water discharge control system capable of executing user-friendly control relating to water discharge and stoppage.SOLUTION: A water discharge control system according to an embodiment comprises: an imaging section configured to capture at least a water discharge area of a water discharge section; an image processing section configured to process an image captured by the imaging section; a state determination section configured to determine a state of the imaging section based on the image captured by the imaging section; and a control section configured to control a water discharge state of the water discharge section, wherein the control section switches between a first mode based on a processing result of the image processing section and a second mode based on a determination result of the state determination section.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The disclosed embodiments relate to a water discharge control system. [Background technology]

[0002] Conventionally, in a water discharge control device, a technology has been disclosed that controls water discharge based on the imaging results obtained by an imaging device (imaging unit), and a technology has been disclosed that controls the water discharge pattern depending on the target object (see, for example, Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-178512 [Patent Document 2] Patent Publication No. 2021-117571 [Patent Document 3] Japanese Patent Application Laid-Open No. 2009-130700 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional technology has room for improvement. For example, in the above-mentioned conventional technology, when used in a wet space, poor image capture may occur depending on the condition of the imaging unit, such as water droplets adhering to the imaging unit or scratches. In this case, the object of water discharge cannot be accurately determined from the captured image, and problems such as the water discharge control system not operating properly or malfunctioning may occur, making it difficult to say that the control of water discharge and stopping is user-friendly. As such, the above-mentioned conventional technology has room for improvement, and it is desirable to implement control of water discharge and stopping that is user-friendly.

[0005] The disclosed embodiment aims to provide a water discharge control system that executes control related to stopping and discharging water in a manner that is user-friendly. [Means for solving the problem]

[0006] A water discharge control system according to one aspect of the embodiment includes an imaging unit that captures an image of at least the water discharge area of ​​the water discharge unit, an image processing unit that processes the image captured by the imaging unit, a state determination unit that determines the state of the imaging unit based on the image captured by the imaging unit, and a control unit that controls the water discharge state of the water discharge unit, and is characterized in that the control unit switches between a first mode based on the processing result of the image processing unit and a second mode based on the determination result of the state determination unit.

[0007] According to one aspect of the embodiment, the water discharge control system can switch between a first mode based on the processing results of the image processing unit and a second mode based on the determination results of the state determination unit, thereby enabling water discharge control according to the state of the image capture unit and enabling user-friendly control of water discharge and stopping. For example, if water discharge control is performed based on the captured image when the image capture unit is dirty, there is a possibility that erroneous water discharge control unintended by the user will occur. Therefore, by switching from the first mode (normal state) that performs normal automatic water discharge control to the second mode that performs special water discharge control based on the state (dirt, scratches) of the image capture unit, erroneous water discharge caused by dirt on the image capture unit can be prevented, and user-friendly control of water discharge and stopping can be performed.

[0008] In a water discharge control system according to one aspect of the embodiment, the first mode has a plurality of water discharge patterns based on the processing results of the image processing unit, and the second mode has a plurality of water discharge patterns based on the judgment results of the state judgment unit.

[0009] According to one aspect of the embodiment, the water discharge control system has multiple water discharge patterns in each of the first and second modes, allowing for flexible adjustment of water discharge and enabling control of water discharge stoppage that is user-friendly. For example, if the system uniformly determines that an abnormality has occurred and suddenly stops water discharge regardless of whether the image capture unit is heavily soiled or not, this may be inconvenient for the user. Therefore, for example, even in the second mode when an abnormality occurs, the water discharge control system can select from multiple water discharge controls depending on the level of the abnormality (such as the level of dirt), thereby eliminating the inconvenience caused by uniform control as an abnormality.

[0010] In one aspect of the embodiment, in the water discharge control system, the control unit selects a water discharge form based on the processing results of the image processing unit and performs water discharge control in the first mode, and selects a water discharge form based on the judgment result of the state judgment unit and performs water discharge control in the second mode.

[0011] According to one aspect of the embodiment, the water discharge control system selects a water discharge form in each of the first and second modes to control the water discharge, enabling flexible adjustment of water discharge and enabling control of water discharge stoppage that is user-friendly. For example, if the water discharge control system uniformly determines an abnormality and immediately stops water discharge regardless of whether the image capture unit is heavily soiled or not, this may be inconvenient for the user. Therefore, for example, even in the second mode when an abnormality occurs, the water discharge control system can select from multiple water discharge control modes depending on the degree of the abnormality (such as the degree of soiling), thereby eliminating the inconvenience caused by uniform control as an abnormality.

[0012] In one aspect of the embodiment, in the water discharge control system, the image processing unit determines whether the object to be imaged detected from the image captured by the imaging unit is an object to be discharged with water in the first mode, and the control unit controls the water discharge state based on the state of the object to be discharged with water.

[0013] For example, there may be cases where water should not be discharged onto an object simply placed in the sink. Therefore, according to the water discharge control system of one aspect of the embodiment, the water discharge state can be controlled based on the state of the object to be discharged, thereby improving usability. Therefore, the water discharge control system can execute control related to stopping and discharging water in a manner that is user-friendly.

[0014] In one aspect of the embodiment, the image processing unit determines, in the first mode, that among the objects being imaged, those that have a predetermined moving speed or are within the water discharge area are the objects to be subjected to water discharge.

[0015] For example, there may be cases where water should not be discharged onto an object that is simply placed in the sink. Therefore, according to the water discharge control system of one aspect of the embodiment, an object that is determined to be in use is determined to be a water discharge target and water is discharged onto that object, thereby improving usability. Therefore, the water discharge control system can execute control related to stopping and discharging water in a manner that is user-friendly.

[0016] In one aspect of the embodiment, the image processing unit controls the instantaneous water discharge flow rate from the water discharge unit in the first mode based on at least one of the size, type, and distance between the water discharge outlet of the water discharge unit and the object to be discharged.

[0017] For example, the desired water discharge flow rate (water pressure) may vary depending on the object to be discharged and the distance from the water outlet. For example, if the water pressure is too strong, splashing may occur, while if the water pressure is too weak, sufficient cleaning may not be achieved. Therefore, according to one aspect of the water discharge control system, by controlling the instantaneous water discharge flow rate based on at least one of the size of the object to be discharged, the type of object to be discharged, or the distance between the water outlet of the water discharge unit and the object to be discharged, it is possible to set the water discharge flow rate (water pressure) appropriate for the water discharge situation, thereby preventing splashing while providing sufficient cleaning and improving usability. Therefore, the water discharge control system can execute control related to stopping and discharging water in a way that is user-friendly.

[0018] In one aspect of the embodiment, in the water discharge control system, the control unit switches from the first mode to the second mode when, based on the image captured by the imaging unit, the dirt on the imaging unit is equal to or greater than a first threshold.

[0019] According to a water discharge control system according to one aspect of the embodiment, by switching from the first mode to the second mode based on the degree of dirt on the imaging unit (degree of dirt), water discharge control according to the state of the imaging unit is possible, and user-friendly control of water discharge stop can be performed. For example, the water discharge control system is basically in the first mode, and when the dirt reaches a certain level or more, it determines that there may be a malfunction in the automatic water discharge control and switches to the second mode, thereby reducing the possibility of erroneous water discharge.

[0020] In one aspect of the embodiment, in a water discharge control system, the state determination unit determines that the state is a first state when the dirt on the imaging unit is less than a second threshold value that is greater than the first threshold value and is equal to or greater than the first threshold value, and determines that the state is a second state when the dirt on the imaging unit is equal to or greater than the second threshold value, and the control unit executes a first water discharge control corresponding to the first state or a second water discharge control corresponding to the second state in the second mode.

[0021] According to the water discharge control system of one aspect of the embodiment, by switching between multiple water discharge controls within the second mode based on the degree of dirt on the imaging unit, water discharge control according to the state of the imaging unit is possible, and control related to stopping water discharge that is easy for the user to use can be performed. For example, by having multiple water discharge controls according to the degree of dirt on the imaging unit, i.e., the degree (level) of dirt on the imaging unit, the water discharge control system can prevent water discharge control that is difficult for the user to use, such as suddenly stopping water if there is even a small amount of dirt.

[0022] In the water discharge control system according to one aspect of the embodiment, the second water discharge control is a water stop control.

[0023] According to the water discharge control system of one aspect of the embodiment, by controlling the water stop according to the degree of dirt on the imaging unit, it is possible to control the water discharge appropriately according to the state of the imaging unit, and it is possible to execute control related to the water discharge stop that is easy for the user to use. For example, when the dirt is equal to or greater than a second threshold, the water discharge control system determines that the dirt on the captured image is large and that prompt cleaning is necessary, and stops the water, thereby suppressing water discharge control that is difficult for the user to use and increasing the likelihood that the user will notice that there is an abnormality in the imaging unit by stopping the water.

[0024] In the water discharge control system according to one aspect of the embodiment, the control unit executes the second water discharge control in the second mode when the first state continues for a predetermined time or longer.

[0025] According to the water discharge control system of one aspect of the embodiment, when the first state continues for a predetermined time or more, the second water discharge control is executed, thereby enabling water discharge control according to the continuation of the state of the imaging unit, and it is possible to execute control relating to stopping water discharge that is user-friendly. For example, when dirt is detected for a predetermined time or more, the water discharge control system determines that the level of dirt is the same as the second state, thereby preventing the dirt state from being left unattended.

[0026] In the water discharge control system according to one aspect of the embodiment, the first water discharge control continues the water discharge control in the first mode immediately before switching to the second mode.

[0027] According to one aspect of the embodiment, the water discharge control system continues the water discharge control in the first mode immediately before switching to the second mode in the first water discharge control, thereby preventing the water from being suddenly stopped due to the mode switch and enabling control of water discharge and stopping that is user-friendly. For example, the water discharge control system controls the water to be discharged in the first water discharge control (when a certain amount of dirt is detected) but does not accept a new water discharge control. As a result, for example, if the imaging unit is dirty, there is a possibility of poor imaging, so the water discharge control system does not accept a new control and can prevent erroneous water discharge. By continuing the previous water discharge state, water is not suddenly stopped even if the imaging unit is dirty, and user-friendly control of water discharge and stopping can be performed.

[0028] In one aspect of the embodiment, in the water discharge control system, if the state determination unit determines that the dirt on the imaging unit is less than the first threshold value in the second mode, the control unit switches from the second mode to the first mode after a predetermined time.

[0029] According to one aspect of the embodiment, the water discharge control system switches from the second mode to the first mode after a predetermined time, thereby preventing a change in the water discharge pattern that would be unnatural to the user and enabling control of water discharge stop that is user-friendly. For example, if the automatic water discharge mode (first mode) is suddenly resumed, water discharge may start in response to a hand touching the device while cleaning, etc. Therefore, the water discharge control system provides a certain amount of time before switching from the second mode to the first mode, thereby preventing unintended water discharge.

[0030] In one aspect of the embodiment, in the water discharge control system, if the status determination unit determines that the dirt on the imaging unit is less than the first threshold in the second mode, the control unit performs a third water discharge control for a predetermined time and then switches to the first mode.

[0031] According to one aspect of the embodiment, when switching from the second mode to the first mode, the third water discharge control is executed for a predetermined time before switching, thereby preventing a change in the water discharge pattern that would be unnatural to the user and enabling control related to stopping water discharge that is user-friendly. For example, if the automatic water discharge mode (first mode) is suddenly resumed, there is a possibility that water discharge will start in response to a hand, such as when cleaning. Therefore, the water discharge control system can prevent unintended water discharge by providing a third water discharge control (return mode) between the second mode and the first mode.

[0032] A water discharge control system according to one aspect of the embodiment includes a notification unit that notifies at least one of a mode and water discharge control.

[0033] According to the water discharge control system of one aspect of the embodiment, by notifying the user of information related to the control, it is possible to provide the user with appropriate information and to execute control related to stopping and discharging of water in a manner that is user-friendly. For example, the water discharge control system can enable the user to recognize which mode the device is currently in and what type of water discharge control is being performed, and can inform the user of the dirt status of the image capture unit (normal, slightly dirty, heavily dirty, etc.), thereby making cleaning of the image capture unit etc. more efficient. [Effects of the Invention]

[0034] According to one aspect of the embodiment, it is possible to execute control relating to water discharge and stop that is user-friendly. [Brief explanation of the drawings]

[0035] [Figure 1]FIG. 1 is a schematic perspective view of a water discharge control system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an example of the configuration of a water discharge control system according to an embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of processing using regions and images. [Figure 4] FIG. 4 is a diagram showing an example of a state of the imaging unit. [Figure 5] FIG. 5 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 6] FIG. 6 is a diagram showing an example of the correspondence between the configuration of the water discharge control system and the processing. [Figure 7] FIG. 7 is a diagram illustrating an example of a state transition. [Figure 8] FIG. 8 is a diagram illustrating an example of a state transition. [Figure 9] FIG. 9 is a diagram showing an example of the settings. [Figure 10] FIG. 10 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 11] FIG. 11 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 12] FIG. 12 is a diagram illustrating an example of a state transition. [Figure 13] FIG. 13 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 14] FIG. 14 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 15] FIG. 15 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 16] FIG. 16 is a diagram showing an example of the settings. [Figure 17] FIG. 17 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 18] FIG. 18 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 19] FIG. 19 is a diagram illustrating an example of a state transition. [Figure 20] FIG. 20 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 21] FIG. 21 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 22] FIG. 22 is a diagram showing an example of the settings. [Figure 23] FIG. 23 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 24] FIG. 24 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 25] FIG. 25 is a diagram illustrating an example of a state transition. [Figure 26] FIG. 26 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 27] FIG. 27 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 28] FIG. 28 is a diagram showing an example of the settings. [Figure 29] FIG. 29 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 30] FIG. 30 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 31] FIG. 31 is a diagram illustrating an example of a state transition. [Figure 32] FIG. 32 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 33] FIG. 33 is a flowchart showing an example of a procedure of a process executed by the water discharge control system. [Figure 34] FIG. 34 is a diagram showing an example of an outline of processing executed by the water discharge control system. [Figure 35]FIG. 35 is a diagram showing an example of an outline of processing executed by the water discharge control system. DETAILED DESCRIPTION OF THE INVENTION

[0036] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the water discharge control system disclosed in the present application will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0037] <1. Embodiment> First, a water discharge control system 1 according to an embodiment will be described below. In the following example, a kitchen space (also simply referred to as a "kitchen") will be described as an example of a wet space where the water discharge control system 1 is applied. However, the water discharge control system 1 can be applied to any wet space as long as it is an applicable wet space. For example, the water discharge control system 1 is not limited to a kitchen, and may be applied to any wet space such as a toilet space with a hand basin or a space (washing space) with a vanity. In order to control the discharge and stopping of water (also referred to as "water discharge stopping"), the water discharge control system 1 detects an object (also referred to as an "imaged object") based on information detected by a sensor that captures an image, and controls the water discharge and stopping depending on whether the detected object (imaged object) is an object for which water discharge control is to be performed (also referred to as a "water discharge target object"). For example, the object may be kitchen-related objects (hereinafter referred to as "supplies") such as ingredients, tableware, and cooking utensils; parts of the human body (also referred to as a "user"), such as the body, head, and hands; or elements that make up a kitchen, such as a stove, sink, and water discharge unit. The object to which water is discharged includes at least one of a person's (user's) hand and an item. Note that the processes described as the processing subject of the water discharge control system according to each embodiment of the water discharge control system 1 and the like may be performed by any device capable of executing the processes, depending on the device configuration included in the water discharge control system.

[0038] <1-1. Water discharge control system configuration> The configuration of a water discharge control system 1 according to an embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a schematic perspective view of a water discharge control system according to an embodiment. Fig. 2 is a diagram showing an example of the configuration of a water discharge control system according to an embodiment.

[0039] As shown in Figures 1 and 2, the water discharge control system 1 has a kitchen main body 2, an imaging unit 10, a control device 100, a water valve 101, a purified water valve 102, a hot water valve 103, and a flow rate adjustment valve 104. The kitchen main body 2 is a plumbing equipment main body. The kitchen main body 2 has a water discharge unit 30, a sink 40, and a stove unit 50 on an upper surface unit 20 where a user performs tasks such as cooking and washing dishes and other objects. For example, the kitchen main body 2 may be a system kitchen.

[0040] The water discharge control system 1 may also include a water supply 80 and a water heater 81. The water supply 80 and the water heater 81 are components for supplying water to be discharged from the water discharge unit 30 via a water valve 101, a purified water valve 102, a hot water valve 103, a flow rate adjustment valve 104, and the like. For example, the water supply 80 is a water supply tool connected to a water distribution pipe or the like, and is connected to the water valve 101, the purified water valve 102, and the water heater 81. The water heater 81 is a device for heating water supplied from the water supply 80 to hot water, and is connected to the hot water valve 103. For example, the hot water temperature of the water heater 81 may be controlled by the control device 100. In this case, the water heater 81 supplies hot water to the water discharge unit 30 via the hot water valve 103 at a temperature according to the control of the control device 100. Note that the configuration shown in FIG. 2 is merely an example, and any configuration may be adopted as long as it is possible to discharge water in a desired water discharge manner.

[0041] 1 and 2 is merely an example, and any configuration can be adopted for the kitchen body 2. For example, the kitchen body 2 does not have to include the stove unit 50. In this case, the stove unit 50 may be provided separately from the kitchen body 2.

[0042] 1, a wall cabinet 60 and a range hood 70 are provided above the kitchen body 2, that is, on the side facing the upper surface 20 of the kitchen body 2. The wall cabinet 60 and the range hood 70 do not necessarily have to be provided.

[0043] The upper surface 20 of the kitchen main body 2 is used for user work. For example, the surface of the upper surface 20 of the kitchen main body 2 between the sink 40 and the stove unit 50 functions as a work surface where the user can perform processing such as cutting ingredients or place dishes after washing. Furthermore, multiple work surfaces may be arranged, such as between the sink 40 and the stove unit 50 and on the right side of the sink 40.

[0044] Water discharger 30 has a water discharge port 321 provided in head 32, which is the tip end portion of water discharge pipe 31, and discharges (spouts) water from water discharge port 321. For example, water discharger 30 may be able to discharge water in any water discharge form (shower, straight, etc.) from water discharge port 321. In this case, water discharger 30 may be able to switch between straight water and shower water from water discharge port 321. For example, water discharger 30 may discharge water in a water discharge form selected by the user, or may discharge water in a water discharge form corresponding to a mode described below.

[0045] 1 and 2, the water discharge unit 30 can switch between discharging a plurality of types of water, such as raw water, purified water, and hot water (also referred to as "hot water" or "warm water"), in accordance with the control of the control device 100 on the water valve 101, the purified water valve 102, and the hot water valve 103. The water discharge unit 30 can also change the discharge flow rate (also referred to simply as "flow rate"), such as the instantaneous discharge flow rate, of any type of water, such as raw water, purified water, or hot water (warm water), in accordance with the control of the flow rate adjustment valve 104 by the control device 100. The water discharge unit 30 may be configured to discharge only raw water. In this case, the water discharge control system 1 has only the water valve 101 out of the water valve 101, the purified water valve 102, and the hot water valve 103. The water discharge unit 30 refers to, for example, the part exposed from the kitchen main body 2.

[0046] Sink 40 is a recess recessed from the surface of upper surface 20, and functions as a water receiving portion that receives water from water discharger 30. Sink 40 is used, for example, for washing objects such as dishes, and is a tank-like stand equipped with a drainage groove that drains water from water discharger 30, etc.

[0047] The stove unit 50 is a stove equipment used by a user for heating operations for cooking. While FIGS. 1 and 2 show an example in which the stove unit 50 has two heating units, 51 and 52, the stove unit 50 may have one heating unit or three or more heating units. The heating units 51 and 52 perform heating using any heat source, such as gas or electricity. In this way, the heating units 51 and 52 can be configured as any type, such as an electric stove, an induction stove, or a gas stove.

[0048] The control device 100 is a control device that performs control related to water discharge. The control device 100 performs control related to water discharge by controlling the cold water valve 101, the purified water valve 102, the hot water valve 103, and the flow rate adjustment valve 104 based on information (sensor information) detected by each sensor such as the imaging unit 10. The control device 100 detects an object to be discharged from an image captured by the imaging unit 10, and controls the water discharge unit 30 based on the detection result. Note that the processing using the image captured by the imaging unit 10 is one example, and the control device 100 may perform control related to water discharge using sensor information detected by any sensor, not limited to the imaging unit 10.

[0049] For example, the control device 100 controls the type of water discharge by controlling the switching of the cold water valve 101, the purified water valve 102, and the hot water valve 103 based on information detected by each sensor such as the imaging unit 10. For example, the control device 100 controls the water discharge flow rate, such as the instantaneous water discharge flow rate, by controlling the flow rate adjustment valve 104 based on information detected by each sensor such as the imaging unit 10.

[0050] Furthermore, the control settings of the control device 100 for the cold water valve 101, the purified water valve 102, the hot water valve 103, and the flow rate adjustment valve 104 may be changed by the user to their preferred settings. For example, the control settings may be changed by the user to reduce the flow rate of purified water discharged to food ingredients, or to change the water discharged to cold water for stains. When detecting an object to be discharged from an image, the control device 100 performs any processing (image processing, etc.) on the captured image, such as brightness and color correction (image correction), monochrome / color conversion (image conversion), object identification (image recognition), and area measurement (image feature extraction).

[0051] The water valve 101 is, for example, a solenoid valve, and functions as a valve for discharging raw water to the water discharge portion 30. The purified water valve 102 is, for example, a solenoid valve, and functions as a valve for discharging purified water to the water discharge portion 30. The hot water valve 103 is, for example, a solenoid valve, and functions as a valve for discharging hot water (warm water) to the water discharge portion 30. The control device 100 is connected to each of the water valve 101, the purified water valve 102, and the hot water valve 103. Note that instead of the water valve 101, the purified water valve 102, and the hot water valve 103, a single flow path switching valve may be used to switch between each type of water discharge (raw water, purified water, hot water, etc.).

[0052] For example, the control device 100 is connected to a water valve 101 that switches between discharging and stopping raw water from the water discharger 30. The control device 100 controls the discharging and stopping of raw water from the water discharger 30 by a control signal that opens and closes the water valve 101.

[0053] For example, the control device 100 is connected to a purified water valve 102 that switches between discharging and stopping purified water from the water discharge unit 30. The control device 100 controls the discharging and stopping of purified water from the water discharge unit 30 using a control signal that opens and closes the purified water valve 102.

[0054] For example, the control device 100 is connected to a hot water valve 103 that switches between discharging and stopping hot water from the water discharger 30. The control device 100 controls the discharging and stopping of hot water from the water discharger 30 by a control signal that opens and closes the hot water valve 103.

[0055] Flow rate adjustment valve 104 is, for example, a control valve that can continuously change the valve opening, and functions as a valve for adjusting the flow rate of water discharged from water discharge unit 30. For example, flow rate adjustment valve 104 supplies the type of water selected by controlling cold water valve 101, purified water valve 102, and hot water valve 103 to water discharge unit 30 at a valve opening controlled by control device 100. Note that any valve configuration may be used for flow rate adjustment valve 104 as long as it can be adjusted to any valve opening (position), such as 0 to 100%.

[0056] For example, the control device 100 is connected to a flow rate adjustment valve 104 that adjusts the water discharge flow rate, such as the instantaneous water discharge flow rate, of the water discharger 30. The control device 100 controls the water discharge flow rate, such as the instantaneous water discharge flow rate, of the water discharger 30 by a control signal that adjusts (specifies) the valve opening degree of the flow rate adjustment valve 104.

[0057] The control device 100 is also connected to each sensor, such as the imaging unit 10, via a predetermined network, such as the Internet, in a wired or wireless manner so as to be able to communicate with the sensors. For example, the control device 100 has a communication function (communication unit) for transmitting and receiving information with other devices. The communication function (communication unit) of the control device 100 is realized by a communication device, a communication circuit, or the like. The control device 100 is connected to an arbitrary network in a wired or wireless manner using the communication function, and transmits and receives information with an external information processing device. For example, the control device 100 transmits and receives information with the imaging unit 10, etc. Note that the control device 100 may be connected to each sensor in any manner as long as it is possible to transmit and receive information, and may be connected to each sensor in a wired or wireless manner so as to be able to communicate with the sensors.

[0058] The control device 100 may be placed in any location. The control device 100 may be provided inside the space corresponding to the kitchen main body 2 (kitchen room), or may be provided outside the space corresponding to the kitchen main body 2 (kitchen room).

[0059] The device configuration and arrangement of the control device 100 can be any configuration as long as it can realize switching control of the cold water valve 101, the clean water valve 102, and the hot water valve 103, adjustment control of the valve opening of the flow rate adjustment valve 104, communication with each sensor such as the imaging unit 10, and processing. The control device 100 may also be disposed inside the kitchen main body 2. The control device 100 may also be disposed outside the kitchen main body 2, rather than inside the kitchen main body 2. Details of the control device 100 will be described later.

[0060] The imaging unit 10 captures an image of the bathroom space, etc. The imaging unit 10 captures an image of at least the water discharge area. The imaging unit 10 functions as a sensor unit that acquires information used to control water discharge. For example, the imaging unit 10 is a camera module that acquires an image by capturing an image of a predetermined area, such as the inside of the sink 40, or a sensor unit that uses an image sensor. The imaging unit 10 captures an image of the bathroom space around the water discharge unit 30. For example, the imaging unit 10 captures an image of the bathroom space including the sink 40, etc.

[0061] The imaging unit 10 is disposed in a position where it can capture an image of a desired range (area). For example, the imaging unit 10 is provided on the upper part (upper side) of the kitchen main body 2. The imaging unit 10 is provided in a position facing the kitchen main body 2 from above the kitchen main body 2. In FIGS. 1 and 2, an example is shown in which the imaging unit 10 is disposed on the underside of a wall cabinet 60 provided above the kitchen main body 2. Note that the placement of the imaging unit 10 shown in FIGS. 1 and 2 is merely an example, and the imaging unit 10 may be disposed in any position as long as it can capture an image of a desired range. For example, the imaging unit 10 may be provided on the water discharger 30 or below the water discharger 30.

[0062] The imaging unit 10 uses any sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. For example, the imaging unit 10 is an area sensor or a distance measuring sensor that uses an image sensor. The imaging unit 10 captures an image of the water-related space around the water discharger 30.

[0063] Also, for example, the imaging unit 10 is disposed facing in a direction to capture an image of the sink 40. Note that the imaging unit 10 may be disposed in any manner as long as it can detect (capture) an object. Also, the imaging unit 10 may capture a still image or a moving image.

[0064] The imaging unit 10 is connected to the control device 100 via a predetermined network so as to be able to communicate with each other via a wired or wireless connection. The imaging unit 10 transmits various types of information to the control device 100. For example, the imaging unit 10 transmits information related to an acquired image to the control device 100. For example, the imaging unit 10 may be connected to the control device 100 so as to be able to communicate with each other via a predetermined wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). Note that the control device 100 and the imaging unit 10 may be connected in any manner as long as they are able to send and receive information, and may be connected to each other so as to be able to communicate with each other via a wired or wireless connection. For example, the imaging unit 10 may be connected to the control device 100 so as to be able to communicate with each other via a wired or wireless connection.

[0065] When describing various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensors." When describing information acquired by various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensor information." Sensor information is a concept that includes information acquired by various sensors for water discharge control, such as information acquired by the imaging unit 10.

[0066] 1 and 2 are merely examples, and the water discharge control system 1 can have any device configuration. For example, in FIG. 2, the solid line connections between each component indicate the communication (transmission and reception) and control relationships of signals (information) between the components, and the dotted line connections between each component indicate an example of the relationship of water flow, but the relationships are not limited to those shown in FIG. 2, and any relationship can be adopted. For example, in the water discharge control system 1, the control device 100 may communicate with and control the water heater 81. Also, for example, the water discharge control system 1 may not include a sensor. In this case, the control device 100 of the water discharge control system 1 may communicate with a sensor not included in the water discharge control system 1 and control the water discharge using sensor information received (acquired) from the sensor. For example, the water discharge control system 1 may not include the imaging unit 10. In this case, the control device 100 of the water discharge control system 1 may communicate with an imaging unit 10 that is not included in the water discharge control system 1, and use the image received (acquired) from the imaging unit 10 to control the water discharge.

[0067] Furthermore, the water discharge control system 1 may have a personal identification unit (identification device) that performs processing (personal identification) to identify the user who uses the kitchen main body 2. For example, the control device 100 may function as the personal identification unit. For example, the personal identification unit of the water discharge control system 1 may perform personal identification based on an image of a person included in an image. Note that the above is merely an example, and the water discharge control system 1 may perform personal identification by any method as long as it is possible to identify the user who uses the kitchen main body 2. For example, the personal identification unit of the water discharge control system 1 may acquire information for identifying the user who uses the kitchen main body 2 by communicating with a device such as a smartphone owned by the user, or by the user's operation on a remote control, and perform personal identification of the user.

[0068] Furthermore, the water discharge control system 1 may also include sensors other than the imaging unit 10. For example, the water discharge control system 1 may also include a human body detection sensor. The human body detection sensor has the function of detecting a human body. For example, the human body detection sensor is realized by a pyroelectric sensor using an infrared signal. For example, the human body detection sensor may be realized by a μ (microwave) wave sensor. Note that the above is just one example, and the human body detection sensor is not limited to the above and may detect a human body by various means. For example, the human body detection sensor detects a person (such as a user) who enters the space (kitchen room) in which the kitchen main body 2 is provided. The human body detection sensor transmits a detection signal to the control device 100.

[0069] <1-2. Control device configuration> Next, each component of the control device 100 will be described in detail. The control device 100 may be, for example, an information processing device (computer) used to control various components and processes. The control device 100 may have, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and may be realized by executing a program stored inside the control device 100 (for example, an information processing program according to the present disclosure) using RAM or the like as a working area. The control device 100 may also have, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0070] As shown in Fig. 2, the control device 100 has an image processing unit 110, a state determination unit 120, a control unit 130, a notification unit 140, a storage unit 150, and an acquisition unit 160, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the control device 100 is not limited to the configuration shown in Fig. 2, and may be any other configuration as long as it performs the information processing described below. Furthermore, the processing performed by the control device 100 may be executed by a cloud server (also referred to as the cloud). In this case, the cloud and the control device 100 are connected via a predetermined network, either wired or wirelessly.

[0071] The image processing unit 110 executes image processing. The image processing unit 110 processes the image captured by the imaging unit 10. The image processing unit 110 determines whether or not an imaged object detected from the image captured by the imaging unit 10 is a water discharge target. For example, the image processing unit 110 determines the state of the imaged object detected from the image captured by the imaging unit 10. The image processing unit 110 functions as an operation detection unit that detects user operations.

[0072] The image processing unit 110 functions as a detection unit that detects the object of water discharge using sensor information. The image processing unit 110 detects the object of water discharge contained in the image captured by the imaging unit 10. The image processing unit 110 determines whether or not the object has been detected. When detecting the object of water discharge contained in the image, the image processing unit 110 performs any processing on the captured image, such as brightness and color correction (image correction), monochrome / color conversion (image conversion), object identification (image recognition), and area measurement (image feature extraction).

[0073] The image processing unit 110 detects objects included in the image and their positions (coordinates, etc.) through image processing. The image processing unit 110 may use any processing to detect the objects included in the image and their positions (ranges) as long as it is possible to acquire information indicating the objects included in the image and their positions. This point will be described in detail later.

[0074] The image processing unit 110 calculates (estimates) the moving speed of an object based on the image captured by the imaging unit 10. For example, the image processing unit 110 estimates the moving speed of the object based on a change in the position (coordinates, etc.) of the object in a video. For example, the image processing unit 110 estimates the moving speed of the object based on, for example, the frame rate of the video (i.e., time information) and a change in the position of the object in the video (i.e., information on the moving distance). For example, the image processing unit 110 estimates the moving speed of the object by, for example, dividing the moving distance of the object in the video by the time corresponding to the frame rate of the video. Note that the above-described processing is merely an example, and the image processing unit 110 may estimate the moving speed of the object using various information as appropriate.

[0075] The image processing unit 110 may use the sensor information to determine whether to discharge water, and if so, select the type of water to be discharged—raw water, purified water, or hot water—based on the content stored in the memory unit 150. In this case, the image processing unit 110 determines to open the valve corresponding to the selected type of water from among the cold water valve 101, the purified water valve 102, and the hot water valve 103. The image processing unit 110 generates a control signal instructing the determined valve to be opened. The image processing unit 110 uses the generated control signal to instruct the control unit 130 to switch the cold water valve 101, the purified water valve 102, and the hot water valve 103 between open and closed.

[0076] Furthermore, when discharging water, the image processing unit 110 may determine the instantaneous water discharge flow rate based on the contents stored in the memory unit 150. In this case, the image processing unit 110 determines the valve opening of the flow rate adjustment valve 104 based on the determined instantaneous water discharge flow rate. The image processing unit 110 generates a control signal that instructs opening at the determined valve opening. The image processing unit 110 uses the generated control signal to instruct the control unit 130 to adjust (set) the valve opening of the flow rate adjustment valve 104. The image processing unit 110 controls the instantaneous water discharge flow rate from the water discharge unit 30 based on at least one of the size and type of the object to be discharged, and the distance between the water discharge port of the water discharge unit 30 and the object to be discharged. For example, the image processing unit 110 controls the instantaneous water discharge flow rate from the water discharge unit 30 by instructing the control unit 130 to adjust (set) the valve opening of the flow rate adjustment valve 104.

[0077] The image processing unit 110 determines the object onto which water is to be discharged from the image captured by the imaging unit 10. The image processing unit 110 can determine the user's hands and items from the image captured by the imaging unit 10. The image processing unit 110 can determine the hands and items from the image captured by the imaging unit 10.

[0078] Image processing unit 110 determines the size of the object to be discharged. Image processing unit 110 controls the instantaneous water discharge flow rate from water discharge unit 30 based on at least one of the size of the object to be discharged determined by the determination unit, the type of object to be discharged, or the distance between water discharge port 321 of water discharge unit 30 and the object to be discharged. Image processing unit 110 increases the instantaneous water discharge flow rate as the object to be discharged is larger.

[0079] Image processing unit 110 classifies the object to be discharged as either a tool or a human hand, and controls the instantaneous water discharge flow rate based on the classification result. If the object to be discharged as a tool, image processing unit 110 further classifies the object to be discharged as either an article or food material, and controls the instantaneous water discharge flow rate based on the classification result.

[0080] Image processing unit 110 determines the distance between water discharge port 321 and the object to be discharged based on the image, and controls the instantaneous water discharge flow rate according to changes in the distance. Image processing unit 110 determines that an object to be imaged that has a predetermined moving speed is an object to be discharged. Image processing unit 110 determines that an object to be imaged that has a moving speed that meets a predetermined standard is an object to be discharged.

[0081] For example, image processing unit 110 determines that an imaged object whose estimated moving speed is within a predetermined range is a water-discharge target. For example, if the moving speed of the imaged object is less than a first speed and greater than or equal to a second speed, image processing unit 110 determines that the imaged object is a water-discharge target. For example, the second speed is a predetermined value greater than the first speed. For example, if the moving speed of the imaged object is within the range between the first speed and the second speed, image processing unit 110 estimates that the imaged object is an object about which the user wants water to be discharged, and determines that the imaged object is a water-discharge target.

[0082] For example, image processing unit 110 determines that an imaged object whose moving speed is less than a first speed is not a water-discharge target. For example, image processing unit 110 estimates that an imaged object whose moving speed is less than the first speed is an object placed there, and determines that it is not a water-discharge target.

[0083] For example, image processing unit 110 determines that an imaged object whose moving speed is equal to or greater than a second speed is not a water-discharge target. For example, image processing unit 110 estimates that an imaged object whose moving speed is equal to or greater than a second speed is an object moving through the image capture area, and determines that it is not a water-discharge target.

[0084] Image processing unit 110 determines that an object to be imaged that is within a predetermined area including the water discharge area is a water discharge target. The predetermined area can be set to any range as long as it is possible to determine the water discharge target. For example, the predetermined area may be an area that includes a position (water discharge drop position) where water discharged (spouted) from water discharge outlet 321 falls, such as a position directly below water discharge outlet 321. For example, image processing unit 110 detects an object in the predetermined area and controls water discharge.

[0085] When the shape of the object to be discharged is a predetermined type, the image processing unit 110 controls the instantaneous water discharge flow rate based on the predetermined type. When the size of the object to be discharged changes while it is held within the water discharge area, the image processing unit 110 does not change the instantaneous water discharge flow rate.

[0086] Image processing unit 110 controls the instantaneous water discharge flow rate according to the water discharge form acquired by acquisition unit 160. Image processing unit 110 increases the instantaneous water discharge flow rate the larger the size of the object to be discharged, and changes the control of the instantaneous water discharge flow rate depending on the type of object to be discharged. Image processing unit 110 increases the instantaneous water discharge flow rate the larger the size of the object to be discharged, and reduces the amount of change in the instantaneous water discharge flow rate when the object to be discharged is a human hand compared to when the object is an item.

[0087] The larger the size of the object onto which water is to be discharged, the smaller the amount of change in the instantaneous water discharge flow rate based on changes in the size of the object onto which water is to be discharged. When the water discharge mode is shower water discharge, the image processing unit 110 reduces the amount of change in the instantaneous water discharge flow rate based on changes in the size of the object onto which water is to be discharged.

[0088] Image processing unit 110 may function as a discharged water temperature adjustment unit that adjusts the temperature of water discharged from water discharge unit 30. For example, image processing unit 110 controls water heater 81 to adjust the temperature of hot water supplied from water heater 81 to water discharge unit 30 via hot water valve 103. Image processing unit 110 detects the degree of dirtiness of the object onto which water is to be discharged and increases the temperature of the discharged water.

[0089] The image processing unit 110 detects user operations using sensor information. The image processing unit 110 detects user operations related to controlling the water discharge state. For example, the image processing unit 110 detects operations related to changing modes. For example, the image processing unit 110 detects a mode switching operation by the user. For example, the image processing unit 110 detects a user operation based on a user gesture detected from an image captured by the imaging unit 10. For example, the image processing unit 110 detects a user operation based on the user's hand movement (hand signs, etc.) detected from an image captured by the imaging unit 10.

[0090] The state determination unit 120 functions as a determination unit that performs various determinations. For example, the state determination unit 120 determines the state of the imaging unit 10. The state determination unit 120 determines the degree of dirt on the imaging unit 10 (also referred to as "dirt on the imaging unit 10"). For example, the state determination unit 120 estimates (calculates) a score (numerical value) that indicates the degree of dirt on the imaging unit 10 (level of dirt). Note that the dirt on the imaging unit 10 referred to here is a concept that includes various elements that affect the capture of an image by the imaging unit 10. For example, dirt on the imaging unit 10 includes water droplets, detergent, water stains, dust, food debris, air bubbles, steam (fogging), light (illumination light, etc.), cracks and scratches on the lens, etc.

[0091] The state determination unit 120 determines the state of the imaging unit 10 based on the image captured by the imaging unit 10. If the dirt on the imaging unit 10 is less than a second threshold value that is greater than the first threshold value and is equal to or greater than the first threshold value, the state determination unit 120 determines that the imaging unit 10 is in the first state, and if the dirt on the imaging unit 10 is equal to or greater than the second threshold value, the state determination unit 120 determines that the imaging unit 10 is in the second state.

[0092] For example, brightness (signal) varies (spatially) depending on the position in an image, and the state determination unit 120 may determine (estimate) the degree of dirt on the image capture unit 10 based on the frequency (also referred to as "spatial frequency") of such spatially varying signals. For example, the state determination unit 120 may determine (estimate) the degree of dirt on the image capture unit 10 by appropriately using various conventional techniques, such as the technique for detecting dirt on the image capture unit 10, such as water droplets, based on frequency components, as disclosed in Patent Document 3. For example, because water droplets and dirt are low frequency components, the state determination unit 120 may determine whether the image contains water droplets or dirt by performing a process (also referred to as an "extraction process") that extracts only the low frequency components of the image.

[0093] For example, the state determination unit 120 may determine (estimate) the degree of dirt on the imaging unit 10 based on the range (proportion) of the image extracted by the extraction process of low-frequency components. For example, the state determination unit 120 may estimate the proportion of the image extracted by the extraction process of low-frequency components as the degree of dirt on the imaging unit 10. For example, the state determination unit 120 estimates that the greater the proportion of the image extracted by the extraction process of low-frequency components, the greater the degree of dirt on the imaging unit 10. For example, the state determination unit 120 estimates (calculates) a larger score (numerical value) indicating the degree of dirt on the imaging unit 10, the greater the proportion of the image extracted by the extraction process of low-frequency components. Note that the above-described process is merely an example, and the state determination unit 120 may determine (estimate) the degree of dirt on the imaging unit 10 using various methods.

[0094] The state determination unit 120 may determine the degree of dirt on the imaging unit 10 using AI (artificial intelligence) technology. For example, the state determination unit 120 may determine the degree of dirt on the imaging unit 10 using a learning model (dirt determination model) generated by machine learning. In this case, the dirt determination model is trained using, for example, training data. This training data includes multiple pieces of training data that combine images captured by the imaging unit 10 with labels (correct answer information) that indicate the degree of dirt on the imaging unit 10 when the images were captured. For example, the dirt determination model is a model that receives an image as input and outputs information (such as a numerical value) that indicates the degree of dirt on the imaging unit 10 that captured the input image.

[0095] For example, when an image is input, the dirt level determination model is trained to output information on a label (such as a numerical value indicating the dirt level of the imaging unit 10) corresponding to the input image. The dirt level determination model is trained using various techniques related to so-called supervised learning as appropriate. In this case, the dirt level determination model may be stored in the storage unit 150, and the state determination unit 120 may determine the dirt level of the imaging unit 10 using the dirt level determination model stored in the storage unit 150. For example, the state determination unit 120 inputs the image captured by the imaging unit 10 to the dirt level determination model, and determines the dirt level of the imaging unit 10 based on the score (numerical value) output by the dirt level determination model to which the image captured by the imaging unit 10 has been input. For example, the control device 100 may perform a learning process to generate the dirt level determination model.

[0096] Furthermore, the state determination unit 120 may determine the dirt level (also simply referred to as "level") indicating the dirt level of the imaging unit 10 using a score (numeric value) indicating the dirt level of the imaging unit 10. For example, the state determination unit 120 uses the score (numeric value) indicating the dirt level of the imaging unit 10 to determine whether the level of dirt level of the imaging unit 10 is one of multiple levels (for example, three or more levels). For example, the state determination unit 120 determines that the larger the score (numeric value) indicating the dirt level of the imaging unit 10, the higher the level of dirt level of the imaging unit 10. For example, the state determination unit 120 uses the score (numeric value) indicating the dirt level of the imaging unit 10 to determine which of levels 1 to 3 the dirt level of the imaging unit 10 is.

[0097] Furthermore, the state determination unit 120 may determine the degree of dirt on the imaging unit 10 based on the determined dirt level of the imaging unit 10. For example, the state determination unit 120 determines that the higher the dirt level of the imaging unit 10, the greater the degree of dirt on the imaging unit 10. For example, if the dirt level of the imaging unit 10 is 3, the state determination unit 120 determines that the degree of dirt on the imaging unit 10 is high. For example, if the dirt level of the imaging unit 10 is 2, the state determination unit 120 determines that the degree of dirt on the imaging unit 10 is medium. For example, if the dirt level of the imaging unit 10 is 1, the state determination unit 120 determines that the degree of dirt on the imaging unit 10 is low. Note that the above is merely an example, and the state determination unit 120 may determine (estimate) various information regarding dirt on the imaging unit 10.

[0098] The control unit 130 executes various processes related to water discharge control. The control unit 130 functions as a water discharge / stop control unit that controls the water discharge state of the water discharger 30. The control unit 130 executes water discharge control that controls the water discharge state of the water discharger 30 based on processing by the image processing unit 110 and the state determination unit 120. For example, the water discharge state includes five elements: water discharge / stop, flow rate, temperature, type, and water discharge form (form). In this way, the water discharge state includes various states related to water discharge, including the water stop state, water discharge form, etc. Note that the above is merely an example, and the water discharge state may include various states related to water discharge.

[0099] The control unit 130 executes water discharge control according to the mode. The control unit 130 switches between a first mode based on the processing results of the image processing unit 110 and a second mode based on the determination results of the state determination unit 120. In the first mode, the control unit 130 executes water discharge control based on the processing by the image processing unit 110. In the second mode, the control unit 130 executes water discharge control based on the processing by the state determination unit 120. For example, the first mode is a mode corresponding to a state in which there is no abnormality in the image capture unit 10 and water can be discharged normally. For example, the second mode is a mode corresponding to a state in which there may be an abnormality in the image capture unit 10, such as dirt, and there is a possibility that water cannot be discharged normally.

[0100] For example, in the first mode, the control unit 130 selects a plurality of water discharge forms corresponding to the first mode based on the processing results of the image processing unit 110. The first mode has a plurality of water discharge forms based on the processing results of the image processing unit 110. For example, in the second mode, the control unit 130 selects a plurality of water discharge forms corresponding to the second mode based on the determination results of the state determination unit 120. The second mode has a plurality of water discharge forms based on the determination results of the state determination unit 120.

[0101] In the first mode, the control unit 130 selects a water discharge mode based on the processing results of the image processing unit 110 and performs water discharge control, and in the second mode, selects a water discharge mode based on the determination results of the state determination unit 120 and performs water discharge control. The control unit 130 controls the water discharge state based on the state of the object onto which water is to be discharged.

[0102] The control unit 130 switches the mode depending on the state of the imaging unit 10. The control unit 130 switches from the first mode to the second mode when the dirt on the imaging unit 10 is equal to or greater than a first threshold based on an image captured by the imaging unit 10. In the second mode, the control unit 130 executes a first water discharge control corresponding to the first state or a second water discharge control corresponding to the second state.

[0103] In the second mode, if the first state continues for a predetermined time or more, the control unit 130 executes the second water discharge control. For example, the first water discharge control continues the water discharge control in the first mode immediately before switching to the second mode. If the state determination unit 120 determines that the dirt on the image capture unit 10 is less than the first threshold, the control unit 130 switches from the second mode to the first mode after a predetermined time. Furthermore, if the state determination unit 120 determines that the dirt on the image capture unit 10 is less than the first threshold, the control unit 130 may execute the third water discharge control for a predetermined time and then switch to the first mode.

[0104] For example, the first state indicates a warning mode. For example, the first state corresponds to a state where there is little dirt and water can be discharged. For example, the second state indicates an abnormal mode. For example, the second state corresponds to a state where there is a lot of dirt and water cannot be discharged. For example, the second state corresponds to a state where water is forcibly stopped.

[0105] For example, the first water discharge control is water discharge control corresponding to the first state. The first water discharge control may be control that maintains the water discharge state of the first mode immediately before transitioning to the second mode. For example, the first water discharge control may be water discharge control similar to the water discharge control in the first mode. For example, the first water discharge control may be water discharge control based on the processing results of the image processing unit 110. For example, the second water discharge control is water stop control. The third water discharge control is water discharge control corresponding to the return mode. For example, less than the first threshold and the second threshold are thresholds used to switch modes, water discharge controls, etc. When the dirt on the imaging unit 10 is equal to or greater than the first threshold and less than the second threshold, the control unit 130 switches to the first state of the second mode and executes water discharge control. For example, when the dirt on the imaging unit 10 is equal to or greater than the second threshold, the control unit 130 switches to a mode corresponding to the first state of the second mode (also referred to as the "first partial mode of the second mode") and executes water discharge control. Furthermore, when the degree of dirt on the imaging unit 10 is equal to or greater than a second threshold, the control unit 130 switches to the second state of the second mode and executes water discharge control. For example, when the degree of dirt on the imaging unit 10 is equal to or greater than the second threshold, the control unit 130 switches to a mode corresponding to the second state of the second mode (also referred to as a "second partial mode of the second mode") and executes water discharge control.

[0106] The control unit 130 controls the water discharge mode from the water discharge unit 30. The control unit 130 controls the switching of the cold water valve 101, the purified water valve 102, and the hot water valve 103, thereby controlling the stopping and stopping of water discharge from the water discharge unit 30. The control unit 130 changes the water discharge mode, such as stopping and discharging of water by the water discharge unit 30. The water discharge mode refers to one type of water discharge, such as the type of water discharge (raw water, purified water, hot water, etc.), the water discharge form (shower, straight, etc.), and the water discharge flow rate (instantaneous water discharge flow rate, etc.). The above is merely an example, and the water discharge mode may be classified in any way. For example, if purified water can be discharged as hot water, the type of water discharge may be classified as raw water, purified water at room temperature, hot water, purified water at high temperature, etc.

[0107] The control unit 130 switches the open / close status of the water valve 101, the purified water valve 102, and the hot water valve 103 based on the processing of at least one of the image processing unit 110 and the state determination unit 120. The control unit 130 switches the type of water discharged from the water discharge unit 30 by sending control signals to the water valve 101, the purified water valve 102, and the hot water valve 103 and switching the open / close status of the water valve 101, the purified water valve 102, and the hot water valve 103.

[0108] The control unit 130 adjusts the valve opening of the flow rate adjustment valve 104 based on the processing of at least one of the image processing unit 110 and the state determination unit 120. The control unit 130 sends a control signal to the flow rate adjustment valve 104 and adjusts (sets) the valve opening of the flow rate adjustment valve 104, thereby adjusting the water discharge flow rate, such as the instantaneous water discharge flow rate, of the water discharge unit 30.

[0109] The notification unit 140 executes a notification process to notify information related to water discharge control. The notification unit 140 notifies at least one of the mode and the water discharge control. The notification unit 140 notifies information indicating the mode at the time of notification. The notification unit 140 notifies information indicating the state of the water discharge control (such as the water discharge state) at the time of notification. For example, the notification unit 140 performs notification by turning on or off a lighting device such as an LED (Light Emitting Diode) in a desired color or the like. For example, the notification unit 140 notifies information related to water discharge control by transmitting lighting control information for controlling the lighting state of the lighting device to the lighting device and controlling the lighting device to the desired state. Note that the lighting device may be included in the water discharge control system 1 or may be a component external to the water discharge control system 1.

[0110] The notification unit 140 may notify the information regarding the water discharge control by displaying the information regarding the water discharge control on a display unit. In this case, the control device 100 may have a display unit (display, projector, etc.) that has a function of displaying information. The notification unit 140 notifies the information regarding the water discharge control by having an audio output unit output the information regarding the water discharge control as audio. In this case, the control device 100 may have an audio output unit (speaker, etc.) that has a function of outputting information as audio.

[0111] The notification unit 140 may transmit information to an external information processing device. For example, the notification unit 140 transmits various information to a display device, an audio output device, etc. For example, the notification unit 140 transmits information related to water discharge control to a display device and causes the display device to display the information related to water discharge control, thereby notifying the information related to water discharge control. For example, the notification unit 140 transmits information related to water discharge control to an audio output device and causes the audio output device to output the information related to water discharge control as audio, thereby notifying the information related to water discharge control.

[0112] The storage unit 150 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. For example, the storage unit 150 is a computer-readable recording medium that non-temporarily records data used by an information processing program. The storage unit 150 stores various information such as information detected by various sensors. The storage unit 150 stores various information used to control water discharge.

[0113] The memory unit 150 stores various information used to detect an object to be discharged. For example, the memory unit 150 stores a program that detects an object to be discharged, determines whether to discharge water, and stops the water discharge. For example, the memory unit 150 stores a threshold value used in the determination process related to the control of water discharge and stopping. For example, the memory unit 150 stores a threshold value used in the determination process of whether an object to be discharged has been detected. The above is merely an example, and the memory unit 150 stores various information related to the process.

[0114] The storage unit 150 may store various types of information depending on the purpose, without being limited to the above. The storage unit 150 may store sensor information detected by various sensors. The storage unit 150 may store the sensor information in association with the date and time when it was acquired. The storage unit 150 may store an image as sensor information. The storage unit 150 stores information indicating the processing result corresponding to the image in association with the image. The storage unit 150 stores the determination result determined for the image (presence or absence of an object to be discharged water, etc.) in association with the image.

[0115] The acquisition unit 160 acquires information. The acquisition unit 160 acquires various information from the storage unit 150. The acquisition unit 160 acquires various information from the kitchen main body 2. The acquisition unit 160 acquires various information collected in the space (kitchen room) corresponding to the kitchen main body 2 from the kitchen main body 2. The acquisition unit 160 acquires user identification information that identifies a user from the kitchen main body 2.

[0116] The acquisition unit 160 acquires sensor information detected by the sensor from the sensor. The acquisition unit 160 acquires sensor information of the user sensed by the sensor. The acquisition unit 160 receives information related to the image acquired by the imaging unit 10 from the imaging unit 10. The acquisition unit 160 may store the received various information in the storage unit 150.

[0117] The acquisition unit 160 acquires the water discharge mode from the water discharger 30. The acquisition unit 160 acquires information indicating whether the water discharge mode of the water discharger 30 is straight or shower. The acquisition unit 160 acquires information indicating the water discharge mode of the water discharger 30 from the water discharger 30. The acquisition unit 160 receives a signal (information) indicating the water discharge mode from the water discharger 30.

[0118] The above-described configuration of the control device 100 is merely an example, and the control device 100 may have various configurations other than those described above. For example, the control device 100 may detect a user's operation using various information. For example, if an operation device such as an operation panel is provided in the kitchen main body 2, the control device 100 may detect a user's operation using operation information indicating the user's operation on the operation device.

[0119] <1-3. Processing examples using regions and images> Before describing the specific processing according to the first embodiment, an example of processing using an image performed by the water discharge control system and the water discharge area will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example of processing using an area and an image. FIG. 3 shows an image IM1 captured by the imaging unit 10. Thus, in FIG. 3, the imaging unit 10 is positioned to capture an image of an area corresponding to the image IM1 (also referred to as a "predetermined imaging area"). The predetermined area (e.g., the imaging area) includes a range that overlaps with the water discharge outlet (e.g., water discharge outlet 321) that discharges water from the water discharge unit 30 when the top surface 20 is viewed from above the kitchen body 2 in a plan view (hereinafter also referred to simply as a "plan view").

[0120] Image IM1 in FIG. 3 shows an example of a case where an image captured by the imaging unit 10 is the processing target. In FIG. 3, the water discharge control system 1 shows an example of a processing result when the processing target is image IM1 that includes a person's hand and an item (tableware) as the captured object. For example, the water discharge control system 1 uses any image recognition technology to detect the area in image IM1 where the captured object is located. In FIG. 3, the water discharge control system 1 detects three areas, area SG1, area SG2, and area SG3, as the areas where the captured object is located.

[0121] 3 shows an example in which a rectangular area is detected as the area where the object to be imaged is located, but the area where the object to be imaged is located is not limited to a rectangular area, and for example, the area where the object to be imaged is located may be detected in more detail. For example, the area where the object to be imaged is located may be detected in pixel units, or may be detected as a shape that follows the outer shape (contour) of the object to be imaged.

[0122] For example, the water discharge control system 1 detects the size of the imaged object as one of the indices used for water discharge control. For example, when the imaged object is an object to be discharged, the water discharge control system 1 detects the size of the object to be discharged. For example, the water discharge control system 1 may detect the size of a rectangular area such as areas SG1 to SG3. For example, the water discharge control system 1 may detect the size of the object to be discharged based on the number of pixels included in area SG1 in which the dish that is the object to be discharged is located. Note that when the water discharge control system 1 detects a shape that follows the outline (contour) of the object to be discharged, it may detect the size of the object to be discharged based on the number of pixels included within that outline. In this way, the water discharge control system 1 may control using the size of the object itself, or may control using the size of the detection result of the object (rectangular area, etc.).

[0123] Furthermore, the water discharge control system 1 classifies (determines) the type of each imaged object in the image IM1 using any image recognition technology. In Fig. 3, the water discharge control system 1 classifies the type of the imaged object located in area SG1 of the image IM1 as a utensil. Furthermore, the water discharge control system 1 classifies the type of the imaged objects located in areas SG2 and SG3 of the image IM1 as a human hand. Note that various conventional technologies can be applied to recognize objects contained in an image, and for example, image recognition technology utilizing various machine learning techniques such as deep learning may be used as appropriate.

[0124] Furthermore, the classification of the area in which the imaged object is located and the type may be performed by a single process. For example, when an image is input, the water discharge control system 1 may perform a process of classifying the area in which the imaged object is located and the type using an image recognition model that outputs information indicating the area and type of each imaged object in the input image. In this case, the water discharge control system 1 may input the image IM1 to the image recognition model, and estimate (determine) the size and type of each imaged object in the image IM1 based on the information indicating the area in which the imaged object is located and the type classification in the image IM1 output by the image recognition model.

[0125] In this way, the water discharge control system 1 uses any image recognition technology to detect the objects included in the image IM1 and classify (determine) the type of the detected objects. For example, the water discharge control system 1 uses any image recognition technology to determine to which of multiple types each of the objects detected in the image IM1 belongs.

[0126] For example, the water discharge control system 1 classifies (determines) the type of the imaged object as one of the indices used for water discharge control. For example, the water discharge control system 1 may classify the imaged object to one of a plurality of types based on individual names such as chopsticks, pot, plate, etc., into which type the imaged object belongs. For example, the water discharge control system 1 may classify the imaged object to one of a plurality of types based on general classifications such as tableware, hands, ingredients, etc., into which type the imaged object belongs. Furthermore, the water discharge control system 1 may classify the imaged object to one of a plurality of newly defined types such as water-splashing dishes, water-collecting dishes, etc.

[0127] It should be noted that any classification can be adopted for the multiple types into which the imaged objects are classified. For example, the multiple types may be types based on category classification. For example, the multiple types may be types based on category classification used in general object recognition or the like. For example, the multiple types may be three types: human hands, supplies, and other. Furthermore, for example, the multiple types may be four types: human hands, objects, food ingredients, and other.

[0128] For example, the plurality of types may be types based on classification of uses, for example, the plurality of types may include types based on classification of uses for which the article is used.

[0129] For example, the multiple types may be types based on a classification of shapes. For example, the multiple types may include types based on a classification of the shape of the article. For example, the multiple types may include types based on a classification of whether the article has a shape that is prone to splashing water. For example, the multiple types may include types based on the degree of susceptibility of the shape of the article to splashing water.

[0130] For example, the multiple types may be types based on a classification of materials. For example, the multiple types may include types based on a classification of what material the article is made of. For example, the multiple types may include types based on a classification of whether the article is made of a material that is prone to splashing water. For example, the multiple types may include types based on the degree of susceptibility to splashing water of the material of the article.

[0131] The above-described classification of types is merely an example, and any type can be adopted as long as the desired processing can be realized. The multiple types may be types based on a combination of at least two of category classification, use classification, shape classification, and material classification. The types may also have a hierarchical relationship. In this case, for example, items and ingredients may belong to a lower level of supplies, tableware and cooking utensils may belong to a lower level of items, and vegetables and meat may belong to a lower level of ingredients. The above-described hierarchical relationship is merely an example, and any hierarchical relationship can be adopted, and may be three or more levels. For example, knives and bowls may belong to a lower level of cooking utensils.

[0132] For example, the water discharge control system 1 estimates (calculates) the distance between the water discharge port and the target object (object onto which water is discharged) as one of the indices used for water discharge control. For example, the water discharge control system 1 may calculate the distance using AI based on an image, or may estimate the distance based on the size of the user's hand.

[0133] For example, when an image is input, the water discharge control system 1 may estimate the distance between the water spout and the object (object to be discharged) using a distance estimation model that outputs information indicating the distance between the object to be discharged in the input image and a predetermined position (the position of the water spout). In this case, the water discharge control system 1 may input the image IM1 to the distance estimation model, and estimate (calculate) the distance between the dish that is the object to be discharged and the water spout 321 based on information indicating the estimated distance between the dish that is the object to be discharged in image IM1 and the water spout 321 output by the distance estimation model. Note that the above is merely an example, and the water discharge control system 1 may estimate the distance between the water spout 321 and the object (object to be discharged) using various information as appropriate. For example, the water discharge control system 1 may estimate the distance between the water spout 321 and the object (object to be discharged) based on the size of at least one of the areas SG2 and SG3 that include a person's hand.

[0134] Here, an example of the state of the imaging unit 10 related to dirt on the imaging unit 10 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the state of the imaging unit. Note that a description of the above-mentioned points, such as the process of determining the degree of dirt on the imaging unit 10, will be omitted.

[0135] For example, if the dirt on the lens is only on a part of the angle of view or the like, the water discharge control system 1 determines that the degree (proportion) of dirt on the imaging unit 10 is small (low). For example, if the number of water droplets is small (such as on a part of the angle of view), the water discharge control system 1 determines that the degree (proportion) of dirt on the imaging unit 10 is small (low).

[0136] For example, if the dirt on the lens is at a medium adhesion rate (medium), such as about half the angle of view, the water discharge control system 1 determines that the degree of dirt (rate) of the imaging unit 10 is medium. For example, if the number of water droplets is medium (about half the angle of view, etc.), the water discharge control system 1 determines that the degree of dirt (rate) of the imaging unit 10 is medium.

[0137] For example, if the lens is heavily soiled over the entire angle of view, the water discharge control system 1 determines that the degree (proportion) of dirt on the imaging unit 10 is high (large). For example, if there are a large number of water droplets (such as adhesion over the entire angle of view), the water discharge control system 1 determines that the degree (proportion) of dirt on the imaging unit 10 is high (large).

[0138] For example, as shown in the image of the lens dirt line in Fig. 4, if the dirt is relatively large, the object being imaged, such as a hand, will be blurred. Also, as shown in the image of the number of water droplets line in Fig. 4, if many water droplets adhere to the lens, the large number of water droplets will make the object unclear. The water discharge control system 1 can determine the degree of dirt on the image capture unit 10 using the dirt degree determination process described above.

[0139] <1-4. Control example> From here, the flow of processing for various controls will be explained based on flowcharts and state transition diagrams, etc. Note that the processing described with the water discharge control system 1 as the processing subject may be performed by any device capable of executing that processing, depending on the device configuration included in the water discharge control system 1. Also, each control, such as the first control to the sixth control shown below, may be executed in any combination as long as each control can be combined. For example, each process included in each control, such as the first control to the sixth control, may be executed in any combination as long as each process can be combined.

[0140] <1-4-1. First control> First, the first control by the water discharge control system 1 will be described with reference to Figs. 5 to 7. First, an overview of the processing executed by the water discharge control system 1 will be described using Figs. 5 and 6. Fig. 5 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 5 is a flowchart showing an example of the procedure of the first processing executed by the water discharge control system 1. Fig. 6 is a diagram showing an example of the correspondence between the configuration of the water discharge control system and the processing.

[0141] The water discharge control system 1 executes a state determination process (step S101). For example, the state determination unit 120 of the control device 100 executes a process of determining the state of the imaging unit 10 using an image acquired from the imaging unit 10 as shown in FIG.

[0142] The water discharge control system 1 executes a mode transition process (step S102). For example, the control unit 130 of the control device 100 executes a process of transitioning (switching) the mode according to the processing result of at least one of the image processing unit 110 and the state determination unit 120, as shown in FIG.

[0143] The water discharge control system 1 executes a notification process (step S103). For example, the notification unit 140 of the control device 100 executes the notification process in accordance with the control result by the control unit 130 as shown in FIG.

[0144] The water discharge control system 1 executes image processing (Step S104). For example, the image processing unit 110 of the control device 100 executes image processing using the image acquired from the imaging unit 10 as shown in FIG.

[0145] The water discharge control system 1 executes the water discharge process (step S105). For example, the water discharge unit 30 executes the water discharge process according to the control result by the control unit 130 as shown in FIG. 6. The water discharge control system 1 repeatedly executes the processes of steps S101 to S105. Note that steps S101 to S105 are symbols for explaining each process, and the order of each process may be reversed as long as it is feasible, and the water discharge control system 1 may execute steps S101 to S105 at any timing.

[0146] Here, the first control by the water discharge control system 1 will be described with reference to Fig. 7. Fig. 7 describes an example of the relationship between modes and states (sometimes collectively referred to as "states") and the transitions between them. Fig. 7 is a diagram showing an example of state transitions. Specifically, Fig. 7 is a state transition diagram showing an example of the first state transition in the control executed by the water discharge control system 1.

[0147] The arrows in FIG. 7 indicate that transitions (switching) are possible between states connected by the arrows. For example, the modes connected by the arrows indicate that transitions (switching) are possible from the mode at the base of the arrow to the mode at the tip of the arrow. For example, an arrow with the first mode MD1 at its base and the second mode MD2 at its tip indicates that the state corresponding to the first mode MD1 can transition (switch) to a state corresponding to the second mode MD2 (either the first state ST1 or the second state ST2, etc.). Note that the arrows shown in FIG. 7 are merely an example of state transitions, and the water discharge control system 1 is not limited to the state transitions shown in FIG. 7, and may perform any desired state transition depending on the processing.

[0148] 7, the water discharge control system 1 switches from the first mode MD1 to the second mode MD2 when the degree of dirt on the imaging unit 10 (dirt on the imaging unit 10) becomes equal to or greater than a first threshold in the first mode MD1. For example, the water discharge control system 1 switches to the first state ST1 of the second mode MD2 when the dirt on the imaging unit 10 is equal to or greater than the first threshold and less than a second threshold. For example, the water discharge control system 1 switches to the second state ST2 of the second mode MD2 when the dirt on the imaging unit 10 is equal to or greater than the second threshold.

[0149] 7, the water discharge control system 1 switches the state to the second state ST2 when a predetermined time has elapsed in the first state ST1. Also, when the dirt on the imaging unit 10 becomes equal to or greater than a second threshold, the water discharge control system 1 switches the state to the second state ST2 of the second mode MD2.

[0150] 7, the water discharge control system 1 switches the mode from the second mode MD2 to the first mode MD1 after a predetermined time has elapsed when the dirt on the imaging unit 10 becomes less than the first threshold in the second mode MD2. For example, the water discharge control system 1 switches the mode from the second mode MD2 to the first mode MD1 after a predetermined time has elapsed during which the dirt on the imaging unit 10 remains less than the first threshold in the second mode MD2.

[0151] <1-4-2. Second control> Next, the second control by the water discharge control system 1 will be described with reference to Fig. 8. Specifically, the second control shows an example of control by a state transition including a third water discharge state. Fig. 8 is a diagram showing an example of a state transition. Specifically, Fig. 8 is a state transition diagram showing an example of a second state transition in the control executed by the water discharge control system 1. Note that explanations of points similar to those described above will be omitted as appropriate.

[0152] 8, when the dirt on the imaging unit 10 becomes less than the first threshold in the second mode MD2, the water discharge control system 1 switches the state to the third state ST3 in which the third water discharge control is performed. For example, the third water discharge control may be a control that continues the water discharge state before the state is switched. In the third state ST3, the water discharge control system 1 executes the third water discharge control for a predetermined time, and switches the mode from the second mode MD2 to the first mode MD1. For example, the water discharge control system 1 executes the third water discharge control for a predetermined time in a return mode (also referred to as the "third partial mode of the second mode") corresponding to the third state ST3, and switches the mode from the second mode MD2 to the first mode MD1. As described above, any state transition is possible, and the third state ST3 may transition to the first state ST1 or the second state ST2. For example, the third state ST3 may transition to the first state ST1 or the second state ST2 depending on a change in the relationship between the dirt and the threshold due to a change in the determined dirt (level, etc.).

[0153] <1-4-3. Third Control> From here, the third control by the water discharge control system 1 will be described with reference to Fig. 9 to Fig. 15. First, an example of settings in the third control will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of settings. Specifically, Fig. 9 is a diagram showing an example of first settings in the control executed by the water discharge control system 1.

[0154] 9 shows a case where dirt level 1 of the imaging unit 10 corresponds to a small degree of dirt, dirt level 2 of the imaging unit 10 corresponds to a medium degree of dirt, and dirt level 3 of the imaging unit 10 corresponds to a large degree of dirt. Also in FIG. 9, mode SQ1 is a mode corresponding to a normal state a, mode SQ2 is a mode corresponding to a warning state b, and mode SQ3 is a mode corresponding to an abnormal state c. For example, mode SQ1 corresponds to the first mode, mode SQ2 corresponds to a first state mode of the second mode (first partial mode of the second mode), and mode SQ3 corresponds to a second state mode of the second mode (second partial mode of the second mode).

[0155] Next, the processing flow of the second processing executed by the water discharge control system 1 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 10 is a flowchart showing an example of the procedure of the state determination processing executed by the water discharge control system 1. For example, the processing shown in Fig. 10 corresponds to the processing of step S101 in Fig. 5.

[0156] The water discharge control system 1 operates the state determination unit 120 (step S201). For example, the control device 100 causes the acquisition unit 160 to acquire an image from the imaging unit 10, and the state determination unit 120 starts the state determination process.

[0157] The water discharge control system 1 determines the dirt level (step S202). For example, the control device 100 determines the dirt level of the imaging unit 10 by the state determination unit 120.

[0158] When the water discharge control system 1 determines that the dirt level is 1, it sets the setting value indicating the dirt level of the imaging unit 10 to "1" (step S203). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 1, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "1".

[0159] When the water discharge control system 1 determines that the dirt level is 2, it sets the setting value indicating the dirt level of the imaging unit 10 to "2" (step S204). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 2, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "2".

[0160] When the water discharge control system 1 determines that the dirt level is 3, it sets the setting value indicating the dirt level of the imaging unit 10 to "3" (step S205). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 3, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "3".

[0161] Next, the processing flow of the third processing executed by the water discharge control system 1 will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 11 is a flowchart showing an example of the procedure of the mode transition processing executed by the water discharge control system 1. For example, the processing shown in Fig. 11 corresponds to the processing of step S102 in Fig. 5.

[0162] The water discharge control system 1 branches the process depending on the current mode (step S301). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0163] If the current mode is normal a (step S310), the water discharge control system 1 executes the processes of steps S311 to S314. The water discharge control system 1 branches the process depending on the dirt level (step S311). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0164] If the dirt level of the imaging unit 10 is 1 (step S311: dirt level=1), the water discharge control system 1 transitions the mode to normal a (step S312). Note that in the mode transition process, if the mode to be transitioned to is the same as the mode before the transition, that mode is maintained.

[0165] Furthermore, if the dirt level of the imaging unit 10 is 2 (step S311: dirt level=2), the water discharge control system 1 transitions the mode to warning b(2) (sometimes simply referred to as "warning b") (step S313).

[0166] Furthermore, if the dirt level of the imaging unit 10 is 3 (step S311: dirt level=3), the water discharge control system 1 transitions the mode to abnormal c (step S314).

[0167] If the current mode is Warning b (step S320), the water discharge control system 1 executes the processes of steps S321 to S324. The water discharge control system 1 branches the process depending on the dirt level (step S321). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0168] If the dirt level of the imaging unit 10 is 1 (step S321: dirt level=1), the water discharge control system 1 transitions the mode to normal a (step S322).

[0169] Furthermore, when the dirt level of the imaging unit 10 is 2 (step S321: dirt level=2), the water discharge control system 1 branches the process depending on whether or not the dirt level=2 has continued for a predetermined time a (step S323). When the dirt level=2 has continued for a predetermined time a (step S323: Yes), the water discharge control system 1 transitions the mode to abnormal c(3) (sometimes simply referred to as "abnormal c") (step S324). When the dirt level=2 has not continued for a predetermined time a (step S323: No), the water discharge control system 1 transitions the mode to warning b (step S325).

[0170] Furthermore, if the soiling level of the imaging unit 10 is 3 (step S321: soiling level=3), the water discharge control system 1 transitions the mode to abnormal c(3) (step S326).

[0171] If the current mode is abnormal c(3) (step S330), the water discharge control system 1 executes the processes of steps S331 to S334. The water discharge control system 1 branches the process depending on the dirt level (step S331). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0172] If the dirt level of the imaging unit 10 is 1 (step S331: dirt level=1), the water discharge control system 1 transitions the mode to normal a (step S332).

[0173] Furthermore, if the soiling level of the imaging unit 10 is 2 (step S331: soiling level=2), the water discharge control system 1 transitions the mode to warning b(2) (step S333).

[0174] Furthermore, if the dirt level of the imaging unit 10 is 3 (step S331: dirt level=3), the water discharge control system 1 transitions the mode to abnormal c (step S334).

[0175] FIG. 12 shows state transitions corresponding to the processing flow shown in FIG. 11. FIG. 12 is a diagram showing an example of state transitions. Specifically, FIG. 12 is a state transition diagram showing an example of a third state transition in the control executed by the water discharge control system 1. In the third control, the water discharge control system 1 executes processing based on the transitions of modes (states) as shown in FIG. 12. Note that what is shown in parentheses in the state transition diagrams such as FIG. 12 is merely an example and may be various. For example, "Example: 5 minutes" shown in parentheses in a section showing the passage of time indicates that an example of the passage of time is 5 minutes. The time passage is not limited to 5 minutes and can be set to any time, such as 3 minutes or 10 minutes. Furthermore, for example, "Cleaning" shown in parentheses in a dirty section indicates that cleaning is an example of a case in which the dirt (level, etc.) changes. The change in dirt (level, etc.) is not limited to cleaning, but may be a change caused by any change, such as a change in dirt over time or the behavior of the user's hand within a predetermined area (e.g., an imaging area).

[0176] Next, the processing flow of the fourth processing executed by the water discharge control system 1 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 13 is a flowchart showing an example of the procedure of the notification processing executed by the water discharge control system 1. For example, the processing shown in Fig. 13 corresponds to the processing of step S103 in Fig. 5.

[0177] The water discharge control system 1 branches the process depending on the current mode (step S401). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0178] If the current mode is normal a (step S410), the water discharge control system 1 turns off the LED (step S411). If the current mode is warning b (2) (step S420), the water discharge control system 1 turns on the LED in yellow (step S421). If the current mode is abnormal c (3) (step S430), the water discharge control system 1 turns on the LED in red (step S431).

[0179] Next, the processing flow of the fifth processing executed by the water discharge control system 1 will be described with reference to Fig. 14. Fig. 14 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 14 is a flowchart showing an example of the procedure of image processing executed by the water discharge control system 1. For example, the processing shown in Fig. 14 corresponds to the processing of step S104 in Fig. 5.

[0180] The water discharge control system 1 executes image processing (step S501). For example, the control device 100 acquires an image from the imaging unit 10 using the acquisition unit 160, and executes image processing using the image processing unit 110. Note that image processing may be executed only in a mode that uses the results of image processing. For example, if the only mode that uses the results of image processing is the normal mode, image processing may or may not be executed in modes other than the normal mode. For example, in modes other than the normal mode, water discharge is controlled without using the results of image processing, so it does not matter whether image processing is executed or not.

[0181] Next, the processing flow of the sixth processing executed by the water discharge control system 1 will be described with reference to Fig. 15. Fig. 15 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 15 is a flowchart showing an example of the procedure of the water discharge processing executed by the water discharge control system 1. For example, the processing shown in Fig. 15 corresponds to the processing of step S105 in Fig. 5.

[0182] The water discharge control system 1 branches the process depending on the current mode (step S601). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0183] If the current mode is normal a(1) (sometimes simply referred to as "normal a") (step S610), the water discharge control system 1 executes the processes of steps S611 to S612. The water discharge control system 1 acquires the image processing results (step S611). For example, the control device 100 starts water discharge control by the control unit 130 based on the results of image processing executed by the image processing unit 110. The water discharge control system 1 performs water discharge control based on the image processing results (step S612).

[0184] If the current mode is Warning b (2) (Step S620), the water discharge control system 1 executes the processing of Steps S621 to S625. The water discharge control system 1 branches the processing depending on whether the previous mode was also Warning b mode (Step S621). For example, the control device 100 branches the processing depending on the previous mode.

[0185] If the previous mode was Warning b (Step S621: Yes), the water discharge control system 1 continues the current water discharge control (Step S622).

[0186] Furthermore, if the previous mode was not Warning b (Step S621: No), the water discharge control system 1 executes one of the processes in Steps S623 to S625. For example, if the previous mode was not Warning b, the water discharge control system 1 continues the previous water discharge control (Step S623). For example, if the previous mode was not Warning b, the water discharge control system 1 switches to water discharge control of setting b (for example, water discharge control of Warning b) (Step S624). For example, if the previous mode was not Warning b, the water discharge control system 1 switches to water discharge control of Warning b. For example, if the previous mode was not Warning b, the water discharge control system 1 continues part of the previous water discharge control and switches part of the water discharge control to water discharge control of setting b' (for example, water discharge control of Warning b) (Step S625).

[0187] If the current mode is abnormal c(3) (step S630), the water discharge control system 1 executes the processing of steps S631 to S633. The water discharge control system 1 branches the processing depending on whether the previous mode was also abnormal c mode (step S631). For example, the control device 100 branches the processing depending on the previous mode.

[0188] If the previous mode is abnormal c (step S631: Yes), the water discharge control system 1 continues the current water discharge control (step S632). If the previous mode is not abnormal c (step S631: No), the water discharge control system 1 forcibly stops water (step S633).

[0189] <1-4-4. Fourth Control> From here, the fourth control by the water discharge control system 1 will be explained with reference to Figs. 16 to 21. Note that explanations of points similar to those described above will be omitted as appropriate. For example, the image processing in the fourth control is similar to the processing shown in Fig. 14, and therefore explanations will be omitted. First, an example of settings in the fourth control will be explained using Fig. 16. Fig. 16 is a diagram showing an example of settings. Specifically, Fig. 16 is a diagram showing an example of second settings in the control executed by the water discharge control system 1.

[0190] 16 shows a case where dirt level 1 of the imaging unit 10 corresponds to a small degree of dirt, and dirt level 3 of the imaging unit 10 corresponds to a large degree of dirt. Also, in FIG. 16, mode SQ1 corresponds to the normal state a, mode SQ3 corresponds to the abnormal state c, and mode SQ5 corresponds to the recovery state e. For example, mode SQ5 corresponds to the recovery mode (third partial mode of the second mode).

[0191] Next, the processing flow of the seventh processing executed by the water discharge control system 1 will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 17 is a flowchart showing an example of the procedure of the state determination processing executed by the water discharge control system 1. For example, the processing shown in Fig. 17 corresponds to the processing of step S101 in Fig. 5.

[0192] The water discharge control system 1 operates the state determination unit 120 (step S701). For example, the control device 100 causes the acquisition unit 160 to acquire an image from the imaging unit 10, and the state determination unit 120 starts the state determination process.

[0193] The water discharge control system 1 determines the dirt level (step S702). For example, the control device 100 determines the dirt level of the imaging unit 10 by the state determination unit 120.

[0194] When the water discharge control system 1 determines that the dirt level is 1, it sets the setting value indicating the dirt level of the imaging unit 10 to "1" (step S703). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 1, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the storage unit 150 to "1".

[0195] When the water discharge control system 1 determines that the dirt level is 3, it sets the setting value indicating the dirt level of the imaging unit 10 to "3" (step S704). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 3, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "3".

[0196] Next, the processing flow of the eighth processing executed by the water discharge control system 1 will be described with reference to Fig. 18. Fig. 18 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 18 is a flowchart showing an example of the procedure of the mode transition processing executed by the water discharge control system 1. For example, the processing shown in Fig. 18 corresponds to the processing of step S102 in Fig. 5.

[0197] The water discharge control system 1 branches the process depending on the current mode (step S801). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0198] If the current mode is normal a (step S810), the water discharge control system 1 executes the processes of steps S811 to S813. The water discharge control system 1 branches the process depending on the dirt level (step S811). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0199] If the dirt level of the imaging unit 10 is 1 (step S811: Yes), the water discharge control system 1 transitions the mode to normal a (step S812). If the dirt level of the imaging unit 10 is not 1 (step S811: No), the water discharge control system 1 transitions the mode to abnormal c (step S813).

[0200] If the current mode is abnormal c(3) (step S820), the water discharge control system 1 executes the processes of steps S821 to S823. The water discharge control system 1 branches the process depending on the dirt level (step S821). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0201] If the contamination level of the imaging unit 10 is 1 (step S821: Yes), the water discharge control system 1 transitions to the mode return e(5) (sometimes simply referred to as "return e") (step S822).

[0202] Furthermore, if the contamination level of the imaging unit 10 is not 1 (step S821: No), the water discharge control system 1 transitions the mode to abnormal c(3) (step S823).

[0203] If the current mode is return e (5) (step S830), the water discharge control system 1 executes the processing of steps S831 to S833. The water discharge control system 1 branches the processing after a predetermined time c has elapsed (step S831). For example, the control device 100 branches the processing depending on whether the time elapsed since the mode transitioned to return e has reached the predetermined time c.

[0204] If the predetermined time c has elapsed (step S831: Yes), the water discharge control system 1 transitions the mode to normal a (step S832).

[0205] Moreover, if the predetermined time c has not elapsed (step S831: No), the water discharge control system 1 transitions to (maintains) the mode return e(5) (step S833).

[0206] The state transitions corresponding to the processing flow shown in Fig. 18 are shown in Fig. 19. Fig. 19 is a diagram showing an example of the state transitions. Specifically, Fig. 19 is a state transition diagram showing an example of a fourth state transition in the control executed by the water discharge control system 1. In the fourth control, the water discharge control system 1 executes processing based on the transitions of modes (states) as shown in Fig. 19.

[0207] Next, the processing flow of the ninth processing executed by the water discharge control system 1 will be described with reference to Fig. 20. Fig. 20 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 20 is a flowchart showing an example of the procedure of the notification processing executed by the water discharge control system 1. For example, the processing shown in Fig. 20 corresponds to the processing of step S103 in Fig. 5.

[0208] The water discharge control system 1 branches the process depending on the current mode (step S901). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0209] If the current mode is normal a (step S910), the water discharge control system 1 turns off the LED (step S911). If the current mode is abnormal c (3) (step S920), the water discharge control system 1 turns on the LED in red (step S921). If the current mode is recovery e (5) (step S930), the water discharge control system 1 blinks the LED in red (step S931).

[0210] Next, the processing flow of the tenth processing executed by the water discharge control system 1 will be described with reference to Fig. 21. Fig. 21 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 21 is a flowchart showing an example of the procedure of the water discharge processing executed by the water discharge control system 1. For example, the processing shown in Fig. 21 corresponds to the processing of step S105 in Fig. 5.

[0211] The water discharge control system 1 branches the process depending on the current mode (step S1001). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0212] If the current mode is normal a(1) (step S1010), the water discharge control system 1 executes the processes of steps S1011 to S1012. The water discharge control system 1 acquires the image processing results (step S1011). For example, the control device 100 starts water discharge control by the control unit 130 based on the results of image processing executed by the image processing unit 110, as in the process shown in FIG. 14 (corresponding to the process of step S104 in FIG. 5). The water discharge control system 1 performs water discharge control based on the image processing results (step S1012).

[0213] If the current mode is abnormal c(3) (step S1020), the water discharge control system 1 executes the processing of steps S1021 to S1023. The water discharge control system 1 branches the processing depending on whether the previous mode was also abnormal c mode (step S1021). For example, the control device 100 branches the processing depending on the previous mode.

[0214] If the previous mode is abnormal c (step S1021: Yes), the water discharge control system 1 continues the current water discharge control (step S1022). If the previous mode is not abnormal c (step S1021: No), the water discharge control system 1 forcibly stops water (step S1023).

[0215] If the current mode is return e (5) (step S1030), the water discharge control system 1 executes the processing of steps S1031 to S1035. The water discharge control system 1 branches the processing depending on whether the previous mode was also return e mode (step S1031). For example, the control device 100 branches the processing depending on the previous mode.

[0216] If the previous mode is return e (step S1031: Yes), the water discharge control system 1 continues the current water discharge control (step S1032).

[0217] Furthermore, if the previous mode was not return e (step S1031: No), the water discharge control system 1 executes one of the processes in steps S1033 to S1035. For example, if the previous mode was not return e, the water discharge control system 1 forcibly stops water (step S1033). For example, if the previous mode was not return e, the water discharge control system 1 switches to water discharge control of setting e (for example, water discharge control of return e) (step S1034). For example, if the previous mode was not return e, the water discharge control system 1 switches to water discharge control of return e. For example, if the previous mode was not return e, the water discharge control system 1 continues the previous water discharge control in part and switches to water discharge control of setting e' in part (for example, water discharge control of return e) (step S1035).

[0218] <1-4-5. Fifth Control> From here, the fifth control by the water discharge control system 1 will be explained with reference to Figs. 22 to 27. Note that explanations of points similar to those described above will be omitted as appropriate. For example, the image processing in the fifth control is similar to the processing shown in Fig. 14, and therefore explanations will be omitted. First, an example of settings in the fifth control will be explained using Fig. 22. Fig. 22 is a diagram showing an example of settings. Specifically, Fig. 22 is a diagram showing an example of third settings in the control executed by the water discharge control system 1.

[0219] 22 shows a case where dirt level 1 of the imaging unit 10 corresponds to a small degree of dirt, dirt level 2 of the imaging unit 10 corresponds to a medium degree of dirt, and dirt level 3 of the imaging unit 10 corresponds to a large degree of dirt. Also, in FIG. 22, mode SQ1 is a mode corresponding to the normal state a, mode SQ2 is a mode corresponding to the warning state b, mode SQ3 is a mode corresponding to the abnormal state c, mode SQ4 is a mode corresponding to the recovery state d, and mode SQ5 is a mode corresponding to the recovery state e. For example, mode SQ4 corresponds to the recovery mode (third partial mode of the second mode).

[0220] Next, the processing flow of the eleventh processing executed by the water discharge control system 1 will be described with reference to Fig. 23. Fig. 23 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 23 is a flowchart showing an example of the procedure of the state determination processing executed by the water discharge control system 1. For example, the processing shown in Fig. 23 corresponds to the processing of step S101 in Fig. 5.

[0221] The water discharge control system 1 operates the state determination unit 120 (step S1101). For example, the control device 100 causes the acquisition unit 160 to acquire an image from the imaging unit 10, and the state determination unit 120 starts the state determination process.

[0222] The water discharge control system 1 determines the dirt level (step S1102). For example, the control device 100 determines the dirt level of the imaging unit 10 by the state determination unit 120.

[0223] When the water discharge control system 1 determines that the dirt level is 1, it sets the setting value indicating the dirt level of the imaging unit 10 to "1" (step S1103). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 1, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "1".

[0224] When the water discharge control system 1 determines that the dirt level is 2, it sets the setting value indicating the dirt level of the imaging unit 10 to "2" (step S1104). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 2, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "2".

[0225] When the water discharge control system 1 determines that the dirt level is 3, it sets the setting value indicating the dirt level of the imaging unit 10 to "3" (step S1105). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 3, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "3".

[0226] Next, the processing flow of the twelfth processing executed by the water discharge control system 1 will be described with reference to Fig. 24. Fig. 24 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 24 is a flowchart showing an example of the procedure of the mode transition processing executed by the water discharge control system 1. For example, the processing shown in Fig. 24 corresponds to the processing of step S102 in Fig. 5.

[0227] The water discharge control system 1 branches the process depending on the current mode (step S1201). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0228] If the current mode is normal a (step S1210), the water discharge control system 1 executes the processes of steps S1211 to S1214. The water discharge control system 1 branches the process depending on the dirt level (step S1211). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0229] If the dirt level of the imaging unit 10 is 1 (step S1211: dirt level=1), the water discharge control system 1 transitions the mode to normal a (step S1212). If the dirt level of the imaging unit 10 is 2 (step S1211: dirt level=2), the water discharge control system 1 transitions the mode to warning b(2) (step S1213). If the dirt level of the imaging unit 10 is 3 (step S1211: dirt level=3), the water discharge control system 1 transitions the mode to abnormal c (step S1214).

[0230] If the current mode is Warning b(2) (step S1220), the water discharge control system 1 executes the processes of steps S1221 to S1226. The water discharge control system 1 branches the process depending on the dirt level (step S1221). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0231] If the dirt level of the imaging unit 10 is 1 (step S1221: dirt level=1), the water discharge control system 1 transitions the mode to return d (step S1222).

[0232] Furthermore, when the dirt level of the imaging unit 10 is 2 (step S1221: dirt level=2), the water discharge control system 1 branches the process depending on whether the dirt level=2 has continued for a predetermined time a (step S1223). When the dirt level=2 has continued for a predetermined time a (step S1223: Yes), the water discharge control system 1 transitions the mode to abnormal c(3) (step S1224). When the dirt level=2 has not continued for a predetermined time a (step S1223: No), the water discharge control system 1 transitions the mode to warning b (step S1225).

[0233] Furthermore, if the dirt level of the imaging unit 10 is 3 (step S1221: dirt level=3), the water discharge control system 1 transitions the mode to abnormal c(3) (step S1226).

[0234] If the current mode is abnormal c(3) (step S1230), the water discharge control system 1 executes the processes of steps S1231 to S1233. The water discharge control system 1 branches the process depending on the dirt level (step S1231). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0235] If the contamination level of the imaging unit 10 is 1 (step S1231: Yes), the water discharge control system 1 transitions the mode to return e(5) (step S1232).

[0236] Furthermore, if the contamination level of the imaging unit 10 is not 1 (step S1231: No), the water discharge control system 1 transitions to (maintains) the mode as abnormal c(3) (step S1233).

[0237] If the current mode is return d (4) (step S1240), the water discharge control system 1 executes the processes of steps S1241 to S1243. The water discharge control system 1 branches the process after a predetermined time b has elapsed (step S1241). For example, the control device 100 branches the process depending on whether the time elapsed since the mode transitioned to return d has reached the predetermined time b.

[0238] If the predetermined time b has elapsed (step S1241: Yes), the water discharge control system 1 transitions the mode to normal a (step S1242).

[0239] Moreover, if the predetermined time b has not elapsed (step S1241: No), the water discharge control system 1 transitions to (maintains) the mode return d(4) (step S1243).

[0240] If the current mode is return e (5) (step S1250), the water discharge control system 1 executes the processing of steps S1251 to S1253. The water discharge control system 1 branches the processing after a predetermined time c has elapsed (step S1251). For example, the control device 100 branches the processing depending on whether the time elapsed since the mode transitioned to return e has reached the predetermined time c.

[0241] If the predetermined time c has elapsed (step S1251: Yes), the water discharge control system 1 transitions the mode to normal a (step S1252).

[0242] Moreover, if the predetermined time c has not elapsed (step S1251: No), the water discharge control system 1 transitions to (maintains) the mode return e(5) (step S1253).

[0243] The state transitions corresponding to the processing flow shown in Fig. 24 are shown in Fig. 25. Fig. 25 is a diagram showing an example of the state transitions. Specifically, Fig. 25 is a state transition diagram showing an example of the third state transition in the control executed by the water discharge control system 1. In the fifth control, the water discharge control system 1 executes processing based on the transitions of modes (states) as shown in Fig. 25.

[0244] Next, the processing flow of the thirteenth processing executed by the water discharge control system 1 will be described with reference to Fig. 26. Fig. 26 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 26 is a flowchart showing an example of the procedure of the notification processing executed by the water discharge control system 1. For example, the processing shown in Fig. 26 corresponds to the processing of step S103 in Fig. 5.

[0245] The water discharge control system 1 branches the process depending on the current mode (step S1301). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0246] If the current mode is normal a (step S1310), the water discharge control system 1 turns off the LED (step S1311). If the current mode is warning b (2) (step S1320), the water discharge control system 1 turns on the LED in yellow (step S1321). If the current mode is abnormal c (3) (step S1330), the water discharge control system 1 turns on the LED in red (step S1331). If the current mode is recovery d (4) (step S1340), the water discharge control system 1 flashes the LED in yellow (step S1341). If the current mode is recovery e (5) (step S1350), the water discharge control system 1 flashes the LED in red (step S1351).

[0247] Next, the processing flow of the 14th processing executed by the water discharge control system 1 will be described with reference to Fig. 27. Fig. 27 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 27 is a flowchart showing an example of the procedure of the water discharge processing executed by the water discharge control system 1. For example, the processing shown in Fig. 27 corresponds to the processing of step S105 in Fig. 5.

[0248] The water discharge control system 1 branches the process depending on the current mode (step S1401). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0249] If the current mode is normal a(1) (step S1410), the water discharge control system 1 executes the processes of steps S1411 to S1412. The water discharge control system 1 acquires the image processing results (step S1411). For example, the control device 100 starts water discharge control by the control unit 130 based on the results of image processing executed by the image processing unit 110, as in the process shown in FIG. 14 (corresponding to the process of step S104 in FIG. 5). The water discharge control system 1 performs water discharge control based on the image processing results (step S1412).

[0250] If the current mode is Warning b (2) (step S1420), the water discharge control system 1 executes the processing of steps S1421 to S1425. The water discharge control system 1 branches the processing depending on whether the previous mode was also Warning b mode (step S1421). For example, the control device 100 branches the processing depending on the previous mode.

[0251] If the previous mode was Warning b (step S1421: Yes), the water discharge control system 1 continues the current water discharge control (step S1422).

[0252] Furthermore, if the previous mode was not warning b (step S1421: No), the water discharge control system 1 executes one of the processes in steps S1423 to S1425. For example, if the previous mode was not warning b, the water discharge control system 1 continues the previous water discharge control (step S1423). For example, if the previous mode was not warning b, the water discharge control system 1 switches to water discharge control of setting b (for example, water discharge control of warning b) (step S1424). For example, if the previous mode was not warning b, the water discharge control system 1 switches to water discharge control of warning b. For example, if the previous mode was not warning b, the water discharge control system 1 continues part of the previous water discharge control and switches part of the water discharge control to water discharge control of setting b' (for example, water discharge control of warning b) (step S1425).

[0253] If the current mode is abnormal c(3) (step S1430), the water discharge control system 1 executes the processing of steps S1431 to S1433. The water discharge control system 1 branches the processing depending on whether the previous mode was also abnormal c mode (step S1431). For example, the control device 100 branches the processing depending on the previous mode.

[0254] If the previous mode was abnormal c (step S1431: Yes), the water discharge control system 1 continues the current water discharge control (step S1432). If the previous mode was not abnormal c (step S1431: No), the water discharge control system 1 forcibly stops water flow (step S1433).

[0255] If the current mode is return d (4) (step S1440), the water discharge control system 1 executes the processing of steps S1441 to S1445. The water discharge control system 1 branches the processing depending on whether the previous mode was also return d mode (step S1441). For example, the control device 100 branches the processing depending on the previous mode.

[0256] If the previous mode is return d (step S1441: Yes), the water discharge control system 1 continues the current water discharge control (step S1442).

[0257] Furthermore, if the previous mode was not return d (step S1441: No), the water discharge control system 1 executes one of the processes in steps S1443 to S1445. For example, if the previous mode was not return d, the water discharge control system 1 continues the previous water discharge control (step S1443). For example, if the previous mode was not return d, the water discharge control system 1 switches to water discharge control of setting d (for example, water discharge control of return d) (step S1444). For example, if the previous mode was not return d, the water discharge control system 1 switches to water discharge control of return d. For example, if the previous mode was not return d, the water discharge control system 1 continues part of the previous water discharge control and switches part of the water discharge control to water discharge control of setting d' (for example, water discharge control of return d) (step S1445).

[0258] If the current mode is return e (5) (step S1450), the water discharge control system 1 executes the processing of steps S1451 to S1455. The water discharge control system 1 branches the processing depending on whether the previous mode was also return e mode (step S1451). For example, the control device 100 branches the processing depending on the previous mode.

[0259] If the previous mode is return e (step S1451: Yes), the water discharge control system 1 continues the current water discharge control (step S1452).

[0260] Furthermore, if the previous mode was not return e (step S1451: No), the water discharge control system 1 executes one of the processes in steps S1453 to S1455. For example, if the previous mode was not return e, the water discharge control system 1 forcibly stops water (step S1453). For example, if the previous mode was not return e, the water discharge control system 1 switches to water discharge control of setting e (for example, water discharge control of return e) (step S1454). For example, if the previous mode was not return e, the water discharge control system 1 switches to water discharge control of return e. For example, if the previous mode was not return e, the water discharge control system 1 continues the previous water discharge control in part and switches to water discharge control of setting e' in part (for example, water discharge control of return e) (step S1455).

[0261] An outline of the processing executed by the water discharge control system 1 in the fifth control as described above is shown in Fig. 34. Fig. 34 is a diagram showing an example of the outline of the processing executed by the water discharge control system. Specifically, Fig. 34 shows an outline of the processing executed by the water discharge control system 1 in the fifth control. In the fifth control, the water discharge control system 1 performs control by the operation of each component and water discharge control as shown in Fig. 34.

[0262] <1-4-6. Sixth Control> From here, the sixth control by the water discharge control system 1 will be explained with reference to Figs. 28 to 33. Note that explanations of points similar to those described above will be omitted as appropriate. For example, the image processing in the sixth control is similar to the processing shown in Fig. 14, and therefore explanations will be omitted. First, an example of settings in the sixth control will be explained with reference to Fig. 28. Fig. 28 is a diagram showing an example of settings. Specifically, Fig. 28 is a diagram showing an example of fourth settings in the control executed by the water discharge control system 1.

[0263] FIG. 28 illustrates a case where dirt level 1 of the imaging unit 10 corresponds to a small degree of dirt, dirt level 2 of the imaging unit 10 corresponds to a medium degree of dirt, and dirt level 3 of the imaging unit 10 corresponds to a large degree of dirt. Also, in FIG. 28, mode SQ1 corresponds to the normal state a, mode SQ2 corresponds to the warning state b, mode SQ6 corresponds to the warning state f, mode SQ4 corresponds to the recovery state d, and mode SQ7 corresponds to the recovery state g. For example, mode SQ6 corresponds to the second state mode of the second mode (the second partial mode of the second mode), and mode SQ7 corresponds to the recovery mode (the third partial mode of the second mode). The warning f mode may be a second-stage warning mode. For example, the warning f mode may be a mode in which the change in water discharge control is larger than the warning b mode, which is the first-stage warning mode, but does not change water discharge control as abruptly as in the abnormal c mode.

[0264] Next, the processing flow of the 15th processing executed by the water discharge control system 1 will be described with reference to Fig. 29. Fig. 29 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 29 is a flowchart showing an example of the procedure of the state determination processing executed by the water discharge control system 1. For example, the processing shown in Fig. 29 corresponds to the processing of step S101 in Fig. 5.

[0265] The water discharge control system 1 operates the state determination unit 120 (step S1501). For example, the control device 100 causes the acquisition unit 160 to acquire an image from the imaging unit 10, and the state determination unit 120 starts the state determination process.

[0266] The water discharge control system 1 determines the dirt level (step S1502). For example, the control device 100 determines the dirt level of the imaging unit 10 by the state determination unit 120.

[0267] When the water discharge control system 1 determines that the dirt level is 1, it sets the setting value indicating the dirt level of the imaging unit 10 to "1" (step S1503). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 1, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the storage unit 150 to "1".

[0268] When the water discharge control system 1 determines that the dirt level is 2, it sets the setting value indicating the dirt level of the imaging unit 10 to "2" (step S1504). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 2, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the storage unit 150 to "2".

[0269] When the water discharge control system 1 determines that the dirt level is 3, it sets the setting value indicating the dirt level of the imaging unit 10 to "3" (step S1505). For example, when the state determination unit 120 determines that the dirt level of the imaging unit 10 is 3, the control device 100 sets the setting value indicating the dirt level of the imaging unit 10 stored in the memory unit 150 to "3".

[0270] Next, the processing flow of the 16th processing executed by the water discharge control system 1 will be described with reference to Fig. 30. Fig. 30 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 30 is a flowchart showing an example of the procedure of the mode transition processing executed by the water discharge control system 1. For example, the processing shown in Fig. 30 corresponds to the processing of step S102 in Fig. 5.

[0271] The water discharge control system 1 branches the process depending on the current mode (step S1601). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0272] If the current mode is normal a (step S1610), the water discharge control system 1 executes the processes of steps S1611 to S1614. The water discharge control system 1 branches the process depending on the dirt level (step S1611). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0273] If the dirt level of the imaging unit 10 is 1 (step S1611: dirt level=1), the water discharge control system 1 transitions the mode to normal a (step S1612). If the dirt level of the imaging unit 10 is 2 (step S1611: dirt level=2), the water discharge control system 1 transitions the mode to warning b(2) (step S1613). If the dirt level of the imaging unit 10 is 3 (step S1611: dirt level=3), the water discharge control system 1 transitions the mode to warning f(6) (step S1614).

[0274] If the current mode is Warning b(2) (step S1620), the water discharge control system 1 executes the processes of steps S1621 to S1626. The water discharge control system 1 branches the process depending on the dirt level (step S1621). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0275] If the dirt level of the imaging unit 10 is 1 (step S1621: dirt level=1), the water discharge control system 1 transitions the mode to return d (step S1622).

[0276] Furthermore, when the dirt level of the imaging unit 10 is 2 (step S1621: dirt level=2), the water discharge control system 1 branches the process depending on whether or not the dirt level=2 has continued for a predetermined time a (step S1623). When the dirt level=2 has continued for a predetermined time a (step S1623: Yes), the water discharge control system 1 transitions the mode to warning f(6) (sometimes simply referred to as "warning f") (step S1624). When the dirt level=2 has not continued for a predetermined time a (step S1623: No), the water discharge control system 1 transitions the mode to warning b (step S1625).

[0277] Furthermore, if the dirt level of the imaging unit 10 is 3 (step S1621: dirt level=3), the water discharge control system 1 transitions the mode to warning f(6) (step S1626).

[0278] If the current mode is warning f(6) (step S1630), the water discharge control system 1 executes the processes of steps S1631 to S1633. The water discharge control system 1 branches the process depending on the dirt level (step S1631). For example, the control device 100 branches the process depending on the dirt level of the imaging unit 10.

[0279] If the contamination level of the imaging unit 10 is 1 (step S1631: Yes), the water discharge control system 1 transitions the mode to return g(7) (step S1632).

[0280] Furthermore, if the contamination level of the imaging unit 10 is not 1 (step S1631: No), the water discharge control system 1 transitions to (maintains) the mode as warning f(6) (step S1633).

[0281] If the current mode is return d (4) (step S1640), the water discharge control system 1 executes the processing of steps S1641 to S1643. The water discharge control system 1 branches the processing after a predetermined time b has elapsed (step S1641). For example, the control device 100 branches the processing depending on whether the time elapsed since the mode transitioned to return d has reached the predetermined time b.

[0282] If the predetermined time b has elapsed (step S1641: Yes), the water discharge control system 1 transitions the mode to normal a (step S1642).

[0283] Moreover, if the predetermined time b has not elapsed (step S1641: No), the water discharge control system 1 transitions to (maintains) the mode return d(4) (step S1643).

[0284] If the current mode is return g (7) (step S1650), the water discharge control system 1 executes the processing of steps S1651 to S1653. The water discharge control system 1 branches the processing after a predetermined time d has elapsed (step S1651). For example, the control device 100 branches the processing depending on whether the time elapsed since the mode transitioned to return g has reached the predetermined time d.

[0285] If the predetermined time d has elapsed (step S1651: Yes), the water discharge control system 1 transitions the mode to normal a (step S1652).

[0286] Moreover, if the predetermined time d has not elapsed (step S1651: No), the water discharge control system 1 transitions to (maintains) the mode return g(7) (step S1653).

[0287] The state transitions corresponding to the processing flow shown in Fig. 30 are shown in Fig. 31. Fig. 31 is a diagram showing an example of the state transitions. Specifically, Fig. 31 is a state transition diagram showing an example of the third state transition in the control executed by the water discharge control system 1. In the sixth control, the water discharge control system 1 executes processing based on the transitions of modes (states) as shown in Fig. 31.

[0288] Next, the processing flow of the 17th processing executed by the water discharge control system 1 will be described with reference to Fig. 32. Fig. 32 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 32 is a flowchart showing an example of the procedure of the notification processing executed by the water discharge control system 1. For example, the processing shown in Fig. 32 corresponds to the processing of step S103 in Fig. 5.

[0289] The water discharge control system 1 branches the process depending on the current mode (step S1701). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0290] If the current mode is normal a (step S1710), the water discharge control system 1 turns off the LED (step S1711). If the current mode is warning b (2) (step S1720), the water discharge control system 1 turns on the LED in yellow (step S1721). If the current mode is warning f (6) (step S1730), the water discharge control system 1 turns on the LED in orange (step S1731). If the current mode is return d (4) (step S1740), the water discharge control system 1 flashes the LED in yellow (step S1741). If the current mode is return g (7) (step S1750), the water discharge control system 1 flashes the LED in orange (step S1751).

[0291] Next, the processing flow of the 18th processing executed by the water discharge control system 1 will be described using Fig. 33. Fig. 33 is a flowchart showing an example of the procedure of the processing executed by the water discharge control system. Specifically, Fig. 33 is a flowchart showing an example of the procedure of the water discharge processing executed by the water discharge control system 1. For example, the processing shown in Fig. 33 corresponds to the processing of step S105 in Fig. 5.

[0292] The water discharge control system 1 branches the process depending on the current mode (step S1801). For example, the control device 100 branches the process depending on the mode at the time of processing.

[0293] If the current mode is normal a(1) (step S1810), the water discharge control system 1 executes the processes of steps S1811 to S1812. The water discharge control system 1 takes in the image processing results (step S1811). For example, the control device 100 starts water discharge control by the control unit 130 based on the results of image processing executed by the image processing unit 110, as in the process shown in FIG. 14 (corresponding to the process of step S104 in FIG. 5). The water discharge control system 1 performs water discharge control based on the image processing results (step S1812).

[0294] If the current mode is Warning b (2) (step S1820), the water discharge control system 1 executes the processing of steps S1821 to S1825. The water discharge control system 1 branches the processing depending on whether the previous mode was also Warning b mode (step S1821). For example, the control device 100 branches the processing depending on the previous mode.

[0295] If the previous mode was Warning b (step S1821: Yes), the water discharge control system 1 continues the current water discharge control (step S1822).

[0296] Furthermore, if the previous mode was not warning b (step S1821: No), the water discharge control system 1 executes one of the processes in steps S1823 to S1825. For example, if the previous mode was not warning b, the water discharge control system 1 continues the previous water discharge control (step S1823). For example, if the previous mode was not warning b, the water discharge control system 1 switches to water discharge control of setting b (for example, water discharge control of warning b) (step S1824). For example, if the previous mode was not warning b, the water discharge control system 1 switches to water discharge control of warning b. For example, if the previous mode was not warning b, the water discharge control system 1 continues part of the previous water discharge control and switches part of the water discharge control to water discharge control of setting b' (for example, water discharge control of warning b) (step S1825).

[0297] If the current mode is warning f (6) (step S1830), the water discharge control system 1 executes the processing of steps S1831 to S1834. The water discharge control system 1 branches the processing depending on whether the previous mode was also warning f mode or not (step S1831). For example, the control device 100 branches the processing depending on the previous mode.

[0298] If the previous mode was warning f (step S1831: Yes), the water discharge control system 1 continues the current water discharge control (step S1832). If the previous mode was not warning f (step S1831: No), the water discharge control system 1 executes one of the processes in steps S1833 to S1834. For example, if the previous mode was not warning f, the water discharge control system 1 switches to water discharge control of setting f (for example, water discharge control of warning f) (step S1833). For example, if the previous mode was not warning f, the water discharge control system 1 switches to water discharge control of warning f. For example, if the previous mode was not warning f, the water discharge control system 1 continues the previous water discharge control in part and switches to water discharge control of setting f' in part (for example, water discharge control of warning f) (step S1834). For example, a change from the first level warning b to the second level warning f will not occur unless some change is made from warning b, so in this case, the water discharge control system 1 does not need to continue the previous water discharge control.

[0299] If the current mode is return d (4) (step S1840), the water discharge control system 1 executes the processing of steps S1841 to S1845. The water discharge control system 1 branches the processing depending on whether the previous mode was also return d mode (step S1841). For example, the control device 100 branches the processing depending on the previous mode.

[0300] If the previous mode is return d (step S1841: Yes), the water discharge control system 1 continues the current water discharge control (step S1842).

[0301] Furthermore, if the previous mode was not return d (step S1841: No), the water discharge control system 1 executes one of the processes in steps S1843 to S1845. For example, if the previous mode was not return d, the water discharge control system 1 continues the previous water discharge control (step S1843). For example, if the previous mode was not return d, the water discharge control system 1 switches to water discharge control of setting d (for example, water discharge control of return d) (step S1844). For example, if the previous mode was not return d, the water discharge control system 1 switches to water discharge control of return d. For example, if the previous mode was not return d, the water discharge control system 1 continues part of the previous water discharge control and switches part of the water discharge control to water discharge control of setting d' (for example, water discharge control of return d) (step S1845).

[0302] If the current mode is return g (7) (step S1850), the water discharge control system 1 executes the processing of steps S1851 to S1855. The water discharge control system 1 branches the processing depending on whether the previous mode was also return g mode (step S1851). For example, the control device 100 branches the processing depending on the previous mode.

[0303] If the previous mode is return g (step S1851: Yes), the water discharge control system 1 continues the current water discharge control (step S1852).

[0304] Furthermore, if the previous mode was not return g (step S1851: No), the water discharge control system 1 executes one of the processes in steps S1853 to S1855. For example, if the previous mode was not return g, the water discharge control system 1 continues the previous water discharge control (step S1853). For example, if the previous mode was not return g, the water discharge control system 1 switches to water discharge control of setting g (for example, water discharge control of return g) (step S1854). For example, if the previous mode was not return g, the water discharge control system 1 switches to water discharge control of return g. For example, if the previous mode was not return g, the water discharge control system 1 continues the previous water discharge control in part and switches to water discharge control of setting g' in part (for example, water discharge control of return g) (step S1855).

[0305] An outline of the processing executed by the water discharge control system 1 in the sixth control as described above is shown in Fig. 35. Fig. 35 is a diagram showing an example of the outline of the processing executed by the water discharge control system. Specifically, Fig. 35 shows an outline of the processing executed by the water discharge control system 1 in the sixth control. In the sixth control, the water discharge control system 1 performs control by the operation of each component and water discharge control as shown in Fig. 35.

[0306] The above-described configuration and processing are merely examples, and the water discharge control system 1 is not limited to the above-described configuration and processing, and may have various configurations and execute various processing. For example, the water discharge control system 1 may execute a combination of the above-described various processing.

[0307] The above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0308] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

[0309] The above-described embodiments and modifications may have the following configurations, but are not limited to these. (1) an imaging unit that images at least the water discharge area of ​​the water discharge unit; an image processing unit that processes the image captured by the imaging unit; a state determination unit that determines a state of the imaging unit based on an image captured by the imaging unit; a control unit that controls the water discharge state of the water discharge unit; Equipped with The control unit switches between a first mode based on a processing result of the image processing unit and a second mode based on a determination result of the state determination unit. A water discharge control system characterized by: (2) the first mode has a plurality of water discharge forms based on the processing results of the image processing unit, The second mode has a plurality of water discharge patterns based on the determination result of the state determination unit. The water discharge control system according to (1) is characterized in that: (3) In the first mode, the control unit selects a water discharge mode based on the processing result of the image processing unit and performs water discharge control, and in the second mode, selects a water discharge mode based on the determination result of the state determination unit and performs water discharge control. The water discharge control system according to (1) is characterized in that: (4) the image processing unit, in the first mode, determines whether an imaged object detected from an image captured by the imaging unit is a water discharge target, The control unit controls the water discharge state based on the state of the water discharge target. The water discharge control system according to (1) is characterized in that: (5) In the first mode, the image processing unit determines that an object having a predetermined moving speed or an object within a water discharge area is the water discharge target. The water discharge control system according to (4) above. (6) In the first mode, the image processing unit controls the instantaneous water discharge flow rate from the water discharge unit based on at least one of the size and type of the object to be discharged and the distance between the water discharge port of the water discharge unit and the object to be discharged. The water discharge control system according to (4) or (5) above. (7) The control unit switches from the first mode to the second mode when the dirt on the imaging unit is equal to or greater than a first threshold based on the image captured by the imaging unit. The water discharge control system according to any one of (1) to (6) above, characterized in that: (8) the state determination unit determines that the image capture unit is in a first state when the dirt on the image capture unit is less than a second threshold value that is greater than the first threshold value and is equal to or greater than the first threshold value, and determines that the image capture unit is in a second state when the dirt on the image capture unit is equal to or greater than the second threshold value; In the second mode, the control unit executes a first water discharge control corresponding to the first state or a second water discharge control corresponding to the second state. The water discharge control system according to (7) above. (9) The second water discharge control is a water stop control. The water discharge control system according to (8) above. (10) The control unit executes the second water discharge control when the first state continues for a predetermined time or more in the second mode. The water discharge control system according to (8) or (9) is characterized in that: (11) The first water discharge control continues the water discharge control in the first mode immediately before switching to the second mode. The water discharge control system according to any one of (8) to (10) above. (12) In the second mode, when the state determination unit determines that the dirt on the imaging unit is less than the first threshold, the control unit switches from the second mode to the first mode after a predetermined time. The water discharge control system according to any one of (8) to (11) above, characterized in that: (13) In the second mode, when the state determination unit determines that the dirt on the imaging unit is less than the first threshold, the control unit executes a third water discharge control for a predetermined time, and then switches to the first mode. The water discharge control system according to any one of (7) to (12) above, characterized in that: (14) a notification unit that notifies at least one of the mode and the water discharge control; The water discharge control system according to any one of (1) to (13) above, comprising: [Explanation of symbols]

[0310] 1. Water discharge control system 2 Kitchen unit 10. Imaging unit 20 Top part 30 Water outlet 31 Water pipe 32 heads 321 Outlet 40 Sink 100 control device 101 Water valve 102 Purified water valve 103 Hot water valve 104 Flow control valve 110 Image processing section 120 Status determination unit 130 control unit (water discharge / stop control unit) 140 Notification Department 150 Storage section 160 Acquisition Department

Claims

1. an imaging unit that images at least the water discharge area of ​​the water discharge unit; an image processing unit that processes the image captured by the imaging unit; a state determination unit that determines a state of the imaging unit based on an image captured by the imaging unit; a control unit that controls the water discharge state of the water discharge unit; Equipped with The control unit switches between a first mode based on a processing result of the image processing unit and a second mode based on a determination result of the state determination unit. A water discharge control system characterized by:

2. the first mode has a plurality of water discharge forms based on the processing results of the image processing unit, The second mode has a plurality of water discharge patterns based on the determination result of the state determination unit. The water discharge control system according to claim 1 .

3. In the first mode, the control unit selects a water discharge mode based on the processing result of the image processing unit and performs water discharge control, and in the second mode, selects a water discharge mode based on the determination result of the state determination unit and performs water discharge control. The water discharge control system according to claim 1 .

4. the image processing unit determines, in the first mode, whether an imaged object detected from an image captured by the imaging unit is a water discharge target, The control unit controls the water discharge state based on the state of the water discharge target. The water discharge control system according to claim 1 .

5. In the first mode, the image processing unit determines that an object having a predetermined moving speed or an object within a water discharge area is the water discharge target. The water discharge control system according to claim 4 .

6. In the first mode, the image processing unit controls the instantaneous water discharge flow rate from the water discharge unit based on at least one of the size and type of the object to be discharged and the distance between the water discharge port of the water discharge unit and the object to be discharged. The water discharge control system according to claim 4 .

7. The control unit switches from the first mode to the second mode when the dirt on the imaging unit is equal to or greater than a first threshold based on the image captured by the imaging unit. The water discharge control system according to claim 1 .

8. the state determination unit determines that the image capture unit is in a first state when the dirt on the image capture unit is less than a second threshold value that is greater than the first threshold value and is equal to or greater than the first threshold value, and determines that the image capture unit is in a second state when the dirt on the image capture unit is equal to or greater than the second threshold value; In the second mode, the control unit executes a first water discharge control corresponding to the first state or a second water discharge control corresponding to the second state. The water discharge control system according to claim 7 .

9. The second water discharge control is a water stop control. The water discharge control system according to claim 8 .

10. The control unit executes the second water discharge control when the first state continues for a predetermined time or more in the second mode. The water discharge control system according to claim 8 .

11. The first water discharge control continues the water discharge control in the first mode immediately before switching to the second mode. The water discharge control system according to claim 8 .

12. In the second mode, when the state determination unit determines that the dirt on the imaging unit is less than the first threshold, the control unit switches from the second mode to the first mode after a predetermined time. The water discharge control system according to claim 8 .

13. In the second mode, when the state determination unit determines that the dirt on the imaging unit is less than the first threshold, the control unit executes a third water discharge control for a predetermined time, and then switches to the first mode. The water discharge control system according to claim 7 .

14. a notification unit that notifies at least one of the mode and the water discharge control; The water discharge control system according to claim 1 .

Images