Water discharge control system and water discharge control method

Abstract

To properly execute control relating to discharge and stop of water.SOLUTION: A water discharge control system according to an embodiment comprises: a water discharge part; a water discharge / stop switching part to switch water discharging and stopping of the water discharge part; an image part to image a water use space; a determination part to determine movement of a recognition target detected by an image imaged by the image part; and a control part to control the water discharge / stop switching part. The determination part determines a travel speed of an article when the recognition target detected within a water discharge range is the article. The control part controls water discharge or stop of the water discharge part by controlling the water discharge / stop switching part based on determination result of the determination part.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The disclosed embodiments relate to a water discharge control system and a water discharge control method. [Background technology]

[0002] Conventionally, there have been provided technologies for controlling the spouting and stopping of water at a water spouting section in a kitchen or other water-related area based on sensing (see, for example, Patent Documents 1 to 3). For example, a system has been disclosed that detects from a captured image that a target object is in a first area and that a held object is in a second area, and controls the spouting of water based on the detection results. Also disclosed is a control that spouts water when the moving speed of the held object is below a predetermined threshold and stops water when the moving speed is equal to or greater than the predetermined threshold. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7263128 [Patent Document 2] Patent No. 7145635 [Patent Document 3] JP 2012-002033 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above-mentioned conventional technology. For example, in the above-mentioned conventional technology, since the held object is located near the user's body, there is a high possibility that the held object will be blocked by the user's body, and it may be difficult to appropriately execute control regarding the stop of water discharge. Thus, there is room for improvement in the above-mentioned conventional technology in terms of appropriate control regarding the stop of water discharge. Therefore, it is desirable to appropriately execute control regarding the stop of water discharge.

[0005] An object of the disclosed embodiments is to provide a water discharge control system and a water discharge control method that appropriately executes control regarding water discharge and stopping. [Means for solving the problem]

[0006] A water discharge control system according to one aspect of the embodiment includes a water discharge section, a water discharge stop switching section which switches the water discharge from the water discharge section, an imaging section which images the water-related space, a determination section which determines the movement of a recognized object detected from an image captured by the imaging section, and a control section which controls the water discharge stop switching section, wherein when the recognized object detected within the water discharge area is an item, the determination section determines the movement speed of the item, and the control section controls the water discharge from the water discharge section by controlling the water discharge stop switching section based on the determination result of the determination section.

[0007] According to a water discharge control system according to one aspect of the embodiment, by determining whether to stop water discharge based on the moving speed of the item, it is possible to prevent the determination from being hindered by the user's head or an obstructing object. Furthermore, for example, the water discharge control system focuses only on the item, so complex image recognition such as detection of a held object and complex water discharge control conditions are not required, and the burden on the control unit can be reduced. This allows the water discharge control system to easily and accurately grasp the user's intention to stop water discharge. For example, since the movement of the item is always caused by the user's actions, the water discharge control system can accurately read the user's intention to stop water discharge. Therefore, the water discharge control system can appropriately execute control regarding water discharge and stop.

[0008] In one aspect of the embodiment, in the water discharge control system, the determination unit determines, based on the moving speed of the item, which of a plurality of states the item is in, including a first state corresponding to the item being stationary, and a second state in which the moving speed of the item is faster than the first state and corresponds to work being performed using the item, and if the determination unit determines that the item is in the first state, the control unit controls the water discharge unit to stop water discharge, and if the determination unit determines that the item is in the second state, the control unit controls the water discharge unit to discharge water.

[0009] According to a water discharge control system according to one aspect of the embodiment, when the equipment is stationary, it is determined that the equipment is simply placed in the sink and water is not discharged, but when the user is moving the equipment (working), it is determined that there is an intention to discharge water and water is discharged. This allows the water discharge control system to prevent water from being discharged when the equipment is simply placed in the sink, and enables water discharge control that takes into account the user's intention to discharge water. Therefore, the water discharge control system can appropriately execute control regarding the stopping and discharging of water.

[0010] In a water discharge control system according to one aspect of the embodiment, the determination unit determines that the item is in a third state corresponding to passing when the moving speed of the item is greater than the speed corresponding to the second state, and the control unit controls the water discharge unit to stop water discharge when the determination unit determines that the item is in the third state.

[0011] For example, a scene may be considered in which a user wishes to move an item through an area such as inside a sink. In this way, when there is no intention to discharge water and the item is simply crossing an area such as inside a sink, it is assumed that the item is moved at a certain speed. Therefore, according to a water discharge control system according to one aspect of the embodiment, water is not discharged onto an item that is moving through an area such as inside a sink at a speed equal to or higher than a certain speed. This allows the water discharge control system to prevent water discharge unintended by the user. Therefore, the water discharge control system can appropriately execute control regarding water discharge and stop.

[0012] In a water discharge control system according to one aspect of the embodiment, the control unit controls the water discharge unit to discharge water when the recognition object detected within the water discharge area is a human hand.

[0013] When a user brings their hand to the water discharge area, it is considered that they want to perform the task for which water was discharged. Therefore, according to the water discharge control system of one aspect of the embodiment, regardless of the movement of the tool, if a human hand is detected in the water discharge area, water is controlled to be discharged, so that the user's intention to discharge water can be accurately read and water can be discharged. Therefore, the water discharge control system can appropriately execute control regarding the stopping of water discharge.

[0014] A water discharge control method according to one aspect of an embodiment includes an imaging process for imaging a water-related space, a determination process for determining the movement of a recognized object detected from an image captured by the imaging process, and a control process for controlling a water discharge stop switching unit that switches the water discharge of the water discharge section, wherein the determination process determines the movement speed of the recognized object when the recognized object detected within the water discharge area is an item, and the control process controls the water discharge stop of the water discharge section by controlling the water discharge stop switching unit based on the determination result of the determination process.

[0015] According to the water discharge control method of one aspect of the embodiment, by determining whether to stop the water discharge based on the moving speed of the item, it is possible to prevent the determination from being hindered by the user's head or an obstructing object. Furthermore, for example, the water discharge control method focuses only on the item, so complex image recognition such as detection of a held object and complex water discharge control conditions are not required, and the burden on the control unit can be reduced. This makes it possible for the water discharge control method to easily and accurately grasp the user's intention to stop the water discharge. For example, since the movement of the item is always caused by the user's behavior, the water discharge control method can accurately read the user's intention to stop the water discharge. Therefore, the water discharge control method can appropriately execute control regarding the water discharge and stop. Effect of the Invention

[0016] According to one aspect of the embodiment, control regarding water discharge and stop can be appropriately executed. [Brief description of the drawings]

[0017] [Figure 1]FIG. 1 is a schematic perspective view of a water discharge control system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the configuration of the water discharge control system according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of a region. [Figure 4] FIG. 4 is a flowchart showing an example of a procedure related to the first processing according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing an example of a procedure for the second process according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of a procedure related to the third process according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a region. [Figure 8] FIG. 8 is a flowchart showing an example of a procedure related to the fourth process according to the second embodiment. [Figure 9] FIG. 9 shows an example of a hand gripping position. [Figure 10] FIG. 10 is a diagram showing an example of a hand. [Figure 11] FIG. 11 is a flowchart illustrating an example of a procedure related to the fifth process according to the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of an inference model. [Figure 13] FIG. 13 is a diagram showing an example of a region. [Figure 14] FIG. 14 is a flowchart illustrating an example of a procedure related to the sixth process according to the third embodiment. [Figure 15] FIG. 15 is a flowchart illustrating an example of a procedure related to the seventh process according to the third embodiment. [Figure 16] FIG. 16 is a diagram showing an example of changing the area. [Figure 17] FIG. 17 is a diagram showing an example of changing the area. [Figure 18] FIG. 18 is a diagram showing an example of changing the area. [Figure 19] FIG. 19 is a diagram showing an example in which there are a plurality of water outlets. [Figure 20] FIG. 20 is a diagram showing an example of a region when there are a plurality of water outlets. [Figure 21] FIG. 21 is a diagram showing an example of processing when an imaging section is included in the water discharger. [Figure 22] FIG. 22 is a diagram showing an example of processing when an imaging section is included in the water discharge section. [Diagram 23] FIG. 23 is a diagram showing an example of processing when an imaging section is included in the water discharger. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, embodiments of a water discharge control system and a water discharge control method disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0019] <1. First embodiment> First, the water discharge control system 1 according to the first embodiment will be described below. In order to control water discharge and water stop (also referred to as "water discharge stop"), the water discharge control system 1 detects (recognizes) a target object (also referred to as "target") based on information detected by a sensor that captures an image, and controls water discharge and stop according to the recognized target (also referred to as "recognized target"). For example, the target is a kitchen-related object such as food, tableware, cooking utensils, etc. (hereinafter also referred to as "items"), a part of the human body such as the body, head, and hand of a person (also referred to as a "user"), and elements that constitute a kitchen such as a stove, sink, and water discharge unit. The recognized target includes at least one of the hand of a person (user) and items. Note that the process described as the processing subject of the water discharge control system according to each embodiment of the water discharge control system such as the water discharge control system 1 may be performed by any device capable of executing the process, depending on the device configuration included in the water discharge control system.

[0020] <1-1. Water discharge control system configuration> The configuration of a water discharge control system 1 according to a first embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a schematic perspective view of a water discharge control system according to a first embodiment. Fig. 2 is a diagram showing an example of the configuration of the water discharge control system according to the first embodiment.

[0021] As shown in Fig. 1 and Fig. 2, the water discharge control system 1 has a kitchen main body 2, an imaging unit 10, a control unit 100, and solenoid valves 101 to 103. The kitchen main body 2 is a plumbing device main body. The kitchen main body 2 has a water discharge unit 30, a sink 40, and a stove unit 50 on an upper surface unit 20 where a user performs tasks such as cooking and washing objects such as dishes. For example, the kitchen main body 2 may be a system kitchen.

[0022] 1 and 2 is merely an example, and any configuration may be adopted for the kitchen body 2. For example, the kitchen body 2 does not have to include the stove unit 50. In this case, the stove unit 50 may be provided separately from the kitchen body 2.

[0023] 1, a wall cabinet 60 and a range hood 70 are provided above the kitchen body 2, that is, on the side facing the upper surface 20 of the kitchen body 2. The wall cabinet 60 and the range hood 70 do not necessarily have to be provided.

[0024] The upper surface 20 of the kitchen main body 2 is used for the user's work. For example, the surface of the upper surface 20 of the kitchen main body 2 between the sink 40 and the stove unit 50 functions as a work surface that the user can use to perform processing such as cutting ingredients, or to place dishes after washing. In addition to being located between the sink 40 and the stove unit 50, multiple work surfaces may be located, such as on the right side of the sink 40.

[0025] The water discharger 30 has a water outlet 321 provided in a head 32, which is a portion on the tip side of the water discharge pipe 31, and discharges (spouts) water from the water outlet 321. For example, the water discharger 30 may be capable of spouting water in any shape (shower, straight, etc.) from the water outlet 321. In this case, the water discharger 30 may be capable of switching the water spout from the water outlet 321 between straight and shower. For example, the water discharger 30 may spout water in different shapes according to the user's selection. The water discharger 30 may have multiple water outlets, which will be described later. In the example of FIG. 1 and FIG. 2, the water discharger 30 spouts multiple types of water, such as raw water, purified water, and hot water (warm water), according to the control of the solenoid valves 101 to 103 by the control unit 100. The flow rate of the water, such as raw water, purified water, and hot water (warm water), may also be changed according to the control of the solenoid valves 101 to 103. The water discharge unit 30 may be configured to discharge only raw water. In this case, the water discharge control system 1 has only the solenoid valve 101 among the solenoid valves 101 to 103. The water discharge unit 30 refers to a portion exposed from the kitchen main body 2, for example.

[0026] The sink 40 is a recess recessed from the surface of the upper surface 20, and functions as a water receiving portion that receives water from the water discharger 30. The sink 40 is used, for example, for washing objects such as dishes, and is a tank-like platform equipped with a drain to drain water from the water discharger 30, etc.

[0027] The stove unit 50 is stove equipment used by a user for heating operations for cooking. Although Figs. 1 and 2 show an example in which the stove unit 50 has two heating units, 51 and 52, the stove unit 50 may have one heating unit or three or more heating units. The heating units 51 and 52 perform heating using any heat source, such as gas or electricity. In this way, the heating units 51 and 52 can be of any configuration, such as an electric stove, an IH stove, or a gas stove.

[0028] The control unit 100 is a control device that performs control regarding water discharge. The control unit 100 performs control regarding water discharge by controlling the switching of the solenoid valves 101 to 103 based on information detected by each sensor such as the imaging unit 10. The control unit 100 detects a recognition target from an image captured by the imaging unit 10, and controls the water discharge unit 30 based on the detection result. In addition, the control settings of the control unit 100 for the solenoid valves 101 to 103 may be changed to a preferred setting by the user. For example, the control settings may be changed by the user, such as reducing the flow rate of purified water discharged for ingredients, or changing the water discharged for dirt to water. In addition, when detecting a recognition target from an image, the control unit 100 performs any processing such as brightness and color correction (image correction), monochrome / color conversion (image conversion), target identification (image recognition), and area measurement (image feature extraction) on the captured image.

[0029] The solenoid valve 101 functions as a valve for discharging raw water to the water discharge unit 30. The solenoid valve 102 functions as a valve for discharging purified water to the water discharge unit 30. The solenoid valve 103 functions as a valve for discharging hot water (warm water) to the water discharge unit 30. The control unit 100 is connected to each of the solenoid valves 101-103. Note that instead of the solenoid valves 101-103, a single flow path switching valve may be used to switch between each type of discharge (raw water, purified water, hot water, etc.).

[0030] For example, the control unit 100 is connected to a solenoid valve 101 that switches between discharging and stopping the raw water by the water discharge unit 30. The control unit 100 controls the discharge and stopping of raw water by the water discharge unit 30 using a control signal that opens and closes the solenoid valve 101. Note that the flow rate of raw water by the water discharge unit 30 may be changed using a control signal that opens and closes the solenoid valve 101.

[0031] For example, the control unit 100 is connected to a solenoid valve 102 that switches between discharging and stopping the purified water by the water discharge unit 30. The control unit 100 controls discharging and stopping the purified water by the water discharge unit 30 using a control signal that opens and closes the solenoid valve 102. Note that the flow rate of the purified water by the water discharge unit 30 may be changed using a control signal that opens and closes the solenoid valve 102.

[0032] For example, the control unit 100 is connected to a solenoid valve 103 that switches between discharging and stopping hot water by the water discharge unit 30. The control unit 100 controls discharging and stopping of hot water by the water discharge unit 30 using a control signal that opens and closes the solenoid valve 103. The flow rate of hot water by the water discharge unit 30 may be changed using the control signal that opens and closes the solenoid valve 103.

[0033] The control unit 100 is also connected to each sensor such as the imaging unit 10 via a predetermined network such as the Internet in a wired or wireless manner so as to be able to communicate with the sensors. For example, the control unit 100 has a communication function (communication unit) for transmitting and receiving information with other devices. The communication function (communication unit) of the control unit 100 is realized by a communication device, a communication circuit, or the like. The control unit 100 is connected to an arbitrary network in a wired or wireless manner by the communication function, and transmits and receives information with an external information processing device. For example, the control unit 100 transmits and receives information with the imaging unit 10, etc. Note that the control unit 100 may be connected to each sensor in any manner as long as it is possible to transmit and receive information, and may be connected to each sensor in a wired or wireless manner so as to be able to communicate with the sensors.

[0034] The control unit 100 may be disposed in any location. The control unit 100 may be provided in a space (kitchen room) corresponding to the kitchen main body 2, or may be provided outside the space (kitchen room) corresponding to the kitchen main body 2.

[0035] The device configuration and arrangement of the control unit 100 may be of any form as long as it is possible to realize switching control of the solenoid valves 101-103, communication with each sensor such as the imaging unit 10, and processing. The control unit 100 may also be disposed inside the kitchen main body 2. The control unit 100 may also be disposed outside the kitchen main body 2, rather than inside the kitchen main body 2. Details of the control unit 100 will be described later.

[0036] The imaging unit 10 captures an image of the water-related space and the like. The imaging unit 10 functions as a sensor unit that acquires information used to control water discharge. For example, the imaging unit 10 is a camera module that acquires an image by capturing an image of a specific area, such as inside the sink 40, or a sensor unit that uses an image sensor. The imaging unit 10 captures an image of the water-related space around the water discharge unit 30. For example, the imaging unit 10 captures an image of the water-related space including the sink 40 and the like.

[0037] The imaging unit 10 is disposed in a position where it can image a desired range (area). For example, the imaging unit 10 is provided below the water discharge unit 30 or the water discharge unit 30. In the following, a case where the imaging unit 10 is provided along the water discharge pipe 31 of the water discharge unit 30 is shown as an example. Note that the arrangement of the imaging unit 10 shown in Figures 1 and 2 is merely an example, and the imaging unit 10 may be disposed in any position as long as it can image a desired range.

[0038] The imaging unit 10 may be any sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. For example, the imaging unit 10 may be an area sensor or a distance measuring sensor using an image sensor. The imaging unit 10 captures an image of the water surrounding space around the water discharger 30.

[0039] Also, for example, the imaging unit 10 is disposed facing a direction in which it captures an image of the sink 40. Note that the imaging unit 10 may be disposed in any manner as long as it is capable of detecting (capturing) an object. Also, the imaging unit 10 may capture a still image or a moving image.

[0040] The imaging unit 10 is connected to the control unit 100 via a predetermined network so as to be able to communicate with each other by wire or wirelessly. The imaging unit 10 transmits various information to the control unit 100. For example, the imaging unit 10 transmits information about an acquired image to the control unit 100. For example, the imaging unit 10 may be connected to the control unit 100 so as to be able to communicate with each other by a predetermined wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). Note that the control unit 100 and the imaging unit 10 may be connected in any manner so long as they are capable of transmitting and receiving information, and may be connected to each other by wire or may be connected to each other so as to be able to communicate with each other wirelessly. For example, the imaging unit 10 may be connected to the control unit 100 so as to be able to communicate with each other by wire or wirelessly.

[0041] When describing various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensors." When describing information acquired by various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensor information." The sensor information is a concept that includes information acquired by various sensors for water discharge control, such as information acquired by the imaging unit 10.

[0042] Further, the device configuration of the water discharge control system 1 shown in FIG. 1 and FIG. 2 is merely an example, and the water discharge control system 1 can adopt any device configuration. For example, the water discharge control system 1 does not need to include a sensor. In this case, the control unit 100 of the water discharge control system 1 may communicate with a sensor not included in the water discharge control system 1, and control the water discharge using sensor information received (acquired) from the sensor. For example, the water discharge control system 1 does not need to include the imaging unit 10. In this case, the control unit 100 of the water discharge control system 1 may communicate with an imaging unit 10 not included in the water discharge control system 1, and control the water discharge using an image received (acquired) from the imaging unit 10.

[0043] The water discharge control system 1 may also have a personal identification unit (identification device) that performs a process (personal identification) to identify a user who uses the kitchen main body 2. For example, the control unit 100 may function as the personal identification unit. For example, the personal identification unit of the water discharge control system 1 may perform personal identification based on an image of a person included in an image. Note that the above is merely an example, and the water discharge control system 1 may perform personal identification by any method as long as it is possible to identify a user who uses the kitchen main body 2. For example, the personal identification unit of the water discharge control system 1 may acquire information for identifying a user who uses the kitchen main body 2 by communicating with a device such as a smartphone owned by the user, or by the user's operation on a remote control, and perform personal identification of the user.

[0044] The water discharge control system 1 may also include sensors other than the imaging unit 10. For example, the water discharge control system 1 may also include a human body detection sensor. The human body detection sensor has a function of detecting a human body. For example, the human body detection sensor is realized by a pyroelectric sensor using an infrared signal. For example, the human body detection sensor may be realized by a μ (microwave) wave sensor. Note that the above is an example, and the human body detection sensor is not limited to the above, and may detect the human body by various means. For example, the human body detection sensor detects a person (such as a user) who enters the space (kitchen room) in which the kitchen main body 2 is provided. The human body detection sensor transmits a detection signal to the control unit 100.

[0045] <1-2. Configuration of the control unit (control device)> From here, each component of the control unit 100 will be described in detail. The control unit 100 may be, for example, an information processing device (computer) used to control various components and processes. The control unit 100 may have, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and may be realized by executing a program (for example, an information processing program related to the present disclosure) stored inside the control unit 100 using a RAM or the like as a working area. The control unit 100 may also have, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0046] As shown in FIG. 2, the control unit 100 has a switching unit 110, a processing unit 120, a storage unit 130, and an acquisition unit 140, and realizes or executes the functions and actions of the information processing described below. The internal configuration of the control unit 100 is not limited to the configuration shown in FIG. 2, and may be other configurations as long as they perform the information processing described below. For example, the processing unit 120 may be divided into a determination unit that performs processing related to determination, and a water discharge / stop control unit that performs processing related to control of water discharge / stop of the water discharge unit 30. Also, the processing performed by the control unit 100 may be executed by a cloud server (also called a cloud). In this case, the cloud and the control unit 100 are connected via a specified network, either wired or wirelessly.

[0047] The switching unit 110 is a water discharge / stop switching unit that switches the water discharge mode, such as water discharge / stop, by the water discharger 30. The water discharge mode refers to one mode of water discharge, such as the type of water discharged (raw water, purified water, electrolyzed water, etc.), temperature (cold water, room temperature water, hot water), shape (shower, straight, etc.), flow rate, etc.

[0048] The switching unit 110 switches between opening and closing the solenoid valves 101-103 in response to instructions from the processing unit 120. The switching unit 110 transmits control signals to the solenoid valves 101-103, and switches between opening and closing the solenoid valves 101-103, thereby switching the water discharge state of the water discharger 30. The water discharge state refers to a state related to the water discharge / stop of the water discharger 30, including a state in which water is discharged in any water discharge mode and a state in which water is stopped.

[0049] The processing unit 120 functions as a detection unit that detects a recognition target object using sensor information. The processing unit 120 detects a recognition target object included in an image captured by the imaging unit 10. The processing unit 120 functions as a determination unit that determines whether or not a detection has occurred. When detecting a recognition target object included in an image, the processing unit 120 performs any process on the captured image, such as brightness and color correction (image correction), monochrome / color conversion (image conversion), target object identification (image recognition), and area measurement (image feature extraction).

[0050] The processing unit 120 detects an object included in an image and its position (coordinates, etc.) by image processing. The processing unit 120 may detect an object included in an image and its position (range) by any processing as long as it can acquire information indicating the object included in the image and its position.

[0051] The processing unit 120 calculates (estimates) the moving speed of the object based on the image captured by the imaging unit 10. For example, the processing unit 120 estimates the moving speed of the object based on a change in the position (coordinates, etc.) of the object in the video. For example, the processing unit 120 estimates the moving speed of the object based on, for example, the frame rate of the video (i.e., time information) and a change in the position of the object in the video (i.e., information on the moving distance). For example, the processing unit 120 estimates the moving speed of the object by, for example, dividing the moving distance of the object in the video by the time corresponding to the frame rate of the video. Note that the above-mentioned process is merely an example, and the processing unit 120 may estimate the moving speed of the object by appropriately using various information.

[0052] The processing unit 120 may use the sensor information to determine whether or not to discharge water, and when discharging water, select raw water, purified water, or hot water as the type of water to be discharged based on the contents stored in the memory unit 130. In this case, the processing unit 120 determines to open the valve corresponding to the selected type of water among the solenoid valves 101-103. The processing unit 120 generates a control signal to instruct to open the determined valve. The processing unit 120 uses the generated control signal to instruct the switching unit 110 to switch between opening and closing the solenoid valves 101-103. Note that the opening and closing of the solenoid valves 101-103 may be controlled in response to an instruction from the processing unit 120 to change the flow rate of water such as raw water, purified water, and hot water (warm water).

[0053] The processing unit 120 determines a recognition target object from an image captured by the imaging unit 10. The processing unit 120 can determine a user's hand and an object from an image captured by the imaging unit 10. The processing unit 120 can determine a hand and an object from an image captured by the imaging unit 10.

[0054] The processing unit 120 determines the movement of the recognition object detected from the image captured by the imaging unit 10. When the recognition object detected in the water discharge area is an item, the processing unit 120 determines the moving speed of the item. Based on the moving speed of the item, the processing unit 120 determines which of a plurality of states the item is in, including a first state corresponding to the item being stationary, and a second state in which the moving speed of the item is faster than the first state and corresponds to the item being used for work. When the moving speed of the item is faster than the speed corresponding to the second state, the processing unit 120 determines that the item is in a third state corresponding to the item passing through.

[0055] The processing unit 120 controls the processing unit 120 and the switching unit 110. The processing unit 120 controls the switching of the switching unit 110, thereby controlling the water discharge unit 30 to stop discharging water. The processing unit 120 controls the switching unit 110 based on the determination result, thereby controlling the water discharge unit 30 to stop discharging water. If the processing unit 120 determines that the first state is present, it controls the water discharge unit 30 to stop discharging water, and if the processing unit 120 determines that the second state is present, it controls the water discharge unit 30 to stop discharging water.

[0056] When the processing unit 120 determines that the third state is present, it controls the water discharger 30 to stop water. When the recognition object detected within the water discharge area is a human hand, the processing unit 120 controls the water discharger 30 to discharge water.

[0057] The storage unit 130 is realized, for example, by a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. For example, the storage unit 130 is a computer-readable recording medium that non-temporarily records data used by an information processing program. The storage unit 130 stores various information such as information detected by various sensor units. The storage unit 130 stores various information used to control water discharge.

[0058] The memory unit 130 stores various information used in detecting the recognition object. For example, the memory unit 130 stores a program for detecting the recognition object, determining whether to discharge water and stop water, and the like. For example, the memory unit 130 stores a threshold value used in the determination process related to the control of water discharge and stop. For example, the memory unit 130 stores various threshold values ​​such as a first threshold value and a second threshold value. For example, the memory unit 130 stores a threshold value used in the determination process of whether or not the recognition object has been detected. The above is merely an example, and the memory unit 130 stores various information related to the process.

[0059] The storage unit 130 may store various information according to the purpose, without being limited to the above. The storage unit 130 may store sensor information detected by various sensors. The storage unit 130 may store the sensor information in association with the date and time when the sensor information was acquired. The storage unit 130 may store an image as the sensor information. The storage unit 130 stores information indicating a processing result corresponding to the image in association with the image. The storage unit 130 stores a determination result (presence or absence of a recognition target object, etc.) determined for the image in association with the image.

[0060] The acquisition unit 140 acquires information. The acquisition unit 140 acquires various information from the storage unit 130. The acquisition unit 140 acquires various information from the kitchen body 2. The acquisition unit 140 acquires various information collected in the space (kitchen room) corresponding to the kitchen body 2 from the kitchen body 2. The acquisition unit 140 acquires user identification information that identifies a user from the kitchen body 2.

[0061] The acquisition unit 140 acquires sensor information detected by the sensor from the sensor. The acquisition unit 140 acquires sensor information of the user sensed by the sensor. The acquisition unit 140 receives information related to the image acquired by the imaging unit 10 from the imaging unit 10. The acquisition unit 140 may store the received various information in the storage unit 130.

[0062] The above-described configuration of the control unit 100 is merely an example, and the control unit 100 may have various configurations other than the above. For example, if the control unit 100 has a function of displaying information, the control unit 100 may have a display unit.

[0063] <1-3. Area example> Before describing specific processing according to the first embodiment, an example of a water discharge area will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the area. Fig. 3 shows a case corresponding to a plan view (hereinafter also simply referred to as "plan view") of the upper surface portion 20 from above the kitchen main body 2. For example, Fig. 3 shows an example of a water discharge area WA1.

[0064] In Fig. 3, water discharge area WA1 includes an area that overlaps with the water outlet (e.g., water outlet 321) that discharges water from water discharger 30 in a plan view. Note that water discharge area WA1 shown in Fig. 3 is merely an example, and the water discharge area can be changed to any range, which will be described later. When the recognition object detected to be located in water discharge area WA1 is an item or a human hand, water discharge control system 1 executes the following process.

[0065] <1-4. Processing of the First Embodiment> Below, some processing examples according to the first embodiment are described. The water discharge control system 1 according to the first embodiment controls water discharge and stopping based on the moving speed of the item. That is, the water discharge control system 1 according to the first embodiment focuses on items that are less likely to be blocked by the user's body. In this way, the water discharge control system 1 according to the first embodiment focuses on the movement of the item, which is the held object, rather than on an object held by the user, etc. As a result, the water discharge control system 1 according to the first embodiment appropriately executes water discharge and stopping control based on a captured image (camera image).

[0066] From here, a specific example of the process flow related to the first embodiment will be described. The water discharge control system 1 according to the first embodiment executes the following first to third processes. The water discharge control system 1 executes at least one of the first to third processes. The water discharge control system 1 may execute water discharge control by combining each of the first to third processes. In the following, the water discharge control system 1 is described as the processing subject, but the first to third processes may be performed by any device, such as the control unit 100, various sensors such as the imaging unit 10, etc., depending on the device configuration included in the water discharge control system 1.

[0067] <1-4-1. First process flow> First, the flow of processing related to the first processing will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of a procedure related to the first processing according to the first embodiment. For example, Fig. 4 describes the processing in the case where an item to be held is set as the recognition object as an example.

[0068] The water discharge control system 1 acquires the image processing result (step S101). For example, the control unit 100 receives an image captured by the imaging unit 10 from the imaging unit 10, and detects objects and their positions (coordinates, etc.) contained in the image by performing image processing on the received image. Note that various image processing techniques may be used as appropriate to detect objects and positions from the image, and detailed explanations will be omitted.

[0069] Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (step S102). For example, the control unit 100 detects a product, which is a held object, as a recognition target in the water discharge area in the image captured by the imaging unit 10.

[0070] When the water discharge control system 1 detects a held object in the water discharge area (step S102: Yes), it determines the moving speed of the held object (step S103). For example, when the control unit 100 detects a held object in the water discharge area in the image captured by the imaging unit 10, it calculates (estimates) the moving speed of the held object and executes a determination process using the estimated moving speed.

[0071] When the moving speed of the held object is equal to or higher than the first threshold (step S103: equal to or higher than the first threshold), the water discharge control system 1 determines that the held object, which is an item, is in a working state (also referred to as a "second state") and executes water discharge (step S104). For example, when the moving speed of the held object is equal to or higher than the first threshold and the control unit 100 determines that the object is in a working state (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water. When the water discharge control system 1 is in a water discharge state, it may maintain that state or may change the water discharge state according to the determination content. The first threshold can be set to any value.

[0072] On the other hand, if the moving speed of the held object is less than the first threshold (step S103: less than first threshold), the water discharge control system 1 determines that the item is stationary (also referred to as the "first state") and stops the water flow (step S105). For example, if the control unit 100 determines that the moving speed of the held object is less than the first threshold and that the item is stationary (first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water flow. Note that if the water discharge control system 1 is in a stopped water state, it maintains that state.

[0073] When the water discharge control system 1 does not detect a held object in the water discharge area (step S102: No), it stops the water (step S106). For example, when the control unit 100 does not detect a held object in the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to stop the water discharge unit 30. Note that when the water discharge control system 1 is in a stopped state, it maintains that state.

[0074] In this way, through the first process, the water discharge control system 1 is able to accurately control the water discharge by determining, from the movement speed of the held object, which is less likely to be blocked by an obstruction, whether the object is in a state where it is doing work such as washing dishes (working) or where items are placed (stationary).

[0075] <1-4-2. Second process flow> The process shown in FIG. 4 is merely an example, and the water discharge control system 1 may determine three or more states depending on the moving speed. In this regard, the flow of the process will be described as the process related to the second process with reference to FIG. 5. FIG. 5 is a flowchart showing an example of the procedure related to the second process according to the first embodiment. Note that the description of the same points as those described in FIG. 4 will be omitted as appropriate.

[0076] The water discharge control system 1 acquires the image processing result (Step S201). Then, the water discharge control system 1 determines whether or not there is a recognition target object in the water discharge area (Step S202).

[0077] When the water discharge control system 1 detects a held object in the water discharge area (step S202: Yes), it executes the process of determining the moving speed of the held object (1) (step S203). For example, the control unit 100 determines whether the moving speed of the held object is equal to or greater than a first threshold value as the process of determining the moving speed of the held object (1).

[0078] When the moving speed of the held object is equal to or greater than the first threshold (step S203: equal to or greater than the first threshold), the water discharge control system 1 executes the process of determining the moving speed of the held object (2) (step S204). For example, the control unit 100 determines whether the moving speed of the held object is equal to or greater than the second threshold as the process of determining the moving speed of the held object (2). The second threshold can be set to any value greater than the first threshold.

[0079] When the moving speed of the held object is less than the second threshold (step S204: less than the second threshold), the water discharge control system 1 determines that the held object, which is an item, is in a working state (second state) and executes water discharge (step S205). For example, when the moving speed of the held object is less than the second threshold and determines that the working state (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0080] On the other hand, when the moving speed of the held object is equal to or higher than the second threshold (step S204: equal to or higher than the second threshold), the water discharge control system 1 determines that the held object, which is an item, is in a passing state (also referred to as a "third state") and executes water stop (step S206). For example, when the moving speed of the held object is equal to or higher than the second threshold and determines that the object is in a passing state (third state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop water.

[0081] Thus, in the second process, if the second threshold value is equal to or greater than the second threshold value, it is determined that the held object is being moved past the sink 40 or the like. In other words, if the moving speed of the held object is greater than the speed assumed to be during work, the water discharge control system 1 determines that the held object is simply being moved, rather than that work is being performed using the held object, and does not discharge water. Note that the process flow shown in FIG. 5 is merely an example, and the water discharge control system 1 may simultaneously perform the moving speed determination (1) of the held object shown in step S203 and the moving speed determination (2) of the held object shown in step S204.

[0082] Furthermore, when the moving speed of the held object is less than the first threshold (step S203: less than first threshold), the water discharge control system 1 determines that the item is in a stationary state (first state) and stops the water (step S207). For example, when the moving speed of the held object is less than the first threshold and the control unit 100 determines that the item is in a stationary state (first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0083] When the water discharge control system 1 does not detect a held object in the water discharge area (step S202: No), it executes water stop (step S208). For example, when the control unit 100 does not detect a held object in the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101 to 103 to make the water discharge unit 30 stop water.

[0084] In this way, through the second process, the water discharge control system 1 is able to accurately control the water discharge by determining from the movement speed of the held object that the object is in a state where a task such as washing dishes is being done (work in progress) and that the object is not in a moving state (passing by).

[0085] <1-4-3. Third process flow> The water discharge control system 1 may perform processing not only for items to be held, but also for human hands as recognition objects. In this regard, the flow of the processing related to the third processing will be described with reference to FIG. 6. FIG. 6 is a flow chart showing an example of the procedure related to the third processing according to the first embodiment. Note that the same points as those described in FIG. 4 and FIG. 5 will not be described as appropriate.

[0086] The water discharge control system 1 acquires the image processing result (step S301). Then, the water discharge control system 1 judges whether or not there is a recognition target in the water discharge area (step S302). For example, the control unit 100 detects a person's hand and a product that is a held object as the recognition target, in the water discharge area in the image captured by the imaging unit 10.

[0087] When the water discharge control system 1 detects a recognition object in the water discharge area (step S302: Yes), it detects a category of the recognition object (step S303). For example, the control unit 100 determines whether the recognition object detected in the water discharge area in the image captured by the imaging unit 10 is a human hand or an item.

[0088] When the object to be recognized detected in the water discharge area is only a product, i.e., a held object (step S303: "product"), the water discharge control system 1 executes a process of determining the moving speed of the held object (1) (step S304). For example, the control unit 100 determines whether the moving speed of the held object is equal to or greater than a first threshold value as the process of determining the moving speed of the held object (1).

[0089] When the moving speed of the held object is equal to or greater than the first threshold (step S304: equal to or greater than the first threshold), the water discharge control system 1 executes the process of determining the moving speed of the held object (2) (step S305). For example, the control unit 100 determines whether the moving speed of the held object is equal to or greater than the second threshold as the process of determining the moving speed of the held object (2).

[0090] When the moving speed of the held object is less than the second threshold (step S305: less than the second threshold), the water discharge control system 1 determines that the held object, which is an item, is in a working state (second state) and executes water discharge (step S306). For example, when the moving speed of the held object is less than the second threshold and determines that the working state (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0091] On the other hand, when the moving speed of the held object is equal to or higher than the second threshold (step S305: equal to or higher than the second threshold), the water discharge control system 1 determines that the held object, which is an item, is in a passing state (third state) and executes water stop (step S307). For example, when the moving speed of the held object is equal to or higher than the second threshold and determines that the object is in a passing state (third state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop water.

[0092] Furthermore, when the moving speed of the held object is less than the first threshold (step S304: less than first threshold), the water discharge control system 1 determines that the item is in a stationary state (first state) and stops the water (step S308). For example, when the moving speed of the held object is less than the first threshold and the control unit 100 determines that the item is in a stationary state (first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0093] Furthermore, when the recognized object detected within the water discharge area is only a hand, or an item and a hand, i.e., a human hand is included in the recognized object detected within the water discharge area (step S303: "hand" or "item + hand"), the water discharge control system 1 executes water discharge regardless of the presence or absence of a held object (item) (step S309). For example, when a human hand is present within the water discharge area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0094] When the water discharge control system 1 detects no held object in the water discharge area (step S302: No), it stops the water (step S310). For example, when the control unit 100 detects neither an object nor a hand in the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0095] In this way, through the third process, when only a held object is detected in the water discharge area, the water discharge control system 1 determines that the person is performing an activity such as washing hands (working), regardless of the state of the held object, and executes water discharge, thereby enabling accurate water discharge control.

[0096] <1-5. Effects of the First Embodiment> As described above, the water discharge control system 1 according to the first embodiment can appropriately control the water discharge by controlling the water discharge and stop according to the moving speed of the held object, i.e., the utensil, and can provide a user-friendly system. In this way, the water discharge control system 1 according to the first embodiment can appropriately control the water discharge and stop.

[0097] <2. Second embodiment> When an image of a person's hand is captured, the water discharge control system may determine whether the person is working or not based on the state of the hand, and control water discharge and stopping based on the result of the determination. A second embodiment that performs this process will be described below.

[0098] In the water discharge control system 1 according to the second embodiment, the description of the same points as those in the water discharge control system 1 according to the first embodiment will be omitted as appropriate. For example, the water discharge control system 1 according to the second embodiment has the same configuration and arrangement as the water discharge control system 1 according to the first embodiment, and therefore the description of the configuration and arrangement will be omitted.

[0099] The control unit 100 according to the second embodiment executes various processes according to the state of the person's hand. For example, the processing unit 120 according to the second embodiment executes the following processes. When the recognition object is a human hand, the processing unit 120 determines the state of the recognition object. The processing unit 120 determines whether or not the person is working from the state of the hand. The processing unit 120 determines whether or not the person is working based on at least one of the shape of the person's hand and the hidden area of ​​the person's hand.

[0100] When the processing unit 120 determines that the shape of the hand is a clenched hand, it determines that the person is working. When the palm and the back of the person's hand are hidden, or when the fingertips of the person's hand are hidden, the processing unit 120 determines that the person is working. When the person's hand is present within the water discharge area, the processing unit 120 determines that the person is working. The processing unit 120 uses an inference model learned from past captured images that have been determined to be working or not working to determine whether the state corresponding to the image captured by the imaging unit 10 is working or not.

[0101] When it is determined that work is being performed, the processing unit 120 controls the water discharger 30 to discharge water, and when it is determined that work is not being performed, the processing unit 120 controls the water discharger 30 to stop water.

[0102] <2-1. Area example> Before describing specific processing according to the second embodiment, an example of a predetermined area will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of an area. Fig. 7 shows a case corresponding to a plan view of the upper surface portion 20 from above the kitchen body 2. For example, the water discharge area WA2 shown in Fig. 7 is similar to the water discharge area WA1 shown in Fig. 3, and therefore a detailed description thereof will be omitted.

[0103] For example, FIG. 7 shows an example of the predetermined area PA2. FIG. 7 shows a case where the predetermined area PA2 is a range corresponding to almost the entire sink 40. For example, the predetermined area PA2 is a range wider than the water discharge area WA2, and corresponds to a range including the water discharge area WA2 in a plan view. Note that the predetermined area PA2 shown in FIG. 7 is merely an example, and the predetermined area can be changed to any range. For example, the predetermined area PA2 can be set to any range as long as it is a range within which it is desired to determine the state of the hand. For example, the predetermined area PA2 may be the imaging range of the imaging unit 10.

[0104] <2-2. Processing of the Second Embodiment> Below, some processing examples according to the second embodiment are described. The water discharge control system 1 according to the second embodiment determines the state of the person's hand from a captured image, and controls water discharge and stop based on the determination result. That is, the water discharge control system 1 according to the second embodiment focuses on the state of the user's hand. In this way, the water discharge control system 1 according to the second embodiment focuses on the state in which the person's hand is presumed to be working, rather than on the presence or absence of tools, and can determine water discharge and stop control based only on information about the person's hand even when information about the tools cannot be detected successfully. As a result, the water discharge control system 1 according to the second embodiment appropriately executes water discharge and stop control based on the captured image (camera image).

[0105] From here, a specific example of the process flow related to the second embodiment will be described. The water discharge control system 1 according to the second embodiment executes the following processes 4 to 5. The water discharge control system 1 executes at least one of the processes 4 to 5. The water discharge control system 1 may execute water discharge control by combining each of the processes 4 to 5. In the following, the water discharge control system 1 is described as the processing subject, but the processes 4 to 5 may be performed by any device, such as the control unit 100, various sensors such as the imaging unit 10, etc., depending on the device configuration included in the water discharge control system 1.

[0106] <2-2-1. The fourth process flow> First, the flow of processing related to the fourth processing will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the procedure related to the fourth processing according to the second embodiment. For example, in Fig. 8, processing in the case where a human hand is set as a recognition target object will be described as an example. Note that the description of the same points as those in the above-mentioned processing will be omitted as appropriate.

[0107] The water discharge control system 1 acquires the image processing result (step S401). For example, the control unit 100 receives an image captured by the imaging unit 10 from the imaging unit 10, and detects objects included in the image and their positions (coordinates, etc.) by performing image processing on the received image.

[0108] Then, the water discharge control system 1 determines the state of the person's hand in the predetermined area (step S402). For example, the control unit 100 detects a human hand as a recognition target in a predetermined area in the image captured by the imaging unit 10, and if a human hand is detected in the predetermined area, it determines the state of the person's hand. Note that the water discharge control system 1 may execute the process of step S404 if a human hand is not detected in the predetermined area.

[0109] When the water discharge control system 1 determines that the state of the person's hands in the predetermined area is working (step S402: working), it executes water discharge (step S403). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is working (second state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0110] On the other hand, when the water discharge control system 1 determines that the state of the person's hands in the predetermined area is not working (step S402: not working), it stops the water (step S403). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is not working (for example, the first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0111] In this way, through the fourth process, the water discharge control system 1 determines whether or not the user is working based on the state of the person's hands, thereby enabling water discharge control in accordance with the user's intention.

[0112] 8 is merely an example, and the water discharge control system 1 may perform the same process as step S102 in Fig. 4 before the judgment of step S402. In this case, when the water discharge control system 1 detects a held object in the water discharge area, it executes the process from step S402 onwards, and when the water discharge control system 1 does not detect a held object in the water discharge area, it executes water stopping.

[0113] <2-2-2. Examples of hand shape assessment> Here, an example of determining the state of a person's hand will be shown with reference to Fig. 9 and Fig. 10. Fig. 9 is a diagram showing an example of a hand in a clenched grip. Fig. 10 is a diagram showing an example of a hand.

[0114] First, as shown in the working mode group BL1 in Fig. 9, the state of the hand varies depending on the item the person is holding, and there are various modes of the hand corresponding to working. For example, when the state of the person's hand included in a predetermined area of ​​the image resembles at least one of the modes shown in the mode group BL1, the water discharge control system 1 may determine that the state shown by the state of the person's hand included in the predetermined area of ​​the image is a state of working. For example, when the state of the person's hand included in a predetermined area of ​​the image resembles at least one of the modes shown in the mode group BL1, the water discharge control system 1 may determine that the hand included in the predetermined area of ​​the image is a clenched shape and determine that the person is working.

[0115] For example, the water discharge control system 1 may have information on the hand state corresponding to each of the states shown in the state group BL1, and by comparing that information with the state of a person's hand included in a specified area of ​​the image, determine whether the state indicated by the state of a person's hand included in a specified area of ​​the image is a working state.

[0116] For example, when working in the kitchen, a person's hands hold dishes, cooking utensils, etc. Therefore, the water discharge control system 1 distinguishes whether the person's hands are in a clenched (closed) or open shape, and if it distinguishes that the hands are clenched, it determines that the person is working.

[0117] Also, for example, the water discharge control system 1 may determine whether the state indicated by the state of the person's hand included in a predetermined area in the image is a working state, depending on whether the area indicated by the dotted lines on the back side BH and palm side PH in Fig. 10 is included in the image. In this case, the water discharge control system 1 may determine that the person is working when the palm and the back of the person's hand are hidden, or when the fingertips of the person's hand are hidden.

[0118] For example, when working in the kitchen, the palms and fingertips are hidden. For example, the water discharge control system 1 determines that the user is working when the palm and back of at least one hand are hidden, or when three or more fingertips of five fingers are hidden. Note that the case where three or more fingertips of five fingers are hidden is merely one example of a determination condition, and any number of fingertips may be hidden, such as when two or more fingertips of five fingers are hidden, or when four or more fingertips of five fingers are hidden.

[0119] For example, if it is determined that a user is working when only the palm is covered, the system may erroneously determine that a user is working when the back of the hand is facing up. On the other hand, the water discharge control system requires that the palm and back of the hand are covered, and can determine that a user is working only when the palm and back of the hand are covered by tools, for example, and can control the water discharge and stop in accordance with the user's intention.

[0120] As described above, during work, the hand is in a gripping position or part of the hand is hidden by an object. Therefore, when the hand is in a gripping position or part of the hand is hidden by an object, the water discharge control system 1 determines that work is in progress and can appropriately execute control related to water discharge and stopping.

[0121] <2-2-3. Fifth processing flow> The water discharge control system 1 may process not only a human hand but also an item as a recognition target. In this regard, the flow of the process will be described as the fifth process with reference to Fig. 11. Fig. 11 is a flow chart showing an example of the procedure of the fifth process according to the second embodiment.

[0122] The water discharge control system 1 acquires the image processing result (step S501). Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (step S502). For example, the control unit 100 detects a human hand and an item as a recognition target in the water discharge area in the image captured by the imaging unit 10.

[0123] When the water discharge control system 1 detects a recognition object in the water discharge area (step S502: Yes), it detects a category of the recognition object (step S503). For example, the control unit 100 determines whether the recognition object detected in the water discharge area in the image captured by the imaging unit 10 is a human hand or an item.

[0124] When the only object to be recognized detected within the water discharge area is an item, i.e., a held object (step S503: "Item"), the water discharge control system 1 executes a process of determining the state of the hand within the specified area (step S504). For example, the control unit 100 determines whether or not the person is working by the process of determining the state of the hand within the specified area. For example, the control unit 100 detects a human hand as the object to be recognized within a specified area in the image captured by the imaging unit 10, and if a human hand is detected within the specified area, it determines the state of the person's hand. Note that the water discharge control system 1 may execute the process of step S506 if a human hand is not detected within the specified area.

[0125] When the water discharge control system 1 determines that the state of the person's hands in the predetermined area is working (step S504: working), it executes water discharge (step S505). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is working (second state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0126] On the other hand, when the water discharge control system 1 determines that the state of the person's hands in the predetermined area is not working (step S504: not working), it stops the water (step S506). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is not working (for example, the first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0127] Furthermore, when the recognized object detected within the water discharge area is only a hand, or an item and a hand, i.e., when the recognized object detected within the water discharge area includes a human hand (step S503: "hand" or "item + hand"), the water discharge control system 1 executes water discharge regardless of the state of the hand (step S507). For example, when a human hand is present within the water discharge area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0128] When the water discharge control system 1 detects no held object in the water discharge area (step S502: No), it stops the water (step S508). For example, when the control unit 100 detects neither an object nor a hand in the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0129] For example, if a user brings their hand to the water discharge area, it is considered that they want to perform the task for which water was discharged. Therefore, by the fifth process, the water discharge control system 1 can accurately read the user's intention and discharge water regardless of the movement of the item.

[0130] <2-3. Example of inference model> The water discharge control system 1 may use an inference model to determine whether or not work is in progress. For example, the water discharge control system 1 may use an inference model learned from past captured images that were determined to be in progress or not in progress to determine whether or not the state corresponding to the image captured by the imaging unit is in progress. An example of the inference model used by the water discharge control system 1 will be described with reference to FIG. 12. FIG. 12 is a diagram showing an example of the inference model.

[0131] FIG. 12 shows an example of learning of inference model M1, which is an example of an inference model used by the water discharge control system 1 for judgment. For example, inference model M1 is a machine learning model that, when an image is input, outputs information indicating whether or not the state of the hand included in the image is working. Learning of inference models such as inference model M1 is performed using various methods related to so-called supervised learning as appropriate. For example, inference model M1 is learned (generated) by a learning process using learning data group LD1 as supervised data. Note that supervised learning for inference models such as inference model M1 is similar to general supervised learning, and detailed explanation of the learning process will be omitted.

[0132] Of the learning data group LD1 in FIG. 12, the three images in the right column are images corresponding to a state where the user is not working (also referred to as "non-working data"), and the other six images are images corresponding to a state where the user is working (also referred to as "working data"). Working data is, for example, an image including a hand in a shape where an object is being held, or where the palm or pads of the fingers are hidden. Non-working data is, for example, an image including a hand in a shape where an object is not being held, or where the palm or pads of the fingers are not hidden.

[0133] Inference models such as the inference model M1 are learned based on data such as those shown in the learning data group LD1. Note that inference models such as the inference model M1 may be learned by a device (machine learning device) not included in the water discharge control system 1, or may be learned by a device (e.g., the control unit 100) included in the water discharge control system 1. For example, when a machine learning device learns (generates) an inference model such as the inference model M1, a device (e.g., the control unit 100) included in the water discharge control system 1 may receive (acquire) the inference model such as the inference model M1 from the machine learning device and use the inference model such as the inference model M1 to determine whether or not work is in progress.

[0134] For example, the control unit 100 may input an image to be judged to an inference model such as the inference model M1, and may use information output from the inference model such as the inference model M1 to judge whether or not the image to be judged is being worked on. In this case, the inference model such as the inference model M1 is stored in the storage unit 130, and for example, the control unit 100 may use the inference model such as the inference model M1 stored in the storage unit 130 to judge whether or not work is being performed. For example, the control unit 100 may perform a learning process to generate an inference model such as the inference model M1. Note that the above is merely an example, and the control unit 100 may appropriately use various information to judge whether or not work is being performed.

[0135] <2-4. Effects of the Second Embodiment> As described above, the water discharge control system 1 according to the second embodiment can appropriately control water discharge by controlling water discharge and stopping according to the state of the hand, and can provide a user-friendly system. In this way, the water discharge control system 1 according to the second embodiment can appropriately control water discharge and stopping.

[0136] <3. Third embodiment> The water discharge control system may target different regions and control water discharge / stop based on information on the recognition target included in the target. A third embodiment for carrying out this process will be described below.

[0137] In the water discharge control system 1 according to the third embodiment, the description of the same points as those of the water discharge control system 1 according to the first or second embodiment will be omitted as appropriate. For example, the water discharge control system 1 according to the third embodiment has the same configuration and arrangement as the water discharge control system 1 according to the first embodiment, and therefore the description of the configuration and arrangement will be omitted.

[0138] The control unit 100 according to the third embodiment executes various processes according to the detection results in the first area and the second area. For example, the processing unit 120 according to the third embodiment executes the following process. When the processing unit 120 determines that only products are present in the first area, it determines whether or not a human hand is present in the second area, which is an area that encompasses the first area.

[0139] When the processing unit 120 determines that only items are present in the first area and that a human hand is present in the second area, it controls the water discharger 30 to discharge water. When the processing unit 120 determines that only items are present in the first area and that a human hand is not present in the second area, it controls the water discharger 30 to stop water.

[0140] When the processing unit 120 determines that a human hand is present in the first area, it controls the water discharger 30 to discharge water. When the processing unit 120 determines that the utensil present in the first area is equal to or larger than a predetermined size, it controls the water discharger 30 to discharge water.

[0141] <3-1. Area example> Before describing specific processing according to the third embodiment, an example of a predetermined area will be described with reference to Fig. 13. Fig. 13 is a diagram showing an example of an area. Fig. 13 shows a case corresponding to a plan view of the upper surface portion 20 from above the kitchen body 2. For example, the first area WA3 includes an area overlapping with the water outlet that spouts water from the water spouting portion 30 in a plan view. The first area WA3 shown in Fig. 13 is similar to the water spouting area WA1 shown in Fig. 3, and therefore a detailed description thereof will be omitted.

[0142] For example, FIG. 13 shows an example of the second area EA3. In FIG. 13, the second area EA3 is a range corresponding to almost the entire sink 40. For example, the second area EA3 is a range wider than the first area WA3, and corresponds to a range including the first area WA3 in a plan view. Note that the first area WA3 and the second area EA3 shown in FIG. 13 are merely examples, and the first area and the second area can be changed to any range. For example, the first area WA3 and the second area EA3 can be set to any range as long as it is a range in which the state of the hand is to be determined, but this point will be described later. Note that the first area may be read as a water discharge area, and the second area may be read as a predetermined area or a surrounding area.

[0143] <3-2. Processing of the Third Embodiment> Below, some processing examples according to the third embodiment are described. The water discharge control system 1 according to the third embodiment categorizes items (target objects) and hands (held objects), and determines the user's intention to discharge water based on the positional conditions of both. That is, the water discharge control system 1 according to the third embodiment can make an accurate determination without any time-dependent conditions. Furthermore, the water discharge control system 1 according to the third embodiment distinguishes by category, not by "held objects," so there is no need to detect the presence or skeleton of a person to determine the held object, and the control load on the control unit can be reduced. As a result, the water discharge control system 1 according to the third embodiment appropriately executes water discharge stop control based on the captured image (camera image).

[0144] From here, a specific example of the process flow related to the third embodiment will be described. The water discharge control system 1 according to the third embodiment executes the following sixth to seventh processes. The water discharge control system 1 executes at least one of the sixth to seventh processes. The water discharge control system 1 may execute water discharge control by combining each of the sixth to seventh processes. In the following, the water discharge control system 1 is described as the processing subject, but the sixth to seventh processes may be performed by any device, such as the control unit 100, various sensors such as the imaging unit 10, etc., depending on the device configuration included in the water discharge control system 1.

[0145] <3-2-1. 6th Processing Flow> First, the flow of processing related to the sixth processing will be described with reference to Fig. 14. Fig. 14 is a flowchart showing an example of a procedure related to the sixth processing according to the third embodiment. Note that the description of the same points as those in the above processing will be omitted as appropriate.

[0146] The water discharge control system 1 acquires the image processing result (step S601). For example, the control unit 100 executes image processing using any image processing technology, and acquires the image processing result as shown below. For example, the image processing result indicates the result of any image processing, and includes information indicating the category and position information of the recognized object based on the captured image. Also, for example, the position information is information indicating the center of the area in which the product exists, each vertex of the rectangular area, the maximum and minimum values ​​in the vertical direction (Y coordinate), the maximum and minimum coordinates in the horizontal direction (X coordinate), etc. Note that the above is merely one example of the image processing result, and the image processing result is not limited to the above, and any information can be adopted as long as it includes information necessary for processing.

[0147] Then, the water discharge control system 1 determines whether or not there is a recognition target in the first region (step S602). For example, the control unit 100 detects a human hand and an item as a recognition target in the first region in the image captured by the imaging unit 10.

[0148] When the water discharge control system 1 detects a recognition object in the first area (step S602: Yes), it detects a category of the recognition object (step S603). For example, the control unit 100 determines whether the recognition object detected in the first area in the image captured by the imaging unit 10 is a human hand or an item.

[0149] When the object to be recognized detected in the first area is only an item, i.e., a held object (step S603: "only items"), the water discharge control system 1 determines whether or not a hand is present in the second area (step S604). For example, the control unit 100 detects a human hand as an object to be recognized in the second area in the image captured by the imaging unit 10, and determines whether or not a hand is present in the second area based on the detection result.

[0150] When the water discharge control system 1 determines that a hand is present in the second area (step S604: Yes), it executes water discharge (step S605). For example, when the control unit 100 determines that a hand is present in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to discharge water.

[0151] On the other hand, when the water discharge control system 1 determines that there is no hand in the second area (step S604: No), it stops the water (step S606). For example, when the control unit 100 determines that there is no hand in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water.

[0152] Furthermore, the water discharge control system 1 executes water discharge (step S607) when the recognized object detected in the first area is only a hand, or an item and a hand, i.e., when the recognized object detected in the first area includes a human hand (step S603: "item and hand" or "hand only") For example, when a human hand is present in the first area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0153] When the water discharge control system 1 detects no held object in the first area (step S602: No), it stops the water (step S608). For example, when the control unit 100 detects neither an object nor a hand in the first area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0154] By the sixth process, the water discharge control system 1 acquires the category (item or hand) and position information of the object present in the image, and controls the water discharge and stopping based on the position information for each category, so there is no need to use complex judgment conditions or time-dependent conditions, and water discharge judgment and control with little time lag is possible. In this way, the water discharge control system 1 can accurately read the user's intention and discharge water regardless of the movement of the item.

[0155] <3-2-2. Seventh Processing Flow> Note that the process shown in Fig. 14 is merely an example, and the water discharge control system 1 may change the second area. In this regard, the flow of the process will be described as the process related to the seventh process with reference to Fig. 15. Fig. 15 is a flow chart showing an example of the procedure related to the seventh process according to the third embodiment. Note that the description of the same points as those in the above-mentioned processes will be omitted as appropriate.

[0156] The water discharge control system 1 acquires the image processing result (step S701). Then, the water discharge control system 1 determines whether or not there is a recognition object in the first area (step S702). If the water discharge control system 1 detects a recognition object in the first area (step S702: Yes), it detects the category of the recognition object (step S703).

[0157] When the object to be recognized detected in the first area is only an item, i.e., a held object (step S703: "Items only"), the water discharge control system 1 changes the size of the second area based on the size of the item (step S704). For example, when the object to be recognized detected in the first area is only an item, the control unit 100 changes the size of the second area according to the size of the item detected in the first area. In this way, the second area changes according to the size of the item present in the first area.

[0158] The size of the product here is any index indicating the size of the product, such as the size on the image plane or the size of the area in which the product exists output by image processing. For example, the control unit 100 changes the size of the second area by increasing the size of the second area as the size of the product detected in the first area increases, and decreasing the size of the second area as the size of the product detected in the first area decreases. For example, the control unit 100 increases the size of the second area when the size of the product is large relative to the second area, and decreases the size of the second area when the size of the product is small.

[0159] The change in size of the second area described above is merely an example, and any change in size of the second area can be adopted depending on the size of the item. For example, when there are multiple items in the first area, the water discharge control system 1 may change the second area depending on the size of the smallest item. For example, when there are multiple dishes of different sizes in the first area, with the smallest dish on top, the water discharge control system 1 may change the second area depending on the size of the smallest dish.

[0160] Then, the water discharge control system 1 determines whether or not there is a hand in the second area (step S705). That is, in the seventh processing example, the water discharge control system 1 determines whether or not there is a hand in the second area, which is changed according to the size of the item present in the first area.

[0161] When the water discharge control system 1 determines that a hand is present in the second area (step S705: Yes), it executes water discharge (step S706). For example, when the control unit 100 determines that a hand is present in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to discharge water.

[0162] On the other hand, when the water discharge control system 1 determines that there is no hand in the second area (step S705: No), it stops the water (step S707). For example, when the control unit 100 determines that there is no hand in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water.

[0163] Furthermore, the water discharge control system 1 executes water discharge (step S708) when the recognized object detected in the first area is only a hand, or an item and a hand, i.e., when the recognized object detected in the first area includes a human hand (step S703: "items and hand" or "hand only") For example, when a human hand is present in the first area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0164] When the water discharge control system 1 detects no held object in the first area (step S702: No), it stops the water (step S709). For example, when the control unit 100 detects neither an article nor a hand in the first area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0165] By the seventh process, the water discharge control system 1 can change the size of the second area according to the size of the product, thereby enabling more accurate water discharge / stop control. For example, by the seventh process, the water discharge control system 1 can achieve accurate water discharge control when the second area is changed according to the product.

[0166] <3-3. Example of changing area> Here, an example of changing the area will be described with reference to Figures 16 to 18. Figures 16 to 18 are diagrams showing an example of changing the area. Note that a description of the same points as in the above-mentioned process will be omitted as appropriate.

[0167] <3-3-1. Example of changing the second area> First, an example of the change of the second area by the seventh process will be described with reference to Fig. 16. Fig. 16 is a diagram showing an example of the change of the area. Fig. 16 shows a case corresponding to a state in which the upper surface portion 20 is viewed from above the kitchen body 2. The first area WA3 shown in Fig. 16 is similar to the first area WA3 shown in Fig. 13, and therefore a detailed description thereof will be omitted.

[0168] For example, Fig. 16 shows a case where the item detected in the first area WA3 is small. Therefore, in Fig. 16, the water discharge control system 1 changes the size of the second area to be smaller. For example, the water discharge control system 1 changes the size of the second area from the size of the second area EA3 shown in Fig. 13 to the size of the second area EA30. The second area EA30 shown in Fig. 16 shows a state where it is smaller than the second area EA3 shown in Fig. 13. This allows the water discharge control system 1 to prevent unnecessary water discharge when the second area is too large for the item.

[0169] Furthermore, when the product detected in the first area WA3 is large, the water discharge control system 1 changes the second area to a larger size. In this case, for example, the water discharge control system 1 changes the second area to a size larger than the size of the second area EA3 shown in Fig. 13 (for example, the size of the predetermined area PA2 in Fig. 7).

[0170] <3-3-2. Scope of the second area> In the water discharge control system 1, the water discharger 30 may be capable of changing the position of the water discharge port 321. In this case, the water discharger 30 may have a rotatable water discharge pipe 31. Note that the above is merely one example, and the water discharger 30 may have any configuration as long as the position of the water discharge port 321 is capable of being changed. For example, the head 32 on which the water discharge port 321 is provided may be of a pull-out type, and the position of the water discharge port 321 may be changed by changing the position of the head 32.

[0171] In this way, when the position of the water discharger 30's water outlet 321 is changeable, the water outlet 321 may move to the edge of the sink 40. In such a case, the second area may include the outside of the sink 40. In that case, the presence of an unintended hand may be detected and water may be erroneously discharged.

[0172] Therefore, the water discharge control system 1 may be configured so that the second area does not include the area outside the sink 40. An example of this case will be described with reference to FIG. 17. FIG. 17 is a diagram showing an example of changing the area. As a specific example, FIG. 17 shows an example of the second area when the water discharge pipe 31 of the water discharger 30 rotates and the position of the water discharge port 321 can be changed. FIG. 17 shows a case corresponding to the state in which the top surface part 20 is viewed from above the kitchen main body 2 in a plan view.

[0173] Figure 17 shows a case where, in a plan view, the water discharge pipe 31 is rotated counterclockwise from the state in Figure 13, and the position of the water discharge port 321 is changed to the side end of the sink 40 (the right end in Figure 17). The first area WA31 shown in Figure 17 is the same size as the first area WA3 shown in Figure 13, but shows a state where its position has been changed in accordance with the change in the position of the water discharge port 321.

[0174] 13 so that it is only within the sink 40. As a result, the second area EA31 shown in FIG. 17 does not include the area outside the sink 40. In this way, the second area EA31 includes only the area within the sink 40 that corresponds to the water discharger 30.

[0175] 17 is merely an example, and any modification may be adopted as long as the second region does not include the area outside the sink 40. For example, the second region may be changed to a range that does not include the area outside the sink 40 by shifting the center of the second region toward the center of the sink 40, without changing the shape.

[0176] In this way, by limiting the second area to within the sink, the water discharge control system 1 is able to detect the presence of hands and discharge water only when it is desired to use the faucet.

[0177] <3-3-3. Example of changing the first area> In addition, the water discharge control system 1 may change the first area, not limited to the second area. For example, the water discharge control system 1 may change the first area according to the selection of the user. In this way, the first area may be changeable by the user.

[0178] An example of changing the first area will be described below with reference to Fig. 18. Fig. 18 is a diagram showing an example of changing the area. Fig. 18 shows a case corresponding to a state in which the upper surface portion 20 is viewed from above the kitchen body 2. The second area EA3 shown in Fig. 18 is similar to the second area EA3 shown in Fig. 13, and therefore a detailed description thereof will be omitted.

[0179] For example, Fig. 18 shows a case where the user sets (operates) the first area to be smaller. Therefore, in Fig. 18, the water discharge control system 1 changes the first area to be smaller. Note that the method of changing the first area may be a method using any operation means, such as the operation of a switch (e.g., a switch provided on the water discharger 30) or an operation by an app (e.g., an application related to the water discharge control system).

[0180] For example, the water discharge control system 1 changes the size of the first area from the size of the first area WA3 shown in Fig. 13 to the size of the first area WA30. The first area WA30 shown in Fig. 18 shows a state in which it is smaller than the first area WA3 shown in Fig. 13. This allows the water discharge control system 1 to change the first area according to the user's preference, and allows water discharge control to be performed based on the first area that is suitable for the user's usage of the bathroom.

[0181] Furthermore, the first region is not limited to being set by the user, and may be changed in any manner. For example, the water discharge control system 1 may change the first region depending on the form of water discharge from the water discharger 30. For example, if the water discharger 30 is capable of switching between straight water and shower water discharge from the water discharge port 321, the water discharge control system 1 may change the first region depending on whether the form of water discharged from the water discharge port 321 is straight water or shower water.

[0182] In this case, for example, when the shape of the water discharged from the water discharge port 321 is straight, the water discharge control system 1 may set the first region to the size of the first region WA3 shown in FIG. 13. Also, for example, when the shape of the water discharged from the water discharge port 321 is a shower, the water discharge control system 1 may set the first region to a size larger than the size of the first region WA3 shown in FIG. 13. Note that the above-mentioned change of the first region according to the water discharge mode is only one example, and the water discharge control system 1 may make any change to the first region according to the water discharge mode. For example, when high-temperature water such as hot water (warm water) is discharged from the water discharge port 321, the water discharge control system 1 may set the size of the first region smaller than when low-temperature water such as raw water is discharged.

[0183] <3-4. When the water outlet has multiple outlets> In the above example, the case where the water discharger 30 has one water discharge outlet 321 has been described as an example, but as described above, the water discharger 30 may have multiple water discharge outlets. This case will be described using Figure 19. Figure 19 is a diagram showing an example of a case where there are multiple water discharge outlets.

[0184] Fig. 19 shows an example in which water outlet 321 spouts water in a straight shape, and water outlet 322 spouts water in a shower shape. Thus, in Fig. 19, water outlet 321 is a straight water outlet, and water outlet 322 is a shower water outlet. Water outlet 322 is provided along water outlet pipe 31, rearward of water outlet 321 provided in head 32. Fig. 19 shows water being spouted in a shower shape from water outlet 322.

[0185] In this case, for example, the water discharge control system 1 discharges water from either the water outlet 321 or the water outlet 322 in response to a switching operation by the user. For example, when discharging water, the water discharge control system 1 discharges water from the water outlet selected in response to a switching operation by the user. For example, when the water discharge control system 1 selects the water outlet 321, it discharges water in a straight shape from the water outlet 321. For example, when the water outlet 322 is selected, the water discharge control system 1 discharges water in a shower shape from the water outlet 322.

[0186] Here, an example of the regions will be described with reference to FIG. 20. FIG. 20 is a diagram showing an example of the regions when there are multiple water outlets. FIG. 20 shows the state corresponding to the state in which the upper surface portion 20 is viewed from above the kitchen main body 2 in a plan view. Note that explanations of points similar to the above-mentioned processing will be omitted as appropriate. In FIG. 20, the water outlet portion 30 is shown in a see-through state (dotted lines) in order to clearly show the multiple first regions. Also, in FIG. 20, the second regions are not shown, but the second regions are set according to each water outlet, similar to the first regions.

[0187] For example, the first area WA41 is the first area corresponding to the water outlet 321, and includes an area overlapping the water outlet 321 in a plan view. The first area WA41 shown in Fig. 20 is similar to the first area WA3 shown in Fig. 13, so a detailed description will be omitted. In Fig. 20, the first area WA41 corresponds to the first area during straight water spouting.

[0188] Also, for example, first area WA42 is the first area corresponding to water spout 322, and in plan view includes a range overlapping with water spout 322. In Fig. 20, first area WA42 corresponds to the first area during shower water spouting.

[0189] 20 includes an area that overlaps with the water outlet 322 provided along the water outlet pipe 31 of the water outlet unit 30, and is therefore provided in a shape that is longer and thinner than the first area WA41 in a plan view. In this manner, the first area is set according to the water outlet mode. Note that the first areas WA41 and WA42 are merely examples, and the first area may be set to an appropriate range according to the corresponding water outlet.

[0190] For example, when the water outlet 321 is selected as the water outlet that will spout water, the water discharge control system 1 performs processing using the first area WA41 corresponding to the water outlet 321. Also, for example, when the water outlet 322 is selected as the water outlet that will spout water, the water discharge control system 1 performs processing using the first area WA42 corresponding to the water outlet 322.

[0191] For example, depending on the configuration of the faucet, the water outlet, the direction in which the water is discharged, and the position where the water falls into the sink may differ depending on the water discharge mode (any mode, such as shower / straight, raw water / purified water, etc.). Therefore, the water discharge control system 1 changes the size or position of the first area depending on the water discharge mode selected (specified) by the user, making it possible to accurately discharge water onto the target object.

[0192] <3-5. Processing example when there is an imaging unit in the water discharge section> Here, as described above, when the imaging unit 10 is located on the water discharger 30 or below the water discharger 30, the user's hands may not be imaged. In this regard, a processing example in which the imaging unit 10 is located on the water discharger 30 will be described with reference to Figures 21 to 23. Figures 21 to 23 are diagrams showing an example of processing in which the imaging unit is located on the water discharger.

[0193] Fig. 21 is a conceptual diagram showing the position where a user stands when using the sink 40, that is, when the sink 40 is viewed from the opposite side of the sink 40 from the side where the water discharge unit 30 is provided, that is, when the sink 40 is viewed from the front. For example, in Fig. 21, the position of the imaging unit 10 that images the sink 40 is indicated by a dot, and the relationship between the position of the imaging unit 10 and the angle of view in the downward direction is shown.

[0194] Fig. 22 shows the range of imaging range FR1 in Fig. 21 when viewed from above. Imaging range FR1 corresponds to a position close to the faucet (such as the water outlet 321 of the water spouter 30) in the vertical direction. Fig. 23 shows the range of imaging range FR2 in Fig. 21 when viewed from above. Imaging range FR2 corresponds to a position near the upper end of sink 40 in the vertical direction.

[0195] For example, when an object (item DA1, which is a dish in FIG. 22) is held close to the faucet (such as the water outlet 321 of the water outlet 30), the captured image will be within the dotted line of the imaging range FR1 shown in FIG. 22, so the user's hand (hand MN1 in FIG. 22) may not be captured even if it is within the sink 40.

[0196] For example, when an object (item DA2, which is a cutting board in FIG. 22) is held near the top end of sink 40, the captured image will be within the dotted line of imaging range FR2 shown in FIG. 23; however, when a large object such as a pot, cutting board, or frying pan is held over the object, the user's hand (hand MN2 in FIG. 23) may not be captured even if it is inside the sink.

[0197] Therefore, the water discharge control system 1 may perform processing according to the size of the item in the first area. In this case, when the water discharge control system 1 determines that the size of the item in the first area is equal to or larger than a predetermined size, the water discharge control system 1 may discharge water even if the user's hand is not present in the second area. This allows the water discharge control system 1 to accurately control the water discharge in accordance with the user's intention.

[0198] <3-6. Effects of the Third Embodiment> As described above, the water discharge control system 1 according to the third embodiment can appropriately control water discharge by controlling water discharge and stopping according to the detection results in a plurality of regions, and can provide a system that is easy to use. In this way, the water discharge control system 1 according to the third embodiment can appropriately control water discharge and stopping.

[0199] <4. First to third embodiments> The water discharge control system 1 may execute a combination of the processes shown in the first to third embodiments. For example, the water discharge control system 1 may execute a combination of various processes such as the first process to the seventh process described above. For example, when the first to third embodiments are executed in combination, the water discharge area may be read as the first area, and the first area may be read as the water discharge area. Furthermore, for example, when at least the second and third embodiments of the first to third embodiments are executed in combination, the predetermined area may be read as the second area, and the second area may be read as the predetermined area.

[0200] In the above embodiment, the water discharge control system 1 is described as being applied to a kitchen, but it can be applied to any water-related space where utensils can be used, for example, a wash space in a toilet space, or a place where water discharge and stopping actions such as hand washing are performed, such as a vanity. Note that the above-mentioned embodiments and modified examples can be appropriately combined within a range that does not cause contradictions in the processing contents.

[0201] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof.

[0202] The above-described embodiments and modifications may have the following configurations, but are not limited to these. (1) A water outlet section; A water discharge / stop switching unit that switches the water discharge of the water discharge unit; An imaging unit that images a water-related space; a determination unit that determines a movement of a recognition target object detected from an image captured by the imaging unit; A control unit that controls the water discharge / stop switching unit; Equipped with The determination unit is If the object detected within the water discharge area is an item, a moving speed of the item is determined; The control unit is The water discharge stop switching unit is controlled based on the determination result of the determination unit, thereby controlling the water discharge stop of the water discharge unit. A water discharge control system. (2) The determination unit is Based on the moving speed of the tool, a first state corresponding to when the tool is stationary and a second state corresponding to when the tool is in operation and in which the moving speed of the tool is greater than that of the first state are determined; The control unit is When the determination unit determines that the water supply is in the first state, the water discharge unit is controlled to stop water supply, and when the determination unit determines that the water supply is in the second state, the water discharge unit is controlled to discharge water. The water discharge control system according to (1) above. (3) The determination unit is If the moving speed of the item is greater than the speed corresponding to the second state, it is determined that the item is in a third state corresponding to passing; The control unit is When the determination unit determines that the water supply is in the third state, the water discharge unit is controlled to stop water discharge. The water discharge control system according to (2) above. (4) The control unit is When the object to be recognized detected within the water discharge area is a human hand, the water discharge unit is controlled to discharge water. The water discharge control system according to any one of (1) to (3) above. (5) An imaging step of imaging a water-related space; a determination step of determining a movement of a recognition target object detected from the image captured by the imaging step; A control step of controlling a water discharge / stop switching unit that switches water discharge from the water discharge unit; Including, The determination step includes: If the object to be recognized detected within the water discharge area is an item, a moving speed of the object to be recognized is determined; The control step includes: The water discharge stop switching unit is controlled based on the determination result of the determining step, thereby controlling the water discharge stop of the water discharge unit. A water discharge control method comprising: [Explanation of symbols]

[0203] 1. Water discharge control system 2 Kitchen unit 10. Imaging unit 20 Top part 30 Water outlet 31 Water pipe 32 Head 321, 322 Outlets 40 Sink 100 Control unit (control device) 101, 102, 103 Solenoid valve 110 Switching section 120 Processing section (judgment section, control section) 130 Storage section 140 Acquisition Department

Claims

1. A water outlet section; A water discharge / stop switching unit that switches the water discharge of the water discharge unit; An imaging unit that images a water-related space; a determination unit that determines a movement of a recognition target object detected from an image captured by the imaging unit; A control unit that controls the water discharge / stop switching unit; Equipped with The determination unit is If the object detected within the water discharge area is an item, a moving speed of the item is determined; The control unit is The water discharge stop switching unit is controlled based on the determination result of the determination unit, thereby controlling the water discharge stop of the water discharge unit. A water discharge control system.

2. The determination unit is Based on the moving speed of the tool, a first state corresponding to when the tool is stationary and a second state corresponding to when the tool is in operation and in which the tool is moving at a faster moving speed than the first state are determined; The control unit is When the determination unit determines that the water supply is in the first state, the water discharge unit is controlled to stop water supply, and when the determination unit determines that the water supply is in the second state, the water discharge unit is controlled to discharge water. The water discharge control system according to claim 1 .

3. The determination unit is If the moving speed of the item is greater than the speed corresponding to the second state, it is determined that the item is in a third state corresponding to passing; The control unit is When the determination unit determines that the water supply is in the third state, the water discharge unit is controlled to stop water discharge. The water discharge control system according to claim 2 .

4. The control unit is When the object to be recognized detected within the water discharge area is a human hand, the water discharge unit is controlled to discharge water.

4. The water discharge control system according to claim 1, wherein the water discharge control system comprises: a water discharge unit;

5. An imaging step of imaging a water-related space; a determination step of determining a movement of a recognition target object detected from the image captured by the imaging step; A control step of controlling a water discharge / stop switching unit that switches water discharge from the water discharge unit; Including, The determination step includes: If the object to be recognized detected within the water discharge area is an item, a moving speed of the object to be recognized is determined; The control step includes: The water discharge stop switching unit is controlled based on the determination result of the determining step, thereby controlling the water discharge stop of the water discharge unit. A water discharge control method comprising:

Images