Water discharge control system and water discharge control method

Abstract

To properly execute control relating to discharge and stop of water.SOLUTION: A water discharge control system according to an embodiment comprises: a water discharge part; a water discharge / stop switching part to switch water discharging and stopping of the water discharge part; an image part to image a water use space; a determination part to determine a recognition target detected by an image imaged by the image part; and a control part to control the water discharge / stop switching part. The determination part determines whether or not a human hand exists in a second area that is a range covering a first area, when determining that only an article exists in the first area. The control part controls so that the water discharge part discharges water when the determination part determines that only the article exists in the first area and the human hand exists in the second area, and controls so that the water discharge part stops water when the determination part determines that only the article exists in the first area and the human hand does not exist in the second area.SELECTED DRAWING: Figure 14

Description

[Technical Field]

[0001] The disclosed embodiments relate to a water discharge control system and a water discharge control method. [Background technology]

[0002] Conventionally, there have been technologies provided that control the stopping and spouting of water at a spout unit in a kitchen or other wet area based on sensing (see, for example, Patent Documents 1 to 3). For example, it has been disclosed that water spouting is controlled by detecting a target object or a held object in a first area and a second area based on a captured image that includes the spout. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7263128 [Patent Document 2] Patent No. 7145635 [Patent Document 3] Japanese Patent Application Laid-Open No. 2012-002033 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional technology has room for improvement. For example, the above-mentioned conventional technology determines the conditions for both the target object and the held object separately, which requires time-dependent conditions to determine the user's intention to discharge water. This can lead to a time lag in the water discharge control and prevent smooth water discharge. Furthermore, human presence detection and skeletal detection are required to determine whether the object is a held object, which complicates the conditions for water discharge and stop control, resulting in a time lag in the water discharge control and a greater control load on the control unit. As such, the above-mentioned conventional technology has room for improvement in terms of appropriate control of water discharge and stop. Therefore, it is desirable to appropriately execute control of water discharge and stop.

[0005] The disclosed embodiments aim to provide a water discharge control system and a water discharge control method that appropriately execute control related to stopping and discharging water. [Means for solving the problem]

[0006] A water discharge control system according to one aspect of the embodiment comprises a water discharge unit, a water discharge stop switching unit that switches the water discharge unit to stop or start discharging, an imaging unit that images the water-related space, a determination unit that determines the recognized object detected from the image captured by the imaging unit, and a control unit that controls the water discharge stop switching unit, wherein when the determination unit determines that only items are present in a first area, it determines whether a human hand is present in a second area that is an area that encompasses the first area, and when the determination unit determines that only items are present in the first area and that a human hand is present in the second area, the control unit controls the water discharge unit to discharge water, and when the determination unit determines that only items are present in the first area and that a human hand is not present in the second area, it controls the water discharge unit to stop water.

[0007] According to one aspect of the embodiment, a water discharge control system determines whether only items are present in a first area, determines whether a human hand is present in a second area encompassing the first area, and controls water discharge if it determines that only items are present in the first area and that a human hand is present in the second area. If it determines that only items are present in the first area and that a human hand is not present in the second area, it controls water discharge to stop. For example, the water discharge control system categorizes objects present in the image as items or hands based on a captured image, acquires their location information, and controls water discharge and stopping based on the location information for each category. This eliminates the need for multiple complex determination conditions or time-dependent conditions, enabling water discharge determination and control with a short time lag. Therefore, the water discharge control system can appropriately control water discharge and stopping.

[0008] In one aspect of the embodiment, in the water discharge control system, the control unit controls the water discharge unit to discharge water when the determination unit determines that a human hand is present in the first area.

[0009] According to the water discharge control system of one aspect of the embodiment, for example, when a user brings their hand over the first area corresponding to the water discharge area, it is assumed that the user intends to discharge water, and by controlling the water discharge, the water discharge control system can control the water discharge without time lag. Therefore, the water discharge control system can appropriately execute control related to stopping and starting the water discharge.

[0010] In one aspect of the embodiment, in the water discharge control system, the second area changes depending on at least one of the position and size of the item present in the first area.

[0011] For example, if an item is placed in a first area in a sink, the size of the hand (the range of the second area) that is thought to be reaching for the item will differ depending on whether the item is small or large. For example, if the second area is constant, water may be discharged earlier when the hand is reaching for a small dish, and later when the hand is reaching for a large dish. Therefore, according to a water discharge control system according to one aspect of the embodiment, by changing the second area depending on at least one of the position and size of the item in the first area, it is possible to improve the accuracy of determining whether the user intends to discharge water, and to control the water discharge and stopping in accordance with the user's intention. Therefore, the water discharge control system can appropriately control the water discharge and stopping.

[0012] In one aspect of the embodiment, the first region includes an area that overlaps with a water discharge port that discharges water from the water discharger in a plan view.

[0013] In the water discharge control system according to one aspect of the embodiment, the first region includes an area that overlaps with the water discharge port, so that accurate water discharge is possible even when the water discharger and the water discharge port move. Therefore, the water discharge control system can appropriately control water discharge stop.

[0014] In one aspect of the embodiment, in the water discharge control system, the water discharge unit is capable of changing the position of the water discharge port, and the second area includes only the area within the sink that corresponds to the water discharge unit.

[0015] If the spout is moved to the edge of the sink, the second area may extend beyond the sink. In this case, the presence of a hand that is not intended to spout water may be detected, resulting in erroneous spouting of water. Therefore, according to one aspect of the water spout control system, by limiting the second area to within the sink, it is possible to detect only the presence of a hand intended to spout water. Therefore, the water spout control system can appropriately control the spouting and stopping of water.

[0016] In the water discharge control system according to one aspect of the embodiment, at least one of the range of the first area and the time period for determining whether or not a recognition target object exists in the first area can be changed by a user.

[0017] According to the water discharge control system of one aspect of the embodiment, the user can change the settings of at least one of the range of the detection area and the time (determination time) for determining whether or not a recognition target object exists in the detection area, thereby enabling adjustments to the detection area, determination time, detection sensitivity, etc. that are convenient for the user. Therefore, the water discharge control system can appropriately execute control related to stopping and starting water discharge.

[0018] In the water discharge control system according to one aspect of the embodiment, the first area changes depending on the form of water discharge from the water discharger.

[0019] For example, the water discharge range may change depending on the water discharge mode selected by the user, such as shower water discharge or straight water discharge. Therefore, according to one aspect of the embodiment, the water discharge control system can more accurately control the water discharge by setting the detection area for the appliance according to the water discharge range. Therefore, the water discharge control system can appropriately control the water discharge stop.

[0020] In a water discharge control system according to one aspect of the embodiment, the imaging unit is provided at the water discharge unit or below the water discharge unit.

[0021] In a water discharge control system according to one aspect of the embodiment, by providing an image capture unit on or below the water discharge unit, objects other than the object being discharged or a person's hand are not captured in the captured image, which prevents oversight of object detection and improves the accuracy of categorization. Therefore, the water discharge control system can appropriately control the stopping and stopping of water discharge.

[0022] In one aspect of the embodiment, in a water discharge control system, the control unit controls the water discharge unit to discharge water when the determination unit determines that the item present in the first area is larger than a predetermined size.

[0023] For example, when washing large items such as pots and frying pans, it is conceivable that the items are too large for the sink and the user's hands cannot fit into the second area. Therefore, according to one aspect of the water discharge control system, if the item in the first area is determined to be larger than a predetermined size, the water discharge unit is controlled to discharge water, thereby understanding the user's intention to discharge water even when the item is large and the user's hands are outside the second area. Therefore, the water discharge control system can appropriately control the water discharge and stop.

[0024] In one aspect of the embodiment, in a water discharge control system, when the determination unit determines that only supplies are present in the first area, it determines whether a human hand is present in the second area, which is an area that includes at least a portion of the first area.

[0025] According to one aspect of the embodiment, a water discharge control system determines whether a human hand is present in a second area, which is an area including at least a portion of the first area, when it determines that only items are present in the first area and that a human hand is present in the second area. If it determines that only items are present in the first area and that a human hand is present in the second area, it controls to discharge water. If it determines that only items are present in the first area and that a human hand is not present in the second area, it controls to stop water discharge. This allows the water discharge control system to determine and control water discharge with a short time lag without the need for multiple complex determination conditions or time-dependent conditions. Therefore, the water discharge control system can appropriately control the discharge and stopping of water discharge. In this way, the water discharge control system determines whether a human hand is present in a second area, which is an area that encompasses the first area, such as an area that includes at least a portion of the first area. In other words, the concept of an area that encompasses the first area herein also includes an area that includes at least a portion of the first area. Thus, the area that encompasses the first area herein may be any area as long as it includes an area that includes at least a portion of the first area.

[0026] A water discharge control method according to one aspect of the embodiment includes an imaging process for imaging a water-related space, a determination process for determining a recognized object detected from the image captured by the imaging process, and a control process for controlling a water discharge stop switching unit that switches the water discharge on and off from the water discharge unit, wherein the determination process, when it is determined that only items are present in a first area, determines whether a human hand is present in a second area that is an area that encompasses the first area, and the control process, when it is determined by the determination process that only items are present in the first area and a human hand is present in the second area, controls the water discharge unit to discharge water, and when it is determined by the determination process that only items are present in the first area and no human hand is present in the second area, controls the water discharge unit to stop water.

[0027] According to one aspect of the embodiment, a water discharge control method determines whether only items are present in a first area, determines whether a human hand is present in a second area encompassing the first area, and controls water discharge if it is determined that only items are present in the first area and that a human hand is present in the second area. If it is determined that only items are present in the first area and that a human hand is not present in the second area, controls water discharge to stop. For example, the water discharge control method categorizes objects present in the image as items or hands based on a captured image, acquires their position information, and controls water discharge and stop based on the position information for each category. This eliminates the need for multiple complex determination conditions or time-dependent conditions, enabling water discharge determination and control with a small time lag. Therefore, the water discharge control method can appropriately control water discharge and stop.

[0028] In one aspect of the embodiment, in the water discharge control method, when it is determined that only supplies are present in the first area, the determination process determines whether a human hand is present in the second area, which is an area that includes at least a portion of the first area.

[0029] According to one aspect of the embodiment, the water discharge control method determines whether only items are present in the first area, determines whether a human hand is present in a second area that includes at least a portion of the first area, and controls to discharge water if it is determined that only items are present in the first area and a human hand is present in the second area. If it is determined that only items are present in the first area and a human hand is not present in the second area, controls to stop water discharge. This eliminates the need for multiple complex determination conditions or time-dependent conditions, enabling water discharge determination and control with a small time lag. Therefore, the water discharge control method can appropriately control water discharge and stop. [Effects of the Invention]

[0030] According to one aspect of the embodiment, control relating to water discharge and stop can be appropriately executed. [Brief explanation of the drawings]

[0031] [Figure 1] FIG. 1 is a schematic perspective view of a water discharge control system according to a first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of the configuration of the water discharge control system according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of a region. [Figure 4] FIG. 4 is a flowchart showing an example of a procedure related to the first processing according to the first embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of a procedure for the second process according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of a procedure related to the third process according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a region. [Figure 8] FIG. 8 is a flowchart showing an example of a procedure related to the fourth process according to the second embodiment. [Figure 9] FIG. 9 shows an example of a hand grip. [Figure 10] FIG. 10 is a diagram illustrating an example of a hand. [Figure 11] FIG. 11 is a flowchart showing an example of a procedure related to the fifth process according to the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of an inference model. [Figure 13] FIG. 13 is a diagram showing an example of a region. [Figure 14] FIG. 14 is a flowchart illustrating an example of a procedure for the sixth process according to the third embodiment. [Figure 15] FIG. 15 is a flowchart showing an example of a procedure related to the seventh process according to the third embodiment. [Figure 16] FIG. 16 is a diagram showing an example of changing the area. [Figure 17] FIG. 17 is a diagram showing an example of changing the area. [Figure 18]FIG. 18 is a diagram illustrating an example of changing the area. [Figure 19] FIG. 19 is a diagram showing an example in which there are multiple water outlets. [Figure 20] FIG. 20 is a diagram showing an example of a region when there are multiple water outlets. [Figure 21] FIG. 21 is a diagram showing an example of processing when an imaging unit is included in the water discharger. [Figure 22] FIG. 22 is a diagram showing an example of processing when an imaging unit is included in the water discharger. [Figure 23] FIG. 23 is a diagram showing an example of processing when an imaging unit is included in the water discharger. [Figure 24] FIG. 24 is a diagram illustrating an example of the relationship between the first region and the second region. DETAILED DESCRIPTION OF THE INVENTION

[0032] Hereinafter, embodiments of a water discharge control system and a water discharge control method disclosed in the present application will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described below.

[0033] <1. First embodiment> First, a water discharge control system 1 according to a first embodiment will be described below. In order to control water discharge and stopping (also referred to as "water discharge stopping"), the water discharge control system 1 detects (recognizes) a target object (also referred to as "target") based on information detected by a sensor or the like that captures images, and controls water discharge stopping according to the recognized object (also referred to as "recognized object"). For example, the target object may be a kitchen-related object (hereinafter referred to as "item") such as food ingredients, tableware, or cooking utensils; a part of the human body (also referred to as "user"), such as the body, head, or hand; or an element that constitutes a kitchen, such as a stove, sink, or water discharge unit. The recognized object may include at least one of a person's (user's) hand and an item. Note that the process described as the processing entity of the water discharge control system according to each embodiment, such as the water discharge control system 1, may be performed by any device capable of executing that process, depending on the device configuration included in the water discharge control system.

[0034] <1-1. Water discharge control system configuration> The configuration of a water discharge control system 1 according to a first embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a schematic perspective view of the water discharge control system according to the first embodiment. Fig. 2 is a diagram showing an example of the configuration of the water discharge control system according to the first embodiment.

[0035] As shown in Figures 1 and 2, the water discharge control system 1 has a kitchen main body 2, an imaging unit 10, a control unit 100, and solenoid valves 101 to 103. The kitchen main body 2 is a plumbing equipment main body. The kitchen main body 2 has a water discharge unit 30, a sink 40, and a stove unit 50 on an upper surface unit 20 where a user performs tasks such as cooking and washing objects such as dishes. For example, the kitchen main body 2 may be a system kitchen.

[0036] 1 and 2 is merely an example, and any configuration can be adopted for the kitchen body 2. For example, the kitchen body 2 does not have to include the stove unit 50. In this case, the stove unit 50 may be provided separately from the kitchen body 2.

[0037] 1, a wall cabinet 60 and a range hood 70 are provided above the kitchen body 2, that is, on the side facing the upper surface 20 of the kitchen body 2. The wall cabinet 60 and the range hood 70 do not necessarily have to be provided.

[0038] The upper surface 20 of the kitchen main body 2 is used for user work. For example, the surface of the upper surface 20 of the kitchen main body 2 between the sink 40 and the stove unit 50 functions as a work surface where the user can perform processing such as cutting ingredients or place dishes after washing. Furthermore, multiple work surfaces may be arranged, such as between the sink 40 and the stove unit 50 and on the right side of the sink 40.

[0039] The water discharger 30 has a water outlet 321 provided in a head 32, which is the distal end portion of the water discharge pipe 31, and discharges (spouts) water from the water outlet 321. For example, the water discharger 30 may be able to discharge water in any shape (shower, straight, etc.) from the water outlet 321. In this case, the water discharger 30 may be able to switch between straight and shower water from the water outlet 321. For example, the water discharger 30 may discharge water in different shapes depending on the user's selection. The water discharger 30 may have multiple water outlets, which will be described later. In the example of FIGS. 1 and 2, the water discharger 30 discharges multiple types of water, such as raw water, purified water, and hot water (warm water), in accordance with the control of the solenoid valves 101 to 103 by the control unit 100. The flow rate of the raw water, purified water, hot water, etc. may also be changed in accordance with the control of the solenoid valves 101 to 103. Note that water discharger 30 may be configured to discharge only raw water. In this case, water discharge control system 1 has only solenoid valve 101 among solenoid valves 101 to 103. Water discharger 30 refers to, for example, the part exposed from kitchen main body 2.

[0040] Sink 40 is a recess recessed from the surface of upper surface 20, and functions as a water receiving portion that receives water from water discharger 30. Sink 40 is used, for example, for washing objects such as dishes, and is a tank-like stand equipped with a drainage groove that drains water from water discharger 30, etc.

[0041] The stove unit 50 is a stove equipment used by a user for heating operations for cooking. While FIGS. 1 and 2 show an example in which the stove unit 50 has two heating units, 51 and 52, the stove unit 50 may have one heating unit or three or more heating units. The heating units 51 and 52 perform heating using any heat source, such as gas or electricity. In this way, the heating units 51 and 52 can be configured as any type, such as an electric stove, an induction stove, or a gas stove.

[0042] The control unit 100 is a control device that controls water discharge. The control unit 100 controls water discharge by switching the solenoid valves 101-103 based on information detected by sensors such as the imaging unit 10. The control unit 100 detects a recognition target from an image captured by the imaging unit 10 and controls the water discharge unit 30 based on the detection results. The control settings of the control unit 100 for the solenoid valves 101-103 may be changed by the user to their preferred settings. For example, the control settings may be changed by the user to reduce the flow rate of purified water discharged for ingredients or to change the water discharged for soiling to water. When detecting a recognition target from an image, the control unit 100 performs any processing on the captured image, such as brightness and color correction (image correction), monochrome / color conversion (image conversion), object identification (image recognition), and area measurement (image feature extraction).

[0043] Solenoid valve 101 functions as a valve for discharging raw water to water discharge unit 30. Solenoid valve 102 functions as a valve for discharging purified water to water discharge unit 30. Solenoid valve 103 functions as a valve for discharging hot water (warm water) to water discharge unit 30. Control unit 100 is connected to each of solenoid valves 101-103. Note that instead of solenoid valves 101-103, a single flow path switching valve may be used to switch between each type of water discharge (raw water, purified water, hot water, etc.).

[0044] For example, the control unit 100 is connected to a solenoid valve 101 that switches between discharging and stopping the raw water from the water discharge unit 30. The control unit 100 controls the discharge and stopping of the raw water from the water discharge unit 30 using a control signal that opens and closes the solenoid valve 101. The flow rate of the raw water from the water discharge unit 30 may be changed using the control signal that opens and closes the solenoid valve 101.

[0045] For example, the control unit 100 is connected to a solenoid valve 102 that switches between discharging and stopping purified water from the water discharge unit 30. The control unit 100 controls the discharging and stopping of purified water from the water discharge unit 30 using a control signal that opens and closes the solenoid valve 102. The flow rate of purified water from the water discharge unit 30 may be changed using the control signal that opens and closes the solenoid valve 102.

[0046] For example, the control unit 100 is connected to a solenoid valve 103 that switches between discharging and stopping hot water from the water discharge unit 30. The control unit 100 controls the discharging and stopping of hot water from the water discharge unit 30 using a control signal that opens and closes the solenoid valve 103. The flow rate of hot water from the water discharge unit 30 may also be changed using the control signal that opens and closes the solenoid valve 103.

[0047] Furthermore, the control unit 100 is communicably connected to each sensor, such as the imaging unit 10, via a predetermined network, such as the Internet, either wired or wirelessly. For example, the control unit 100 has a communication function (communication unit) for transmitting and receiving information to and from other devices. The communication function (communication unit) of the control unit 100 is realized by a communication device, a communication circuit, or the like. The control unit 100 is connected to an arbitrary network via wired or wirelessly using the communication function, and transmits and receives information to and from an external information processing device. For example, the control unit 100 transmits and receives information to and from the imaging unit 10, etc. Note that the control unit 100 may be connected to each sensor in any manner as long as it is possible to transmit and receive information, and may be communicably connected via wired or wireless.

[0048] The control unit 100 may be disposed in any location. The control unit 100 may be provided inside the space corresponding to the kitchen main body 2 (kitchen room), or may be provided outside the space corresponding to the kitchen main body 2 (kitchen room).

[0049] The control unit 100 may have any configuration and arrangement as long as it can control the switching of the solenoid valves 101 to 103, communicate with each sensor such as the imaging unit 10, and perform processing. The control unit 100 may also be arranged inside the kitchen main body 2. The control unit 100 may also be arranged outside the kitchen main body 2, rather than inside the kitchen main body 2. Details of the control unit 100 will be described later.

[0050] The imaging unit 10 captures images of the bathroom space, etc. The imaging unit 10 functions as a sensor unit that acquires information used to control water discharge. For example, the imaging unit 10 is a camera module that acquires images by capturing an image of a predetermined area, such as the inside of the sink 40, or a sensor unit that uses an image sensor. The imaging unit 10 captures images of the bathroom space around the water discharge unit 30. For example, the imaging unit 10 captures images of the bathroom space including the sink 40, etc.

[0051] The imaging unit 10 is disposed in a position where it can capture an image of a desired range (area). For example, the imaging unit 10 is provided on the water discharger 30 or below the water discharger 30. The following describes an example where the imaging unit 10 is provided along the water discharge pipe 31 of the water discharger 30. Note that the placement of the imaging unit 10 shown in Figures 1 and 2 is merely an example, and the imaging unit 10 may be disposed in any position as long as it can capture an image of a desired range.

[0052] The imaging unit 10 uses any sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. For example, the imaging unit 10 is an area sensor or a distance measuring sensor that uses an image sensor. The imaging unit 10 captures an image of the water-related space around the water discharger 30.

[0053] Also, for example, the imaging unit 10 is disposed facing in a direction to capture an image of the sink 40. Note that the imaging unit 10 may be disposed in any manner as long as it can detect (capture) an object. Also, the imaging unit 10 may capture a still image or a moving image.

[0054] The imaging unit 10 is connected to the control unit 100 via a predetermined network so as to be able to communicate with each other via a wired or wireless connection. The imaging unit 10 transmits various types of information to the control unit 100. For example, the imaging unit 10 transmits information related to an acquired image to the control unit 100. For example, the imaging unit 10 may be connected to the control unit 100 so as to be able to communicate with each other via a predetermined wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). Note that the control unit 100 and the imaging unit 10 may be connected in any manner as long as they are able to send and receive information, and may be connected to each other via a wired or wireless connection so as to be able to communicate with each other. For example, the imaging unit 10 may be connected to the control unit 100 so as to be able to communicate with each other via a wired or wireless connection.

[0055] When describing various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensors." When describing information acquired by various sensors such as the imaging unit 10 without distinction, they may be referred to as "sensor information." Sensor information is a concept that includes information acquired by various sensors for water discharge control, such as information acquired by the imaging unit 10.

[0056] 1 and 2 is merely an example, and the water discharge control system 1 can have any device configuration. For example, the water discharge control system 1 does not need to include a sensor. In this case, the control unit 100 of the water discharge control system 1 may communicate with a sensor not included in the water discharge control system 1, and control the water discharge using sensor information received (acquired) from the sensor. For example, the water discharge control system 1 does not need to include the imaging unit 10. In this case, the control unit 100 of the water discharge control system 1 may communicate with an imaging unit 10 not included in the water discharge control system 1, and control the water discharge using an image received (acquired) from the imaging unit 10.

[0057] Furthermore, the water discharge control system 1 may have a personal identification unit (identification device) that performs processing (personal identification) to identify the user who uses the kitchen main body 2. For example, the control unit 100 may function as the personal identification unit. For example, the personal identification unit of the water discharge control system 1 may perform personal identification based on an image of a person included in an image. Note that the above is merely an example, and the water discharge control system 1 may perform personal identification by any method as long as it is possible to identify the user who uses the kitchen main body 2. For example, the personal identification unit of the water discharge control system 1 may acquire information for identifying the user who uses the kitchen main body 2 by communicating with a device such as a smartphone owned by the user, or by the user's operation on a remote control, and then perform personal identification of the user.

[0058] Furthermore, the water discharge control system 1 may also include sensors other than the imaging unit 10. For example, the water discharge control system 1 may also include a human body detection sensor. The human body detection sensor has the function of detecting a human body. For example, the human body detection sensor is realized by a pyroelectric sensor using an infrared signal. For example, the human body detection sensor may be realized by a μ (microwave) wave sensor. Note that the above is just an example, and the human body detection sensor is not limited to the above, and may detect a human body by various means. For example, the human body detection sensor detects a person (such as a user) who enters the space (kitchen room) in which the kitchen main body 2 is provided. The human body detection sensor transmits a detection signal to the control unit 100.

[0059] <1-2. Configuration of the control unit (control device)> Next, each component of the control unit 100 will be described in detail. The control unit 100 may be, for example, an information processing device (computer) used to control various components and processes. The control unit 100 may have, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and may be realized by executing a program stored inside the control unit 100 (for example, an information processing program according to the present disclosure) using a RAM or the like as a working area. The control unit 100 may also have, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0060] As shown in FIG. 2, control unit 100 has a switching unit 110, a processing unit 120, a storage unit 130, and an acquisition unit 140, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of control unit 100 is not limited to the configuration shown in FIG. 2, and may be other configurations that perform the information processing described below. For example, processing unit 120 may be divided into a determination unit that performs processing related to determination, and a water discharge / stop control unit that performs processing related to controlling the water discharge / stop of water discharge unit 30. Furthermore, the processing performed by control unit 100 may be executed by a cloud server (also called a cloud). In this case, the cloud and control unit 100 are connected via a predetermined network, either wired or wirelessly.

[0061] The switching unit 110 is a water discharge / stop switching unit that switches the water discharge mode, such as water discharge / stop, by the water discharger 30. The water discharge mode refers to one mode of water discharge, such as the type of water discharged (raw water, purified water, electrolyzed water, etc.), temperature (cold water, room temperature water, hot water), shape (shower, straight, etc.), flow rate, etc.

[0062] Switching unit 110 switches between the open and closed states of solenoid valves 101-103 in response to instructions from processing unit 120. Switching unit 110 sends control signals to solenoid valves 101-103, and switches between the open and closed states of solenoid valves 101-103, thereby switching the water discharge state of water discharger 30. The water discharge state refers to a state related to the water discharge stop of water discharger 30, including a state in which water is being discharged in any water discharge mode and a state in which water is stopped.

[0063] The processing unit 120 functions as a detection unit that detects a recognition target using sensor information. The processing unit 120 detects a recognition target included in an image captured by the imaging unit 10. The processing unit 120 functions as a determination unit that determines whether or not a detection has occurred. When detecting a recognition target included in an image, the processing unit 120 performs any processing on the captured image, such as brightness and color correction (image correction), monochrome / color conversion (image conversion), target identification (image recognition), and area measurement (image feature extraction).

[0064] The processing unit 120 detects an object included in the image and its position (coordinates, etc.) by image processing. The processing unit 120 may detect the object included in the image and its position (range) by any processing as long as it can acquire information indicating the object included in the image and its position.

[0065] The processing unit 120 calculates (estimates) the moving speed of the object based on the image captured by the imaging unit 10. For example, the processing unit 120 estimates the moving speed of the object based on a change in the position (coordinates, etc.) of the object in a video. For example, the processing unit 120 estimates the moving speed of the object based on, for example, the frame rate of the video (i.e., time information) and a change in the position of the object in the video (i.e., information on the moving distance). For example, the processing unit 120 estimates the moving speed of the object by, for example, dividing the moving distance of the object in the video by the time corresponding to the frame rate of the video. Note that the above-described processing is merely an example, and the processing unit 120 may estimate the moving speed of the object using various information as appropriate.

[0066] The processing unit 120 may use the sensor information to determine whether to discharge water, and if so, may select the type of water to be discharged (raw water, purified water, or hot water) based on the content stored in the memory unit 130. In this case, the processing unit 120 determines to open the valve corresponding to the selected type of water among the solenoid valves 101-103. The processing unit 120 generates a control signal instructing the determined valve to be opened. The processing unit 120 uses the generated control signal to instruct the switching unit 110 to switch between opening and closing the solenoid valves 101-103. Note that the flow rate of raw water, purified water, hot water, etc. may be changed by controlling the opening and closing of the solenoid valves 101-103 in response to the instruction from the processing unit 120.

[0067] The processing unit 120 determines a recognition target object from an image captured by the imaging unit 10. The processing unit 120 can determine a user's hand and an object from an image captured by the imaging unit 10. The processing unit 120 can determine a hand and an object from an image captured by the imaging unit 10.

[0068] The processing unit 120 determines the movement of the recognition object detected from the image captured by the imaging unit 10. When the recognition object detected in the water discharge area is an item, the processing unit 120 determines the movement speed of the item. Based on the movement speed of the item, the processing unit 120 determines which of a plurality of states the item is in, including a first state corresponding to the item being stationary, and a second state in which the movement speed of the item is faster than the first state and corresponds to work being performed using the item. When the movement speed of the item is faster than the speed corresponding to the second state, the processing unit 120 determines that the item is in a third state corresponding to passing.

[0069] The processing unit 120 controls the processing section 120 and the switching section 110. The processing section 120 controls the switching of the switching section 110, thereby controlling whether the water discharger 30 stops discharging water. The processing section 120 controls the switching section 110 based on the determination result, thereby controlling whether the water discharger 30 stops discharging water. If the processing section 120 determines that the state is the first state, it controls the water discharger 30 to stop discharging water, and if the processing section 120 determines that the state is the second state, it controls the water discharger 30 to start discharging water.

[0070] When processing unit 120 determines that the third state is present, it controls water discharger 30 to stop water. When the recognition object detected within the water discharge area is a human hand, processing unit 120 controls water discharger 30 to discharge water.

[0071] The storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. For example, the storage unit 130 is a computer-readable recording medium that non-temporarily records data used by an information processing program. The storage unit 130 stores various information such as information detected by various sensors. The storage unit 130 stores various information used to control water discharge.

[0072] The storage unit 130 stores various information used to detect the recognition target. For example, the storage unit 130 stores a program that detects the recognition target, determines whether to discharge water, and stops the water flow. For example, the storage unit 130 stores thresholds used in the determination process related to the control of water discharge and stoppage. For example, the storage unit 130 stores various thresholds such as a first threshold and a second threshold. For example, the storage unit 130 stores thresholds used in the determination process of whether or not the recognition target has been detected. The above is merely an example, and the storage unit 130 stores various information related to the process.

[0073] The storage unit 130 may store various types of information depending on the purpose, without being limited to the above. The storage unit 130 may store sensor information detected by various sensors. The storage unit 130 may store the sensor information in association with the date and time when it was acquired. The storage unit 130 may store an image as sensor information. The storage unit 130 stores information indicating a processing result corresponding to the image in association with the image. The storage unit 130 stores a determination result (presence or absence of a recognition target object, etc.) determined for the image in association with the image.

[0074] The acquisition unit 140 acquires information. The acquisition unit 140 acquires various information from the storage unit 130. The acquisition unit 140 acquires various information from the kitchen main body 2. The acquisition unit 140 acquires various information collected in a space (kitchen room) corresponding to the kitchen main body 2 from the kitchen main body 2. The acquisition unit 140 acquires user identification information that identifies a user from the kitchen main body 2.

[0075] The acquisition unit 140 acquires sensor information detected by the sensor from the sensor. The acquisition unit 140 acquires sensor information of the user sensed by the sensor. The acquisition unit 140 receives information related to the image acquired by the imaging unit 10 from the imaging unit 10. The acquisition unit 140 may store the received various information in the storage unit 130.

[0076] The above-described configuration of the control unit 100 is merely an example, and the control unit 100 may have various configurations other than the above. For example, if the control unit 100 has a function of displaying information, it may have a display unit.

[0077] <1-3. Area example> Before describing the specific processing according to the first embodiment, an example of a water discharge area will be described using Fig. 3. Fig. 3 is a diagram showing an example of the area. Fig. 3 shows a case corresponding to a plan view (hereinafter simply referred to as "plan view") of the upper surface portion 20 from above the kitchen body 2. For example, Fig. 3 shows an example of a water discharge area WA1.

[0078] In Fig. 3, water discharge area WA1 includes an area that overlaps with the water discharge outlet (e.g., water discharge outlet 321) that discharges water from water discharger 30 in a plan view. Note that water discharge area WA1 shown in Fig. 3 is only an example, and the water discharge area can be changed to any range, as will be described later. When the recognition object detected as being located in water discharge area WA1 is an item or a human hand, water discharge control system 1 performs the following processing.

[0079] <1-4. Processing of the First Embodiment> Below, several processing examples according to the first embodiment will be described. The water discharge control system 1 according to the first embodiment controls the stopping and spouting of water based on the movement speed of the item. That is, the water discharge control system 1 according to the first embodiment focuses on items that are less likely to be blocked by the user's body. In this way, the water discharge control system 1 according to the first embodiment focuses on the movement of the item, which is the held object, rather than the held object, such as the user. As a result, the water discharge control system 1 according to the first embodiment appropriately controls the stopping and spouting of water based on the captured image (camera image).

[0080] From here, a specific example of the processing flow related to the first embodiment will be described. The water discharge control system 1 according to the first embodiment executes the following first to third processes. The water discharge control system 1 executes at least one of the first to third processes. Note that the water discharge control system 1 may execute water discharge control by combining each of the first to third processes. Furthermore, the following description will be given with the water discharge control system 1 as the processing subject, but the first to third processes may be executed by any device, such as the control unit 100 or various sensors such as the imaging unit 10, depending on the device configuration included in the water discharge control system 1.

[0081] <1-4-1. First processing flow> First, the flow of processing related to the first processing will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the procedure related to the first processing according to the first embodiment. For example, Fig. 4 describes an example of processing in the case where an item to be held is set as the recognition object.

[0082] The water discharge control system 1 acquires the image processing result (step S101). For example, the control unit 100 receives an image captured by the imaging unit 10 from the imaging unit 10, and detects objects contained in the image and their positions (coordinates, etc.) by performing image processing on the received image. Note that various image processing techniques may be used as appropriate to detect objects and positions from the image, and detailed explanations thereof will be omitted.

[0083] Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (step S102). For example, the control unit 100 detects a product, which is a held object, as a recognition target in the water discharge area in the image captured by the imaging unit 10.

[0084] When the water discharge control system 1 detects a holdable object in the water discharge area (step S102: Yes), it determines the movement speed of the holdable object (step S103). For example, when the control unit 100 detects a holdable object in the water discharge area in the image captured by the imaging unit 10, it calculates (estimates) the movement speed of the holdable object and executes a determination process using the estimated movement speed.

[0085] When the moving speed of the holdable object is equal to or greater than the first threshold value (step S103: equal to or greater than the first threshold value), the water discharge control system 1 determines that the holdable object, which is an item, is in a working state (also referred to as the "second state") and executes water discharge (step S104). For example, when the moving speed of the holdable object is equal to or greater than the first threshold value and the control unit 100 determines that the object is in a working state (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water. When the water discharge control system 1 is in a water discharge state, it may maintain that state or may change the water discharge state depending on the determination. The first threshold value can be set to any value.

[0086] On the other hand, if the moving speed of the held object is less than the first threshold (step S103: less than first threshold), the water discharge control system 1 determines that the item is stationary (also referred to as the "first state") and stops the water flow (step S105). For example, if the moving speed of the held object is less than the first threshold and the control unit 100 determines that the item is stationary (first state), it controls the solenoid valves 101-103 to stop the water flow from the water discharge unit 30. Note that if the water discharge control system 1 is in a stopped state, it maintains that state.

[0087] If the water discharge control system 1 does not detect a holdable object within the water discharge area (step S102: No), it stops the water (step S106). For example, if the control unit 100 does not detect a holdable object within the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to stop the water discharge unit 30. Note that if the water discharge control system 1 is in a stopped state, it maintains that state.

[0088] In this way, through the first process, the water discharge control system 1 can accurately control the water discharge by determining, from the movement speed of the held object, which is unlikely to be blocked by an obstruction, whether the object is doing work such as washing dishes (working) or has items placed on it (stationary).

[0089] <1-4-2. Second processing flow> The process shown in Fig. 4 is merely an example, and the water discharge control system 1 may determine three or more states depending on the moving speed. In this regard, the flow of the process will be explained as a process related to the second process using Fig. 5. Fig. 5 is a flowchart showing an example of the procedure related to the second process according to the first embodiment. Note that explanations of points similar to those explained in Fig. 4 will be omitted as appropriate.

[0090] The water discharge control system 1 acquires the image processing result (Step S201). Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (Step S202).

[0091] When the water discharge control system 1 detects a holdable object in the water discharge area (step S202: Yes), it executes the process of determining the movement speed of the holdable object (1) (step S203). For example, as the process of determining the movement speed of the holdable object (1), the control unit 100 determines whether the movement speed of the holdable object is equal to or greater than a first threshold value.

[0092] When the movement speed of the holdable object is equal to or greater than the first threshold value (step S203: equal to or greater than the first threshold value), the water discharge control system 1 executes the process of determining the movement speed of the holdable object (2) (step S204). For example, as the process of determining the movement speed of the holdable object (2), the control unit 100 determines whether the movement speed of the holdable object is equal to or greater than the second threshold value. Note that the second threshold value can be set to any value greater than the first threshold value.

[0093] When the moving speed of the held object is less than the second threshold (step S204: less than second threshold), the water discharge control system 1 determines that the hold object, which is an item, is in a working state (second state) and executes water discharge (step S205). For example, when the moving speed of the held object is less than the second threshold and determines that the work is in progress (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0094] On the other hand, if the moving speed of the holdable object is equal to or greater than the second threshold value (step S204: equal to or greater than the second threshold value), the water discharge control system 1 determines that the holdable object, which is an item, is in a passing state (also referred to as a "third state") and stops the water flow (step S206). For example, if the control unit 100 determines that the moving speed of the holdable object is equal to or greater than the second threshold value and that the object is in a passing state (third state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water flow.

[0095] Thus, in the second process, if the second threshold value is equal to or greater than the second threshold value, it is determined that the holdable object is being moved past the sink 40 or the like. In other words, if the movement speed of the holdable object is greater than the speed assumed to be during work, the water discharge control system 1 determines that the holdable object is not being used for work, but is simply being moved, and does not discharge water. Note that the processing flow shown in FIG. 5 is merely an example, and the water discharge control system 1 may simultaneously perform the movement speed determination (1) of the holdable object shown in step S203 and the movement speed determination (2) of the holdable object shown in step S204.

[0096] Furthermore, if the moving speed of the held object is less than the first threshold (step S203: less than first threshold), the water discharge control system 1 determines that the equipment is in a stationary state (first state) and stops the water flow (step S207). For example, if the moving speed of the held object is less than the first threshold and the control unit 100 determines that the equipment is in a stationary state (first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water flow.

[0097] If the water discharge control system 1 does not detect a holdable object within the water discharge area (step S202: No), it stops the water (step S208). For example, if the control unit 100 does not detect a holdable object within the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water.

[0098] In this way, through the second process, the water discharge control system 1 is able to accurately control the water discharge by determining from the movement speed of the held object that the object is in a state where it is doing work such as washing dishes (working) and not in a state where it is moving (passing by).

[0099] <1-4-3. Third processing flow> The water discharge control system 1 may perform processing using not only the product to be held but also a human hand as the recognition object. In this regard, the flow of the processing related to the third processing will be explained using FIG. 6. FIG. 6 is a flowchart showing an example of the procedure related to the third processing according to the first embodiment. Note that explanations of points similar to those explained in FIG. 4 and FIG. 5 will be omitted as appropriate.

[0100] The water discharge control system 1 acquires the image processing result (step S301). Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (step S302). For example, the control unit 100 detects a human hand and a tool, which is a held object, as the recognition target in the water discharge area in the image captured by the imaging unit 10.

[0101] When the water discharge control system 1 detects a recognition object in the water discharge area (step S302: Yes), it detects the category of the recognition object (step S303). For example, the control unit 100 determines whether the recognition object detected in the water discharge area in the image captured by the imaging unit 10 is a human hand or an item.

[0102] When the object to be recognized detected in the water discharge area is only an article, that is, a held object (step S303: "article"), the water discharge control system 1 executes the process of determining the movement speed of the held object (1) (step S304). For example, as the process of determining the movement speed of the held object (1), the control unit 100 determines whether the movement speed of the held object is equal to or greater than a first threshold value.

[0103] When the moving speed of the holdable object is equal to or greater than the first threshold value (step S304: equal to or greater than the first threshold value), the water discharge control system 1 executes the process of determining the moving speed of the holdable object (2) (step S305). For example, as the process of determining the moving speed of the holdable object (2), the control unit 100 determines whether the moving speed of the holdable object is equal to or greater than the second threshold value.

[0104] When the moving speed of the held object is less than the second threshold (step S305: less than second threshold), the water discharge control system 1 determines that the hold object, which is an item, is in a working state (second state) and executes water discharge (step S306). For example, when the moving speed of the held object is less than the second threshold and determines that the work is in progress (second state), the control unit 100 controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0105] On the other hand, if the moving speed of the holdable object is equal to or greater than the second threshold value (step S305: equal to or greater than the second threshold value), the water discharge control system 1 determines that the holdable object, which is an item, is in a passing state (third state) and stops the water flow (step S307). For example, if the moving speed of the holdable object is equal to or greater than the second threshold value and the control unit 100 determines that the holdable object is in a passing state (third state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water flow.

[0106] Furthermore, if the moving speed of the held object is less than the first threshold (step S304: less than first threshold), the water discharge control system 1 determines that the equipment is in a stationary state (first state) and stops the water flow (step S308). For example, if the moving speed of the held object is less than the first threshold and the control unit 100 determines that the equipment is in a stationary state (first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water flow.

[0107] Furthermore, if the recognized object detected within the water discharge area is only a hand, or an item and a hand, i.e., if the recognized object detected within the water discharge area includes a human hand (step S303: "hand" or "item + hand"), the water discharge control system 1 executes water discharge regardless of whether or not there is a held object (item) (step S309). For example, if there is a human hand within the water discharge area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0108] If the water discharge control system 1 does not detect a held object within the water discharge area (step S302: No), it stops the water (step S310). For example, if the control unit 100 does not detect either an object or a hand within the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0109] In this way, through the third process, when only a held object is detected in the water discharge area, the water discharge control system 1 determines that the person is performing an activity such as washing their hands (working), regardless of the state of the held object, and performs water discharge, thereby enabling accurate water discharge control.

[0110] <1-5. Effects of the First Embodiment> As described above, the water discharge control system 1 according to the first embodiment can appropriately control the water discharge by controlling the stop of water discharge according to the moving speed of the held object, i.e., the utensil, and can provide a user-friendly system. In this way, the water discharge control system 1 according to the first embodiment can appropriately control the stop of water discharge.

[0111] 2. Second embodiment When an image of a person's hands is captured, the water discharge control system may determine whether the person is working based on the state of the hands, and control water discharge and stopping based on the result of this determination. A second embodiment that performs this processing will be described below.

[0112] In the water discharge control system 1 according to the second embodiment, explanations of the same points as those in the water discharge control system 1 according to the first embodiment will be omitted as appropriate. For example, the water discharge control system 1 according to the second embodiment has the same configuration and arrangement as the water discharge control system 1 according to the first embodiment, and therefore explanations of the configuration and arrangement will be omitted.

[0113] The control unit 100 according to the second embodiment executes various processes according to the state of the person's hand. For example, the processing unit 120 according to the second embodiment executes the following processes. When the object to be recognized is a human hand, the processing unit 120 determines the state of the object to be recognized. The processing unit 120 determines whether or not the person is working based on the state of the person's hand. The processing unit 120 determines whether or not the person is working based on at least one of the shape of the person's hand and the hidden area of ​​the person's hand.

[0114] If the processing unit 120 determines that the shape of the person's hand is a clenched hand, it determines that the person is working. If the palm and the back of the person's hand are hidden, or if the fingertips of the person's hand are hidden, it determines that the person is working. If the person's hand is present within the water discharge area, it determines that the person is working. The processing unit 120 uses an inference model learned from past captured images that were determined to be working or not working to determine whether the state corresponding to the image captured by the imaging unit 10 is working or not.

[0115] When determining that work is in progress, processing unit 120 controls water discharger 30 to discharge water, and when determining that work is not in progress, controls water discharger 30 to stop water discharge.

[0116] <2-1. Area example> Before describing specific processing according to the second embodiment, an example of a predetermined area will be described using Fig. 7. Fig. 7 is a diagram showing an example of an area. Fig. 7 shows a case corresponding to a plan view of the upper surface portion 20 from above the kitchen body 2. For example, the water discharge area WA2 shown in Fig. 7 is similar to the water discharge area WA1 shown in Fig. 3, and therefore a detailed description thereof will be omitted.

[0117] For example, FIG. 7 shows an example of the predetermined area PA2. In FIG. 7, the predetermined area PA2 is shown as a range corresponding to almost the entire sink 40. For example, the predetermined area PA2 is wider than the water discharge area WA2, and corresponds to a range that includes the water discharge area WA2 in a plan view. Note that the predetermined area PA2 shown in FIG. 7 is merely an example, and the predetermined area can be changed to any range. For example, the predetermined area PA2 can be set to any range as long as it is a range within which it is desired to determine the state of the hand. For example, the predetermined area PA2 may be the imaging range of the imaging unit 10.

[0118] <2-2. Processing of the Second Embodiment> Below, several processing examples according to the second embodiment will be described. The water discharge control system 1 according to the second embodiment determines the state of the person's hand from a captured image and controls water discharge and stopping based on the determination result. That is, the water discharge control system 1 according to the second embodiment focuses on the state of the user's hand. In this way, the water discharge control system 1 according to the second embodiment focuses on the state of the person's hand that is presumed to be working, rather than on the presence or absence of tools, so that even if the tool information cannot be successfully detected, it can determine water discharge and stopping control based only on the information about the person's hand. As a result, the water discharge control system 1 according to the second embodiment appropriately controls water discharge and stopping based on the captured image (camera image).

[0119] From here, a specific example of the processing flow related to the second embodiment will be described. The water discharge control system 1 according to the second embodiment executes the following fourth to fifth processes. The water discharge control system 1 executes at least one of the fourth to fifth processes. Note that the water discharge control system 1 may execute water discharge control by combining each of the fourth to fifth processes. Furthermore, although the following description will be given with the water discharge control system 1 as the processing subject, the fourth to fifth processes may be executed by any device, such as the control unit 100 or various sensors such as the imaging unit 10, depending on the device configuration included in the water discharge control system 1.

[0120] <2-2-1. Fourth processing flow> First, the flow of processing related to the fourth processing will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the procedure related to the fourth processing according to the second embodiment. For example, Fig. 8 describes processing in the case where a human hand is the recognition target object as an example. Note that descriptions of points similar to those in the above-described processing will be omitted as appropriate.

[0121] The water discharge control system 1 acquires the image processing result (step S401). For example, the control unit 100 receives an image captured by the imaging unit 10 from the imaging unit 10, and detects objects included in the image and their positions (coordinates, etc.) by performing image processing on the received image.

[0122] Then, the water discharge control system 1 determines the state of the person's hand in the predetermined area (step S402). For example, the control unit 100 detects a human hand as a recognition target in a predetermined area in the image captured by the imaging unit 10, and if a human hand is detected in the predetermined area, it determines the state of the person's hand. Note that if the water discharge control system 1 does not detect a human hand in the predetermined area, it may execute the processing of step S404.

[0123] When the water discharge control system 1 determines that the state of the person's hands in the predetermined area is working (step S402: working), it executes water discharge (step S403). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is working (second state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0124] On the other hand, when the water discharge control system 1 determines that the state of the person's hands in the predetermined area is not at work (step S402: not at work), it stops the water (step S403). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is not at work (for example, the first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0125] In this way, through the fourth process, the water discharge control system 1 determines whether or not the person is working based on the state of their hands, thereby enabling water discharge control in accordance with the user's intentions.

[0126] 8 is merely an example, and the water discharge control system 1 may perform the same process as step S102 in Fig. 4 before making the determination in step S402. In this case, if the water discharge control system 1 detects a holdable object within the water discharge area, it executes the processes from step S402 onwards, and if it does not detect a holdable object within the water discharge area, it stops the water.

[0127] <2-2-2. Example of hand condition assessment> Here, an example of determining the state of a person's hand will be shown using Figures 9 and 10. Figure 9 is a diagram showing an example of a hand in a clenched grip, and Figure 10 is a diagram showing an example of a hand.

[0128] First, as shown in the working state group BL1 in Fig. 9, the state of a person's hand varies depending on the item they are holding, and there are various states of hands that correspond to working. For example, if the state of a person's hand included in a predetermined area of ​​the image resembles at least one of the states shown in the state group BL1, the water discharge control system 1 may determine that the state shown by the state of the person's hand included in the predetermined area of ​​the image is working. For example, if the state of a person's hand included in the predetermined area of ​​the image resembles at least one of the states shown in the state group BL1, the water discharge control system 1 may determine that the person's hand included in the predetermined area of ​​the image is in a clenched shape and determine that they are working.

[0129] For example, the water discharge control system 1 may have information on the hand state corresponding to each of the states shown in the state group BL1, and by comparing that information with the state of a person's hand included in a specified area of ​​the image, determine whether the state indicated by the state of a person's hand included in a specified area of ​​the image is a state in which the person is working.

[0130] For example, when working in the kitchen, a person's hands hold dishes, cooking utensils, etc. Therefore, the water discharge control system 1 distinguishes whether the person's hands are in a clenched (closed) or open shape, and if it identifies that the person's hands are clenched, it determines that the person is working.

[0131] Furthermore, for example, the water discharge control system 1 may determine whether the state indicated by the state of the person's hand included in a predetermined area in the image is a state in which the person is working, depending on whether the areas indicated by dotted lines on the back side BH and palm side PH in Fig. 10 are included in the image. In this case, the water discharge control system 1 may determine that the person is working when the palm and the back of the person's hand are hidden, or when the fingertips of the person's hand are hidden.

[0132] For example, when working in the kitchen, the palms and fingertips of the hands are hidden. For example, the water discharge control system 1 determines that work is being performed when the palm and back of at least one hand are hidden, or when the tips of three or more of the five fingers are hidden. Note that the case where three or more of the five fingers are hidden is merely one example of a determination condition, and any number of fingertips may also be hidden, such as when two or more of the five fingers are hidden, or when four or more of the five fingers are hidden.

[0133] For example, if a system determines that a user is working when only the palm of the hand is covered, it may erroneously determine that a user is working even if the back of the hand is facing up. On the other hand, by setting the condition that both the palm and the back of the hand are covered, the water discharge control system can determine that a user is working only when, for example, the palm and the back of the hand are covered by tools, and can control the water discharge and stop in accordance with the user's intentions.

[0134] As described above, when working, the hand is shaped as if gripping something or part of the hand is hidden by an object. Therefore, when the hand is shaped as if gripping something or part of the hand is hidden by an object, the water discharge control system 1 determines that the person is working, and can appropriately control the water discharge and stopping.

[0135] <2-2-3. Fifth processing flow> The water discharge control system 1 may perform processing using not only a human hand but also an item as the recognition object. In this regard, the flow of the processing related to the fifth processing will be explained using Fig. 11. Fig. 11 is a flowchart showing an example of the procedure related to the fifth processing according to the second embodiment.

[0136] The water discharge control system 1 acquires the image processing result (step S501). Then, the water discharge control system 1 determines whether or not there is a recognition target in the water discharge area (step S502). For example, the control unit 100 detects a human hand and an item as a recognition target in the water discharge area in the image captured by the imaging unit 10.

[0137] When the water discharge control system 1 detects a recognition object in the water discharge area (step S502: Yes), it detects the category of the recognition object (step S503). For example, the control unit 100 determines whether the recognition object detected in the water discharge area in the image captured by the imaging unit 10 is a human hand or an item.

[0138] If the only object to be recognized detected within the water discharge area is an item, i.e., the only object to be held (step S503: "item"), the water discharge control system 1 executes a process to determine the state of the hand within the predetermined area (step S504). For example, the control unit 100 determines whether or not the person is working by the process of determining the state of the hand within the predetermined area. For example, the control unit 100 detects a human hand as the object to be recognized within a predetermined area in the image captured by the imaging unit 10, and if a human hand is detected within the predetermined area, it determines the state of the person's hand. Note that if the water discharge control system 1 does not detect a human hand within the predetermined area, it may execute the process of step S506.

[0139] When the water discharge control system 1 determines that the state of the person's hands in the predetermined area is working (step S504: working), it executes water discharge (step S505). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is working (second state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0140] On the other hand, when the water discharge control system 1 determines that the state of the person's hands in the predetermined area is not at work (step S504: not at work), it stops the water (step S506). For example, when the control unit 100 determines that the state indicated by the state of the user's (person's) hands in the predetermined area in the image is not at work (for example, the first state), it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0141] Furthermore, if the recognized object detected within the water discharge area is only a hand, or an item and a hand, i.e., if the recognized object detected within the water discharge area includes a human hand (step S503: "hand" or "item + hand"), the water discharge control system 1 will discharge water regardless of the state of the hand (step S507). For example, if there is a human hand within the water discharge area, the control unit 100 determines that the person (user) wants water to be discharged, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0142] If the water discharge control system 1 does not detect a held object within the water discharge area (step S502: No), it stops the water (step S508). For example, if the control unit 100 does not detect either an object or a hand within the water discharge area in the image captured by the imaging unit 10, it controls the solenoid valves 101-103 to cause the water discharge unit 30 to stop the water.

[0143] For example, if a user brings their hand to the water discharge area, it is assumed that they want to perform the task of discharging water. Therefore, by the fifth process, the water discharge control system 1 can accurately read the user's intention and discharge water regardless of the movement of the implement.

[0144] <2-3. Example of inference model> The water discharge control system 1 may use an inference model to determine whether or not work is in progress. For example, the water discharge control system 1 may use an inference model learned from past captured images that were determined to be in progress or not to be in progress to determine whether or not work is in progress in the state corresponding to the image captured by the imaging unit. An example of the inference model used by the water discharge control system 1 will be described with reference to FIG. 12. FIG. 12 is a diagram showing an example of the inference model.

[0145] FIG. 12 shows an example of learning of inference model M1, which is an example of an inference model used by the water discharge control system 1 for determination. For example, inference model M1 is a machine learning model that, when an image is input, outputs information indicating whether the state of a hand included in the image is working or not. Learning of inference models such as inference model M1 is performed using various techniques related to so-called supervised learning as appropriate. For example, inference model M1 is learned (generated) by a learning process using learning data group LD1 as supervised data. Note that supervised learning for inference models such as inference model M1 is similar to general supervised learning, and a detailed description of the learning process will be omitted.

[0146] Of the learning data group LD1 in FIG. 12, the three images in the right column are images corresponding to a state where the user is not working (also referred to as "non-working data"), and the other six images are images corresponding to a state where the user is working (also referred to as "working data"). The working data are, for example, images including a hand holding an object or with the palm or pads of the fingers hidden. The non-working data are, for example, images including a hand not holding an object or with the palm or pads of the fingers not hidden.

[0147] Inference models such as inference model M1 are trained based on data such as that shown in training data group LD1. Note that inference models such as inference model M1 may be trained by a device (machine learning device) not included in the water discharge control system 1, or may be trained by a device (e.g., control unit 100) included in the water discharge control system 1. For example, when a machine learning device trains (generates) an inference model such as inference model M1, a device (e.g., control unit 100) included in the water discharge control system 1 may receive (acquire) the inference model such as inference model M1 from the machine learning device and use the inference model such as inference model M1 to determine whether work is in progress.

[0148] For example, the control unit 100 may input an image to be determined to an inference model such as the inference model M1, and use information output by the inference model such as the inference model M1 to determine whether or not work is being performed on the image to be determined. In this case, the inference model such as the inference model M1 is stored in the storage unit 130, and the control unit 100 may determine whether or not work is being performed using the inference model such as the inference model M1 stored in the storage unit 130. For example, the control unit 100 may perform a learning process to generate an inference model such as the inference model M1. Note that the above is merely an example, and the control unit 100 may determine whether or not work is being performed using various information as appropriate.

[0149] <2-4. Effects of the Second Embodiment> As described above, the water discharge control system 1 according to the second embodiment can appropriately control the water discharge by controlling the water discharge and stopping according to the state of the hand, making it possible to provide a user-friendly system. In this way, the water discharge control system 1 according to the second embodiment can appropriately control the water discharge and stopping.

[0150] 3. Third Embodiment The water discharge control system may target different areas and control water discharge and stopping based on information about the recognition target included in the target. A third embodiment that performs this processing will be described below.

[0151] In the water discharge control system 1 according to the third embodiment, explanations of the same points as those of the water discharge control system 1 according to the first or second embodiment will be omitted as appropriate. For example, the water discharge control system 1 according to the third embodiment has the same configuration and arrangement as the water discharge control system 1 according to the first embodiment, and therefore explanations of the configuration and arrangement will be omitted.

[0152] The control unit 100 according to the third embodiment executes various processes according to the detection results in the first area and the second area. For example, the processing unit 120 according to the third embodiment executes the following process. When the processing unit 120 determines that only items are present in the first area, it determines whether a human hand is present in the second area, which is an area that encompasses the first area.

[0153] When processing unit 120 determines that only items are present in the first area and that a human hand is present in the second area, it controls water discharger 30 to discharge water. When processing unit 120 determines that only items are present in the first area and that a human hand is not present in the second area, it controls water discharger 30 to stop water.

[0154] When the processing unit 120 determines that a human hand is present in the first area, it controls the water discharger 30 to discharge water. When the processing unit 120 determines that the item present in the first area is equal to or larger than a predetermined size, it controls the water discharger 30 to discharge water.

[0155] <3-1. Area example> Before describing specific processing according to the third embodiment, an example of a predetermined area will be described using Fig. 13. Fig. 13 is a diagram showing an example of an area. Fig. 13 shows a case corresponding to a plan view of the upper surface portion 20 from above the kitchen body 2. For example, the first area WA3 includes an area that overlaps with the water outlet from which water is discharged by the water discharger 30 in plan view. The first area WA3 shown in Fig. 13 is similar to the water discharge area WA1 shown in Fig. 3, and therefore a detailed description thereof will be omitted.

[0156] For example, FIG. 13 shows an example of the second area EA3. In FIG. 13, the second area EA3 corresponds to a range that substantially covers the entire sink 40. For example, the second area EA3 is wider than the first area WA3 and corresponds to a range that includes the first area WA3 in a plan view. Note that the first area WA3 and the second area EA3 shown in FIG. 13 are merely examples, and the first area and the second area can be changed to any range. For example, the first area WA3 and the second area EA3 can be set to any range as long as it is within the range in which it is desired to determine the state of the hand; this point will be described later. Note that the first area may be interpreted as a water discharge area, and the second area may be interpreted as a predetermined area or a peripheral area.

[0157] <3-2. Processing of the Third Embodiment> Below, several processing examples according to the third embodiment will be described. The water discharge control system 1 according to the third embodiment categorizes objects as tools (target objects) and hands (held objects), and determines the user's intention to discharge water based on the positional conditions of both. In other words, the water discharge control system 1 according to the third embodiment enables accurate determination without any time-dependent conditions. Furthermore, because the water discharge control system 1 according to the third embodiment distinguishes by category rather than by "held object," there is no need to detect the presence or skeleton of a person to determine the held object, and the control load on the control unit can be reduced. As a result, the water discharge control system 1 according to the third embodiment appropriately controls water discharge and stop based on the captured image (camera image).

[0158] From here, a specific example of the processing flow related to the third embodiment will be described. The water discharge control system 1 according to the third embodiment executes the following sixth to seventh processes. The water discharge control system 1 executes at least one of the sixth to seventh processes. The water discharge control system 1 may execute water discharge control by combining the sixth to seventh processes. Furthermore, although the following description will be given with the water discharge control system 1 as the processing subject, the sixth to seventh processes may be executed by any device, such as the control unit 100 or various sensors such as the imaging unit 10, depending on the device configuration included in the water discharge control system 1.

[0159] <3-2-1. 6th process flow> First, the flow of processing related to the sixth processing will be described with reference to Fig. 14. Fig. 14 is a flowchart showing an example of the procedure related to the sixth processing according to the third embodiment. Note that the description of the same points as those in the above-described processing will be omitted as appropriate.

[0160] The water discharge control system 1 acquires the image processing result (step S601). For example, the control unit 100 executes image processing using any image processing technology and acquires the image processing result shown below. For example, the image processing result indicates the result of any image processing and includes information indicating the category and position information of the recognized object based on the captured image. Furthermore, for example, the position information is information indicating the center of the area where the item exists, each vertex of the rectangular area, the maximum and minimum values ​​in the vertical direction (Y coordinate), and the maximum and minimum coordinates in the horizontal direction (X coordinate). Note that the above is merely an example of the image processing result, and the image processing result is not limited to the above, and any information can be used as long as it includes the information necessary for processing.

[0161] Then, the water discharge control system 1 determines whether or not there is a recognition target in the first region (step S602). For example, the control unit 100 detects a human hand and an item as a recognition target in the first region in the image captured by the imaging unit 10.

[0162] When the water discharge control system 1 detects a recognition object in the first area (step S602: Yes), it detects the category of the recognition object (step S603). For example, the control unit 100 determines whether the recognition object detected in the first area in the image captured by the imaging unit 10 is a human hand or an item.

[0163] If the object to be recognized detected in the first area is only an item, i.e., a held object (step S603: "Items only"), the water discharge control system 1 determines whether or not a hand is present in the second area (step S604). For example, the control unit 100 detects a human hand as the object to be recognized in the second area in the image captured by the imaging unit 10, and determines whether or not a hand is present in the second area based on the detection result.

[0164] When the water discharge control system 1 determines that a hand is present in the second area (step S604: Yes), it executes water discharge (step S605). For example, when the control unit 100 determines that a hand is present in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to discharge water.

[0165] On the other hand, if the water discharge control system 1 determines that there is no hand in the second area (step S604: No), it stops the water flow (step S606). For example, if the control unit 100 determines that there is no hand in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water flow.

[0166] Furthermore, the water discharge control system 1 executes water discharge (step S607) when the recognized object detected in the first area is only a hand, or an item and a hand, i.e., when the recognized object detected in the first area includes a human hand (step S603: "item and hand" or "hand only") For example, when a human hand is present in the first area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0167] If the water discharge control system 1 does not detect a held object in the first area (step S602: No), it stops the water (step S608). For example, if the control unit 100 does not detect either an object or a hand in the first area in the image captured by the imaging unit 10, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water.

[0168] By the sixth process, the water discharge control system 1 acquires the category (item or hand) and position information of the object present in the image, and controls the water discharge stop based on the position information for each category, which eliminates the need for complex judgment conditions or time-dependent conditions, and enables water discharge judgment and control with little time lag.In this way, the water discharge control system 1 can accurately read the user's intention and discharge water regardless of the movement of the item.

[0169] <3-2-2. Seventh Processing Flow> It should be noted that the process shown in Fig. 14 is merely an example, and the water discharge control system 1 may change the second area. In this regard, the flow of the process will be explained as a process related to the seventh process using Fig. 15. Fig. 15 is a flowchart showing an example of the procedure related to the seventh process according to the third embodiment. It should be noted that explanations of the same points as those in the above-mentioned processes will be omitted as appropriate.

[0170] The water discharge control system 1 acquires the image processing result (step S701). Then, the water discharge control system 1 determines whether or not there is a recognition object in the first area (step S702). If the water discharge control system 1 detects a recognition object in the first area (step S702: Yes), it detects the category of the recognition object (step S703).

[0171] When the object to be recognized detected in the first area is only an item, i.e., only the object to be held (step S703: "Items only"), the water discharge control system 1 changes the size of the second area based on the size of the item (step S704). For example, when the object to be recognized detected in the first area is only an item, the control unit 100 changes the size of the second area according to the size (dimension) of the item detected in the first area. In this way, the second area changes according to the size of the item present in the first area.

[0172] The size of the item referred to here is any index indicating the size of the item, such as the size on the image plane or the size of the area where the item is output by image processing. For example, the control unit 100 changes the size of the second area by increasing the size of the second area as the size of the item detected in the first area increases, and decreasing the size of the second area as the size of the item detected in the first area decreases. For example, the control unit 100 increases the size of the second area when the size of the item is large relative to the second area, and decreases the size of the second area when the size of the item is small.

[0173] The change in size of the second area described above is merely an example, and any change in size of the second area can be adopted depending on the size of the items. For example, when there are multiple items in the first area, the water discharge control system 1 may change the second area depending on the size of the smallest item. For example, when there are multiple dishes of different sizes stacked in the first area, with the smallest dish on top, the water discharge control system 1 may change the second area depending on the size of the smallest dish.

[0174] The second area may also change depending on the position of the item detected in the first area. In this case, the water discharge control system 1 may change the second area depending on the position of the item present in the first area. For example, the water discharge control system 1 may change the range (size) of the second area depending on the distance between the center of the first area and the center of the item. For example, the water discharge control system 1 may make the range (size) of the second area smaller the farther the item is located from the center of the first area. For example, the water discharge control system 1 may make the range (size) of the second area larger the farther the item is located from the center of the first area. Note that the above is merely an example, and the water discharge control system 1 may change the second area in various ways depending on the position of the item present in the first area. In this way, the water discharge control system 1 changes the second area depending on at least one of the position and size of the item present in the first area.

[0175] Then, the water discharge control system 1 determines whether or not there is a hand in the second area (step S705). That is, in the seventh processing example, the water discharge control system 1 determines whether or not there is a hand in the second area, which is changed depending on the size of the item present in the first area.

[0176] When the water discharge control system 1 determines that a hand is present in the second area (step S705: Yes), it executes water discharge (step S706). For example, when the control unit 100 determines that a hand is present in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to discharge water.

[0177] On the other hand, if the water discharge control system 1 determines that there is no hand in the second area (step S705: No), it stops the water flow (step S707). For example, if the control unit 100 determines that there is no hand in the second area in the image, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water flow.

[0178] Furthermore, the water discharge control system 1 executes water discharge (step S708) when the recognized object detected in the first area is only a hand, or an item and a hand, i.e., when the recognized object detected in the first area includes a human hand (step S703: "item and hand" or "hand only") For example, when a human hand is present in the first area, the control unit 100 determines that the person (user) desires water discharge, and controls the solenoid valves 101-103 to cause the water discharge unit 30 to discharge water.

[0179] If the water discharge control system 1 does not detect a held object in the first area (step S702: No), it stops the water (step S709). For example, if the control unit 100 does not detect either an item or a hand in the first area in the image captured by the imaging unit 10, it controls the solenoid valves 101 to 103 to cause the water discharge unit 30 to stop the water.

[0180] By the seventh process, the water discharge control system 1 can change the size of the second area according to the size of the product, thereby enabling more accurate water discharge control. For example, by the seventh process, the water discharge control system 1 can accurately control water discharge when the second area is changed to match the product.

[0181] <3-3. Example of changing the area> Here, an example of changing the area will be described with reference to Figures 16 to 18. Figures 16 to 18 are diagrams showing an example of changing the area. Note that the description of the same points as in the above-mentioned processing will be omitted as appropriate.

[0182] <3-3-1. Example of changing the second area> First, an example of changing the second area by the seventh process will be described with reference to Fig. 16. Fig. 16 is a diagram showing an example of changing the area. Fig. 16 shows a case corresponding to a state in which the upper surface portion 20 is viewed from above the kitchen body 2. The first area WA3 shown in Fig. 16 is the same as the first area WA3 shown in Fig. 13, and therefore a detailed description thereof will be omitted.

[0183] For example, Fig. 16 shows a case where the item detected in the first area WA3 is small. Therefore, in Fig. 16, the water discharge control system 1 reduces the size of the second area. For example, the water discharge control system 1 changes the size of the second area from the size of the second area EA3 shown in Fig. 13 to the size of the second area EA30. The second area EA30 shown in Fig. 16 shows a state where it is smaller than the second area EA3 shown in Fig. 13. This allows the water discharge control system 1 to prevent unnecessary water discharge when the second area is too large for the item.

[0184] Furthermore, if the product detected in the first area WA3 is large, the water discharge control system 1 changes the second area to a larger size. In this case, for example, the water discharge control system 1 changes the second area to a size larger than the size of the second area EA3 shown in Fig. 13 (for example, the size of the predetermined area PA2 in Fig. 7).

[0185] <3-3-2. Scope of the second area> In the water discharge control system 1, the water discharger 30 may be able to change the position of the water discharge outlet 321. In this case, the water discharger 30 may have a rotatable water discharge pipe 31. Note that the above is merely one example, and the water discharger 30 may have any configuration as long as the position of the water discharge outlet 321 is changeable. For example, the head 32 on which the water discharge outlet 321 is provided may be of a pull-out type, and the position of the water discharge outlet 321 may be changed by changing the position of the head 32.

[0186] In this way, when the position of the water discharger 30's water outlet 321 is changeable, it is possible that the water outlet 321 may move to the edge of the sink 40. In such a case, the second area may include the area outside the sink 40. In that case, the presence of an unintended hand may be detected and water may be erroneously discharged.

[0187] Therefore, the water discharge control system 1 may be configured so that the second area does not include the area outside the sink 40. An example of this case will be described with reference to FIG. 17. FIG. 17 is a diagram showing an example of changing the area. As a specific example, FIG. 17 shows an example of the second area when the water discharge pipe 31 of the water discharger 30 rotates and the position of the water discharge port 321 can be changed. FIG. 17 shows a case corresponding to the state when the top surface 20 is viewed from above the kitchen body 2 in a plan view.

[0188] Figure 17 shows a state in which, in a plan view, the water discharge pipe 31 has been rotated counterclockwise from the state in Figure 13, and the position of the water discharge outlet 321 has been changed to the side end (the right end in Figure 17) of the sink 40. The first area WA31 shown in Figure 17 is the same size as the first area WA3 shown in Figure 13, but shows a state in which its position has been changed in accordance with the change in the position of the water discharge outlet 321.

[0189] 17 is changed in shape from the second area EA3 shown in FIG. 13 so that it is only within the sink 40. As a result, the second area EA31 shown in FIG. 17 is an area that does not include the area outside the sink 40. In this way, the second area EA31 includes only the area within the sink 40 that corresponds to the water discharger 30.

[0190] 17 is merely an example, and any modification can be adopted as long as the second region does not include the area outside the sink 40. For example, the second region may be changed to a range that does not include the area outside the sink 40 by shifting its center toward the center of the sink 40, without changing its shape.

[0191] In this way, by limiting the second area to the inside of the sink, the water discharge control system 1 is able to detect the presence of a hand and discharge water only when it is desired to use the faucet.

[0192] <3-3-3. Example of changing the first area> The water discharge control system 1 may change the first area, not limited to the second area. For example, the water discharge control system 1 may change the first area according to the selection of the user. In this way, the first area may be changeable by the user.

[0193] An example of changing the first area will be described below with reference to Fig. 18. Fig. 18 is a diagram showing an example of changing the area. Fig. 18 shows a case corresponding to a state in which the upper surface portion 20 is viewed from above the kitchen body 2. The second area EA3 shown in Fig. 18 is similar to the second area EA3 shown in Fig. 13, and therefore a detailed description thereof will be omitted.

[0194] For example, Fig. 18 shows a case where the user sets (operates) the first area to be smaller. Therefore, in Fig. 18, the water discharge control system 1 changes the first area to be smaller. Note that the method for changing the first area may be a method using any operating means, such as operating a switch (for example, a switch provided on the water discharger 30) or an app (for example, an application related to the water discharge control system).

[0195] For example, the water discharge control system 1 changes the size of the first area from the size of the first area WA3 shown in Fig. 13 to the size of the first area WA30. The first area WA30 shown in Fig. 18 is smaller than the first area WA3 shown in Fig. 13. This allows the water discharge control system 1 to change the first area according to the user's preference, and allows water discharge control based on the first area that is suited to the user's usage of the bathroom.

[0196] Furthermore, the first region is not limited to being set by the user, and may be changed in any manner. For example, the water discharge control system 1 may change the first region depending on the form of water discharge from the water discharger 30. For example, if the water discharger 30 is capable of switching between straight water and shower water discharge from the water discharge port 321, the water discharge control system 1 may change the first region depending on whether the form of water discharged from the water discharge port 321 is straight water or shower water.

[0197] In this case, for example, when the shape of the water discharged from the water discharge outlet 321 is straight, the water discharge control system 1 may set the first area to the size of the first area WA3 shown in Fig. 13. Also, for example, when the shape of the water discharged from the water discharge outlet 321 is a shower, the water discharge control system 1 may set the first area to a size larger than the size of the first area WA3 shown in Fig. 13. Note that changing the first area according to the water discharge mode described above is just one example, and the water discharge control system 1 may make any change to the first area according to the water discharge mode. For example, when high-temperature water such as hot water (warm water) is discharged from the water discharge outlet 321, the water discharge control system 1 may make the size of the first area smaller than when low-temperature water such as raw water is discharged.

[0198] Note that the above is merely an example, and the water discharge control system 1 may change various settings related to the first area in response to a user's instruction, not limited to the range of the first area. For example, the water discharge control system 1 may change the time (determination time) for determining whether or not a recognition object exists in the first area in response to a user's instruction. For example, the water discharge control system 1 may accept a user's instruction (such as an operation to change the determination time) via a terminal device used by the user. For example, the water discharge control system 1 may lengthen the determination time in response to a user's operation to extend the determination time. For example, the water discharge control system 1 may shorten the determination time in response to a user's operation to shorten the determination time. In this way, the water discharge control system 1 may change at least one of the range of the first area and the time for determining whether or not a recognition object exists in the first area in response to a user's instruction. In other words, at least one of the range of the first area and the time for determining whether or not a recognition object exists in the first area can be changed by the user.

[0199] <3-4. When the water outlet has multiple outlets> In the above example, the case where water spouting unit 30 has one water spout 321 has been described as an example, but as mentioned above, water spouting unit 30 may have multiple water spouts. This case will be explained using Figure 19. Figure 19 is a diagram showing an example of a case where there are multiple water spouts.

[0200] Figure 19 shows an example in which water outlet 321 spouts water in a straight line, and water outlet 322 spouts water in a shower pattern. Thus, in Figure 19, water outlet 321 is a straight water outlet, and water outlet 322 is a shower pattern. Water outlet 322 is provided along water discharge pipe 31, further rearward than water outlet 321 provided in head 32. Figure 19 shows water being discharged in a shower pattern from water outlet 322.

[0201] In this case, for example, the water discharge control system 1 discharges water from either the water outlet 321 or the water outlet 322 in response to a switching operation by the user. For example, when discharging water, the water discharge control system 1 discharges water from the water outlet selected in response to a switching operation by the user. For example, when the water discharge control system 1 selects the water outlet 321, it discharges water in a straight stream from the water outlet 321. For example, when the water discharge control system 1 selects the water outlet 322, it discharges water in a shower-like stream from the water outlet 322.

[0202] Here, an example of the regions will be described using Figure 20. Figure 20 is a diagram showing an example of the regions when there are multiple spouts. Figure 20 shows the top surface 20 as viewed from above the kitchen body 2. Note that explanations of points similar to the processing described above will be omitted as appropriate. In Figure 20, the water spout 30 is shown in a see-through state (dotted lines) to clearly show the multiple first regions. Also, although the second regions are not shown in Figure 20, the second regions are also set according to each spout, just like the first regions.

[0203] For example, first area WA41 is the first area corresponding to water spout 321, and includes the area overlapping with water spout 321 in plan view. First area WA41 shown in Figure 20 is similar to first area WA3 shown in Figure 13, so detailed description will be omitted. In Figure 20, first area WA41 corresponds to the first area during straight water spouting.

[0204] Furthermore, for example, first area WA42 is the first area corresponding to water spout 322, and in plan view includes an area that overlaps with water spout 322. In Figure 20, first area WA42 corresponds to the first area during shower water spouting.

[0205] 20 includes an area that overlaps with the water discharge port 322 provided along the water discharge pipe 31 of the water discharger 30, and is therefore provided with a shape that is longer and thinner than the first area WA41 in a plan view. In this way, the first area is set according to the water discharge mode. Note that the first areas WA41 and WA42 are merely examples, and the first area may be set to an appropriate range according to the corresponding water discharge port.

[0206] For example, when the water outlet 321 is selected as the water outlet that will spout water, the water discharge control system 1 performs processing using the first area WA41 that corresponds to the water outlet 321. Also, when the water outlet 322 is selected as the water outlet that will spout water, the water discharge control system 1 performs processing using the first area WA42 that corresponds to the water outlet 322.

[0207] For example, depending on the configuration of the faucet, the water outlet, the direction in which the water is discharged, and the position where the water falls into the sink may differ depending on the water discharge mode (shower / straight, raw water / purified water, or any other mode). Therefore, the water discharge control system 1 can accurately discharge water onto the target object by changing the size or position of the first area depending on the water discharge mode selected (specified) by the user.

[0208] <3-5. Processing example when there is an imaging unit in the water discharge section> Here, as mentioned above, if the imaging unit 10 is located on the water discharger 30 or below the water discharger 30, the user's hands may not be imaged. In this regard, an example of processing when the imaging unit 10 is located on the water discharger 30 will be described using Figures 21 to 23. Figures 21 to 23 are diagrams showing an example of processing when the imaging unit is located on the water discharger.

[0209] Figure 21 is a conceptual diagram showing the position where a user stands when using sink 40, that is, when viewing sink 40 from the side of sink 40 opposite the side where water discharge unit 30 is provided, that is, when viewing sink 40 from the front. For example, in Figure 21, the position of imaging unit 10 that captures an image of sink 40 is indicated by a dot, and the relationship between the position of imaging unit 10 and the angle of view in the downward direction is shown.

[0210] Fig. 22 shows the range of imaging range FR1 in Fig. 21 when viewed from above. Imaging range FR1 corresponds to a position close to the faucet (such as the spout 321 of the spouter 30) in the vertical direction. Fig. 23 shows the range of imaging range FR2 in Fig. 21 when viewed from above. Imaging range FR2 corresponds to a position near the top of the sink 40 in the vertical direction.

[0211] For example, if an object (item DA1, which is a plate in Figure 22) is held near the faucet (such as the spout 321 of the spout 30), the captured image will be within the dotted line of the imaging range FR1 shown in Figure 22, so the user's hand (hand MN1 in Figure 22) may not be captured even if it is inside the sink 40.

[0212] For example, if an object (item DA2, which is a cutting board in Figure 22) is held near the top of sink 40, the captured image will be within the dotted line of the imaging range FR2 shown in Figure 23, but if a large object such as a pot, cutting board, or frying pan is held over it, the user's hand (hand MN2 in Figure 23) may not be captured even if it is inside the sink.

[0213] Therefore, the water discharge control system 1 may perform processing according to the size of the item in the first area. In this case, if the water discharge control system 1 determines that the size of the item in the first area is equal to or larger than a predetermined size, it may discharge water even if the user's hand is not in the second area. This allows the water discharge control system 1 to accurately control water discharge in accordance with the user's intention.

[0214] <3-6. Effects of the Third Embodiment> As described above, the water discharge control system 1 according to the third embodiment can appropriately control water discharge by controlling water discharge and stopping according to the detection results in multiple regions, making it possible to provide a user-friendly system. In this way, the water discharge control system 1 according to the third embodiment can appropriately control water discharge and stopping.

[0215] <4. First to third embodiments> The water discharge control system 1 may execute a combination of the processes shown in the first to third embodiments. For example, the water discharge control system 1 may execute a combination of various processes such as the first process to the seventh process described above. For example, when executing a combination of the first to third embodiments, the water discharge area may be read as the first area, and the first area may be read as the water discharge area. Furthermore, for example, when executing a combination of at least the second and third embodiments of the first to third embodiments, the predetermined area may be read as the second area, and the second area may be read as the predetermined area.

[0216] The relationship between the first and second regions will be described with reference to Fig. 24. Fig. 24 is a diagram showing an example of the relationship between the first and second regions. Note that the same points as those described above will not be described again.

[0217] FIG. 24 shows two examples of detection (shape) of a recognition target object: detection pattern #1 for rectangular detection, and detection pattern #2 for detection according to the object (shape). For example, in detection pattern #1, the recognition target object (or a corresponding area) is detected along a rectangle (quadrilateral) containing the recognition target object. For example, in detection pattern #2, the recognition target object (or a corresponding area) is detected along the contour (outer shape) of the recognition target object. Note that detection pattern #2 in FIG. 24 shows an example in which an elliptical shape is detected along the shape of a plate, but the elliptical shape is merely an example. If the shape of the object is circular other than an ellipse, it is detected along the circular shape, and if the shape is polygonal such as a triangle, it is detected along the polygonal shape. Furthermore, for object detection, any method such as image segmentation may be used as long as the desired object detection is possible, and detailed description thereof will be omitted.

[0218] FIG. 24 shows two examples according to the detection (shape) of the recognition target for each of four relation patterns #1 to #4 of the relationship between the first area and the second area.

[0219] For example, relational pattern #1 is a relationship in which the entire first region (entire range) overlaps (is included in) the second region. In other words, relational pattern #1 is a relationship in which the first region is contained within the second region, and the first region corresponds to a part of the second region. In this way, in relational pattern #1, the second region is a range that encompasses the first region. In other words, relational pattern #1 is included in the relationship between the first region and the second region, in which the second region is a range that encompasses the first region.

[0220] In the combination of relational pattern #1 and detection pattern #1, the recognition object OB51, which is a plate, is detected as a rectangular area SG51 indicated by a dashed line in Fig. 24. In the combination of relational pattern #1 and detection pattern #1, the entire first area WA51 is included in the second area EA51, as shown in Fig. 24. In addition, in the combination of relational pattern #1 and detection pattern #2, the recognition object OB61, which is a plate, is detected as a circular area SG61 indicated by a dashed line in Fig. 24. In the combination of relational pattern #1 and detection pattern #2, the entire first area WA61 is included in the second area EA61, as shown in Fig. 24.

[0221] When describing the first areas WA51-WA54, WA61-WA64, etc. without distinction, they may be referred to as first areas WA. When describing the second areas EA51-EA54, EA61-EA64, etc. without distinction, they may be referred to as second areas EA. When describing the recognition objects OB51-OB54, OB61-OB64, etc. without distinction, they may be referred to as recognition objects OB. When describing the areas SG51-SG54, SG61-SG64, etc. without distinction, they may be referred to as areas SG.

[0222] Furthermore, for example, relational pattern #2 is a relationship in which a part of the first region overlaps with the second region, and the remaining part of the first region does not overlap with the second region. In other words, relational pattern #2 is a relationship in which the second region includes a part of the first region. In this way, in relational pattern #2, the second region is a range that encompasses the first region. In other words, relational pattern #2 is included in the relationship between the first region and the second region in which the second region is a range that encompasses the first region.

[0223] In the combination of relational pattern #2 and detection pattern #1, the recognition object OB52, which is a plate, is detected as a rectangular area SG52 indicated by a dashed line in Fig. 24. In the combination of relational pattern #2 and detection pattern #1, the second area EA52 includes only a part of the first area WA52, as shown in Fig. 24. In addition, in the combination of relational pattern #2 and detection pattern #2, the recognition object OB62, which is a plate, is detected as a circular area SG62 indicated by a dashed line in Fig. 24. In the combination of relational pattern #2 and detection pattern #2, the second area EA62 includes only a part of the first area WA62, as shown in Fig. 24.

[0224] As shown in relational patterns #1 and #2 in Fig. 24, when the second area EA is a range that encompasses the first area WA, it is desirable to set the second area EA to an area slightly larger than the range (area SG) in which the recognition object OB present in the first area WA is detected. For example, when the recognition object OB is detected in a rectangular area (areas SG51, SG52, etc.), it is desirable to set (define) the second area EA as a rectangular area (second areas EA51, EA52, etc.) slightly larger than the detection range. Also, when the recognition object OB is detected in a circular area (areas SG61, SG62, etc.), it is desirable to set (define) the second area EA as a circular area (second areas EA61, EA62, etc.) slightly larger than the detection range.

[0225] Below, we will also explain relational patterns #3 and #4, which are relational patterns in which the second area does not encompass the first area. For example, relational pattern #3 is a relationship in which the second area has a simple shape and is different from the first area. Relational pattern #3 is a relationship in which the first area and the second area do not overlap. In other words, relational pattern #3 is a relationship in which the second area does not encompass the first area.

[0226] When relational pattern #3 is combined with detection pattern #1, recognition object OB53, which is a plate, is detected as a rectangular area SG53 indicated by a dashed line in Fig. 24. When relational pattern #3 is combined with detection pattern #1, the second area EA53 does not overlap with the first area WA53, as shown in Fig. 24. When relational pattern #3 is combined with detection pattern #2, recognition object OB63, which is a plate, is detected as a circular area SG63 indicated by a dashed line in Fig. 24. When relational pattern #3 is combined with detection pattern #2, the second area EA63 does not overlap with the first area WA63, as shown in Fig. 24.

[0227] For example, relational pattern #4 is a relationship in which the second region has a complex shape and is different from the first region. Relational pattern #4 is a relationship in which the first region and the second region do not overlap. In other words, relational pattern #4 is a relationship in which the second region does not encompass the first region.

[0228] When relational pattern #4 is combined with detection pattern #1, recognition object OB54, which is a plate, is detected as a rectangular area SG54 indicated by a dashed line in FIG. 24. When relational pattern #4 is combined with detection pattern #1, the second area EA54 does not overlap with the first area WA54, as shown in FIG. 24. For example, the second area EA54 is set to a rectangular area excluding the area that overlaps with the first area WA54. When relational pattern #4 is combined with detection pattern #2, recognition object OB64, which is a plate, is detected as a circular area SG64 indicated by a dashed line in FIG. 24. When relational pattern #4 is combined with detection pattern #2, the second area EA64 does not overlap with the first area WA64, as shown in FIG. 24. For example, the second area EA64 is set to a circular area excluding the area that overlaps with the first area WA64.

[0229] As shown in relational patterns #3 and #4 in Fig. 24, when the second area EA does not encompass the first area WA, it is desirable to define as the second area EA a range (area) that includes at least a part of the range (area SG) in which the recognition object OB present in the first area WA is detected, but does not include the first area WA. Note that the above is only an example, and the size of the second area EA itself is smaller than the detection range of the recognition object OB, but a range (area) that spreads slightly only toward the user (in the direction of the user's hand) may be set (defined) as the second area EA.

[0230] In the above-described embodiment, the water discharge control system 1 has been described using a kitchen as the application location, but it can be applied to any wet space where utensils can be used, and for example, it may be applied to a wash space provided in a toilet space or a place where water discharge and stopping actions such as hand washing are performed, such as a bathroom vanity. Note that the above-described embodiments and modified examples can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0231] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

[0232] The above-described embodiments and modifications may have the following configurations, but are not limited to these. (1) A water outlet section; A water discharge stop switching unit that switches the water discharge stop of the water discharge unit; an imaging unit that images a water-related space; a determination unit that determines a recognition target detected from an image captured by the imaging unit; a control unit that controls the water discharge / stop switching unit; Equipped with The determination unit If it is determined that only items are present in the first area, it is determined whether or not a human hand is present in a second area that is a range that encompasses the first area; The control unit When the determination unit determines that only items are present in the first area and that a human hand is present in the second area, the water discharge unit is controlled to discharge water; When the determination unit determines that only items are present in the first area and that no human hands are present in the second area, the water discharge unit is controlled to stop water. A water discharge control system characterized by: (2) The control unit When the determination unit determines that a human hand is present in the first area, the water discharge unit is controlled to discharge water. The water discharge control system according to (1) is characterized in that: (3) The second area changes in response to at least one of the position and size of the items present in the first area. The water discharge control system according to (1) or (2) is characterized in that: (4) The first region includes an area that overlaps with a water discharge port that discharges water from the water discharger in a plan view. The water discharge control system according to any one of (1) to (3) above, characterized in that: (5) The water discharge section is The position of the spout can be changed, The second area includes only the area within the sink corresponding to the water discharge portion. The water discharge control system according to any one of (1) to (4) above, characterized in that: (6) At least one of the range of the first area and the time required to determine whether or not a recognition target exists in the first area can be changed by the user. The water discharge control system according to any one of (1) to (5) above, characterized in that: (7) The first region changes depending on the form of water discharged from the water discharger. The water discharge control system according to any one of (1) to (6) above, characterized in that: (8) The imaging unit Provided on the water discharge unit or below the water discharge unit The water discharge control system according to any one of (1) to (7) above, characterized in that: (9) The control unit When the determining unit determines that the product present in the first area is equal to or larger than a predetermined size, the water discharge unit is controlled to discharge water. The water discharge control system according to (8) above. (10) The determination unit If it is determined that only items are present in the first area, it is determined whether a human hand is present in the second area, which is a range including at least a part of the first area. The water discharge control system according to any one of (1) to (9) above, characterized in that: (11) an imaging step of imaging a water-related space; a determination step of determining a recognition target detected from the image captured by the imaging step; a control step of controlling a water discharge stop switching unit that switches the water discharge unit to stop or stop; Including, The determination step includes: If it is determined that only items are present in the first area, it is determined whether or not a human hand is present in a second area that is a range that encompasses the first area; The control step includes: When it is determined in the determination step that only items are present in the first area and that a human hand is present in the second area, the water discharger is controlled to discharge water, When it is determined in the determination step that only items are present in the first area and that no human hands are present in the second area, the water discharge unit is controlled to stop water. A water discharge control method characterized by the above. (12) The determination step includes: If it is determined that only items are present in the first area, it is determined whether a human hand is present in the second area, which is a range including at least a part of the first area. The water discharge control method according to (11) above. [Explanation of symbols]

[0233] 1. Water discharge control system 2 Kitchen unit 10. Imaging unit 20 Top part 30 Water outlet 31 Water pipe 32 heads 321, 322 Outlets 40 Sink 100 control unit (control device) 101, 102, 103 Solenoid valves 110 Switching section 120 Processing section (judgment section, control section) 130 Storage section 140 Acquisition Department

Claims

1. A water outlet section; A water discharge / stop switching unit that switches the water discharge of the water discharge unit; An imaging unit that images a water-related space; a determination unit that determines a recognition target object detected from an image captured by the imaging unit; A control unit that controls the water discharge / stop switching unit; Equipped with The determination unit is When it is determined that only products are present in the first area, it is determined whether or not a human hand is present in a second area that is an area that encompasses the first area; The control unit is When the determination unit determines that only items are present in the first area and that a human hand is present in the second area, the water discharge unit is controlled to discharge water, When the determination unit determines that only items are present in the first area and that no human hands are present in the second area, the water discharge unit is controlled to stop water. A water discharge control system.

2. The control unit is When the determination unit determines that a human hand is present in the first area, the water discharge unit is controlled to discharge water. The water discharge control system according to claim 1 .

3. The second area changes in response to at least one of a position and a size of items present in the first area. The water discharge control system according to claim 1 .

4. The first region includes an area overlapping a water outlet that spouts water from the water spouting portion in a plan view. The water discharge control system according to claim 3 .

5. The water discharge portion is The position of the water outlet can be changed. The second area includes only the area within the sink corresponding to the water discharge portion. The water discharge control system according to claim 1 .

6. At least one of the range of the first area and the time for which it is determined whether or not a recognition target object exists in the first area can be changed by a user. The water discharge control system according to claim 1 .

7. The first region changes according to the form of water discharged from the water discharger. The water discharge control system according to claim 1 .

8. The imaging unit includes: Provided at the water discharge unit or below the water discharge unit 8. The water discharge control system according to claim 1, wherein the water discharge control system comprises:

9. The control unit is When the determining unit determines that the product present in the first area is equal to or larger than a predetermined size, the water discharge unit is controlled to discharge water. The water discharge control system according to claim 8 .

10. The determination unit is When it is determined that only products are present in the first area, it is determined whether or not a human hand is present in the second area, which is an area including at least a part of the first area. The water discharge control system according to claim 1 .

11. An imaging step of imaging a water-related space; a determination step of determining a recognition target object detected from the image captured by the imaging step; A control step of controlling a water discharge / stop switching unit that switches water discharge from the water discharge unit; Including, The determination step includes: When it is determined that only products are present in the first area, it is determined whether or not a human hand is present in a second area that is an area that encompasses the first area; The control step includes: When it is determined that only items are present in the first area and a human hand is present in the second area by the determination step, the water discharger is controlled to discharge water, When it is determined in the determination step that only items are present in the first area and that no human hands are present in the second area, the water discharge unit is controlled to stop water. A water discharge control method comprising:

12. The determination step includes: When it is determined that only products are present in the first area, it is determined whether or not a human hand is present in the second area, which is an area including at least a part of the first area. The water discharge control method according to claim 11 .

Images