Hand-washing recognition device, hand-washing recognition method, hand-washing recognition program, and hand-washing recognition system

The system uses an image processing device and camera to analyze hand washing actions, setting a threshold for foam removal to ensure complete rinsing, addressing the issue of residual bacteria and dirt from soap suds.

JP7583273B2Active Publication Date: 2024-11-14FUJITSU LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021060544
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-31
Publication Date
2024-11-14
Estimated Expiration
2041-03-31

AI Technical Summary

Technical Problem

Existing hand washing methods fail to ensure that soap suds are completely rinsed off, leading to residual bacteria and dirt on the skin, which can spread hygiene issues.

Method used

A system comprising an image processing device and a camera that analyzes hand washing actions to determine if the soap suds have been properly rinsed by setting a threshold for the estimated amount of foam remaining on the hands, ensuring it is below a certain level for a predetermined time.

Benefits of technology

Effectively determines whether hand washing has been properly performed by ensuring the soap suds are adequately rinsed, enhancing hygiene by reducing residual bacteria and dirt on the hands.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583273000001
    Figure 0007583273000001
  • Figure 0007583273000002
    Figure 0007583273000002
  • Figure 0007583273000003
    Figure 0007583273000003
Patent Text Reader

Abstract

To determine whether hands have been washed properly.SOLUTION: The present invention includes: an imaging unit for acquiring an image of a hand washing place; a first detection unit for detecting hands of a person from the image; a monitoring unit for monitoring the amount of estimated foam as foam estimated to be on the hands; a second detection unit for detecting a step for the person to wet the hands to wash the hands; and a determination unit for setting a first threshold value on the basis of the amount of the estimated foam in the wetting step and determining that the hands were washed properly when the estimated foam amount was not larger than the first threshold value for a first period of time.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system. [Background technology]

[0002] In recent years, the importance of hand washing as an infection prevention measure has been reconsidered due to the spread of viruses and pathogens. For example, in food handling sites, hospitals, and nursing homes, hygiene management of workers is particularly important, and hand washing is a common practice. In particular, there is an international standard for hygiene management records, HACCP, which is aimed at food-related businesses, and requires checking, monitoring, and recording of hygiene management actions.

[0003] Techniques relating to hand washing are disclosed below. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-211268 A [Patent Document 2] JP 2020-048628 A [Patent Document 3] JP 2020-091739 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, when washing hands, for example, the surfactant action of soap lifts bacteria and dirt from the surface of the skin, trapping them in the soap bubbles. In other words, the soap bubbles after hand washing contain a large amount of bacteria and dirt. Therefore, if the soap bubbles are not washed off thoroughly (the act of washing off the bubbles that adhere to the hands with running water), bacteria and dirt will remain on the surface of the hands. Also, if the soap bubbles are not washed off thoroughly, the bacteria and dirt will spread due to rubbing of the hands, and the hands may become less hygienic than before hand washing.

[0006] Therefore, one disclosure provides a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system that determine whether washing has been performed properly. [Means for solving the problem]

[0007] The device comprises an image unit that acquires an image of a hand-washing area, a first detection unit that detects a person's hands from the image, a monitoring unit that monitors an estimated foam amount that indicates the amount of foam estimated to be adhering to the hands, a second detection unit that detects the process of wetting the hands of the person when washing their hands, and a judgment unit that sets a first threshold based on the estimated foam amount in the process of wetting the hands and judges that the foam has been properly rinsed off when the estimated foam amount remains below the first threshold for a first hour. Effect of the Invention

[0008] One disclosure provides a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system that determine whether or not washing has been properly performed when washing hands. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a hand-washing recognition system 10. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of the image processing device 100. [Diagram 3]FIG. 3 is a diagram showing an example of a process flowchart of the hand-washing determination process S100. [Figure 4] FIG. 4 is a diagram showing an example of calculation of an estimated foam volume. [Diagram 5] FIG. 5 is a diagram showing an example of calculation of an estimated amount of lather when hands are wet. [Figure 6] FIG. 6 is a diagram showing an example of a change in the estimated foam volume during hand washing. [Figure 7] FIG. 7 is a diagram showing an example of hand movements during hand washing. [Figure 8] FIG. 8 is a diagram showing an example in which the determination region T10 is a polygon. [Figure 9] FIG. 9 is a diagram showing an example of a hand-washing process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [First embodiment] A first embodiment will be described.

[0011] <Example of the configuration of hand-washing recognition system 10> 1 is a diagram showing an example of the configuration of a hand-washing recognition system 10. The hand-washing recognition system 10 includes an image processing device (hand-washing recognition device) 100 and a camera 200. The hand-washing recognition system 10 analyzes image data of a video captured by the camera 200, and judges whether or not a target person properly rinsed their hands.

[0012] The camera 200 is an imaging device that captures the hands of a target person in a washbasin. The camera 200 is installed in a place where a person washes his / her hands, such as a toilet or a kitchen, and captures the hands of the target person with a focus on the washbasin such as a sink. The camera 200 is connected to the image processing device 100, for example, via a wire (such as a network cable) or wirelessly (such as Bluetooth (registered trademark)), and transmits captured image data to the image processing device 100. The camera 200, for example, captures a moving image as an image, and continuously transmits the moving image data of a predetermined data size or a predetermined time to the image processing device 100. The camera 200 also captures the moving image constantly or periodically. Furthermore, the camera 200 may capture a series of still images instead of the moving image.

[0013] The target person 300 is a person who is washing his / her hands, and is a person who is the subject of a judgment as to whether or not the washing has been properly performed. The target person 300 washes his / her hands with soap at a hand-washing area.

[0014] The image processing device 100 is a device that analyzes video data acquired from a camera 200 and determines whether or not a target person 300 appearing in the video data has been properly washed off, and is, for example, a computer or a server machine.

[0015] In the hand-washing recognition system 10, the camera 200 transmits captured image data to the image processing device 100. The image processing device 100 detects that the hand of the target person 300 is captured in the image data. The image processing device 100 measures (calculates) the amount of foam attached to the hand (estimated foam amount), and when the amount of foam satisfies a rinsing completion condition, determines that the target person 300 has been properly rinsed. The rinsing completion condition is, for example, that the estimated foam amount (including the average and maximum estimated foam amount) is equal to or less than a threshold value for a predetermined time (first time). For example, the image processing device 100 regards the white portion in the hand area as foam (estimated foam) and calculates the estimated foam amount.

[0016] The image processing device 100 detects the state in which the target person 300 wets his / her hands before applying soap, and calculates an estimated amount of lather (initial value) for the wet hands. In reality, even when the hands are simply wet with water before applying soap, a part of the hand may appear white due to light reflection, and this white part may be mistaken for lather. Therefore, the image processing device 100 measures the estimated amount of lather on wet hands as an initial value, and uses this to set a threshold value, thereby improving the accuracy of determining the amount of lather remaining on the hands.

[0017] <Configuration example of image processing device 100> 2 is a diagram illustrating an example of the configuration of the image processing device 100. The image processing device 100 includes a CPU (Central Processing Unit) 110, a storage 120, a memory 130, a communication circuit 140, and an accelerator 150.

[0018] The storage 120 is an auxiliary storage device that stores programs and data, such as a flash memory, a hard disk drive (HDD), a solid state drive (SSD), etc. The storage 120 stores a hand-washing determination program 121.

[0019] The memory 130 is an area into which the programs stored in the storage 120 are loaded. The memory 130 may also be used as an area in which the programs store data.

[0020] The CPU 110 is a processor that loads a program stored in the storage 120 into the memory 130, executes the loaded program, configures each unit, and realizes each process.

[0021] The communication circuit 140 is a circuit that communicates with the camera 200. The communication circuit 140 is, for example, a network interface card (NIC). The communication circuit 140 is also a Bluetooth connection adapter. The communication means in the communication circuit 140 may be either wireless or wired.

[0022] The accelerator 150 is, for example, a graphics processing unit (GPU) or a field programmable gate array (FPGA) that performs specific processing according to instructions from the CPU 110. The accelerator 150 is, for example, a hardware accelerator, and performs image processing, arithmetic processing, and the like.

[0023] The CPU 110 executes the hand-washing determination program 121 to configure an image section, a first detection section, a second detection section, a monitoring section, and a determination section, and to perform hand-washing determination processing. The hand-washing determination processing is processing for determining whether the target person 300 has washed his / her hands properly.

[0024] In the hand-washing determination process, the image processing device 100 acquires image data from the camera 200. Then, the image processing device 100 detects the hands of the target person 300 from the image data. Then, the image processing device 100 detects from the image data that the target person 300 is performing a process of wetting his / her hands. Then, the image processing device 100 calculates an initial value of an estimated amount of foam in the process in which the target person 300 wets his / her hands, and sets a rinse-off threshold (first threshold) based on the initial value. Furthermore, the image processing device 100 monitors the estimated amount of foam attached to the hands, and determines that the target person 300 has properly rinsed the hands when a rinse-off completion condition is satisfied.

[0025] CPU 110 executes hand detection module 1211 included in hand-washing determination program 121 to construct a first detection unit and perform hand detection processing. Hand detection processing is processing for detecting a person's hand (right hand, left hand, etc.) from image data. Image processing device 100 detects hands from an image using, for example, a convolutional neural network.

[0026] CPU 110 executes hand wetting step detection module 1212 included in hand washing determination program 121 to construct a second detection unit and perform hand wetting step detection processing. The hand wetting step detection processing is processing for detecting, from image data, whether a target person is (has) performed the step of wetting his / her hands.

[0027] CPU 110 executes initial lather volume calculation module 1213 included in hand-washing determination program 121 to construct a determination unit and perform initial lather volume calculation processing. The initial lather volume calculation processing is a process for calculating an initial value of an estimated lather volume for hands when it is detected from image data that a target person is (has) performed the process of wetting the hands. Note that in the initial lather volume calculation processing, image processing device 100 calculates, for example, initial values ​​of the estimated lather volumes for the right hand and the left hand.

[0028] The CPU 110 executes the lather amount monitoring module 1214 of the hand-washing determination program 121 to construct a monitoring section and perform lather amount monitoring processing. The lather amount monitoring processing is a processing to monitor the estimated amount of lather on the hands after detecting from the image data that the target person is (has) performed the process of wetting the hands. In the lather amount monitoring processing, the image processing device 100 monitors the estimated amount of lather on each of the right hand and the left hand.

[0029] The CPU 110 executes the rinsing determination module 1215 of the hand-washing determination program 121 to construct a determination unit and perform a rinsing determination process. The rinsing determination process is a process that compares the estimated amount of foam with a rinsing completion condition (a condition for determining that rinsing has been performed appropriately) and determines whether the rinsing completion condition is satisfied. If the rinsing completion condition is satisfied, the image processing device 100 determines that the target person 300 has been properly rinsed. The rinsing completion condition is, for example, that the estimated amount of foam is equal to or less than a rinsing threshold for a predetermined period of time.

[0030] <About hand washing judgment processing> The hand-washing determination process S100 will now be described. Fig. 3 is a diagram showing an example of a processing flowchart of the hand-washing determination process S100.

[0031] In the hand-washing determination process S100, the image processing device 100 starts acquiring images (S100-1). The images are, for example, image data captured by the camera 200, and are periodically acquired from the camera 200. The image data are, for example, video data.

[0032] The image processing device 100 waits to detect the hand of the target person from the image (No in S100-2). When the image processing device 100 detects the hand of the target person from the image (Yes in S100-2), it waits to detect the process of wetting the hand (No in S100-3). The method of detecting the process of wetting the hand will be described later. When the image processing device 100 detects the process of wetting the hand (Yes in S100-3), it calculates an initial value of the estimated amount of lather (S100-4).

[0033] FIG. 4 is a diagram showing an example of calculation of an estimated amount of lather. FIG. 4(A) is a diagram showing an example of an image at the time when lather is taken on the hand. FIG. 4(B) is a diagram showing an example of a hand region. FIG. 4(C) is a diagram showing an example of a foam region. The image processing device 100 detects a hand from the image of FIG. 4(A) and detects the hand region T1 of FIG. 4(B). Then, the image processing device 100 detects the white component in the hand region T1 as foam from the image of FIG. 4(A) and detects the foam region T2 of FIG. 4(C). Then, the image processing device 100 calculates the ratio of the area of ​​the foam region T2 to the area of ​​the hand region T1 as the estimated amount of lather.

[0034] FIG. 5 is a diagram showing an example of calculation of an estimated amount of foam when the hands are wet. As shown in FIG. 5, when the step of wetting the hands is performed, a part of the hand may appear white due to factors other than foam, such as light reflection. Since the image processing device 100 determines the white components in the hand area as estimated foam, the image processing device 100 may also determine areas T3 and T4 that appear white due to light reflection as estimated foam. Therefore, the image processing device 100 calculates an initial value of the estimated amount of foam from wetting the hands to picking up the foam. The initial value is a numerical value indicating the amount (proportion) of estimated foam at the timing when the hands are wet. The image processing device 100 uses the initial value of the estimated amount of foam to determine whether or not washing has been performed appropriately. The initial value includes, for example, the maximum value or average value of the estimated amount of foam within a predetermined time.

[0035] Returning to the process flowchart of Fig. 3, the image processing device 100 sets a wash-off threshold based on the calculated initial value (S100-5). The wash-off threshold is a threshold used as a wash-off completion condition, and is a threshold for determining whether or not the foam has been sufficiently washed off. The image processing device 100 sets the initial value or a value obtained by increasing or decreasing the initial value by a few percent as the wash-off threshold.

[0036] The image processing device 100 starts monitoring the estimated amount of foam on the hand (S100-6). During monitoring, the image processing device 100 calculates the estimated amount of foam in the hand region at each predetermined timing.

[0037] The image processing device 100 determines whether the estimated foam volume satisfies a washing-off completion condition at the timing of calculating the estimated foam volume (S100-7). The washing-off completion condition may be, for example, that the estimated foam volume is equal to or less than the washing-off threshold for a predetermined time. Alternatively, the washing-off completion condition may be, for example, that the average estimated foam volume for a predetermined time is equal to or less than the washing-off threshold.

[0038] 6 is a diagram showing an example of a change in the estimated amount of foam during hand washing. The estimated amount of foam increases during the process of wetting the hands. Image processing device 100 sets the value near the maximum increase as the initial value.

[0039] The estimated amount of foam gradually increases during the process of lathering the soap. Note that the estimated amount of foam is an estimate of the amount of foam attached to the hand, so it also increases or decreases depending on the orientation or angle of the hand. Since the hand is frequently moved during the process of lathering the soap, the estimated amount of foam may increase or decrease repeatedly, but generally shows a tendency to increase over time.

[0040] The estimated amount of foam decreases during the rinsing process. The estimated amount of foam decreases to near the initial value. When most of the foam has been rinsed away during the rinsing process, the hands are left with water. The estimated amount of foam in this state is close to the initial value measured during the wetting process.

[0041] As shown in Fig. 6, the image processing device 100 determines that rinsing has been performed appropriately when the estimated lather amount becomes equal to or less than a set rinsing threshold from the initial value based on the approximation between the estimated lather amount (initial value) during the process of wetting the hands and the estimated lather amount after rinsing is completed. Note that the image processing device 100 takes into consideration a measurement error in the estimated lather amount and sets the rinsing completion condition to be that the estimated lather amount is equal to or less than the rinsing threshold continuously for a predetermined period of time. Furthermore, the image processing device 100 may take into consideration a measurement error in the estimated lather amount and set the rinsing completion condition to be that the average estimated lather amount for a predetermined period of time is equal to or less than the rinsing threshold.

[0042] Returning to the process flowchart of FIG. 3, if the estimated foam volume satisfies the rinsing completion condition (Yes in S100-7), the image processing device 100 determines that rinsing has been properly performed (S100-8) and ends the process.

[0043] On the other hand, if the estimated amount of foam does not satisfy the rinsing completion condition (No in S100-7), the image processing device 100 judges whether or not a hand is captured in the image (S100-9). By detecting the hand, the image processing device 100 judges whether or not the target person continues to wash his / her hands.

[0044] If the image processing device 100 cannot detect the hands (No in S100-9), it considers that the target person has finished washing their hands, and if it determines that the washing was inappropriate (S100-10), ends the process.

[0045] On the other hand, if the image processing device 100 detects hands (Yes in S100-9), it determines that the target person is still washing his / her hands, and judges whether the rinsing completion condition is met (S100-7). In this way, as long as the target person continues washing his / her hands, the image processing device 100 continues to monitor the estimated amount of lather until the rinsing completion condition is met or the image processing device 100 cannot detect hands.

[0046] <Conditions for completing washing> The estimated amount of lather is calculated, for example, by integrating both hands. The image processing device 100 calculates the estimated amount of lather as the total area of ​​the right hand region and the left hand region, or the amount of lather relative to the area of ​​the overlapping hand regions of both hands. The image processing device 100 may determine that the rinsing has been properly performed based on the estimated amount of lather for both hands as the completion condition for rinsing. The image processing device 100 may determine that the rinsing in a series of hand washing has been properly performed as the total amount of estimated lather for the right hand and the left hand is equal to or less than a rinsing threshold, for example.

[0047] Further, the estimated amount of lather may be calculated for each of the right hand and the left hand, for example. The image processing device 100 calculates the amount of lather relative to the area of ​​the hand region of the right hand as the estimated amount of lather for the right hand. The image processing device 100 calculates the amount of lather relative to the area of ​​the hand region of the left hand as the estimated amount of lather for the left hand. The image processing device 100 may calculate the estimated amount of lather for each of both hands, and set the condition for completion of rinsing as being that both hands have been properly rinsed. For example, the image processing device 100 may determine whether or not rinsing has been properly performed for each of the right hand or the left hand, and set the condition for determining that rinsing in a series of hand washing has been properly performed as being that both hands have been properly rinsed.

[0048] <Detection of the process of wetting hands> The method for detecting the process of wetting the hands will be described. There are, for example, a method for detecting the process of wetting the hands (first method) based on the movement of the hands, and a method for detecting by detecting running water (second method). Each method will be described below.

[0049] <1. Detection method based on hand movements (Method 1)> 7 is a diagram showing an example of hand movement during hand washing. A flow line L1 is a line showing an example of hand movement.

[0050] When the target person starts washing his / her hands, his / her hands appear in area A1 outside the sink. The hands move along line of movement L1 and stay in area A2 in determination area T10 for a short period of time, from one second to a few seconds. At this time, the target person is in the process of wetting his / her hands. Determination area T10 is an area in which the process of wetting hands and the process of rinsing hands are assumed to be performed, and is, for example, an area set with the area under running water as its center. Then, after the process of wetting hands is completed, the hands move along line of movement L1 into area A3 outside determination area T10, for example to pick up soap.

[0051] When the hand is located within the determination area T10, the image processing device 100 determines that the hand wetting process is being performed. This allows the image processing device 100 to reduce erroneous determinations that the hand wetting process is being performed, even when the hand is located in a position where running water does not hit the hand. Note that the hand also moves into the determination area T10 during the rinsing process. Thus, the image processing device 100 determines that the hand wetting process has been performed (is being performed) when it detects that the hand remains within the determination area T10 for a predetermined time (second time) within several seconds from the start of hand washing (for example, when the hand is detected for the first time) or when it is detected for the first time after the start of hand washing. The image processing device 100 detects the hand from the image and monitors the movement of the hand, for example, using a convolutional neural network.

[0052] Whether or not the hand is located within the judgment region T10 is determined, for example, by determining whether the center of gravity (center) position of the hand is located within the judgment region T10. Alternatively, whether or not the hand is located within the judgment region T10 may be determined, for example, by determining whether or not a part of the hand region from the fingertips to the wrist is located within the judgment region T10.

[0053] In addition, in Fig. 7, the determination region T10 is a rectangle, but the determination region T10 is not limited to a rectangle. Fig. 8 is a diagram showing an example in which the determination region T10 is a polygon. The determination region T10 is set based on the range in which the hand may be located when the hand is moved under running water from the fingertips to the wrist.

[0054] <2. Detection by detecting flowing water (Method 2)> The image processing device 100 detects that the process of wetting the hands has been performed by detecting running water (the start of running water). For example, in the case of a running water system that automatically runs water using a sensor, the detection of running water is realized by receiving a notification from the running water system that running water has started in conjunction with the sensor.

[0055] Furthermore, the detection of running water may be realized, for example, by recognizing running water from an image. The image processing device 100 determines that the process of wetting the hands has been performed a predetermined time (third time) after the detection of running water. The predetermined time is assumed to be a time during which the process of wetting the hands is performed, and is a short time such as one second. The image processing device 100 detects running water from an image using, for example, a convolutional neural network.

[0056] The process of wetting the hands may be detected using both the first method and the second method. For example, the image processing device 100 may regard detection by both the first method and the second method as detection of the process of wetting the hands. The image processing device 100 may also regard detection by at least one of the first method and the second method as detection of the process of wetting the hands.

[0057] [Other embodiments] Other embodiments will be described. Fig. 9 is a diagram showing an example of a process of washing hands. For example, when a target person starts washing hands, as shown in Fig. 9, the target person first performs a process of wetting the hands. In the process of wetting the hands, running water is performed. Then, in the process of lathering soap, running water is stopped. Furthermore, in the process of rinsing, running water is performed again. The image processing device 100 needs to distinguish between the process of wetting the hands, where running water is performed, and the rinsing process, so as not to erroneously recognize it.

[0058] For example, the image processing device 100 does not monitor the estimated foam amount for a predetermined time after detecting the initial value (rinsing threshold), thereby excluding the process of wetting the hands from the monitoring target.

[0059] Furthermore, in a system where water is automatically (by a sensor or the like) run, the image processing device 100 may stop running water during lathering. In this case, the image processing device 100 can detect running water in the process of wetting the hands, detect that the running water has stopped during lathering, and then detect running water in the rinsing process. The image processing device 100 may start monitoring the estimated foam volume when it detects running water for rinsing (the second time running water in a series of hand washing).

[0060] To summarise the above, the following is added:

[0061] (Appendix 1) An image unit for acquiring an image of a washroom; a first detection unit that detects a person's hand from the image; A monitoring unit for monitoring an estimated amount of foam, which indicates an amount of foam estimated to be attached to the hand; A second detection unit that detects a process of wetting the person's hands when washing their hands; and a determination unit that sets a first threshold based on the estimated amount of foam in the hand wetting step, and determines that the foam has been properly rinsed off in the hand washing step when the estimated amount of foam is equal to or less than the first threshold for a first period of time. Handwashing recognition device.

[0062] (Appendix 2) The second detection unit determines that the step of wetting the hand is being performed when the time during which the hand is located within the determination area exceeds a second time. 2. A hand-washing recognition device as described in appended claim 1.

[0063] (Appendix 3) The determination area includes a range that is set according to a position where water is flushed in the washbasin. 4. A hand-washing recognition device as described in appended claim 2.

[0064] (Appendix 4) The second detection unit determines that the step of wetting the hands is being performed three hours after detecting running water in the hand-washing area. 2. A hand-washing recognition device as described in appended claim 1.

[0065] (Appendix 5) The second detection unit detects the running water by acquiring information that running water has started from a running water system that automatically runs water. 5. A hand-washing recognition device as described in appended claim 4.

[0066] (Appendix 6) The second detection unit detects the flowing water from the image. 5. A hand-washing recognition device as described in appended claim 4.

[0067] (Appendix 7) The monitoring unit determines that a white component located within the hand area is the estimated foam. 2. A hand-washing recognition device as described in appended claim 1.

[0068] (Appendix 8) Acquire an image of the washroom, Detecting a person's hands from the image; monitoring an estimated amount of lather indicative of an estimated amount of lather adhering to said hands; Detecting a process of wetting the person's hands during hand washing; A first threshold is set based on the estimated amount of foam in the hand wetting step, and when the estimated amount of foam is equal to or less than the first threshold for a first period of time, it is determined that the foam has been properly rinsed off during the hand washing step. Hand washing recognition method.

[0069] (Appendix 9) acquiring an image of a hand washing area; detecting a person's hand from the image; monitoring an estimated lather volume indicative of an estimated amount of lather estimated to be deposited on said hands; detecting a process of wetting the person's hands during hand washing; setting a first threshold based on the estimated amount of lather in the wetting step, and judging that lather has been properly rinsed off in the hand washing step when the estimated amount of lather is equal to or less than the first threshold for a first period of time; A hand-washing recognition program that causes a computer to execute the above.

[0070] (Appendix 10) A photographing device for photographing an image of a washroom; acquiring the image from the imaging device; Detecting a person's hands from the image; monitoring an estimated amount of lather indicative of an estimated amount of lather adhering to said hands; Detecting a process of wetting the person's hands during hand washing; an image processing device that sets a first threshold based on the estimated amount of foam in the hand wetting step, and determines that the foam has been properly rinsed off in the hand washing step when the estimated amount of foam is equal to or less than the first threshold for a first period of time; A hand washing recognition system having [Explanation of symbols]

[0071] 10: Hand-washing recognition system 100: Image processing device 110: CPU 120: Storage 121: Hand-washing assessment program 1211: Hand detection module 1212: Hand wetting process detection module 1213: Foam volume initial value calculation module 1214: Foam volume monitoring module 1215: Washing off judgment module 130: Memory 140: Communication circuit 150: Accelerator 200: Camera 300: Target person

Claims

1. An image unit for acquiring an image of a washroom; a first detection unit that detects a person's hand from the image; A monitoring unit for monitoring an estimated amount of foam, which indicates an amount of foam estimated to be attached to the hand; a second detection unit that detects a process of wetting the person's hands while washing their hands; a determination unit that sets a first threshold based on the estimated amount of foam in the hand wetting step, and determines that the foam has been properly rinsed off in the hand washing step when the estimated amount of foam is equal to or less than the first threshold for a first period of time. Handwashing recognition device.

2. The second detection unit determines that the step of wetting the hand is being performed when a time during which the hand is located within the determination area exceeds a second time. The hand-washing recognition device according to claim 1.

3. The determination area includes a range that is set according to a position where water is flushed in the washbasin. The hand-washing recognition device according to claim 2.

4. The second detection unit determines that the hand wetting process is being performed three hours after detecting running water in the hand washing area. The hand-washing recognition device according to claim 1.

5. The monitoring unit determines that a white component located within the hand area is the estimated foam. The hand-washing recognition device according to claim 1.

6. Acquire an image of the washroom, Detecting a person's hands from the image; monitoring an estimated amount of lather indicative of an estimated amount of lather adhering to said hands; Detecting a process of wetting the person's hands during hand washing; A first threshold is set based on the estimated amount of foam in the hand wetting step, and when the estimated amount of foam is equal to or less than the first threshold for a first period of time, it is determined that the foam has been properly rinsed off during the hand washing step. Hand washing recognition method.

7. acquiring an image of a hand washing area; detecting a person's hand from the image; monitoring an estimated lather volume indicative of an estimated amount of lather estimated to be deposited on said hands; detecting a process of wetting the person's hands during hand washing; setting a first threshold based on the estimated amount of lather in the wetting step, and judging that lather has been properly rinsed off in the hand washing step when the estimated amount of lather is equal to or less than the first threshold for a first period of time; A hand-washing recognition program that causes a computer to execute the above.

8. A photographing device for photographing an image of a washroom; acquiring the image from the imaging device; Detecting a person's hands from the image; monitoring an estimated amount of lather indicative of an estimated amount of lather adhering to said hands; Detecting a process of wetting the person's hands during hand washing; an image processing device that sets a first threshold based on the estimated amount of foam in the wetting of the hands, and determines that the foam has been properly rinsed off in the hand washing process when the estimated amount of foam is equal to or less than the first threshold for a first period of time; A hand washing recognition system having

Citation Information

Patent Citations

  • Hygiene management system, mixture, and discharge vessel

    JP2016186438A

  • Water discharge device

    JP2016211268A

  • Monitoring system, monitoring method, and program

    JP2017012597A

  • Method for bubbles projection mapping

    JP2018200393A

  • Automatic finger washing device

    JP2020048628A