Hand-washing recognition device, hand-washing recognition method, hand-washing recognition program, and hand-washing recognition system
The hand washing recognition system monitors hand movements to ensure thorough rinsing, addressing the inefficiencies in existing hand washing methods by accurately determining proper hand washing completion.
Patent Information
- Application Number
- JP2021061297
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-31
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2041-03-31
AI Technical Summary
Existing hand washing methods fail to effectively remove soap suds and bacteria, leading to potential hygiene issues due to residual bacteria and dirt on the skin surface.
A hand washing recognition system utilizing an image processing device to monitor hand movements through a camera, determining proper hand washing by analyzing the movement of the hand's center of gravity to ensure soap suds are adequately rinsed off.
The system accurately assesses whether hand washing is properly performed, ensuring effective removal of soap suds and bacteria, thereby enhancing hygiene standards.
Smart Images

Figure 0007583275000001 
Figure 0007583275000002 
Figure 0007583275000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system. [Background technology]
[0002] In recent years, the importance of hand washing as an infection prevention measure has been reconsidered due to the spread of viruses and pathogens. For example, in food handling sites, hospitals, and nursing homes, hygiene management of workers is particularly important, and hand washing is a common practice. In particular, there is an international standard for hygiene management records, HACCP, which is aimed at food-related businesses, and requires checking, monitoring, and recording of hygiene management actions.
[0003] Techniques relating to hand washing are disclosed below. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2016-211268 A [Patent Document 2] JP 2020-048628 A [Patent Document 3] JP 2020-091739 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, when washing hands, for example, the surfactant action of soap lifts bacteria and dirt from the surface of the skin, trapping them in the soap bubbles. In other words, the soap bubbles after hand washing contain a large amount of bacteria and dirt. Therefore, if the soap bubbles are not washed off thoroughly (the act of washing off the bubbles that adhere to the hands with running water), bacteria and dirt will remain on the surface of the hands. Also, if the soap bubbles are not washed off thoroughly, the bacteria and dirt will spread due to rubbing of the hands, and the hands may become less hygienic than before hand washing.
[0006] Therefore, one disclosure provides a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system that determine whether washing has been performed properly. [Means for solving the problem]
[0007] The device has an image unit that acquires an image, a detection unit that detects a person's hands from the image, a monitoring unit that monitors the detected movement of the hands, and a judgment unit that judges that the foam has been properly rinsed off during hand washing when the amount of movement of the hands becomes equal to or greater than a first threshold value. Effect of the Invention
[0008] One disclosure provides a hand-washing recognition device, a hand-washing recognition method, a hand-washing recognition program, and a hand-washing recognition system that determine whether or not washing has been properly performed when washing hands. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a hand-washing recognition system 10. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of the image processing device 100. [Diagram 3] FIG. 3 is a diagram showing an example of a process flowchart of the hand-washing determination process S100. [Figure 4] FIG. 4 is a diagram showing an example of the center of gravity of a hand. [Diagram 5]FIG. 5 is a diagram showing an example of the movement of the center of gravity during washing off. [Figure 6] FIG. 6 is a diagram showing an example of the movement of the center of gravity during whipping. [Figure 7] FIG. 7 is a diagram showing an example of a monitoring range. [Figure 8] FIG. 8 is a diagram showing an example of image data when the hands are apart. [Figure 9] FIG. 9 is a diagram showing an example in which a hand is detected as a rectangle. [Figure 10] FIG. 10 is a diagram showing an example of a hand-washing process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] [First embodiment] A first embodiment will be described.
[0011] <Example of the configuration of hand-washing recognition system 10> 1 is a diagram showing an example of the configuration of a hand-washing recognition system 10. The hand-washing recognition system 10 includes an image processing device (hand-washing recognition device) 100 and a camera 200. The hand-washing recognition system 10 analyzes image data of a video captured by the camera 200, and judges whether or not a target person properly rinsed their hands.
[0012] The camera 200 is an imaging device that captures the hands of a target person in a washbasin. The camera 200 is installed in a place where a person washes his / her hands, such as a toilet or a kitchen, and captures the hands of the target person with a focus on the washbasin such as a sink. The camera 200 is connected to the image processing device 100, for example, via a wire (such as a network cable) or wirelessly (such as Bluetooth (registered trademark)), and transmits captured image data to the image processing device 100. The camera 200, for example, captures a moving image as an image, and continuously transmits the moving image data of a predetermined data size or a predetermined time to the image processing device 100. The camera 200 also captures the moving image constantly or periodically. Furthermore, the camera 200 may capture a series of still images instead of the moving image.
[0013] The target person 300 is a person who is washing his / her hands, and is a person who is the subject of a judgment as to whether or not the washing has been properly performed. The target person 300 washes his / her hands with soap at a hand-washing area.
[0014] The image processing device 100 is a device that analyzes video data acquired from a camera 200 and determines whether or not a target person 300 appearing in the video data has been properly washed off, and is, for example, a computer or a server machine.
[0015] In the hand-washing recognition system 10, the camera 200 transmits captured image data to the image processing device 100. The image processing device 100 detects that the hand of the target person 300 is captured in the image data. The image processing device 100 then monitors the movement of the hand of the target person 300, and determines whether the target person 300 has properly washed the hand based on the amount of hand movement (movement distance, movement range, etc.). Note that the hand movement is monitored by, for example, monitoring the movement of the center of gravity of the hand.
[0016] <Configuration example of image processing device 100> 2 is a diagram illustrating an example of the configuration of the image processing device 100. The image processing device 100 includes a CPU (Central Processing Unit) 110, a storage 120, a memory 130, a communication circuit 140, and an accelerator 150.
[0017] The storage 120 is an auxiliary storage device that stores programs and data, such as a flash memory, a hard disk drive (HDD), a solid state drive (SSD), etc. The storage 120 stores a hand-washing determination program 121.
[0018] The memory 130 is an area into which the programs stored in the storage 120 are loaded. The memory 130 may also be used as an area in which the programs store data.
[0019] The CPU 110 is a processor that loads a program stored in the storage 120 into the memory 130, executes the loaded program, configures each unit, and realizes each process.
[0020] The communication circuit 140 is a circuit that communicates with the camera 200. The communication circuit 140 is, for example, a network interface card (NIC). The communication circuit 140 is also a Bluetooth connection adapter. The communication means in the communication circuit 140 may be either wireless or wired.
[0021] The accelerator 150 is, for example, a graphics processing unit (GPU) or a field programmable gate array (FPGA) that performs specific processing according to instructions from the CPU 110. The accelerator 150 is, for example, a hardware accelerator, and performs image processing, arithmetic processing, and the like.
[0022] The CPU 110 executes the hand-washing determination program 121 to configure an image section, a detection section, a monitoring section, and a determination section, and to perform hand-washing determination processing. The hand-washing determination processing is processing for determining whether the target person 300 has washed his / her hands properly.
[0023] In the hand-washing determination process, the image processing device 100 acquires image data from the camera 200. Then, the image processing device 100 detects the hands of the target person 300 from the image data. Then, the image processing device 100 monitors the movement of the hands, and determines whether or not the target person 300 has properly washed the hands based on the monitoring result (the amount of hand movement).
[0024] CPU 110 executes hand detection module 1211 included in hand-washing determination program 121 to construct a detection unit and perform hand detection processing. The hand detection processing is processing for detecting a person's hands (both overlapping hands, a right hand, a left hand, etc.) from image data.
[0025] CPU 110 executes center-of-gravity position monitoring module 1212 included in hand-washing determination program 121 to construct a monitoring unit and perform center-of-gravity position monitoring processing. The center-of-gravity position monitoring processing is processing for calculating the center of gravity of the hand detected in the hand detection processing and monitoring the movement of the center of gravity. The monitoring result of the movement of the center of gravity includes, for example, the distance the center of gravity has moved, the range of movement of the center of gravity, or the movement time during which the center of gravity has moved. In addition, the monitoring result of the movement of the center of gravity includes, for example, the progress of monitoring the movement of the center of gravity (the monitoring result at a certain timing).
[0026] The CPU 110 executes the rinse-off determination module 1213 of the hand-washing determination program 121 to construct a determination unit and perform a rinse-off determination process. The rinse-off determination process is a process for comparing the monitoring result of the movement of the center of gravity with a rinse-off completion condition (a condition for determining that the rinse-off has been properly performed) and determining whether or not the rinse-off completion condition is satisfied. If the rinse-off completion condition is satisfied, the image processing device 100 determines that the target person 300 has been properly rinsed.
[0027] <About hand washing judgment processing> The hand-washing determination process S100 will now be described. Fig. 3 is a diagram showing an example of a processing flowchart of the hand-washing determination process S100.
[0028] In the hand-washing determination process S100, the image processing device 100 starts acquiring images (S100-1). The images are, for example, image data captured by the camera 200, and are periodically acquired from the camera 200. The image data are, for example, video data.
[0029] The image processing device 100 waits for the detection of the hand of the target person from the image (No in S100-2). When the image processing device 100 detects the hand of the target person from the image (Yes in S100-2), it starts monitoring the movement of the center of gravity of the hand (S100-3).
[0030] Fig. 4 is a diagram showing an example of the center of gravity of a hand. Fig. 4(A) is an example of an image of a hand at a certain timing. Fig. 4(B) is a diagram showing an example of a hand region and center of gravity. Image processing device 100 detects hand region T1 (e.g., including from fingertips to wrist) from Fig. 4(A) to Fig. 4(B). Then, image processing device 100 calculates center of gravity C1 of hand region T1.
[0031] The center of gravity includes, for example, a point near the center of overlapping hands when the hands are overlapped, for example, when both hands overlap by a predetermined ratio or more. In general, when a target person washes off, the target person often washes off the foam from one hand with the other hand. Therefore, the image processing device 100 monitors the center of gravity of the overlapping hands, assuming that the target person moves the area where the foam is to be washed off (from the fingertips to the wrist) under the water flow while maintaining the overlapping state of the hands.
[0032] The center of gravity includes, for example, a dynamic center of gravity (a dynamic center of gravity in a solid) when it is assumed that the object has uniform density. The center of gravity also includes, for example, a point (a balance point in a plane) that can support the hand region T1 of uniform density in a balanced manner. Furthermore, the center of gravity may be, for example, any point present in the hand region. Furthermore, the center of gravity may be, for example, a point on the surface of the hand (palm, back of the hand, etc.) or a point inside the hand. The image processing device 100 may monitor any point in the hand region as long as it can monitor the movement of the hand (distance, range, time, etc.).
[0033] Returning to the processing flowchart of Fig. 3, the image processing device 100 judges whether the movement of the center of gravity satisfies a wash-off completion condition (S100-4). The image processing device 100 makes the judgment in process S100-4 based on the monitoring result of the movement of the center of gravity. The wash-off completion condition is, for example, that the movement distance of the center of gravity (the total movement distance) is equal to or greater than a movement distance threshold.
[0034] Fig. 5 is a diagram showing an example of the movement of the center of gravity during washing. Fig. 5(A) is an image in which, for example, foam on the back of the left hand is washed away with the right hand. Fig. 5(B) is an image in which, for example, foam on the wrist of the right hand is washed away with the left hand. Fig. 5(B) is an image captured a predetermined time after the image capture timing of Fig. 5(A).
[0035] In Fig. 5(A), the image processing device 100 detects (calculates) the center of gravity C1-1. In Fig. 5(B), the image processing device 100 detects (calculates) the center of gravity C1-2. The image processing device 100 determines that the center of gravity has moved from the position of center of gravity C1-1 to the position of center of gravity C1-2 over the time lapse from Fig. 5(A) to Fig. 5(B), and calculates the movement distance M12. The image processing device 100 calculates the movement distance of the center of gravity at a predetermined timing interval, for example, and calculates the total value of the movement distance. The image processing device 100 determines that the movement distance M12 is equal to or greater than the movement distance threshold, and determines that washing has been performed appropriately.
[0036] The movement distance threshold is calculated, for example, by collecting multiple samples of hand-washing videos in which the hand is washed appropriately, based on the movement distance when the hand is washed sufficiently. The movement distance threshold may be selected, for example, based on the highest F-value (an index that comprehensively evaluates accuracy and comprehensiveness). For example, the F-value is expressed by the following formula 1. (Formula 1) F-score = (2* precision * recall) / (precision + recall)
[0037] The recall is calculated by dividing the number of correct answers by the number of samples, and the precision is calculated by dividing the number of correct answers by the number of detections. The number of correct answers is, for example, the number of times that the image processing device 100 can correctly determine that "washing was performed appropriately."
[0038] The distance traveled by the center of gravity during rinsing is compared with the distance traveled by the center of gravity during lathering. Lathering is a hand-washing process that is performed before rinsing, in which soap is spread from the fingertips to the wrists to remove bacteria and other contaminants from the skin.
[0039] Fig. 6 is a diagram showing an example of the movement of the center of gravity when whipping. Fig. 6(A) is an image of, for example, rubbing the palms of the right and left hands together. Fig. 6(B) is an image of, for example, spreading foam on the wrist of the right hand with the left hand. Fig. 6(B) is an image captured a predetermined time after the image of Fig. 6(A).
[0040] In Fig. 6(A), the image processing device 100 detects the center of gravity C1-3. In Fig. 6(B), the image processing device 100 detects the center of gravity C1-4. The image processing device 100 determines that the center of gravity has moved from the position of the center of gravity C1-3 to the position of the center of gravity C1-4 over the time lapse from Fig. 6(A) to Fig. 6(B), and calculates the movement distance M34.
[0041] Comparing the movement distance M12 in the rinsing process with the movement distance M34 in the lathering process, the movement distance M12 is larger. This is assumed to be due to, for example, the position of the running water and the relationship between each process. In the lathering process, the subject can spread the lather on the hands and wrists in roughly the same position without moving the position of the hands. However, in the rinsing process, the subject needs to move the washing area to near the bottom of the running water. That is, in rinsing, when washing thoroughly from the fingertips to the wrist, for example, the arm is moved to move the hand so that the fingertips to the wrist pass under the running water, and therefore the movement distance of the center of gravity tends to be larger than that in the lathering process.
[0042] Therefore, if the movement distance of the center of gravity is smaller than the movement distance threshold, the image processing device 100 determines that washing has not been performed properly, for example, by determining that the wrist has not been washed away or that washing has not yet been performed.
[0043] Returning to the processing flowchart of FIG. 3, if the movement of the center of gravity satisfies the washing-off completion condition (Yes in S100-4), the image processing device 100 determines that washing-off has been properly performed (S100-5) and ends the processing.
[0044] On the other hand, if the movement of the center of gravity does not satisfy the washing completion condition (No in S100-4), the image processing device 100 judges whether or not a hand is captured in the image (S100-6). By detecting the hand, the image processing device 100 judges whether or not the target person continues washing his / her hands.
[0045] If the image processing device 100 cannot detect the hands (No in S100-6), it considers that the target person has finished washing their hands, and if it determines that the washing was inappropriate (S100-7), it ends the process.
[0046] On the other hand, if the image processing device 100 detects a hand (Yes in S100-6), it determines that the target person is still washing his / her hands, and judges whether the washing completion condition is met (S100-4). In this way, as long as the target person continues washing his / her hands, the image processing device 100 continues to monitor the center of gravity until the washing completion condition is met or the hand can no longer be detected.
[0047] <Conditions for completing washing> The washing completion condition may be the following condition other than that the movement distance of the center of gravity is equal to or greater than the movement distance threshold value described above.
[0048] The washing-off condition may be that the movement range of the center of gravity is equal to or greater than a movement range threshold. A wide movement range of the center of gravity means that the range over which the hand has moved is wide, and it can be considered that running water is being poured over a wide area of the hand to wash it off. In other words, when the movement range of the center of gravity is equal to or greater than the movement range threshold, the image processing device 100 determines that there is a high possibility that the foam has been properly washed off, and determines that washing has been properly performed.
[0049] As a method for measuring the movement range, the area of the overlapping area of the hand area during a certain period of time in the past may be used instead of the movement of the center of gravity. For example, the image processing device 100 may obtain the hand area from an image, calculate the movement area of the hand area during the certain period of time in the past, and compare this movement area with a movement range threshold.
[0050] The washing-off condition may be that the movement time of the center of gravity is equal to or greater than a movement time threshold. A long movement time of the center of gravity means that the hand has been moving for a long time, and washing-off can be considered to have been performed for a long time. In other words, when the movement time of the center of gravity is equal to or greater than the movement time threshold, the image processing device 100 determines that there is a high possibility that the foam has been properly washed off, and determines that washing-off has been performed properly.
[0051] Furthermore, when measuring the above-mentioned moving distance, moving range, moving time, etc. as a washing-off completion condition, the image processing device 100 may measure only when the center of gravity is located within a certain range. FIG. 7 is a diagram showing an example of a range to be monitored. FIG. 7(A) is a diagram showing an example of a rectangular range T8, and FIG. 7(B) is a diagram showing an example of a polygonal range T9. Both are ranges centered on the position where water is flowing, and when the movement of the center of gravity is performed within the range, it is a range in which it can be considered that running water is on the hand. The image processing device 100 measures (monitors) the moving distance, moving range, moving time, etc. only when the center of gravity of the hand is located within the range shown in FIG. 7, thereby excluding the timing when the running water is not applied and detecting the washing-off process more accurately.
[0052] <About judgment when hands are apart> When washing hands, the subject may perform a motion that involves releasing the hand. For example, the subject may perform a motion with one hand, such as taking soap or turning on the faucet.
[0053] Fig. 8 is a diagram showing an example of image data when the hands are separated. Fig. 8(A) is a diagram showing an example after soap has been taken into the hand. The target person is expected to take soap into his / her right hand and start lathering it. Fig. 8(B) is a diagram showing an example of a right hand region T11 and a left hand region T12. As shown in Fig. 8(B), since the two hand regions are separated, the image processing device 100 can determine that the hands are separated.
[0054] As described above, it is assumed that rinsing is often performed by using one hand to rinse off the foam from the other hand. Based on this assumption, image processing device 100 determines that rinsing is not being performed when the hands are separated.
[0055] There may be cases where the target person removes his / her hands and washes them one by one. In anticipation of this case, the image processing device 100 may monitor, for example, the movement of the left hand and the right hand, respectively. For example, the image processing device 100 may determine that washing is being performed when the center of gravity of one of the hands is present within the range of Fig. 7 described above, and may determine that washing has been properly performed when it is determined that washing of both hands has been completed.
[0056] <How hand movement is detected> The image processing device 100 may detect the hand region as a rectangle instead of the hand region, calculate the degree of overlap of the rectangle, and determine that the hands are overlapping when the degree of overlap is equal to or greater than a predetermined value. The image processing device 100 may also regard the midpoint of the center of gravity of each rectangle as the center of gravity. FIG. 9 is a diagram showing an example of a case where the hands are detected as a rectangle. FIG. 9(A) is a diagram showing an example where the hands are determined to be overlapping. FIG. 9(A) is a diagram showing an example where the hands are determined to be overlapping when the degree of overlap between the left hand L1 and the right hand R1 is equal to or greater than a predetermined value, and the hands are determined to be overlapping. FIG. 9(B) is a diagram showing an example where the hands are determined to be not overlapping. FIG. 9(B) is a diagram showing an example where the degree of overlap between the left hand L2 and the right hand R2 is equal to or less than a predetermined value, and the hands are determined to be not overlapping.
[0057] The following is a summary as follows:
[0058] [Other embodiments] Other embodiments will be described. FIG. 10 is a diagram showing an example of a hand-washing process. For example, when a target person starts washing his / her hands, as shown in FIG. 10, he / she first performs "rinsing" by wetting his / her hands. As described above, the image processing device 100 can distinguish between soap lathering and rinsing and determine the appropriateness of rinsing by monitoring the movement of the center of gravity. However, in this rinsing process, the target person may perform a movement similar to rinsing, such as pouring water up to the wrist. Therefore, the image processing device 100 needs to set the rinsing process as a non-monitoring period in which the movement of the center of gravity is not monitored.
[0059] For example, the image processing device 100 excludes the rinsing process from the monitoring target by not monitoring the movement of the center of gravity for a predetermined time after the detection of the hand. In general, the time required for the rinsing process is expected to be shorter than the subsequent lathering and rinsing processes.
[0060] Furthermore, the image processing device 100 may start monitoring the movement of the center of gravity after detecting the action of picking up soap, which is an action expected to be performed between rinsing and lathering. The action of picking up soap is expected to be performed with one hand (or one hand at a time in turn), and the hand is expected to be released. For example, the image processing device 100 may start monitoring the movement of the center of gravity after detecting that the hand has been released.
[0061] Furthermore, the image processing device 100 may monitor running water in addition to hand movements. For example, in a system where running water is automatic (by a sensor or the like), the running water may stop during lathering. In this case, the image processing device 100 can detect running water during rinsing, detect that the running water has stopped during lathering, and then detect running water during rinsing. The image processing device 100 may start monitoring hand movements when it detects running water during rinsing.
[0062] To summarise the above, the following is added:
[0063] (Appendix 1) an imaging unit for acquiring an image; a detection unit for detecting a person's hand from the image; a monitoring unit that monitors the detected hand movement; and a determination unit that determines that the foam has been properly rinsed off when the amount of movement of the hand is equal to or greater than a first threshold value. Handwashing recognition device.
[0064] (Appendix 2) The movement amount includes a movement distance of the hand. 2. A hand-washing recognition device as described in appended claim 1.
[0065] (Appendix 3) The amount of movement includes a range in which the hand has moved. 2. A hand-washing recognition device as described in appended claim 1.
[0066] (Appendix 4) The monitoring unit sets an effective range based on the location where water is flowing, and performs the monitoring when the hand is located within the effective range. 2. A hand-washing recognition device as described in appended claim 1.
[0067] (Appendix 5) The detection unit detects that the person's hands are overlapped at a predetermined ratio or more, The monitoring unit monitors the movement of the hands when the overlapping of the person's hands is equal to or greater than the predetermined ratio. 2. A hand-washing recognition device as described in appended claim 1.
[0068] (Appendix 6) The monitoring unit calculates a center of gravity of the hand and monitors a movement of the center of gravity as a movement of the hand. 2. A hand-washing recognition device as described in appended claim 1.
[0069] (Appendix 7) The detection unit detects that the hand is no longer visible in the image, The determination unit determines that the foam has not been properly rinsed off during hand washing when the amount of movement of the hand does not become equal to or greater than the first threshold value until the hand is no longer visible in the image. 2. A hand-washing recognition device as described in appended claim 1.
[0070] (Appendix 8) The detection unit detects a left hand and a right hand of the person, The monitoring unit monitors the movements of the left hand and the right hand, The determination unit determines that the foam has been properly rinsed off during the hand washing when both the amount of movement of the left hand and the amount of movement of the right hand are equal to or greater than the first threshold value. 2. A hand-washing recognition device as described in appended claim 1.
[0071] (Appendix 9) The monitoring unit does not monitor the movement of the hands when the overlapping of the person's hands is smaller than the predetermined ratio. 6. A hand-washing recognition device as described in appended claim 5.
[0072] (Appendix 10) Acquire an image, Detecting a person's hands from the image; monitoring the detected hand movements; When the amount of movement of the hand is equal to or greater than a first threshold, it is determined that the foam has been properly rinsed off during hand washing. Hand washing recognition method.
[0073] (Appendix 11) an image acquisition step of acquiring an image; a detection step of detecting a person's hand from the image; a monitoring step of monitoring the detected hand movement; A determination step of determining that the foam has been properly rinsed off during hand washing when the amount of movement of the hand becomes equal to or greater than a first threshold value; A hand-washing recognition program that causes a computer included in the image processing device to execute the above.
[0074] (Appendix 12) A camera for taking images; an image processing device that acquires an image from the camera, detects a person's hands from the image, monitors movement of the detected hands, and determines that the foam has been properly rinsed off when the amount of movement of the hands becomes equal to or greater than a first threshold; A hand washing recognition system having [Explanation of symbols]
[0075] 10: Recognition system 100: Image processing device 110: CPU 120: Storage 121: Judgment program 130: Memory 140: Communication circuit 150: Accelerator 200: Camera 300: Target person 1211: Hand detection module 1212: Center of gravity position monitoring module 1213: Flow detection module
Claims
1. an imaging unit for acquiring an image; a detection unit for detecting a person's hand from the image; a monitoring unit that monitors the detected hand movement; and a determination unit that determines that the foam has been properly rinsed off when the amount of movement of the hand is equal to or greater than a first threshold value. Handwashing recognition device.
2. The movement amount includes a movement distance of the hand. The hand-washing recognition device according to claim 1.
3. The amount of movement includes a range in which the hand has moved. The hand-washing recognition device according to claim 1.
4. The monitoring unit sets an effective range based on the location where water is flowing, and performs the monitoring when the hand is located within the effective range. The hand-washing recognition device according to claim 1.
5. The detection unit detects that the person's hands are overlapped at a predetermined ratio or more, The monitoring unit monitors the movement of the hands when the overlapping of the person's hands is equal to or greater than the predetermined ratio. The hand-washing recognition device according to claim 1.
6. The detection unit detects that the hand is no longer visible in the image, The determination unit determines that the foam has not been properly rinsed off during hand washing when the amount of movement of the hand does not become equal to or greater than the first threshold value until the hand is no longer visible in the image. The hand-washing recognition device according to claim 1.
7. The detection unit detects a left hand and a right hand of the person, The monitoring unit monitors the movements of the left hand and the right hand, The determination unit determines that the foam has been properly rinsed off during the hand washing when both the amount of movement of the left hand and the amount of movement of the right hand are equal to or greater than the first threshold value. The hand-washing recognition device according to claim 1.
8. Acquire an image, Detecting a person's hands from the image; monitoring the detected hand movements; When the amount of movement of the hand becomes equal to or greater than a first threshold, it is determined that the foam has been properly rinsed off during hand washing. Hand washing recognition method.
9. an image acquisition step of acquiring an image; a detection step of detecting a person's hand from the image; a monitoring step of monitoring the detected hand movement; a determining step of determining that the foam has been properly rinsed off during hand washing when the amount of movement of the hand becomes equal to or greater than a first threshold value; A hand-washing recognition program that causes a computer possessed by the image processing device to execute the above.
10. A camera for taking images; an image processing device that acquires an image from the camera, detects a person's hands from the image, monitors movement of the detected hands, and determines that the foam has been properly rinsed off when the amount of movement of the hands becomes equal to or greater than a first threshold; A hand washing recognition system having
Citation Information
Patent Citations
Water discharge device
JP2016211268A
Finger hygiene management device, finger hygiene management system, and finger hygiene management method
JP2018117981A
Method for bubbles projection mapping
JP2018200393A
Automatic finger washing device
JP2020048628A
Procedure detection device and procedure detection program
JP2020091739A
