Hygiene management device and program

Abstract

To provide a hygiene management device, hygiene management method and program, which can ensure that people follow a prescribed hand-washing procedure.SOLUTION: A hygiene management device according to an embodiment comprises a recognition unit and execution unit. The recognition unit recognizes performance of constituent actions that make up a hand-washing procedure by a target person using image recognition. The execution unit executes different processing depending on whether or not predetermined multiple constituent actions were performed by the target person.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to a sanitation management device, a sanitation management method, and a program. [Background technology]

[0002] In food factories and the like, hygiene-controlled areas (clean areas) are separated from non-clean areas, and when entering a clean area from a non-clean area, workers are required to follow hygiene control procedures, including hand washing. Similarly, in hospitals, shops, restaurants, nursing care facilities, and educational facilities, workers are often required to wash their hands properly in order to prevent infectious diseases and maintain hygienic conditions. In such places where hygiene control is required, workers, staff, and other people entering and leaving the place are required to wash their hands properly. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-99968 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the embodiments of the present invention is to provide a hygiene management device, a hygiene management method, and a program that can perform a predetermined hand-washing action. [Means for solving the problem]

[0005] The hygiene management device of the embodiment includes a recognition unit and an execution unit. The recognition unit recognizes that a subject has performed constituent actions that constitute a hand-washing action by using image recognition. The execution unit executes different processes depending on whether the subject has performed a plurality of predetermined constituent actions. [Brief description of the drawings]

[0006] [Figure 1] 1 is a diagram showing an overview of a hygiene management system according to an embodiment. [Diagram 2] 1 is a block diagram showing an example of a main configuration of a hygiene management system according to an embodiment and components included in the hygiene management system; [Diagram 3] 3 is a flowchart showing an example of processing by a processor in FIG. 2; [Figure 4] 3 is a flowchart showing an example of processing by a processor in FIG. 2; [Diagram 5] FIG. 3 is a diagram showing an example of an overall procedure screen displayed on the display device in FIG. 2. [Figure 6] FIG. 3 is a diagram showing an example of a first procedure screen displayed on the display device in FIG. 2; [Figure 7] 3 is a diagram showing an example of a second procedure screen displayed on the display device in FIG. 2; [Figure 8] 3 is a diagram showing an example of a second procedure screen displayed on the display device in FIG. 2; [Figure 9] 3 is a diagram showing an example of a third overall procedure screen displayed on the display device in FIG. 2; [Figure 10] FIG. 3 is a diagram showing an example of a result screen displayed by the display device in FIG. 2. [Figure 11] FIG. 3 is a diagram showing an example of a result screen displayed by the display device in FIG. 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, a hygiene management system according to an embodiment will be described with reference to the drawings. Note that the scale of each part in each drawing used in the following description of the embodiment may be changed as appropriate. Also, for the purpose of explanation, each drawing used in the following description of the embodiment may be shown with the configuration omitted. Also, in each drawing and in this specification, the same reference numerals indicate similar elements.

[0008] FIG. 1 is a diagram showing an overview of a hygiene management system according to an embodiment. FIG. 2 is a block diagram showing an example of a hygiene management system 1 according to an embodiment and a main configuration of components included in the hygiene management system 1. As shown in FIG. 1, the hygiene management system 1 is installed in a place where hands are washed, such as a washbasin S. The hygiene management system 1 is a system that photographs an object washing hands and recognizes the object's hand-washing action by image recognition. The hygiene management system 1 includes, as an example, a control device 100, an imaging device 200, an input device 300, a display device 400, an audio output device 500, a passage control device 600, and a lighting device 700.

[0009] The control device 100 is a device that controls the sanitation management system 1. The control device 100 is, for example, a computer such as a PC (personal computer) or a server. The control device 100 includes, for example, a processor 101, a ROM (read-only memory) 102, a RAM (random-access memory) 103, an auxiliary storage device 104, and a communication interface 105. A bus 106 and the like connect these components. The control device 100 is an example of a sanitation management device.

[0010] The processor 101 corresponds to the central part of a computer that performs processes such as calculations and controls required for the operation of the control device 100. The processor 101 controls each part to realize various functions of the control device 100 based on programs such as firmware, system software, and application software stored in the ROM 102 or the auxiliary storage device 104. The processor 101 also executes processes described below based on the programs. Note that a part or all of the programs may be incorporated in the circuitry of the processor 101. The processor 101 is, for example, a central processing unit (CPU), a micro processing unit (MPU), a system on a chip (SoC), a digital signal processor (DSP), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). Alternatively, the processor 101 is a combination of a plurality of these.

[0011] The ROM 102 corresponds to the main memory device of a computer with the processor 101 at its core. The ROM 102 is a non-volatile memory used exclusively for reading data. The ROM 102 stores, for example, firmware among the above programs. The ROM 102 also stores data used by the processor 101 when performing various processes.

[0012] The RAM 103 corresponds to the main memory device of a computer with the processor 101 at its core. The RAM 103 is a memory used for reading and writing data. The RAM 103 is used as a work area for storing data that is temporarily used when the processor 101 performs various processes. The RAM 103 is typically a volatile memory.

[0013] The auxiliary storage device 104 corresponds to an auxiliary storage device of a computer with the processor 101 as its core. The auxiliary storage device 104 is, for example, an EEPROM (electric erasable programmable read-only memory), a HDD (hard disk drive), or a flash memory. The auxiliary storage device 104 stores, for example, system software and application software among the above programs. The auxiliary storage device 104 also stores data used by the processor 101 in performing various processes, data generated by the processes in the processor 101, various setting values, and the like.

[0014] The communication interface 105 is an interface for the control device 100 to communicate with the imaging device 200, the input device 300, the display device 400, the audio output device 500, the traffic control device 600, the lighting device 700, etc. Each of the imaging device 200, the input device 300, the display device 400, the audio output device 500, the traffic control device 600, and the lighting device 700 may be an external device to the control device 100 or a built-in device to the control device 100. The communication interface 105 may also be an interface for communication via the Internet or a LAN (local area network), etc.

[0015] The imaging device 200 is a camera that captures an image. The imaging device 200 is installed so as to capture the hands of a person washing his / her hands at a washstand S or the like. The imaging device 200 outputs captured image data. The image data is input to the control device 100 via the communication interface 105. Note that a moving image is a type of image.

[0016] The bus 106 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the various parts of the control device 100 .

[0017] The input device 300 accepts operation input by a subject, input based on the subject's action, or voice input. The input device 300 is, for example, a keyboard, a keypad, a touchpad, a mouse, a button, or a microphone. The input device 300 may be various sensors. The input device 300 may be a device such as a camera or a sensor used for biometric authentication. However, the camera used for biometric authentication may be a device separate from the imaging device 200, or the imaging device 200 may also be used for biometric authentication. The hygiene management system 1 may be equipped with multiple types of input devices 300.

[0018] The display device 400 displays a screen for notifying a target of various information. The display device 400 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display. A touch panel can also be used as the input device 300 and the display device 400. That is, a display panel provided in the touch panel can be used as the display device 400, and a pointing device provided in the touch panel by touch input can be used as the input device 300. The display device 400 is an example of a notification unit.

[0019] The audio output device 500 is a speaker that outputs audio for notifying a target of various information.

[0020] The traffic control device 600 controls, for example, opening / closing or locking of a gate or door, etc. In this way, the traffic control device 600 controls whether or not to permit passage through the gate or door, etc.

[0021] The lighting device 700 is a device that controls lighting and illuminates the target's hands. The lighting device 700 prevents a decrease in image recognition accuracy due to insufficient brightness by illuminating the target's hands with the lighting. The lighting device 700 also improves the accuracy of image recognition by using the lighting to keep the optical shooting conditions of the imaging device 200 constant.

[0022] The operation of the control device 100 according to the embodiment will be described below with reference to Figs. 3 and 4. Note that the contents of the process in the following operation description are merely examples, and various processes capable of obtaining similar results can be used as appropriate. Figs. 3 and 4 are flowcharts showing an example of the process by the processor 101 of the control device 100. The processor 101 executes the process of Figs. 3 and 4 based on a program stored in, for example, the ROM 102 or the auxiliary storage device 104.

[0023] 3, processor 101 generates an image corresponding to overall procedure screen 801 showing the overall procedure of a hand-washing action. Then, processor 101 instructs display device 400 to display the generated image. Upon receiving the display instruction, display device 400 displays overall procedure screen 801.

[0024] 5 is a diagram showing an example of the overall procedure screen 801. As an example, the overall procedure screen 801 includes nine areas 810, areas 811 to 819. Each of the areas 810 corresponds to one of steps (1) to (9) included in the hand-washing action. The areas 810 display an explanation and an image showing what kind of action each step is. The hand-washing action includes, as an example, the following steps (1) to (9). Each of the steps (1) to (9) is a constituent action that constitutes the hand-washing action. (1) Wet your hands. (2) Apply soap. (3) Whisk. (4) Rub the backs of your hands. (5) Rub between your fingers. (6) Rub your thumb. (7) Rub your fingertips. (8) Massage your wrists. (9) Rinse with running water.

[0025] In ACT12, the processor 101 determines whether the subject starts washing his / her hands. For example, the processor 101 determines that the subject starts washing his / her hands in response to a predetermined operation performed by the subject on the input device 300. The operation is, for example, an operation using a button, a mouse, a keyboard, or a touch panel. Alternatively, the processor 101 determines that the subject starts washing his / her hands by performing image recognition using an image of the subject captured by an imaging device. For example, the processor 101 determines that a hand is captured in the image by a change in contrast, and determines that the subject starts washing his / her hands when the hand is captured in the image. Alternatively, the processor 101 determines that the subject starts washing his / her hands in response to detection of the subject's hand or an object using an optical sensor such as a human sensor using infrared rays or an obstacle detection sensor using a laser. Alternatively, the processor 101 determines that the subject starts washing his / her hands in response to detection of the subject's hand or an object by a proximity sensor using a non-contact means such as radio waves or magnetism. Alternatively, the processor 101 detects that water has started to flow from the faucet F using a flow rate sensor or the like installed on the faucet F and determines that hand washing should be started. If the processor 101 does not determine that the subject will start washing his / her hands, it determines No in ACT12 and repeats the processing of ACT12. If the processor 101 determines that the subject will start washing his / her hands, it determines Yes in ACT12 and proceeds to ACT13.

[0026] In ACT13, the processor 101 controls the lighting device 700 to turn on the lighting. The processor 101 may also control the lighting device 700 to increase the brightness of the lighting.

[0027] In ACT14, the processor 101 starts a first timeout process. The first timeout process is a process for performing an exception process when a predetermined process has not been completed even after a predetermined time has elapsed since the start of the timer. For example, the processor 101 performs the exception process when the process of ACT34 has not been performed even after a predetermined time has elapsed since the start of the process of ACT14. Alternatively, the processor 101 performs the exception process when the process of ACT34 has not been performed even after a predetermined time has elapsed since the start of the process of ACT21. Alternatively, the processor 101 may perform the exception process when the process of ACT34 has not been performed even after a predetermined time has elapsed since the start of other processes. The exception process here is, for example, a process of displaying an image indicating an error on the display device 400, stopping the process being performed among the processes shown in FIG. 3 and FIG. 4, and returning to the process of ACT11. The processor 101 performs the first timeout process, for example, in a thread different from the processes shown in FIG. 3 and FIG. 4.

[0028] In ACT15, the processor 101 performs personal authentication to identify the personal ID (identifier) ​​of the target. The personal ID is identification information uniquely assigned to each target. The processor 101 performs personal authentication by, for example, reading information recorded on an IC card such as an employee ID card or an electronic device held by the target using a card reader. The card reader communicates with, for example, a magnetic card (magnetic stripe card), a contact IC card, or a non-contact IC card. The card reader also communicates with a non-contact IC chip mounted on an electronic device (for example, a mobile phone, a smartphone, a tablet PC, etc.). Alternatively, the processor 101 may perform personal authentication by performing biometric authentication such as face authentication, fingerprint authentication, iris authentication, or gait authentication on the target. The process of ACT15 may be performed before the process of ACT12. The processor 101 may determine that the target starts washing his / her hands when the personal authentication is performed. Therefore, by performing the processing of ACT15, the processor 101 functions as an identification unit that identifies identification information that identifies an object.

[0029] In ACT16, processor 101 generates an image corresponding to first procedure screen 802 showing the procedures belonging to the first block of hand-washing actions. The procedures included in the hand-washing actions can be divided into a plurality of blocks. Here, they are divided into three blocks. As an example, the procedures belonging to the first block are procedures (1) and (2). Processor 101 then instructs display device 400 to display this generated image. In response to the display instruction, display device 400 displays first procedure screen 802.

[0030] 6 is a diagram showing an example of a first procedure screen 802. The first procedure screen 802 includes an area 811 and an area 812. The area 811 corresponds to procedure (1), and the area 812 corresponds to procedure (2).

[0031] In ACT17, the processor 101 starts a process of determining whether the subject has performed step (1), i.e., whether the subject has performed the action of wetting his / her hands. The processor 101 determines that the subject has performed step (1) by using a sensor or the like. For example, the processor 101 determines that the subject has performed step (1) when the amount of water flowing out of the faucet F is equal to or greater than a predetermined amount by using a flow rate sensor or the like installed on the faucet F. Alternatively, the processor 101 determines that the subject has performed step (1) when the time since the water started to flow is equal to or greater than a predetermined time. Alternatively, the processor 101 may determine that the subject has performed step (1) by image recognition. Alternatively, the processor 101 may determine that the subject has performed step (1) when a certain amount of time has elapsed since the start of the process of ACT17.

[0032] In ACT 18, the processor 101 waits for the target to execute the procedure (1). If the processor 101 determines that the target has executed the procedure (1), the processor 101 judges "Yes" in ACT 18 and proceeds to ACT 19.

[0033] In ACT19, processor 101 starts a process of determining whether or not the subject has performed step (2), i.e., whether or not the subject has performed the action of applying soap. Processor 101 determines that the subject has performed step (2) using a sensor or the like. For example, when processor 101 detects that soap has been dispensed from hand soap dispenser D using a sensor installed in hand soap dispenser D or the like, it determines that the subject has performed step (2). Alternatively, processor 101 may determine that the subject has performed step (2) by image recognition. Alternatively, processor 101 may determine that the subject has performed step (2) a certain period of time after starting the process of ACT17.

[0034] In ACT20, the processor 101 waits for the target to execute the procedure (2). If the processor 101 determines that the target has executed the procedure (2), it judges "Yes" in ACT20 and proceeds to ACT21.

[0035] In ACT21, the processor 101 starts image recognition using image data output from the imaging device 200. Through this image recognition, the processor 101 recognizes the hand motion of the target. For example, the processor 101 performs motion recognition using still images for each of a plurality of frames of a video captured by the imaging device 200. The motion recognition method is, for example, a method using feature quantities. The processor 101 then adopts the most frequent value among the motion recognition results for the plurality of frames as the correct motion recognition result. For example, if the motion recognition result for three frames out of five frames is procedure (3) and the motion recognition result for two frames is procedure (5), the processor 101 adopts procedure (3), which is the most frequent value, as the correct motion recognition result. Alternatively, the processor 101 may recognize the hand motion of the target using other known motion recognition methods.

[0036] In ACT22, processor 101 generates an image corresponding to second procedure screen 803 showing the procedures belonging to the second block of hand-washing actions. The procedures belonging to the second block are, for example, procedures (3) to (8). Processor 101 then instructs display device 400 to display the generated image. In response to the display instruction, display device 400 displays second procedure screen 803. After processing in ACT22, processor 101 proceeds to ACT23 in FIG. 4.

[0037] 7 is a diagram showing an example of a second procedure screen 803. The first procedure screen 802 includes areas 813 to 818 and an area 820. The areas 813 to 818 correspond to steps (3) to (8), respectively. The area 820 displays an image currently being captured by the imaging device 200.

[0038] 4, the processor 101 starts counting the timer T used for the second timeout process. The second timeout process is a process for performing exception processing when it cannot be determined that the target has completed all of the steps (3) to (8) within a predetermined time.

[0039] In ACT 24, processor 101 uses the action recognition result to determine whether or not the subject has performed any of the steps (3) to (8). If processor 101 does not determine that the subject has performed any of the steps (3) to (8), it determines No in ACT 24 and proceeds to ACT 25.

[0040] In ACT25, the processor 101 determines whether or not the subject has performed step (9). The processor 101 determines whether or not the subject has performed step (9) by using, for example, the action recognition result. Alternatively, the processor 101 may determine whether or not the subject has performed step (9) by using, for example, a sensor. If the processor 101 does not determine that the subject has performed step (9), it determines No in ACT25 and proceeds to ACT26.

[0041] In ACT26, processor 101 determines whether or not a timeout has occurred by the second timeout process. For example, processor 101 determines that a timeout has occurred when the time on timer T is equal to or greater than a predetermined time. If processor 101 does not determine that a timeout has occurred, it determines No in ACT26 and proceeds to ACT27. Thus, processor 101 enters a standby state in which ACT24 to ACT26 are repeated until processor 101 determines that the target has executed any one of the procedures (3) to (9) or a timeout occurs by the second timeout process.

[0042] If the processor 101 determines that the target has executed any one of the procedures (3) to (8) while in the standby state of ACT24 to ACT26, it determines Yes in ACT24 and proceeds to ACT26. As described above, by performing the processes in ACT21 and ACT24, the processor 101 functions as a recognition unit that uses image recognition to recognize that the subject has performed the constituent actions that constitute a hand-washing action.

[0043] In ACT27, processor 101 performs a process of counting the execution time during which the subject performs steps (3) to (8). Processor 101 counts the execution time for each of steps (3) to (8). For example, if processor 101 recognizes through action recognition that the subject performed step (3) for n seconds, it adds n seconds to the count of the execution time of (3).

[0044] In ACT28, the processor 101 judges whether the count of the time taken to execute the procedure of the action recognition result has reached or exceeded a threshold value. The control device 100 stores threshold values ​​for each of the procedures (3) to (8) in the auxiliary storage device 104 or the like. The processor 101 considers the procedure whose execution time has reached or exceeded these threshold values ​​to be completed by the target. If the count of the time taken to execute the procedure of the action recognition result has not reached or exceeded the threshold value, the processor 101 judges No in ACT28 and returns to ACT24. On the other hand, if the count of the time taken to execute the procedure of the action recognition result has reached or exceeded the threshold value, the processor 101 judges Yes in ACT28 and proceeds to ACT29.

[0045] In ACT29, the processor 101 sets a flag corresponding to a procedure whose execution time is equal to or exceeds a threshold. The control device 100 stores a flag corresponding to each procedure. Each flag indicates that the corresponding procedure has been completed.

[0046] In ACT30, the processor 101 updates the second procedure screen 803 displayed on the display device 400. FIG. 8 is a diagram showing a second procedure screen 804. The second procedure screen 804 shows an example of the second procedure screen 803 after updating. The processor 101 changes the appearance of the area 810 corresponding to the procedure for which the corresponding flag is set. The processor 101 changes the appearance, for example, by changing the color, size, or transparency of a part or all of the area 810. Alternatively, the processor 101 may change the appearance by not displaying the area 810 in the second procedure screen 804. Alternatively, the processor 101 may change the appearance by displaying a predetermined image on or around the area 810. For example, in the second procedure screen 804 shown in FIG. 8, the appearance of the area 814 is different from that of the second procedure screen 803 due to an overlay display of a check mark.

[0047] In ACT31, processor 101 determines whether or not the target has completed all of steps (3) to (8). For example, if all flags corresponding to steps (3) to (8) are set, processor 101 determines that the target has completed all of steps (3) to (8). If processor 101 does not determine that the target has completed all of steps (3) to (8), processor 101 determines No in ACT31 and returns to ACT24. On the other hand, if all flags corresponding to steps (3) to (8) are set, processor 101 determines Yes in ACT31 and proceeds to ACT32.

[0048] In ACT32, processor 101 generates an image corresponding to third procedure screen 805 showing a procedure belonging to a third block among hand-washing actions. An example of the procedure belonging to the third block is procedure (9). Then, processor 101 instructs display device 400 to display this generated image. In response to the display instruction, display device 400 displays third procedure screen 805.

[0049] 9 is a diagram showing an example of the third procedure screen 805. The third procedure screen 805 includes an area 819. The area 819 corresponds to procedure (9).

[0050] In ACT33, the processor 101 waits for the target to execute step (9). If the processor 101 determines that the target has executed step (9), it determines Yes in ACT33 and proceeds to ACT34. The processor 101 determines that the target has executed step (9) in the same manner as in ACT25, for example. Alternatively, the processor 101 may determine that the target has executed step (9) when a certain amount of time has passed since the execution of the process in ACT32.

[0051] In ACT34, the processor 101 generates an image corresponding to the result screen 806. Then, the processor 101 instructs the display device 400 to display this generated image. In response to the display instruction, the display device 400 displays the result screen 806.

[0052] FIG. 10 shows an example of a result screen 806. The result screen 806 is a screen indicating that the subject has completed all of steps (1) to (9). Like the overall procedure screen 801, the result screen 806 includes areas 811 to 819. However, the result screen 806 indicates that the procedure corresponding to each area 810 has been completed by making the appearance of each area 810 different from that of the overall procedure screen 801. In the result screen 806 shown in FIG. 10, the appearance of each area 810 is different from that of the overall procedure screen 801 by overlaying a check mark indicating completion.

[0053] In ACT35, the processor 101 stores the result that the subject has completed hand washing. For example, the processor 101 associates the personal ID identified in ACT15 of Fig. 3 with the current time, information indicating that each of steps (1) to (9) has been completed, the execution time of each of steps (3) to (8), and information indicating that hand washing has been completed, and stores the information in the auxiliary storage device 104 or the like. Alternatively, the processor 101 may store the result in a server or a cloud. Therefore, by performing the processing of ACT35, the processor 101 functions as a memory unit that stores the fact that the subject has performed the procedure in association with the personal ID.

[0054] In ACT36 in Fig. 4, the processor 101 controls the passage control device 600 to unlock the gate or door, etc., so that the target can pass through the gate or door. The passage control device 600 controls so that the target cannot pass through the gate or door, etc., until the processor 101 performs the process of ACT36.

[0055] In ACT37, the processor 101 resets the flags corresponding to each procedure. As a result, all flags corresponding to each procedure are not set. The processor 101 also resets the execution time of each procedure to 0 seconds. Furthermore, the processor 101 controls the lighting device 700 to turn off the lights. Alternatively, the processor 101 controls the lighting device 700 to dim the brightness of the lights. After processing ACT37, the processor 101 returns to ACT11 in FIG. 3.

[0056] On the other hand, if the processor 101 determines that the target has executed the procedure (9) while in the standby state of ACT24 to ACT26 in FIG. 4, it determines Yes in ACT25 and proceeds to ACT38. Furthermore, if the processor 101 determines that a timeout has occurred in the second timeout process while in the standby state of ACT24 to ACT26, it determines Yes in ACT26 and proceeds to ACT38.

[0057] In ACT38, the processor 101 generates an image corresponding to the result screen 807. Then, the processor 101 instructs the display device 400 to display the generated image. In response to the display instruction, the display device 400 displays the result screen 806. After processing ACT38, the processor 101 returns to ACT11 in FIG. 3.

[0058] FIG. 11 shows an example of the result screen 807. The result screen 807 is a screen that indicates that the subject performed step (9) without completing at least one of steps (3) to (8), or that the subject did not complete steps (3) to (8) within a predetermined time. The result screen 807 is also a screen for encouraging the subject to wash their hands again. The result screen 807 includes areas 811 to 819, similar to the overall procedure screen 801 and the result screen 806. However, the result screen 807 indicates that the corresponding procedure is incomplete by making the appearance of the area 810 corresponding to the incomplete procedure different from that of the overall procedure screen 801 and the result screen 806. In the result screen 807 shown in FIG. 11, the appearance of the area 814 and the area 815 is different from that of the overall procedure screen 801 and the result screen 806 due to the overlay display of an NG mark indicating incompletion. The area 810 corresponding to the completed procedure has the same appearance as that of the result screen 806. The processor 101 determines whether each step has been completed by referring to a flag corresponding to each step. Therefore, the processor 101 executes the process of ACT38 to notify the target that there is an incomplete procedure.

[0059] As described above, when the subject has performed all of the predetermined steps (3) to (8), processor 101 performs the processes of ACT 34 to ACT 37, and when the subject has not performed any of steps (3) to (8), processor 101 performs the process of ACT 38. That is, processor 101 functions as an execution unit that executes different processes depending on whether the subject has performed all of steps (3) to (8).

[0060] If a timeout occurs due to the first timeout process, processor 101 stores a result indicating that the subject has not completed hand washing. For example, processor 101 associates the personal ID identified in ACT15 in Fig. 3 with the current time, information indicating whether each of steps (1) to (9) has been completed, the execution time of each of steps (3) to (8), and information indicating that hand washing has not been completed, and stores these in auxiliary storage device 104 or the like.

[0061] According to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 executes different processes depending on whether the subject has performed the steps (3) to (8). For example, the processor 101 displays a result screen 807 shown in FIG. 11 on the display device 400. This allows the subject to notice when any of the steps (3) to (8) has not been performed. Furthermore, the subject can know which step has not been completed by looking at the result screen 807.

[0062] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 notifies the subject that there are incomplete steps by displaying the result screen 807. This allows the subject to know that there are incomplete steps. Furthermore, if there are incomplete steps, the processor 101 returns from ACT38 in FIG. 4 to ACT16 in FIG. 3. This allows the control device 100 to encourage the subject to wash their hands until they complete all steps.

[0063] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 determines that the subject has completed each step, regardless of the order in which the subject performed steps (3) to (8). Therefore, the subject can perform steps (3) to (8) in any order he or she likes.

[0064] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 associates the results of the hand-washing action of the subject with the personal ID and stores them in the auxiliary storage device 104 or the like. This allows the operator of the hygiene management system 1 or the like to check history information about hand-washing actions performed in the past for each of multiple subjects.

[0065] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 controls the passage control device 600 to prevent the subject from passing through a gate or door if the subject has not performed all of steps (1) to (9). In this way, the processor 101 of the control device 100 prevents the subject who has not completed the hand-washing action from entering a clean area, etc.

[0066] The above embodiment may be modified as follows. In the above embodiment, the control device 100 notifies the target by displaying each screen on the display device 400. However, the control device 100 may notify the target by other methods. For example, the control device 100 may notify the target by using audio output from a speaker or by turning on and off a light source such as an LED (light-emitting diode).

[0067] A part of the processing performed by the processor 101 of the control device 100 in the above embodiment may be performed by a processor included in the imaging device 200. For example, the processor of the imaging device 200 performs image processing such as image recognition and action recognition. The processor of the imaging device 200 may also perform processing to determine whether or not a subject has performed a procedure. The imaging device 200 inputs these processing results to the control device 100 via the communication interface 105. The control device 100 performs each process based on the processing results.

[0068] The processor 101 may implement part or all of the processes implemented by the programs in the above-described embodiments by using a hardware circuit configuration.

[0069] The control device 100 in the above embodiment is transferred to an administrator of the control device 100, for example, in a state in which a program for executing each of the above processes is stored. Alternatively, the control device 100 is transferred to the administrator without the program being stored therein. Then, the program is transferred separately to the administrator and stored in the control device 100 based on an operation by the administrator or a serviceman. The transfer of the program at this time can be realized, for example, by using a removable storage medium such as a disk medium or a semiconductor memory, or by downloading via the Internet or a LAN.

[0070] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0071] 1: sanitation control system, 100: control device, 101: processor, 102: ROM, 103: RAM, 104: auxiliary storage device, 105: communication interface, 106: bus, 200: imaging device, 300: input device, 400: display device, 500: audio output device, 600: traffic control device, 700: lighting device

Claims

1. A recognition unit that recognizes that a subject has performed constituent actions that constitute a hand-washing action using image recognition; An execution unit that executes different processing depending on whether or not the target has executed a plurality of predetermined constituent actions.

2. The hygiene management device of claim 1, wherein the execution unit controls the notification unit to notify the subject that there is a constituent action that has not been performed when the subject has not performed at least one of a predetermined number of the constituent actions.

3. An identification unit that identifies identification information that identifies the target; The hygiene management device according to claim 1 or 2, further comprising a storage unit that, when the target has executed the configuration operation, stores the fact that the configuration operation has been executed in association with the identification information.

4. The hygiene management device according to any one of claims 1 to 3, wherein the execution unit controls a passage control device to stop the passage of the object when the object is not performing at least any of a plurality of predetermined constituent operations.

5. A hygiene management method that uses image recognition to recognize that a subject has performed constituent actions that make up a hand-washing action, and executes different processes depending on whether the subject has performed a predetermined number of the constituent actions.

6. The computer installed in the sanitation management device A recognition unit that recognizes, by using image recognition, that a subject has performed constituent actions that constitute a hand-washing action; A program for causing the target to function as an execution unit that executes different processes depending on whether or not the target has executed a plurality of predetermined constituent operations.

Images