Hygiene management equipment and programs

Abstract

To provide a hygiene management device, hygiene management method and program, which can ensure that people follow a prescribed hand-washing procedure.SOLUTION: A hygiene management device according to an embodiment comprises a recognition unit and execution unit. The recognition unit recognizes performance of constituent actions that make up a hand-washing procedure by a target person using image recognition. The execution unit executes different processing depending on whether or not predetermined multiple constituent actions were performed by the target person.SELECTED DRAWING: Figure 1

Description

Technical Field

[0004] , , , ,

[0005] , , , , ,

[0001] Embodiments of the present invention relate to a hygiene management device, a hygiene management method, and a program.

Background Art

[0002] In food factories and the like, a hygiene management area (clean area) and a non-clean area are separated, and when entering the clean area from the non-clean area, it may be required to perform operations in accordance with hygiene management procedures including handwashing. Similarly, in hospitals, stores, restaurants, nursing care sites, educational sites, etc., it is often required to ensure handwashing to prevent infectious diseases and maintain hygiene. In such places where hygiene management is required, it is required that employees, workers, and other people entering and leaving the place reliably perform a determined handwashing motion.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the embodiments of the present invention is to provide a hygiene management device, a hygiene management method, and a program capable of causing a determined handwashing motion to be performed.

Means for Solving the Problems

[0005] The hygiene management device according to the embodiment includes a recognition unit and an execution unit. The recognition unit recognizes, using image recognition, that the target has performed a constituent motion that constitutes a handwashing motion. The execution unit executes different processes depending on whether or not the target has performed a plurality of the predetermined constituent motions.

Brief Description of the Drawings

[0006] [Figure 1] A diagram illustrating the overview of the hygiene management system according to the embodiment. [Figure 2] A block diagram showing an example of the main components of a hygiene management system and its constituent elements according to an embodiment. [Figure 3] A flowchart showing an example of processing by the processor in Figure 2. [Figure 4] A flowchart showing an example of processing by the processor in Figure 2. [Figure 5] Figure 2 shows an example of the overall procedure screen displayed by the display device. [Figure 6] Figure 2 shows an example of the first procedure screen displayed by the display device. [Figure 7] Figure 2 shows an example of the second procedure screen displayed by the display device. [Figure 8] Figure 2 shows an example of the second procedure screen displayed by the display device. [Figure 9] Figure 2 shows an example of the third overall procedure screen displayed by the display device. [Figure 10] Figure 2 shows an example of a results screen displayed by the display device. [Figure 11] Figure 2 shows an example of a results screen displayed by the display device. [Modes for carrying out the invention]

[0007] The following description of the hygiene management system according to the embodiment will be explained with reference to the drawings. Note that the scale of the parts in the drawings used in the following description of the embodiment may have been changed as appropriate. Also, for illustrative purposes, some components may be omitted from the drawings used in the following description of the embodiment. Furthermore, in the drawings and this specification, the same reference numerals indicate the same elements.

[0008] Figure 1 is a diagram showing an overview of a hygiene management system according to an embodiment. Figure 2 is a block diagram showing an example of the main components of the hygiene management system 1 and its constituent elements according to an embodiment. As shown in Figure 1, the hygiene management system 1 is installed in a place where hands are washed, such as a washbasin S. The hygiene management system 1 is a system that photographs the object to be washed and recognizes the hand-washing action of the object by image recognition. The hygiene management system 1 includes, as an example, a control device 100, an imaging device 200, an input device 300, a display device 400, an audio output device 500, a traffic control device 600, and a lighting device 700.

[0009] The control device 100 is a device that controls the hygiene management system 1. The control device 100 is a computer such as a PC (personal computer) or a server. The control device 100 includes, as an example, a processor 101, ROM (read-only memory) 102, RAM (random-access memory) 103, auxiliary storage device 104, and a communication interface 105. A bus 106 connects these parts. Note that the control device 100 is an example of a hygiene management device.

[0010] The processor 101 corresponds to the central part of the computer that performs calculations and control necessary for the operation of the control device 100. Based on programs such as firmware, system software, and application software stored in the ROM 102 or auxiliary storage device 104, the processor 101 controls each part to realize various functions of the control device 100. The processor 101 also executes the processes described later based on the said program. Note that some or all of the said program may be incorporated into the circuit of the processor 101. The processor 101 is, for example, a CPU (central processing unit), MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array). Alternatively, the processor 101 is a combination of several of these.

[0011] ROM 102 corresponds to the main memory of the computer, with the processor 101 at its core. ROM 102 is a non-volatile memory used exclusively for reading data. ROM 102 stores programs such as firmware. It also stores data used by the processor 101 in performing various processes.

[0012] RAM103 corresponds to the main memory of a computer centered around processor 101. RAM103 is memory used for reading and writing data. RAM103 is used as a work area to store data that processor 101 temporarily uses when performing various processes. RAM103 is typically volatile memory.

[0013] The auxiliary storage device 104 corresponds to the auxiliary storage device of a computer centered around the processor 101. The auxiliary storage device 104 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 104 stores, among the above programs, for example, system software and application software. Further, the auxiliary storage device 104 stores data used by the processor 101 to perform various processes, data generated by the processes in the processor 101, and various setting values.

[0014] The communication interface 105 is an interface for the control device 100 to communicate with the imaging device 200, the input device 300, the display device 400, the audio output device 500, the access control device 600, the lighting device 700, and the like. Each of the imaging device 200, the input device 300, the display device 400, the audio output device 500, the access control device 600, and the lighting device 700 may be an externally attached device or a built-in device of the control device 100. Further, the communication interface 105 may be an interface for communicating via the Internet or a LAN (local area network).

[0015] The imaging device 200 is a camera or the like that captures images. The imaging device 200 is installed so that the hands of the subject washing hands, such as at the washbasin S, are reflected. Further, the imaging device 200 outputs the captured image data. The image data is input to the control device 100 via the communication interface 105. Note that a video is a kind of image.

[0016] The bus 106 includes a control bus, an address bus, a data bus, and the like, and transmits signals exchanged between the respective parts of the control device 100.

[0017] The input device 300 receives operation inputs by the subject, inputs based on the actions of the subject, or voice inputs, etc. The input device 300 is, for example, a keyboard, keypad, touch pad, mouse, button, or microphone, etc. Also, the input device 300 may be various sensors, etc. Further, the input device 300 may be a device such as a camera or sensor used for biometric authentication. However, the camera used for biometric authentication may be a device separate from the imaging device 200, or the imaging device 200 may also be used for biometric authentication. Note that the hygiene management system 1 may be provided with multiple types of input devices 300.

[0018] The display device 400 displays a screen for notifying the subject of various information. The display device 400 is, for example, a display such as a liquid crystal display or an organic EL (electro - luminescence) display. Note that a touch panel can also be used as the input device 300 and the display device 400. That is, the display panel included in the touch panel can be used as the display device 400, and the pointing device by touch input included in the touch panel can be used as the input device 300. Note that the display device 400 is an example of a notification unit.

[0019] The voice output device 500 is a speaker that outputs voices for notifying the subject of various information.

[0020] The access control device 600 controls the opening, closing, or locking of, for example, a gate or a door. Thereby, the access control device 600 controls the permission or non - permission of access to a gate or a door, etc.

[0021] The lighting device 700 is a device that illuminates the subject's hand and controls the lighting. The lighting device 700 prevents a decrease in image recognition accuracy due to insufficient brightness, etc., by brightening the subject's hand with the lighting. Also, the lighting device 700 improves the accuracy of image recognition by making the optical shooting conditions of the imaging device 200 constant using the lighting.

[0022] The operation of the control device 100 according to this embodiment will be described below with reference to Figures 3 and 4. Note that the processing described below is an example, and various processes that can achieve similar results can be used as appropriate. Figures 3 and 4 are flowcharts showing an example of processing by the processor 101 of the control device 100. The processor 101 executes the processing shown in Figures 3 and 4 based on a program stored, for example, in the ROM 102 or auxiliary storage device 104.

[0023] In ACT11 in Figure 3, the processor 101 generates an image corresponding to the overall procedure screen 801, which shows the entire procedure for handwashing. The processor 101 then instructs the display device 400 to display this generated image. Upon receiving the display instruction, the display device 400 displays the overall procedure screen 801.

[0024] Figure 5 shows an example of the overall procedure screen 801. The overall procedure screen 801 includes nine areas 810, from area 811 to area 819, as an example. Each area 810 corresponds to one of the steps (1) to (9) included in the handwashing operation. Area 810 displays a description and image showing what each step is. The handwashing process, as an example, includes the following steps (1) to (9). Each of the steps (1) to (9) is a component of the handwashing process. (1) Wet your hands. (2) Apply soap. (3) Whip. (4) Rub the backs of your hands clean. (5) Wash between your toes. (6) Wash your thumbs by rubbing them. (7) Rub your fingertips together and wash them. (8) Wash your wrists by rubbing them. (9) Rinse with running water.

[0025] In ACT12, the processor 101 determines whether the subject will start washing their hands. For example, the processor 101 determines that the subject will start washing their hands when a predetermined operation is performed by the subject on the input device 300. Such operation may be, for example, an operation using a button, mouse, keyboard, or touch panel. Alternatively, the processor 101 determines that the subject will start washing their hands by performing image recognition using an image of the subject captured by the imaging device. For example, the processor 101 determines that a hand is visible in the image based on a change in contrast, and determines that the subject will start washing their hands when a hand is visible in the image. Alternatively, the processor 101 determines that the subject will start washing their hands when it detects the subject's hand or the subject using an optical sensor such as a human presence sensor using infrared light or an obstacle detection sensor using laser light. Alternatively, the processor 101 determines that the subject will start washing their hands when a proximity sensor using non-contact means such as radio waves or magnetism detects that the subject's hand or the subject is in close proximity. Alternatively, the processor 101 detects that water has started flowing from the faucet F using a flow sensor installed on the faucet F, and determines that the user is starting to wash their hands. If the processor 101 does not determine that the user is starting to wash their hands, it determines No in ACT12 and repeats the process of ACT12. If the processor 101 determines that the user is starting to wash their hands, it determines Yes in ACT12 and proceeds to ACT13.

[0026] In ACT13, the processor 101 controls the lighting device 700 to turn on the lights. The processor 101 may also control the lighting device 700 to increase the brightness of the lights.

[0027] In ACT14, processor 101 initiates a first timeout process. The first timeout process is a process for handling an exception if a predetermined process has not been completed even after a predetermined time has elapsed since the start of the timer. For example, if processor 101 has not performed ACT34 even after a predetermined time has elapsed since the start of ACT14, it will perform an exception. Alternatively, processor 101 will perform an exception if ACT34 has not been performed even after a predetermined time has elapsed since the start of ACT21. Alternatively, processor 101 may perform an exception if ACT34 has not been performed even after a predetermined time has elapsed since the start of any other process. The exception handling here is, for example, displaying an error image on the display device 400, and canceling the process currently in progress among the processes shown in Figures 3 and 4 and returning to the process of ACT11. Processor 101 executes the first timeout process in a separate thread, for example, from the processes shown in Figures 3 and 4.

[0028] In ACT15, the processor 101 identifies the subject's personal ID (identifier) ​​by performing personal authentication. The personal ID is unique identification information assigned to each subject. The processor 101 performs personal authentication, for example, by reading information recorded on an IC card such as an employee ID or on an electronic device possessed by the subject using a card reader. The card reader communicates with, for example, a magnetic card (magnetic stripe card), a contact-type IC card, or a contactless IC card. The card reader also communicates with a contactless IC chip installed in an electronic device (for example, a mobile phone, smartphone, tablet PC, etc.). Alternatively, the processor 101 may perform personal authentication on the subject by performing biometric authentication such as facial recognition, fingerprint recognition, iris recognition, or gait recognition. Note that the processing in ACT15 may occur before the processing in ACT12. The processor 101 may also determine that the subject has started washing their hands when personal authentication has been performed. Therefore, the processor 101 functions as a unit that identifies identification information for identifying an object by performing the processing of ACT 15.

[0029] In ACT16, the processor 101 generates an image corresponding to the first procedure screen 802, which shows the steps belonging to the first block of the handwashing operation. The steps included in the handwashing operation can be divided into multiple blocks. In this case, it is divided into three blocks. The steps belonging to the first block are, for example, steps (1) and (2). The processor 101 then instructs the display device 400 to display the generated image. Upon receiving the display instruction, the display device 400 displays the first procedure screen 802.

[0030] Figure 6 shows an example of the first procedure screen 802. The first procedure screen 802 includes regions 811 and 812. Region 811 corresponds to procedure (1), and region 812 corresponds to procedure (2).

[0031] In ACT17, the processor 101 starts processing to determine whether the target has performed step (1), that is, whether the target has performed the action of wetting their hands. The processor 101 determines whether the target has performed step (1) using sensors or the like. For example, the processor 101 uses a flow sensor installed on the faucet F, etc., to determine that the target has performed step (1) when the amount of water flowing out of the faucet F exceeds a predetermined amount. Alternatively, the processor 101 determines that the target has performed step (1) when the time elapsed since the water started flowing exceeds a predetermined time. Alternatively, the processor 101 may determine that the target has performed step (1) by image recognition. Alternatively, the processor 101 may determine that the target has performed step (1) when a certain amount of time has elapsed since the start of processing in ACT17.

[0032] In ACT18, processor 101 waits for the target to perform step (1). If processor 101 determines that the target has performed step (1), it determines Yes in ACT18 and proceeds to ACT19.

[0033] In ACT19, the processor 101 starts processing to determine whether the target has performed step (2), that is, whether the target has performed the action of applying soap. The processor 101 determines whether the target has performed step (2) using sensors or the like. For example, the processor 101 determines that the target has performed step (2) when it detects that soap has come out of the hand soap dispenser D using a sensor installed in the hand soap dispenser D. Alternatively, the processor 101 may determine that the target has performed step (2) by image recognition. Alternatively, the processor 101 may determine that the target has performed step (2) after a certain amount of time has elapsed since the start of processing in ACT17.

[0034] In ACT20, processor 101 waits for the target to execute step (2). If processor 101 determines that the target has executed step (2), it determines Yes in ACT20 and proceeds to ACT21.

[0035] In ACT21, the processor 101 starts image recognition using image data output from the imaging device 200. Through this image recognition, the processor 101 recognizes the movement of the target hand. For example, the processor 101 performs motion recognition using still images for each of the multiple frames of the video captured by the imaging device 200. This motion recognition method is, for example, a feature-based method. The processor 101 then adopts the mode of the motion recognition results for the multiple frames as the correct motion recognition result. For example, if the motion recognition results for 3 out of 5 frames follow procedure (3) and the motion recognition results for 2 frames follow procedure (5), the processor 101 adopts procedure (3), which is the mode, as the correct motion recognition result. Alternatively, the processor 101 may recognize the movement of the target hand using other known motion recognition methods.

[0036] In ACT22, the processor 101 generates an image corresponding to the second procedure screen 803, which shows the steps belonging to the second block of the handwashing operation. The steps belonging to the second block are, for example, steps (3) to (8). The processor 101 then instructs the display device 400 to display the generated image. Upon receiving the instruction to display, the display device 400 displays the second procedure screen 803. After processing in ACT22, the processor 101 proceeds to ACT23 in Figure 4.

[0037] Figure 7 shows an example of the second procedure screen 803. The first procedure screen 802 includes areas 813 to 818 and area 820. Areas 813 to 818 correspond to procedures (3) to (8), respectively. Area 820 displays the image being captured by the imaging device 200.

[0038] In ACT23 of Figure 4, the processor 101 starts counting down the timer T used for the second timeout process. The second timeout process is a process to handle exceptions if it is determined that the target has not completed all of steps (3) to (8) within a predetermined time.

[0039] In ACT24, the processor 101 uses the action recognition result to determine whether the target has performed any of the steps (3) to (8). If the processor 101 does not determine that the target has performed any of the steps (3) to (8), it determines No in ACT24 and proceeds to ACT25.

[0040] In ACT25, the processor 101 determines whether the target has performed step (9). The processor 101 determines whether the target has performed step (9) using, for example, the motion recognition result. Alternatively, the processor 101 may determine whether the target has performed step (9) using, for example, a sensor. If the processor 101 does not determine that the target has performed step (9), it determines No in ACT25 and proceeds to ACT26.

[0041] In ACT26, the processor 101 determines whether a timeout has occurred due to the second timeout process. For example, the processor 101 determines that a timeout has occurred if the timer T is longer than a predetermined time. If the processor 101 does not determine that a timeout has occurred, it determines No in ACT26 and proceeds to ACT27. Thus, the processor 101 enters a waiting state, repeating ACT24 to ACT26 until it determines that the target has performed any of the steps (3) to (9), or until a timeout occurs due to the second timeout process.

[0042] If processor 101 determines that the target has performed any of steps (3) to (8) while in the waiting state for ACT24 to ACT26, it determines Yes in ACT24 and proceeds to ACT26. Based on the above, the processor 101 functions as a recognition unit that recognizes, using image recognition, that the target has performed the constituent actions that constitute a handwashing action by performing the processing of ACT21 and ACT24.

[0043] In ACT27, processor 101 performs a process to count the execution time of the target performing steps (3) to (8). Processor 101 counts the execution time for each of steps (3) to (8). For example, if processor 101 recognizes through action recognition that the target has executed step (3) for n seconds, it adds n seconds to the execution time count for (3).

[0044] In ACT28, the processor 101 determines whether the time count for executing the procedure of the operation recognition result has exceeded a threshold. The control device 100 stores the threshold for each of the procedures (3) to (8) in the auxiliary storage device 104 or the like. The processor 101 considers a procedure to be completed if its execution time exceeds these thresholds. If the time count for executing the procedure of the operation recognition result has not exceeded a threshold, the processor 101 determines No in ACT28 and returns to ACT24. Conversely, if the time count for executing the procedure of the operation recognition result has exceeded a threshold, the processor 101 determines Yes in ACT28 and proceeds to ACT29.

[0045] In ACT29, the processor 101 sets a flag corresponding to a procedure whose execution time exceeds a threshold. The control device 100 stores a flag corresponding to each procedure. Each flag indicates that the corresponding procedure has been completed.

[0046] In ACT30, the processor 101 updates the second procedure screen 803 displayed on the display device 400. Figure 8 is a diagram showing the second procedure screen 804. The second procedure screen 804 shows an example of the updated second procedure screen 803. The processor 101 changes the appearance of the area 810 corresponding to the procedure for which the corresponding flag is set. The processor 101 changes the appearance by, for example, changing the color, size, or transparency of part or all of the area 810. Alternatively, the processor 101 may change the appearance by not displaying the area 810 in the second procedure screen 804. Alternatively, the processor 101 may change the appearance by displaying a predetermined image on or around the area 810. For example, in the second procedure screen 804 shown in Figure 8, the appearance of the area 814 is different from that of the second procedure screen 803 due to the overlay display of a check mark.

[0047] In ACT31, processor 101 determines whether the target has completed all steps (3) to (8). For example, if all the flags corresponding to each of steps (3) to (8) are set, processor 101 determines that the target has completed all steps (3) to (8). If processor 101 does not determine that the target has completed all steps (3) to (8), it determines No in ACT31 and returns to ACT24. Conversely, if all the flags corresponding to each of steps (3) to (8) are set, processor 101 determines Yes in ACT31 and proceeds to ACT32.

[0048] In ACT32, the processor 101 generates an image corresponding to the third procedure screen 805, which shows the procedure belonging to the third block of the handwashing operation. The procedure belonging to the third block is, for example, procedure (9). The processor 101 then instructs the display device 400 to display the generated image. Upon receiving the display instruction, the display device 400 displays the third procedure screen 805.

[0049] Figure 9 shows an example of the third procedure screen 805. The third procedure screen 805 includes region 819. Region 819 corresponds to procedure (9).

[0050] In ACT33, processor 101 waits for the target to execute step (9). If processor 101 determines that the target has executed step (9), it determines Yes in ACT33 and proceeds to ACT34. Processor 101 may determine, for example, that the target has executed step (9) in the same manner as in ACT25. Alternatively, processor 101 may determine that the target has executed step (9) after a certain amount of time has elapsed since executing the process in ACT32.

[0051] In ACT34, the processor 101 generates an image corresponding to the result screen 806. The processor 101 then instructs the display device 400 to display this generated image. Upon receiving the display instruction, the display device 400 displays the result screen 806.

[0052] Figure 10 shows an example of the results screen 806. The results screen 806 indicates that the target has completed all steps (1) to (9). Like the overall procedure screen 801, the results screen 806 includes areas 811 to 819. However, the results screen 806 indicates that the steps corresponding to each area 810 have been completed by making the appearance of each area 810 different from that of the overall procedure screen 801. In the results screen 806 shown in Figure 10, the appearance of each area 810 differs from that of the overall procedure screen 801 due to the overlay display of check marks indicating completion.

[0053] In ACT35, the processor 101 saves the result that the subject has completed handwashing. For example, the processor 101 associates the personal ID identified in ACT15 in Figure 3 with the current time, information indicating that each of steps (1) to (9) has been completed, the execution time of each of steps (3) to (8), and information indicating that handwashing has been completed, and stores this information in an auxiliary storage device 104 or the like. Alternatively, the processor 101 may store the result in a server or the cloud. Therefore, the processor 101 functions as a memory unit that stores the fact that the target has performed the procedure in association with the personal ID by performing the processing of ACT35.

[0054] In ACT36 in Figure 4, the processor 101 controls the passage control device 600, unlocking it or otherwise allowing the target to pass through the gate or door. The passage control device 600 prevents the target from passing through the gate or door until the processor 101 has completed the processing in ACT36.

[0055] In ACT37, processor 101 resets the flags corresponding to each procedure. As a result, all flags corresponding to each procedure are set to a state where they are not set. Processor 101 also resets the execution time of each procedure to 0 seconds. Furthermore, processor 101 controls the lighting device 700 to turn off the lights. Alternatively, processor 101 controls the lighting device 700 to dim the lights. After processing ACT37, processor 101 returns to ACT11 in Figure 3.

[0056] On the other hand, when processor 101 is in the waiting state of ACT24 to ACT26 in Figure 4, if it determines that the target has performed step (9), it determines Yes in ACT25 and proceeds to ACT38. Furthermore, if processor 101 determines that a timeout has occurred due to the second timeout process while in the waiting state of ACT24 to ACT26, it determines Yes in ACT26 and proceeds to ACT38.

[0057] In ACT38, the processor 101 generates an image corresponding to the result screen 807. The processor 101 then instructs the display device 400 to display this generated image. Upon receiving the display instruction, the display device 400 displays the result screen 806. After processing ACT38, the processor 101 returns to ACT11 in Figure 3.

[0058] Figure 11 shows an example of the results screen 807. The results screen 807 indicates that the subject performed step (9) without completing at least one of steps (3) to (8), or that the subject did not complete steps (3) to (8) within the specified time. The results screen 807 also prompts the subject to wash their hands again. Like the overall procedure screen 801 and the results screen 806, the results screen 807 includes areas 811 to 819. However, the results screen 807 indicates that a corresponding step is incomplete by making the appearance of area 810, which corresponds to an incomplete step, different from that of the overall procedure screen 801 and the results screen 806. In the results screen 807 shown in Figure 11, the appearance of areas 814 and 815 differs from that of the overall procedure screen 801 and the results screen 806 due to the overlay display of an NG mark indicating incompleteness. The area 810 corresponding to a completed step has the same appearance as that of the results screen 806. The processor 101 determines whether each step has been completed by referring to the flag corresponding to each step. Therefore, the processor 101 notifies the target that there is an incomplete procedure by executing the processing of ACT38.

[0059] As described above, the processor 101 performs the processing of ACT34 to ACT37 if the target has performed all of the predetermined steps (3) to (8), and performs the processing of ACT38 if it has not performed any of the steps (3) to (8). In other words, the processor 101 functions as an execution unit that performs different processing depending on whether or not the target has performed all of the steps (3) to (8).

[0060] Furthermore, if the processor 101 times out due to the first timeout process, it saves a result indicating that the subject has not completed handwashing. For example, the processor 101 associates the personal ID identified in ACT15 in Figure 3 with the current time, information indicating whether each of steps (1) to (9) has been completed, the execution time of each of steps (3) to (8), and information indicating that handwashing has not been completed, and stores this information in an auxiliary storage device 104 or the like.

[0061] According to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 performs different processing depending on whether the target has performed steps (3) to (8). For example, the processor 101 displays the result screen 807 shown in Figure 11 on the display device 400. This allows the target to realize if it has not performed any of steps (3) to (8). The target can also find out which step is incomplete by looking at the result screen 807.

[0062] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 notifies the user that there are incomplete procedures by displaying the results screen 807. This allows the user to know that there are incomplete procedures. Also, if there are incomplete procedures, the processor 101 returns from ACT38 in Figure 4 to ACT16 in Figure 3. This allows the control device 100 to prompt the user to wash their hands until all procedures are completed.

[0063] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 determines that the subject has completed each step, regardless of the order in which the subject performed steps (3) to (8). Therefore, the subject can perform steps (3) to (8) in any order they like.

[0064] Furthermore, according to the hygiene management system 1 of this embodiment, the processor 101 of the control device 100 stores the results of the handwashing operations of the target in an auxiliary storage device 104 or the like, in association with the personal ID. This allows the operator of the hygiene management system 1 to check the history information of handwashing performed in the past for each of the multiple targets.

[0065] Furthermore, according to the hygiene management system 1 of the embodiment, the processor 101 of the control device 100 controls the passage control device 600 so that if the subject has not completed all of steps (1) to (9), the subject cannot pass through a gate or door, etc. In this way, the processor 101 of the control device 100 prevents the subject who has not completed the handwashing operation from entering a clean area, etc.

[0066] The above embodiment can also be modified as follows. In the above embodiment, the control device 100 notified the target by displaying each screen on the display device 400. However, the control device 100 may notify the target by other means. For example, the control device 100 may notify the target by using sound output from a speaker or by turning on and off a light source such as an LED (light-emitting diode).

[0067] In the above embodiment, a processor in the imaging device 200 may perform some of the processing that the processor 101 of the control device 100 would normally do. For example, the processor in the imaging device 200 may perform image processing such as image recognition and motion recognition. Alternatively, the processor in the imaging device 200 may perform processing to determine whether or not the target has executed a procedure. The imaging device 200 inputs these processing results to the control device 100 via the communication interface 105. The control device 100 then performs the processing based on these processing results.

[0068] The processor 101 may implement some or all of the processing implemented by the program in the above embodiment through the hardware configuration of the circuit.

[0069] In the above embodiment, the control device 100 is transferred to an administrator of the control device 100, for example, with a program for executing each of the above processes stored within it. Alternatively, the control device 100 is transferred to an administrator without the program stored within it. The program is then transferred separately to the administrator and stored in the control device 100 based on an operation by the administrator or service technician. This transfer of the program can be achieved, for example, using a removable storage medium such as disk media or semiconductor memory, or by downloading it via the Internet or LAN.

[0070] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. The original claims are included below. [1] A recognition unit that uses image recognition to recognize that the object has performed the constituent actions that constitute the handwashing action, A hygiene management device comprising: an execution unit that performs different processing depending on whether or not the target has performed a predetermined set of configuration operations. [2] The hygiene management device according to [1], wherein the execution unit controls the notification unit to notify that there is a configuration operation that has not been performed if the target has not performed at least one of a predetermined plurality of configuration operations. [3] A unit that identifies identification information for identifying the aforementioned target, The hygiene management device according to [1] or [2], further comprising: a storage unit that stores, in association with the identification information, the fact that the object has performed the configuration operation. [4] The sanitation control device according to any one of [1] to [3], wherein the execution unit controls a traffic control device to stop the passage of the target if the target is not performing at least one of a plurality of predetermined configuration operations. [5] A hygiene management method that uses image recognition to recognize that an object has performed a set of constituent actions that constitute a handwashing action, and performs different processing depending on whether or not the object has performed a predetermined set of constituent actions. [6] The computer installed in the hygiene management device A recognition unit that uses image recognition to recognize that the subject has performed the constituent actions that constitute the handwashing action, An execution unit that performs different processing depending on whether the target has performed one of the predetermined configuration operations, and a program for causing it to function as such. [Explanation of Symbols]

[0071] 1... Sanitation management system, 100... Control device, 101... Processor, 102... ROM, 103... RAM, 104... Auxiliary storage device, 105... Communication interface, 106... Bus, 200... Imaging device, 300... Input device, 400... Display device, 500... Audio output device, 600... Traffic control device, 700... Lighting device

Claims

1. A recognition unit that uses image recognition to recognize that the subject has performed the constituent actions that constitute the handwashing action, An image generation unit generates a first image showing the procedure of a first group of handwashing actions, which require the handwashing actions to be performed in a specific order from among a predetermined set of configuration actions, and a second image showing a second group of handwashing actions, which does not require the order of the handwashing actions after the first group of configuration actions. An output unit outputs the first image to a display device, and if it is determined that the target has performed the steps of the first hand-washing action group, it outputs a second image to the display device. A hygiene management device equipped with the following features.

2. The hygiene management device according to claim 1, further comprising an execution unit that recognizes hand-washing operations constituting the second hand-washing operation group via the recognition unit, adds a count associated with the hand-washing operation, and associates a flag indicating that the hand-washing operation has been completed when the count reaches a preset threshold.

3. The computer installed in the hygiene management device A recognition unit that uses image recognition to recognize that the subject has performed the constituent actions that constitute the handwashing action, An image generation unit generates a first image showing the procedure of a first group of handwashing actions, which require the handwashing actions to be performed in a specific order from among a predetermined set of configuration actions, and a second image showing a second group of handwashing actions, which does not require the order of the handwashing actions after the first group of configuration actions. An output unit outputs the first image to a display device, and if it is determined that the target has performed the steps of the first hand-washing action group, it outputs a second image to the display device. A program to make it work.

4. The program according to claim 3, which causes the computer to function as an execution unit that recognizes hand-washing operations constituting the second hand-washing operation group via the recognition unit, adds a count associated with the hand-washing operation, and associates a flag indicating that the hand-washing operation has been completed when the count reaches a preset threshold.

Images