Information processing device and program

Abstract

To provide an information processing device and a program that can determine whether hand washing has been performed appropriately, even if a user performed an action that did not follow a predetermined pattern.SOLUTION: A motion determination device includes a pattern setting unit that configures a handwashing pattern, prepared in advance and containing the sequence of multiple handwashing motions, the duration of each handwashing motion, and the total handwashing time, in a form corresponding to identification information for identifying a user, a motion identification unit that identifies, from an image including the user's fingers, which of the multiple handwashing motions the user is performing, a pattern update unit that updates the duration and total handwashing time set by the pattern setting unit when the duration of the identified handwashing motion exceeds the duration set by the pattern setting unit, and a motion determination unit that determines whether the user's sequence of handwashing motions, their duration, and the total handwashing time are appropriate, on the basis of the handwashing pattern set by the pattern setting unit or updated by the pattern update unit.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] A system for determining whether hand washing has been performed according to a predetermined procedure is known (for example, Patent Document 1). This system identifies a user's hand washing behavior and determines whether the identified hand washing behavior conforms to a specific hand washing pattern.

[0003] In such systems, hand-washing behavior is judged by applying an appropriate pattern according to the area, such as a food factory, hospital, shop, restaurant, nursing care facility, or educational facility. However, depending on the characteristics of the object to be identified, such as an individual, or the process in charge, events such as hand-washing lasting longer than expected may occur. In such cases, it is not possible to apply an appropriate pattern prepared in advance for judgment, which poses a problem in that it is not possible to present an appropriate judgment result according to the object to be identified. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to provide an information processing device and program that can determine whether hand washing has been performed properly even if the user performs actions that do not follow a pre-prepared pattern. [Means for solving the problem]

[0005] An information processing device according to an embodiment includes an identification information acquisition unit, a pattern setting unit, an image acquisition unit, a motion identification unit, a duration measurement unit, a pattern update unit, and a motion determination unit. The identification information acquisition unit acquires identification information for identifying a user. The pattern setting unit sets a hand-washing pattern, which includes a pre-prepared sequence of multiple hand-washing actions, the duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information. The image acquisition unit acquires an image including the user's hands and fingers. The motion identification unit identifies which of the multiple hand-washing actions the user is performing from the image acquired by the image acquisition unit. The duration measurement unit measures the duration of the hand-washing action identified by the motion identification unit. If the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit, the pattern update unit updates the duration and total hand-washing time set by the pattern setting unit. The motion determination unit determines whether the sequence, duration, and total hand-washing time of the user's hand-washing actions are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern update unit. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a first diagram showing an example of a schematic configuration of a motion determining device according to the first embodiment. [Figure 2] FIG. 2 is a second diagram illustrating an example of a schematic configuration of the movement determining device according to the first embodiment. [Figure 3] FIG. 3 is a hardware block diagram illustrating an example of a hardware configuration of the operation determining device according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a hand-washing pattern. [Figure 5] FIG. 5 is a diagram illustrating an example of the pattern setting table. [Figure 6] FIG. 6 is a diagram illustrating an example of the feature quantity model table. [Figure 7] FIG. 7 is a diagram illustrating an example of the operation class table. [Figure 8] FIG. 8 is a diagram illustrating an example of the identification information table. [Figure 9]FIG. 9 is a diagram illustrating an example of the area information table. [Figure 10] FIG. 10 is a functional block diagram illustrating an example of the functional configuration of the movement determining device according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of an instruction screen displayed on an input / output device by the movement determining device of the first embodiment. [Figure 12] FIG. 12 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the first embodiment. [Figure 13] FIG. 13 is a second flowchart showing an example of the flow of processing performed by the movement determining device of the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a pattern setting table used by the movement determining device of the second embodiment. [Figure 15] FIG. 15 is a functional block diagram illustrating an example of the functional configuration of the movement determining device according to the second embodiment. [Figure 16] FIG. 16 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment. [Figure 17] FIG. 17 is a second flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] (First embodiment) A motion determining device 1 according to a first embodiment of the present disclosure will be described below with reference to the drawings. Note that the present invention is not limited to the embodiments described below.

[0008] (Schematic configuration of the motion determination device) The schematic configuration of a movement determination device 1 according to an embodiment will be described with reference to Figures 1 and 2. Figure 1 is a first diagram showing an example of the schematic configuration of the movement determination device according to the first embodiment. Figure 2 is a second diagram showing an example of the schematic configuration of the movement determination device according to the first embodiment.

[0009] The movement determination device 1 according to the embodiment determines whether a user's hands have been washed in a predetermined procedure. The movement determination device 1 captures an image of the user's hands in a sink or the like. The movement determination device 1 determines a movement class of the user's hands from the captured image. A movement class is a hand movement included in a series of hand-washing movements and classified by the parts to be washed, etc. For example, the movement determination device 1 determines hand movements classified by the parts to be washed (back of the hand, between the fingers, thumb, etc.) as movement classes. The movement determination device 1 determines whether the user's hands have been washed in a predetermined procedure based on the order of the movement classes, the duration of the movements, etc. The movement determination device 1 is an example of an information processing device in the present disclosure.

[0010] As shown in FIG. 1, the motion determination device 1 includes a camera 3, an input / output device 5, a reader 6, a sink 20, a faucet 21, and the like.

[0011] Sink 20 is a water tub where a user washes their hands. Sink 20 has a recessed structure. A drain groove is formed at the bottom of sink 20. In addition, faucet 21 is installed in sink 20. Faucet 21 releases water for a user to wash their hands with. The released water is discharged from the drain groove of sink 20. Note that faucet 21 may release water in response to a user's opening operation, or may have a function to detect when a user approaches faucet 21, and when it detects that a user has approached faucet 21, continue to release an appropriate amount of water until the user moves their hand away from faucet 21.

[0012] Camera 3 is installed facing downward above sink 20. Camera 3 captures an area (photographed area) including the user's fingers at a speed of, for example, 10 frames per second. Camera 3 captures two-dimensional images (photographed images). Camera 3 may be a digital camera that outputs color information (RGB (Red Green Blue)) for each pixel. Camera 3 may also be equipped with a light that illuminates the user's hands.

[0013] The input / output device 5 is a monitor, such as a liquid crystal monitor or an organic EL monitor, installed in a position visible to the user. The input / output device 5 also has a touch panel laminated on the display surface of the monitor. In this embodiment, the input / output device 5 is installed in front of a user washing their hands at the sink 20. The input / output device 5 has a display function for displaying image information on the monitor in accordance with instructions from a control device 10 (see FIG. 3) included in the movement determination device 1. The input / output device 5 also has an operation function for acquiring operation information performed by a user touching the touch panel and outputting the acquired operation information to the control device 10 (see FIG. 3) included in the movement determination device 1.

[0014] The reader 6 is an acquisition device that acquires identification information that identifies a user. For example, the reader 6 acquires identification information (such as an ID) that identifies a user from a medium (such as an IC card or an RFID (radio frequency identification) tag) that the user possesses. The reader 6 connects to the medium via a wired or wireless connection and acquires the identification information from the medium. The reader 6 may also be a device that reads codes such as barcodes or two-dimensional codes. The identification information may be information that identifies an individual user, or may indicate the user's position (such as a member of the cooking department or a plating worker).

[0015] The configuration of the motion determination device is not limited to the example shown in Fig. 1. Fig. 2 shows an example of a motion determination device 1' having another configuration. Like the motion determination device 1, the motion determination device 1' is composed of a camera 3, an input / output device 5, a reader 6, a sink 20, a faucet 21, and the like. The motion determination device 2 is an example of an information processing device in the present disclosure.

[0016] In particular, in the motion determination device 1', the camera 3 is installed on the left side as viewed from the sink 20. The camera 3 captures an image of an area including the user's fingers from the left side. In addition, in the motion determination device 2, the input / output device 5 is installed in the left corner of the sink 20. The other configurations are the same as those of the motion determination device 1, and therefore description thereof will be omitted.

[0017] In this way, the motion determining device allows various modifications depending on the location where the device is installed.

[0018] (Hardware configuration of the motion determination device) The hardware configuration of the movement determining device 1 will be described with reference to Fig. 3. Fig. 3 is a hardware block diagram showing an example of the hardware configuration of the movement determining device of the first embodiment. Note that the hardware configuration of the movement determining device 1 is the same as the hardware of the movement determining device 1', so only the movement determining device 1 will be described here.

[0019] 3, the movement determining device 1 includes a control device 10, a camera 3, an input / output device 5, and a reader 6. The control device 10, the camera 3, the input / output device 5, and the reader 6 are connected to each other so that they can communicate with each other.

[0020] The control device 10 includes a processor 11, a ROM 12, a RAM 13, a memory 14, a communication I / F 15, a camera I / F 16, an input / output I / F 18, and a reader I / F 19. The control device 10 is a desktop PC, a notebook PC, a tablet PC, a smartphone, or the like.

[0021] The processor 11, the ROM 12, the RAM 13, the memory 14, the communication I / F 15, the camera I / F 16, the input / output I / F 18, and the reader I / F 19 are communicatively connected to each other.

[0022] The camera I / F 16 is communicably connected to the camera 3. The input / output I / F 18 is communicably connected to the input / output device 5. The reader I / F 19 is communicably connected to the reader 6. The functions of the camera 3, the input / output device 5, and the reader 6 are as described above.

[0023] The processor 11 controls the overall operation of the control device 10. The processor 11 may include an internal cache and various interfaces. The processor 11 executes control programs stored in advance in the internal cache, the ROM 12, or the memory 14, thereby realizing various processes.

[0024] Some of the various functions realized by the processor 11 executing the control program may be realized by hardware circuits. In this case, the processor 11 controls the functions executed by the hardware circuits.

[0025] The ROM 12 is a non-volatile memory in which control programs, control data, etc. are stored in advance. The control programs and control data stored in the ROM 12 are pre-installed in accordance with the specifications of the control device 10. The ROM 12 stores, for example, a program for controlling the circuit board of the control device 10.

[0026] The RAM 13 is a volatile memory that temporarily stores data being processed by the processor 11. The RAM 13 also functions as a work area for expanding and executing control programs read from the ROM 12 or memory 14.

[0027] The memory 14 is a non-volatile memory to which data can be written and rewritten. The memory 14 is configured, for example, by an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory. The memory 14 stores a control program P that operates the control device 10 and various data required to operate the control program P.

[0028] The memory 14 also stores in advance a pattern setting table 22 showing multiple hand-washing patterns, a feature model table 23 showing feature models used to determine hand-washing classes, an action class table 24 showing action classes, an identification information table 25 showing hand-washing patterns for each user, an area information table 26 showing the user's movement history, update history data 27, and feature models 28. The contents of each table will be described in detail later.

[0029] The memory 14 also stores in advance a feature model 28 for determining the hand movement class. The feature model 28 is, for example, a network obtained by machine learning. Because technology for building a network that identifies an input pattern based on data obtained by machine learning is well known, an example of the feature model 28 will not be described here.

[0030] The communication I / F 15 is an interface for transmitting and receiving data to and from an external device. The communication I / F 15 connects to the external device via a network or the like. The communication I / F 15 supports, for example, a wired or wireless LAN (Local Area Network) connection.

[0031] The camera I / F 16 is an interface for transmitting and receiving data to and from the camera 3. The camera I / F 16 transmits a signal instructing the camera 3 to take a photograph based on an instruction from the processor 11. The camera I / F 16 also acquires an image taken by the camera 3. The camera I / F 16 may be one that supports a USB (Universal Serial Bus) connection or one that supports a connection via Camera Link.

[0032] The input / output I / F 18 is an interface for transmitting and receiving data to and from the input / output device 5. The input / output I / F 18 receives a signal indicating an operation accepted from the user from the input / output device 5. The input / output I / F 18 transmits the signal received from the input / output device 5 to the processor 11. Furthermore, the input / output I / F 18 transmits information indicating a screen to be displayed to the user to the input / output device 5 based on an instruction from the processor 11. The input / output I / F 18 may be one that supports a USB connection or one that supports a connection via a parallel interface.

[0033] The reader I / F 19 is an interface for transmitting and receiving data to and from the reader 6. The reader I / F 19 transmits a signal to start the reader 6 based on an instruction from the processor 11. The reader I / F 19 also transmits identification information received from the reader 6 to the processor 11. The reader I / F 19 may support a USB connection.

[0034] 3, the control device 10 may include other components as needed, or certain components may be excluded from the control device 10. Furthermore, the communication I / F 15, the camera I / F 16, the input / output I / F 18, and the reader I / F 19 (or some of these) may be integrally configured.

[0035] (Hand-washing pattern explanation) Hand-washing patterns will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of a hand-washing pattern.

[0036] The hand-washing pattern is a hand-washing pattern performed by a user, which is associated with the shooting environment, the location, and the type, order, and duration of hand-washing actions. The action determination device 1 determines whether the hand-washing action performed by the user matches the set hand-washing pattern.

[0037] FIG. 4 shows examples of three types of hand-washing patterns, namely, hand-washing pattern A, hand-washing pattern B, and hand-washing pattern C.

[0038] Hand-washing pattern A is used to determine the hand-washing procedure in factory "A." Hand-washing pattern A indicates that the hand-washing procedure consists of action classes C3, C4, and C5, each lasting 5 seconds. Hand-washing pattern A is also applied when camera 3 captures the user's hands from above (see Figure 1).

[0039] Hand-washing pattern B is used to determine the hand-washing procedure in factory "A." Like hand-washing pattern A, hand-washing pattern B indicates that the hand-washing procedure consists of action classes C3, C4, and C5, each lasting 5 seconds in that order. Hand-washing pattern B is also used when camera 3 captures the user's hands from the side (here, from the left) (see Figure 2).

[0040] Hand-washing pattern C is used to determine the hand-washing procedure in factory "I." Hand-washing pattern C indicates that the hand-washing procedure consists of action classes C3, C4, C5, and C6, performed in any order, for a total of 20 seconds. Hand-washing pattern C is also used when camera 3 captures the user's hands from above (see Figure 1).

[0041] Although Figure 4 shows an example of three hand-washing classes, the number of hand-washing classes is not limited to three.

[0042] (Explanation of pattern setting table) The pattern setting table 142 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the pattern setting table.

[0043] 5 in the memory 14. The pattern setting table 22 stores a pattern ID 221, a movement order ID 222, a movement class ID 223, a movement duration 224, a feature model ID 225, a total hand-washing time 226, and a pattern update content 227 in association with each other.

[0044] Pattern ID 221 is an identification number (ID) that identifies a hand-washing pattern. Pattern setting table 22 shown in Figure 5 stores four hand-washing patterns: a "default" hand-washing pattern, hand-washing pattern A, hand-washing pattern B, and hand-washing pattern C.

[0045] The hand washing pattern "default" indicates a hand washing pattern when no hand washing pattern is specified.

[0046] Hand-washing patterns A, B, and C are all as described above.

[0047] The "action order ID" indicates the execution order of the action class. For example, in the pattern setting table 22, for hand washing pattern A, "1" is stored as the action order ID 222 corresponding to "3" as the action class ID 223 (i.e., action class C3). That is, in the pattern setting table 22, for hand washing pattern A, "1" is stored as the execution order of action class C3.

[0048] Similarly, pattern setting table 22 stores, as the action sequence ID 222 for hand washing pattern A, "2" as the execution order of action class C4 ("4" as action class ID 223), "3" as the execution order of action class C5 ("5" as action class ID 223), and "4" as the execution order of action class C6 ("6" as action class ID 223). That is, hand washing pattern A is defined so that hand washing actions progress in the order of action class C3, action class C4, action class C5, and action class C6.

[0049] Similarly, the pattern setting table 22 stores the same information as the action sequence ID 222 for hand-washing pattern A as the action sequence ID 222 for hand-washing pattern B.

[0050] Furthermore, in the hand-washing pattern C, the pattern setting table 22 stores "0" as the action order ID 222 corresponding to each action class ID 223. That is, the pattern setting table 22 indicates that in the hand-washing pattern C, each action class is executed in no particular order.

[0051] The action class ID 223 in the pattern setting table 22 indicates the action class to be executed in the hand washing pattern. In this embodiment, the action class ID 223 stores any of the numbers from "1" representing action class C1 to "6" representing action class C6. That is, in this embodiment, action classes Ci (i = 1 to 6) are defined. Note that the total number of action classes is not limited to this example.

[0052] Action class C1 represents the action of "wetting hands with water" when washing hands.

[0053] Action class C2 represents the action of "applying detergent to hands" when washing hands.

[0054] Action class C3 represents the action of "lathering soap well" when washing hands.

[0055] Action class C4 represents the action of "rubbing the back of the hand" when washing hands.

[0056] Action class C5 represents the action of "rubbing between the fingers" when washing hands.

[0057] Action class C6 represents the action of "rubbing the thumbs" when washing hands.

[0058] Action duration 224 indicates the duration of the corresponding action class. For example, in hand-washing pattern A, pattern setting table 22 stores "5 seconds" as action duration 224 corresponding to action class ID 223 "3" (action class C3). That is, pattern setting table 22 indicates that action class C3 lasts for 5 seconds in hand-washing pattern A.

[0059] Furthermore, the pattern setting table 22 stores "0s" as the action duration 224 corresponding to each action class ID 223 in the hand-washing pattern C. This indicates that the duration of each of the action classes C3, C4, C5, and C6 in the hand-washing pattern C does not matter.

[0060] Furthermore, the pattern setting table 22 stores "20s" as the final action duration 224 for hand-washing pattern C. This indicates that the total duration of each action class in hand-washing pattern C is 20 seconds.

[0061] The feature model ID 225 is an ID that identifies the feature model 28 used to determine the action class. The feature model ID 225 corresponds to the direction in which the camera 3 captures an image of the hand. In this embodiment, when the camera 3 captures an image of the hand from above (see FIG. 1), the feature model ID 225 stores "H1". When the camera 3 captures an image of the hand from the side (see FIG. 2), the feature model ID 225 stores "H2".

[0062] Total hand washing time 226 indicates the upper limit of the time a user spends washing their hands. For example, pattern setting table 22 stores "30 seconds" as total hand washing time 226 for hand washing pattern A. That is, pattern setting table 22 indicates that the upper limit of the time a user spends washing their hands in hand washing pattern A is 30 seconds. In this embodiment, hand washing pattern B also stores "30 seconds" as total hand washing time 226. Note that total hand washing time 226 may be set to "no upper limit," as in hand washing pattern C.

[0063] For the hand washing pattern "default," the pattern setting table 22 stores "1" as the operation sequence ID 222 corresponding to the operation class ID 223 "3" (operation class C3), stores "2" as the operation sequence ID 222 corresponding to the operation class ID 223 "4" (operation class C4), and stores "3" as the operation sequence ID 222 corresponding to the operation class ID 223 "5" (operation class C5).

[0064] Furthermore, the pattern setting table 22 stores "10 seconds" as the action duration 224 corresponding to each action class ID 223 in the hand washing pattern "default."

[0065] Furthermore, in the pattern setting table 22, for the hand washing pattern "default", the feature amount model ID 225 stores "H1" which indicates the feature amount when the camera 3 photographs the hand from above.

[0066] Furthermore, the pattern setting table 22 stores "35 seconds" as the total hand washing time 226 for the hand washing pattern "default."

[0067] The pattern update content 227 stores the change content (update content) of the set pattern when a predetermined condition is satisfied.

[0068] For the hand washing pattern "default", the pattern update contents 227 store that the action duration of each action class is extended by 5 seconds only the first time, the total hand washing time is extended by 10 seconds, and the number of updates is unlimited.

[0069] For hand washing pattern A, pattern update content 227 stores that the total hand washing time is to be extended by 20 seconds and that the number of updates is to be limited to two.

[0070] For hand washing pattern B, pattern update content 227 stores that the action duration of each action class is extended by 5 seconds only the first time, that the total hand washing time is extended by 20 seconds, and that the number of updates is limited to three.

[0071] Then, for hand washing pattern C, it is stored that pattern updating will not be performed.

[0072] The pattern setting table 22 may be updated as needed in accordance with an operator's operation or the like.

[0073] (Feature model table explanation) The feature quantity model table 23 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the feature quantity model table.

[0074] The movement determination device 1 stores a feature amount model table 23 shown in Fig. 6 in the memory 14. The feature amount model table 23 stores a feature amount model ID 231, a corresponding movement class ID 232, and a shooting environment 233 in association with each other.

[0075] The feature quantity model ID 231 is an ID for identifying the feature quantity model 28. The feature quantity model ID 231 is the same as the feature quantity model ID 225 described above.

[0076] The corresponding action class ID 232 indicates an action class ID that can be determined by the feature model 28. Here, it indicates that both H1 and H2 stored in the feature model ID 231 can determine action classes corresponding to the action classes C1 to C6.

[0077] The shooting environment 233 indicates the shooting environment corresponding to the feature quantity model ID 231. Here, it indicates that H1 stored in the feature quantity model ID 231 in the feature quantity model table 23 corresponds to a photographed image photographed from above. Also, it indicates that H2 stored in the feature quantity model ID 231 corresponds to a photographed image photographed from the side (left and right).

[0078] The feature quantity model table 23 may be updated as needed in accordance with an operation by an operator or the like.

[0079] (Explanation of the Action Class Table) The operation class table 24 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the operation class table.

[0080] The action determining device 1 stores an action class table 24 shown in Fig. 7 in the memory 14. The action class table 24 stores an action class ID 241, an action class display name 242, and an action class display image 243 in association with each other.

[0081] The action class ID 241 is an ID that identifies an action class. The action class ID 241 is the same as the above-mentioned action class ID 223. Note that Fig. 7 shows, as an example, only the cases where the action class ID 241 is "3" representing action class C3, "4" representing action class C4, and "5" representing action class C5.

[0082] The action class display name 242 is a character string indicating an action class. For example, the action class display name 242 indicates "Lather well" as the action class display name for action class C3. The action class display name 242 also indicates "Rub the backs of the hands" as the action class display name for action class C4. The action class display name 242 also indicates "Rub the spaces between the fingers" as the action class display name for action class C4.

[0083] The action class display image 243 is an image showing an action class. For example, the action class display image 243 is configured by an image in which an action class display name 242 is superimposed on an illustration of the action class, as shown in FIG.

[0084] The action class table 24 may be updated as needed in accordance with an operator's operation or the like.

[0085] (Description of the identification information table) The identification information table 25 will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the identification information table.

[0086] The movement determination device 1 stores an identification information table 25 shown in Fig. 8 in the memory 14. The identification information table 25 indicates changes made to the set hand-washing pattern for each user. The identification information table 25 stores, in association with each other, identification information 251, pattern change type 252, movement order ID 253, movement class ID 254, movement duration 255, feature model ID 256, total hand-washing time 257, and change condition description 258.

[0087] The identification information 251 is identification information for identifying a user. The identification information 251 may indicate a specific user (such as worker A) or may indicate a position (such as a member of the cooking department or a person engaged in plating).

[0088] The pattern change type 252 indicates a method for changing the hand-washing pattern of the user indicated by the corresponding identification information. The pattern change type 252 is, for example, "difference to default pattern" or "overwrite to default pattern."

[0089] "Difference to default pattern" indicates that the hand-washing pattern is changed by applying difference information to the set hand-washing pattern (default pattern).

[0090] "Overwrite default pattern" indicates that the hand-washing pattern is changed by overwriting the default pattern with override information.

[0091] The action order ID 253 indicates the order of the action classes. When the pattern change type 252 is "difference to default pattern," the action order ID 253 indicates addition or deletion to or deletion from the order of the action classes in the default pattern. When the pattern change type 252 is "overwrite to default pattern," the action order ID 253 indicates the order of the action classes. Note that the action order ID 253 is the same as the action order ID 222 described above.

[0092] The action class ID 254 indicates an action class. When the pattern change type 252 is "difference to default pattern," the action class ID 254 indicates an action class corresponding to the added or deleted action order ID 253. When the pattern change type 252 is "overwrite to default pattern," the action class ID 254 indicates an action class in the corresponding action order ID 253. The action class ID 254 is the same as the action class ID 223 and action class ID 241 described above.

[0093] The action duration 255 indicates the duration of the corresponding action class. If the pattern change type 252 is "difference to default pattern," the action duration 255 indicates an extension or shortening of the action duration of the action class in the default pattern. The action duration 255 also indicates the action duration of the action class indicated by the added action class ID 254.

[0094] Furthermore, when the pattern change type 252 is "overwrite to default pattern," the operation duration 255 indicates the operation duration of the operation class indicated by the corresponding operation class ID 254. Note that the operation duration 255 is the same as the operation duration 224 described above.

[0095] The feature quantity model ID 256 is an ID that identifies the feature quantity model 28 used to determine the action class. The feature quantity model ID 256 indicates the feature quantity model ID after the change (or no change). Note that the feature quantity model ID 256 is the same as the feature quantity model ID 225 and the feature quantity model ID 231 described above.

[0096] The total hand washing time 257 indicates the upper limit of the time for the user to wash their hands. If the pattern change type 252 is "difference to default pattern," the total hand washing time 257 indicates the extension or shortening of the total hand washing time in the default pattern. If the pattern change type 252 is "overwrite to default pattern," the total hand washing time 257 indicates the total hand washing time after the change.

[0097] The change condition explanation 258 is information indicating the content of the change for each user. Fig. 8 shows, as an example, the content of the change condition explanation 258 when the set default pattern is hand washing pattern A.

[0098] If the pattern change type 252 is "difference to default pattern," the change condition description 258 indicates the content of the change to the default pattern. If the pattern change type 252 is "overwrite to default pattern," the change condition description 258 indicates the content of the hand washing pattern after the change.

[0099] The identification information table 25 may include other configurations as needed in addition to the configuration shown in FIG. 8, or specific configurations may be excluded from the identification information table 25.

[0100] Furthermore, the identification information table 25 may be updated as needed in accordance with an operator's operation or the like.

[0101] (Description of the area information table) The area information table 26 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of the area information table.

[0102] The movement determination device 1 stores an area information table 26 shown in Fig. 9 in the memory 14. The area information table 26 indicates changes to hand-washing patterns according to area information and identification information. The area information table 26 stores area information 261, identification information 262, pattern change type 263, movement order ID 264, movement class ID 265, movement duration 266, feature model ID 267, total hand-washing time 268, and change condition description 269 in association with each other.

[0103] The area information 261 indicates the user's movement history. The area information table 26 shown in Fig. 9 indicates changes to the hand-washing pattern of a user who has moved from a non-clean area to a clean area. The behavior determination device 1 recognizes that the user has moved from a non-clean area to a clean area, for example, by having the reader 6 installed at the entrance to the clean area read the user's identification information via the reader I / F 19.

[0104] The identification information 262 is identification information that identifies a user. Here, the identification information 262 may indicate a specific user (such as worker A) or may indicate a position (such as a member of the cooking department or a person engaged in plating work). Furthermore, the identification information 262 may indicate "no limitation (all targets)" which indicates all users.

[0105] The pattern change type 263 indicates how to change the hand-washing pattern of the user of the corresponding area information and identification information. Here, the pattern change type 263 is "difference to default pattern," "difference by identification information to default pattern and difference to specific identification information in area information," or "overwrite."

[0106] "Difference to default pattern" indicates that the hand-washing pattern is changed by applying difference information to the set hand-washing pattern (default pattern).

[0107] "Differences based on identification information relative to the default pattern, and differences relative to specific identification information in the area information" indicates that the hand-washing pattern is changed by further applying difference information to a hand-washing pattern obtained by changing the default pattern according to the identification information.

[0108] "Overwrite" indicates that the hand-washing pattern is changed by overwriting the default pattern with override information.

[0109] The action order ID 264 indicates the order of the action classes. If the pattern change type 263 is "difference to default pattern" or "difference based on identification information from the default pattern and difference from specific identification information in the area information," the action order ID 264 indicates addition or deletion to or deletion from the order of the action classes in the hand washing pattern changed according to the default pattern or identification information. If the pattern change type 263 is "overwrite," the action order ID 264 indicates the order of the action classes.

[0110] The action class ID 265 indicates an action class. When the pattern change type 263 is "difference to default pattern" or "difference based on identification information from the default pattern, and difference from specific identification information in the area information," the action class ID 265 indicates an action class corresponding to the added or deleted action order ID 264. When the pattern change type 263 is "overwrite," the action class ID 265 indicates an action class in the corresponding action order ID 264.

[0111] Action duration 266 indicates the duration of the corresponding action class. When pattern change type 263 is "difference to default pattern" or "difference based on identification information from the default pattern, and difference based on specific identification information in the area information," action duration 266 indicates the extension or shortening of the action duration of the action class in the hand-washing pattern after the change based on the default pattern or identification information. Also, action duration 266 indicates the action duration of the action class indicated by added action class ID 265.

[0112] If the pattern change type 263 is “overwrite”, the action duration 266 indicates the action duration of the action class indicated by the corresponding action class ID 265 .

[0113] The feature quantity model ID 267 is an ID for identifying the feature quantity model 28 used to determine the action class. The feature quantity model ID 267 indicates the feature quantity model ID after the change, or "no change."

[0114] The total hand washing time 268 indicates the upper limit of the time a user can wash their hands. If the pattern change type 263 is "difference to default pattern" or "difference based on identification information for the default pattern, and difference based on specific identification information in the area information," the total hand washing time 268 indicates the extension or shortening of the total hand washing time in the default pattern or hand washing pattern after the change based on the identification information. If the pattern change type 263 is "overwrite," the total hand washing time 268 indicates the total hand washing time after the change.

[0115] The change condition explanation 269 is information indicating the change content of the pattern. As an example, Fig. 9 shows the change condition content when the set default pattern is hand washing pattern A.

[0116] If the pattern change type 263 is "difference to default pattern," the change condition description 269 indicates the content of the change to the default pattern. If the pattern change type 263 is "overwrite," the change condition description 269 indicates the content of the hand washing pattern after the change.

[0117] Note that the area information table 26 may include other configurations as needed in addition to the configuration shown in FIG. 9, and specific configurations may be excluded from the area information table 26.

[0118] The area information table 26 may be updated as needed in accordance with an operator's operation or the like.

[0119] (Explanation of update history data) The update history data 27 is data in which the update history of the action duration and total hand-washing time acquired by the action determination device 1 is stored in association with the user's identification information. The update history data 27 may further store the update date and time.

[0120] (Functional configuration of the motion determination device) The functional configuration of the movement determining device 1 will be described with reference to Fig. 10. Fig. 10 is a functional block diagram showing an example of the functional configuration of the movement determining device of the first embodiment.

[0121] The processor 11 reads out the control program P stored in the memory 14, expands it in the RAM 13, and executes it, thereby realizing the following functional parts: a hand-washing pattern input unit 31, an identification information acquisition unit 32, an area information acquisition unit 33, a pattern setting unit 34, an image acquisition unit 35, a motion identification unit 36, a duration measurement unit 37, a pattern update unit 38, an update history storage unit 39, a motion determination unit 40, a display control unit 41, and an operation control unit 42, all of which are shown in Fig. 10. Note that all or part of these functional parts may be realized by dedicated hardware.

[0122] The hand-washing pattern input unit 31 acquires the input hand-washing pattern. The hand-washing pattern input unit 31 acquires the hand-washing pattern input from the input / output device 5 via the input / output I / F 18, for example.

[0123] The identification information acquisition unit 32 acquires identification information 262 that identifies a user. Specifically, the identification information acquisition unit 32 acquires, by the reader 6, identification information (such as an ID) that identifies a user from a medium possessed by the user.

[0124] The area information acquisition unit 33 acquires area information 261 that indicates the movement history of the user.

[0125] The pattern setting unit 34 sets the pattern setting table 22, which has pre-prepared hand washing patterns registered therein, including the order of multiple hand washing actions, the duration of each of the hand washing actions, and the total hand washing time, in the form registered in the area information table 26 based on the identification information acquired by the identification information acquisition unit 32 and the area information acquired by the area information acquisition unit 33.

[0126] The image acquisition unit 35 controls the camera 3 to acquire an image including the user's fingers.

[0127] The action identifying unit 36 ​​identifies, from the image acquired by the image acquiring unit 35, which of a plurality of hand-washing actions the user is performing, that is, the action class Ci (i=0 to 6).

[0128] The duration measuring unit 37 measures the duration of the hand-washing action identified by the action identifying unit 36. Note that the duration measuring unit 37 measures the duration for each action class ID 223.

[0129] When the duration measured by the duration measuring unit 37 is longer than the duration set by the pattern setting unit 34, the pattern updating unit 38 updates the duration and total hand washing time set by the pattern setting unit 34 based on the pattern update content 227 (see FIG. 5). Furthermore, the pattern updating unit 38 updates the duration and total hand washing time set by the pattern setting unit 34 for the same user within a predetermined upper limit value range.

[0130] The update history storage unit 39 stores the update history by the pattern update unit 38 in the update history data 27 in association with the user's identification information.

[0131] The action determination unit 40 determines whether the steps, duration, and total hand washing time of the user's hand washing action are appropriate based on the hand washing pattern set by the pattern setting unit 34 or the hand washing pattern updated by the pattern update unit 38.

[0132] Display control unit 41 causes input / output device 5 to display instruction screen 50 showing hand-washing procedures and the determination results of movement determination device 1. Details of instruction screen 50 will be described later (see FIG. 11).

[0133] The operation control unit 42 acquires operation information for the input / output device 5 (for example, information indicating that an operator 54 (see FIG. 11), which will be described later, has been pressed), and outputs the information to the processor 11. The processor 11 controls the movement determining device 1 in accordance with the acquired operation information.

[0134] (Instruction screen display) The contents of the instruction screen 50 displayed on the input / output device 5 by the movement determining device 1 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of an instruction screen displayed on the input / output device by the movement determining device of the first embodiment.

[0135] 11 on the display screen of the monitor of the input / output device 5. The instruction screen 50 includes an icon 51, an icon 52, and an operator 54.

[0136] The icon 51 displays an action class display image 243 (see FIG. 7). The icon 51 also includes achievement information 53 indicating whether the action class corresponding to the action class display image has been completed. FIG. 11 shows an example in which the icon 51 displays "◯" as achievement information 53 indicating that the action class has been completed, or "X" as achievement information 53 indicating that the action class has not been completed. Furthermore, the icon 51 may display an order corresponding to the action class.

[0137] The instruction screen 50 also displays the same number of icons 51 as the number of action classes indicated by the hand-washing pattern.

[0138] The icon 52 indicates the progress of the action classes. In Fig. 11, the icon 52 is an example that displays the number of action classes indicated by the hand washing pattern and the number of action classes that have been completed.

[0139] The operators 54 are various operation buttons displayed on the instruction screen 50. The operators 54 shown in Fig. 11 are operation buttons for instructing to return the display contents of the instruction screen 50 to the initial state.

[0140] The movement determining device 1 may additionally display information on the instruction screen 50 as needed in addition to the configuration shown in FIG. 11, or may exclude specific information from the instruction screen 50.

[0141] (Processing flow performed by the motion determination device) The flow of processing performed by the movement determination device 1 of the first embodiment will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a first flowchart showing an example of the flow of processing performed by the movement determination device of the first embodiment. Fig. 13 is a second flowchart showing an example of the flow of processing performed by the movement determination device of the first embodiment.

[0142] The hand-washing pattern input unit 31 receives a hand-washing pattern from the input / output device 5 via the input / output I / F 18, for example (step S11).

[0143] The pattern setting unit 34 determines whether there is a pattern setting table 22 that matches the hand washing pattern input in step S11 (step S12). If it is determined that there is a pattern setting table 22 that matches the hand washing pattern (step S12: Yes), the process proceeds to step S13. On the other hand, if it is determined that there is not a pattern setting table 22 that matches the hand washing pattern (step S12: No), the process proceeds to step S16.

[0144] If it is determined in step S12 that there is a pattern setting table 22 that matches the hand-washing pattern, the pattern setting unit 34 refers to the feature quantity model table 23 and acquires the feature quantity model 28 that corresponds to the hand-washing pattern (step S13).

[0145] Next, the pattern setting unit 34 constructs a determination logic for determining whether the hand washing order is appropriate based on the action order ID 222, the action class ID 223, the action duration 224, etc. (step S14).

[0146] Next, the display control unit 41 displays the instruction screen 50 on the input / output device 5 through the input / output I / F 18 (step S15). After that, the process proceeds to step S19.

[0147] On the other hand, if it is determined in step S12 that there is no pattern setting table 22 that meets the determination condition, the pattern setting unit 34 refers to the feature quantity model table 23 and acquires the default feature quantity model 28 (step S16).

[0148] Next, the pattern setting unit 34 constructs default determination logic for determining whether the hand washing order is appropriate based on the action order ID 222, the action class ID 223, the action duration 224, etc. (step S17).

[0149] Next, the display control unit 41 displays the default instruction screen 50 on the input / output device 5 through the input / output I / F 18 (step S15). After that, the process proceeds to step S19.

[0150] Following step S15 or step S18, the identification information acquisition unit 32 determines whether identification information has been acquired through the reader 6 (step S19). If it is determined that identification information has been acquired (step S19: Yes), the process proceeds to step S20. On the other hand, if it is not determined that identification information has been acquired (step S19: No), step S19 is repeated.

[0151] If it is determined in step S19 that the identification information has been acquired, the pattern setting unit 34 determines whether a change in the hand-washing pattern is necessary in accordance with the identification information (step S20). If it is determined that a change in the hand-washing pattern is necessary (step S20: Yes), the process proceeds to step S21. On the other hand, if it is not determined that a change in the hand-washing pattern is necessary (step S20: No), the process proceeds to step S22.

[0152] If it is determined in step S20 that a change in hand-washing pattern is necessary, the pattern setting unit 34 changes the hand-washing pattern to one corresponding to the identification information (step S21).

[0153] Next, the area information acquisition unit 33 acquires the area information through the reader 6 (step S22).

[0154] The pattern setting unit 34 determines whether the hand washing pattern needs to be changed according to the area information (Step S23). If it is determined that the hand washing pattern needs to be changed (Step S23: Yes), the process proceeds to Step S24. On the other hand, if it is not determined that the hand washing pattern needs to be changed (Step S23: No), the process proceeds to Step S25 in FIG. 13.

[0155] If it is determined in step S23 that a change in the hand-washing pattern is necessary, the pattern setting unit 34 updates the determination logic, and the display control unit 41 updates the instruction screen 50 (step S24).

[0156] Thereafter, the movement determining device 1 performs the process according to the flowchart of FIG.

[0157] The duration measurement unit 37 determines whether the total hand washing time has exceeded the total hand washing time stored in the pattern setting table 22 (step S25). If it is determined that the total hand washing time has exceeded (step S25: Yes), the process proceeds to step S36. On the other hand, if it is not determined that the total hand washing time has exceeded (step S25: No), the process proceeds to step S26.

[0158] If it is determined in step S25 that the total hand-washing time has not been exceeded, the duration measurement unit 37 acquires the operation duration corresponding to the first unprocessed operation sequence ID 222 (step S26).

[0159] Next, the motion identification unit 36 ​​determines which of the motion classes Ci (i=0 to 8) the user's hand belongs to, based on the captured image and the feature amount model 28 (step S27).

[0160] When the operation class Ci is determined, the operation determination unit 40 determines whether the determined operation class Ci matches the operation class corresponding to the operation order ID 222 of the operation class Ci (step S28). If it is determined that the two match (step S28: Yes), the process proceeds to step S29. On the other hand, if it is not determined that the two match (step S28: No), the process returns to step S27.

[0161] If it is determined in step S28 that the determined action class Ci matches the action class corresponding to the action order ID 222 of the action class Ci, the duration measurement unit 37 adds the action time (step S29).

[0162] Next, the duration measurement unit 37 determines whether the operation time has exceeded the operation duration (step S30). If it is determined that the operation time has exceeded the operation duration (step S30: Yes), the process proceeds to step S31. On the other hand, if it is not determined that the operation time has exceeded the operation duration (step S30: No), the process returns to step S27.

[0163] If it is determined in step S30 that the action time has exceeded the action duration time, the display control unit 41 updates the instruction screen 50 (step S31).

[0164] When the update of the instruction screen 50 is completed, the pattern setting unit 34 determines whether the next operation order ID 222 exists (step S32). If it is determined that the next operation order ID 222 exists (step S32: Yes), the process proceeds to step S33. On the other hand, if it is not determined that the next operation order ID 222 exists (step S32: No), the process proceeds to step S34.

[0165] If it is determined in step S32 that the next operation sequence ID 222 exists, the pattern setting unit 34 updates the operation sequence ID 222 (step S33), and then returns to step S25.

[0166] If it is determined in step S32 that the next operation sequence ID 222 does not exist, the display control unit 41 displays the determination result on the instruction screen 50 (step S34).

[0167] Next, the operation control unit 42 determines whether the user has instructed to end the determination of the hand-washing motion (step S35). If it is determined that the user has instructed to end the determination of the hand-washing motion (step S35: Yes), the motion determination device 1 ends the process of FIG.

[0168] Returning to step S25, if it is determined in step S25 that the total hand-washing time has not exceeded the total hand-washing time stored in the pattern setting table 22, the action identification unit 36 ​​determines whether the hand-washing action is continuing (step S36). If it is determined that the hand-washing action is continuing (step S36: Yes), the process proceeds to step S37. On the other hand, if it is not determined that the hand-washing action is continuing (step S36: No), the process proceeds to step S34.

[0169] If it is determined in step S36 that the hand-washing action is continuing, the update history storage unit 39 determines whether the number of updates has reached the upper limit. If it is determined that the number of updates has reached the upper limit (step S37: Yes), the process proceeds to step S34. On the other hand, if it is determined that the number of updates has not reached the upper limit (step S37: No), the process proceeds to step S38.

[0170] If it is determined in step S37 that the number of updates has not reached the upper limit, the pattern update unit 38 updates the action duration and the total hand washing time (step S38).

[0171] Next, the pattern update unit 38 adds the number of updates at that time (step S39).

[0172] Furthermore, the update history storage unit 39 associates the update information with the user's identification information and stores it in the update history data 27 (step S40). After that, the process returns to step S26.

[0173] (Operation and effect of the first embodiment) As described above, the movement determination device 1 of the first embodiment includes an identification information acquisition unit 32 that acquires identification information 251 that identifies a user; a pattern setting unit 34 that sets a hand-washing pattern, which includes a pre-prepared sequence of multiple hand-washing actions, the duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information 251; an image acquisition unit 35 that acquires an image including the user's hands and fingers; a movement identification unit 36 ​​that identifies which of the multiple hand-washing actions the user is performing from the image acquired by the image acquisition unit 35; a duration measurement unit 37 that measures the duration of the hand-washing action identified by the movement identification unit 36; a pattern update unit 38 that updates the duration and total hand-washing time set by the pattern setting unit 34 if the duration measured by the duration measurement unit 37 is longer than the duration set by the pattern setting unit 34; and a movement determination unit 40 that determines whether the sequence, duration, and total hand-washing time of the user's hand-washing actions are appropriate, based on the hand-washing pattern set by the pattern setting unit 34 or the hand-washing pattern updated by the pattern update unit 38. Therefore, even if an action is performed that does not conform to a pre-prepared pattern, such as when the duration of a particular action pattern exceeds a set duration, it is possible to determine whether the hand washing was performed appropriately.

[0174] Furthermore, in the movement determination device 1 of the first embodiment, the pattern update unit 38 updates the duration and total hand-washing time set by the pattern setting unit 34 for the same user within a predetermined upper limit value range. Therefore, even if the duration of a specific movement pattern exceeds the set duration, it is possible to determine whether hand-washing has been performed appropriately.

[0175] The action determination device 1 of the first embodiment further includes an update history storage unit 39 that stores the update history by the pattern update unit 38 in association with the user's identification information 251. This allows the update history to be stored for each user. This allows the pattern update history to be stored, which can be useful for statistical analysis of hand-washing patterns, etc.

[0176] Moreover, the movement determination device 1 of the first embodiment further includes an area information acquisition unit 33 that acquires area information 261 that indicates the movement history of the user, and a pattern setting unit 34 sets a hand washing pattern, which includes a pre-prepared sequence of multiple hand washing actions, the duration of each hand washing action, and the total hand washing time, in a form that corresponds to the area information 261. Therefore, a hand washing pattern that corresponds to the movement pattern of the user can be set.

[0177] The scope of application of the present disclosure is not limited to the hand-washing action described above. The present disclosure can be applied to an action determination device (information processing device) that determines whether a "series of actions" in which multiple different actions are performed consecutively is being performed appropriately.

[0178] That is, the action determination device (information processing device) may include an identification information acquisition unit that acquires identification information that identifies a user, a pattern setting unit that sets a pre-prepared action pattern including the order of multiple actions, the duration of each of the actions, and the total action time in a form corresponding to the identification information, an image acquisition unit that acquires an image in which the action being performed by the user can be identified, an action identification unit that identifies which of the multiple actions the user is performing from the image acquired by the image acquisition unit, a duration measurement unit that measures the duration of the action identified by the action identification unit, a pattern update unit that updates the duration and total action time set by the pattern setting unit if the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit, and an action determination unit that determines whether the order, duration, and total action time of the user's actions are appropriate based on the action pattern set by the pattern setting unit or the action pattern updated by the pattern update unit.

[0179] (Second embodiment) A motion determining device 2 (not shown) according to a second embodiment of the present disclosure will be described below with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0180] The hardware configuration of the movement determining device 2 is the same as that of the movement determining device 1 described above, and therefore will not be described again.

[0181] The pattern setting table 29 of the movement determining device 2 will be described with reference to Fig. 14. Fig. 14 is a diagram showing an example of a pattern setting table used by the movement determining device of the second embodiment.

[0182] Unlike the pattern setting table 22 (see FIG. 5) of the above-described movement determining device 1, the pattern setting table 29 of the movement determining device 2 estimates the total hand-washing time from the tendency of the user's hand-washing sessions and allows an extension of the total hand-washing time. That is, the pattern setting table 29 stores, for example, content that allows a user who takes time to wash their hands carefully to have a total hand-washing time that exceeds the estimated total hand-washing time.

[0183] More specifically, the pattern setting table 29 has pattern update content 228 instead of pattern update content 227 of the pattern setting table 22. The pattern update content 228 in Fig. 14 stores that when the pattern ID 221 is hand-washing pattern A, the total hand-washing time is estimated from the hand-washing session tendency of the user and added, and that the number of updates is limited to two.

[0184] (Functional configuration of the motion determination device) The functional configuration of the movement determining device 2 will be described with reference to Fig. 15. Fig. 15 is a functional block diagram showing an example of the functional configuration of the movement determining device of the second embodiment.

[0185] In addition to the functions of the above-described movement determination device 1, the movement determination device 2 further includes a duration estimation unit 44. Furthermore, the movement determination device 2 includes a pattern setting unit 43 instead of the pattern setting unit 34 included in the above-described movement determination device 1. Furthermore, the movement determination device 2 includes a pattern update unit 45 instead of the pattern update unit 38 included in the above-described movement determination device 1.

[0186] When the duration of any of the multiple hand-washing actions exceeds the standard time, the duration estimation unit 44 estimates the total hand-washing time of the user. Specifically, the duration estimation unit 44 estimates the total hand-washing time based on the duration of each action pattern currently being measured, the duration of each past action pattern of the user stored in the update history storage unit 39, etc.

[0187] The pattern setting unit 43 sets the pattern setting table 29, which has pre-prepared hand washing patterns registered therein, including the order of a plurality of hand washing actions, the duration of each of the hand washing actions, and the total hand washing time, in the form registered in the area information table 26, based on the identification information acquired by the identification information acquisition unit 32 and the area information acquired by the area information acquisition unit 33. As described above, the pattern setting table 29 allows the total hand washing time to be estimated and added based on the user's hand washing session tendency.

[0188] When the duration measured by the duration measuring unit 37 is longer than the duration set by the pattern setting unit 43, the pattern updating unit 45 updates the duration and total hand washing time set by the pattern setting unit 43 based on the pattern update content 228 (see FIG. 14). Furthermore, the pattern updating unit 45 updates the duration and total hand washing time set by the pattern setting unit 43 for the same user within a predetermined upper limit value range.

[0189] (Processing flow performed by the motion determination device) The flow of processing performed by the movement determination device 2 of the second embodiment will be described with reference to Fig. 16 and Fig. 17. Fig. 16 is a first flowchart showing an example of the flow of processing performed by the movement determination device of the second embodiment. Fig. 17 is a second flowchart showing an example of the flow of processing performed by the movement determination device of the second embodiment.

[0190] The processes from step S51 to step S64 shown in Fig. 16 are the same as the processes from step S11 to step S24 shown in Fig. 12, and therefore will not be described again. Furthermore, the processes from step S65 to step S77 shown in Fig. 17 are the same as the processes from step S25 to step S37 shown in Fig. 13, and therefore will not be described again.

[0191] In step S77 of FIG. 17, if it is determined that the number of updates has not reached the upper limit (step S77: No), the duration estimation unit 44 estimates the updated values ​​of the action duration and the total hand-washing time (step S78).

[0192] Subsequently, the pattern update unit 45 updates the action duration and the total hand-washing time (step S79).

[0193] Next, the pattern update unit 45 adds the number of updates at that time (step S80).

[0194] Furthermore, the update history storage unit 39 stores the update information in the update history data 27 in association with the user's identification information (step S81). After that, the process returns to step S66.

[0195] (Operation and effect of the second embodiment) As described above, the movement determination device 2 of the second embodiment further includes a duration estimation unit 44 that estimates the duration of any of a plurality of hand-washing movements when the duration exceeds the standard time, and the pattern update unit 45 updates the duration and the total hand-washing time based on the estimation result of the duration estimation unit 44. Therefore, by estimating an appropriate duration from the tendency or past history of the person's hand-washing session, it is possible to determine whether hand-washing has been performed appropriately even when the hand-washing movement exceeds the expected time.

[0196] Although the embodiments of the present invention have been described above, these embodiments are merely examples and are not intended to limit the scope of the invention. This novel embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0197] 1,1',2 Motion determination device (information processing device) 3 Camera 5 Input / Output Devices 6 Leader 10 Control device 11 processors 22,29 Pattern setting table 23 Feature Model Table 24 Action Class Table 25 Identification Information Table 26 Area Information Table 27 Update history data 28 Feature Model 31 Hand washing pattern input section 32 Identification information acquisition unit 33 Area Information Acquisition Department 34,43 Pattern setting section 35 Image acquisition unit 36 Operation specific part 37 Duration measurement unit 38,45 Pattern update section 39 Update history memory section 40 Operation judgment section 41 Display control unit 42 Operation control section 44 Duration Estimation Unit 50 Instruction screen 51,52 Icons 53 Achievement information 54 Operator 221 Pattern ID 222,253,264 Operation order ID 223,241,254,265 Operation Class ID 224,255,266 Operation duration 225,231,256,267 Feature model ID 226,257,268 Total hand washing time 227,228 Pattern Updates 232 Supported Action Class ID 233 Shooting Environment 242 Action Class Display Name 243 Operation Class Display Image 251 Identification Information 252,263 Pattern change type 258 Explanation of Change Conditions 261 Area information 262 Identification Information 269 ​​Explanation of Change Conditions A, B, C hand washing patterns C3, C4, C5, C6, Ci operation class [Prior art documents] [Patent documents]

[0198] [Patent Document 1] Japanese Patent Application Publication No. 2020-140678

Claims

1. an identification information acquisition unit that acquires identification information that identifies a user; a pattern setting unit that sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, the duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information; an image acquisition unit that acquires an image including the user's fingers; an action identification unit that identifies which of the plurality of hand-washing actions the user is performing from the image acquired by the image acquisition unit; a duration measurement unit that measures the duration of the hand-washing action identified by the action identification unit; a pattern update unit that updates the total hand-washing time with the duration set by the pattern setting unit when the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit; and and an action determination unit that determines whether the sequence, duration, and total hand-washing time of the user's hand-washing action are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern update unit. Information processing device.

2. a duration estimation unit that estimates the duration of any one of the plurality of hand-washing actions when the duration of the any one of the plurality of hand-washing actions exceeds a standard time, the pattern update unit updates the duration and the total hand-washing time based on the estimation result of the duration estimation unit. The information processing device according to claim 1 .

3. the pattern update unit updates the duration and total hand-washing time set by the pattern setting unit for the same user within a range of a predetermined upper limit value.

3. The information processing device according to claim 1.

4. an update history storage unit that stores an update history by the pattern update unit in association with user identification information; 3. The information processing device according to claim 1.

5. The system further includes an area information acquisition unit that acquires area information indicating the user's movement history, the pattern setting unit sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, a duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the area information.

3. The information processing device according to claim 1.

6. Computer, an identification information acquisition unit that acquires identification information that identifies a user; a pattern setting unit that sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, the duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information; an image acquisition unit that acquires an image including the user's fingers; an action identification unit that identifies which of the plurality of hand-washing actions the user is performing from the image acquired by the image acquisition unit; a duration measurement unit that measures the duration of the hand-washing action identified by the action identification unit; a pattern update unit that updates the total hand-washing time with the duration set by the pattern setting unit when the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit; and The hand-washing action determining unit determines whether the sequence, duration, and total hand-washing time of the user are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern updating unit. program.

Images