Information processing device and program

Abstract

To provide an information processing device and a program that can determine whether hand washing has been performed appropriately, even if a user performed an action that did not follow a predetermined pattern.SOLUTION: A motion determination device includes a pattern setting unit that configures a handwashing pattern, prepared in advance and containing the sequence of multiple handwashing motions, the duration of each handwashing motion, and the total handwashing time, in a form corresponding to identification information for identifying a user, a motion identification unit that identifies, from an image including the user's fingers, which of the multiple handwashing motions the user is performing, a pattern update unit that updates the duration and total handwashing time set by the pattern setting unit when the duration of the identified handwashing motion exceeds the duration set by the pattern setting unit, and a motion determination unit that determines whether the user's sequence of handwashing motions, their duration, and the total handwashing time are appropriate, on the basis of the handwashing pattern set by the pattern setting unit or updated by the pattern update unit.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device and a program. [Background technology]

[0002] There is known a system for determining whether hand washing has been performed in a predetermined procedure (for example, Patent Document 1). This system identifies a user's hand washing behavior and determines whether the identified hand washing behavior conforms to a specific hand washing pattern.

[0003] In such a system, the hand-washing action is judged by applying an appropriate pattern according to the area, such as a food factory, a hospital, a store, a restaurant, a nursing care site, or an educational site. However, depending on the characteristics of the object to be identified, such as an individual, or the process in charge, an event such as hand-washing continuing for a longer period than expected may occur. In such a case, since it is not possible to apply an appropriate pattern prepared in advance for judgment, there is a problem that it is not possible to present an appropriate judgment result according to the object to be identified. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to provide an information processing device and a program that can determine whether hand washing has been performed properly even if the user performs actions that do not follow a pre-prepared pattern. [Means for solving the problem]

[0005] The information processing device of the embodiment includes an identification information acquisition unit, a pattern setting unit, an image acquisition unit, a motion identification unit, a duration measurement unit, a pattern update unit, and a motion determination unit. The identification information acquisition unit acquires identification information for identifying a user. The pattern setting unit sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing motions prepared in advance, the duration of each of the hand-washing motions, and a total hand-washing time, in a form corresponding to the identification information. The image acquisition unit acquires an image including the user's fingers. The motion identification unit identifies which of a plurality of hand-washing motions the user is performing from the image acquired by the image acquisition unit. The duration measurement unit measures the duration of the hand-washing motion identified by the motion identification unit. The pattern update unit updates the duration and total hand-washing time set by the pattern setting unit when the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit. The motion determination unit determines whether the sequence, duration, and total hand-washing time of the user's hand-washing motion are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern update unit. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a first diagram showing an example of a schematic configuration of a motion determining device according to the first embodiment. [Diagram 2] FIG. 2 is a second diagram illustrating an example of a schematic configuration of the movement determining device according to the first embodiment. [Diagram 3] FIG. 3 is a hardware block diagram illustrating an example of a hardware configuration of the operation determining device according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a hand-washing pattern. [Diagram 5] FIG. 5 is a diagram illustrating an example of the pattern setting table. [Figure 6] FIG. 6 is a diagram illustrating an example of the feature quantity model table. [Figure 7] FIG. 7 is a diagram illustrating an example of the action class table. [Figure 8] FIG. 8 is a diagram illustrating an example of the identification information table. [Figure 9]FIG. 9 is a diagram illustrating an example of the area information table. [Figure 10] FIG. 10 is a functional block diagram illustrating an example of a functional configuration of the movement determining device according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of an instruction screen displayed on an input / output device by the movement determining device of the first embodiment. [Figure 12] FIG. 12 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the first embodiment. [Figure 13] FIG. 13 is a second flowchart showing an example of the flow of the process performed by the movement determining device of the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a pattern setting table used by the movement determining device of the second embodiment. [Figure 15] FIG. 15 is a functional block diagram illustrating an example of a functional configuration of the movement determining device according to the second embodiment. [Figure 16] FIG. 16 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment. [Figure 17] FIG. 17 is a second flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] (First embodiment) Hereinafter, a motion determining device 1 according to a first embodiment of the present disclosure will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below.

[0008] (Schematic configuration of the operation determination device) A schematic configuration of a movement determining device 1 according to an embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a first diagram showing an example of a schematic configuration of the movement determining device according to the first embodiment. Fig. 2 is a second diagram showing an example of a schematic configuration of the movement determining device according to the first embodiment.

[0009] A motion determination device 1 according to an embodiment determines whether a user's hand washing has been performed in a predetermined procedure. The motion determination device 1 captures an image of the user's hand in a sink or the like. The motion determination device 1 determines a motion class of the user's hand from the captured image. A motion class is a hand motion classified according to the part to be washed, etc., included in a series of hand washing motions. For example, the motion determination device 1 determines a hand motion classified according to the part to be washed (back of the hand, between the fingers, thumb, etc.) as a motion class. The motion determination device 1 determines whether a user's hand washing has been performed in a predetermined procedure based on the order of the motion classes, the duration of the motion, etc. The motion determination device 1 is an example of an information processing device in the present disclosure.

[0010] As shown in FIG. 1, the motion determining device 1 includes a camera 3, an input / output device 5, a reader 6, a sink 20, a faucet 21, and the like.

[0011] The sink 20 is a water tank in which a user washes his / her hands. The sink 20 has a recessed structure. A drain is formed at the bottom of the sink 20. A faucet 21 is also installed in the sink 20. The faucet 21 releases water for the user to wash his / her hands. The released water is discharged from the drain of the sink 20. The faucet 21 may release water in response to a user's opening operation, or may have a function for detecting that a user has brought their hand close to the faucet 21, and when it detects that the user has brought their hand close to the faucet 21, it may continue to release an appropriate amount of water until the user moves their hand away from the faucet 21.

[0012] Camera 3 is installed facing downward on the top of sink 20. Camera 3 captures an area (captured area) including the user's fingers at a speed of, for example, 10 frames per second. Camera 3 captures a two-dimensional image (captured image). Camera 3 is a digital camera and may output color information (RGB (Red Green Blue)) for each pixel. Camera 3 may also include a light that illuminates the user's hands.

[0013] The input / output device 5 is a monitor, such as a liquid crystal monitor or an organic electroluminescence monitor, installed at a position where the user can see it. The input / output device 5 also includes a touch panel laminated on the display surface of the monitor. In this embodiment, the input / output device 5 is installed in front of a user who washes his / her hands at the sink 20. The input / output device 5 includes a display function for displaying image information on the monitor according to an instruction from a control device 10 (see FIG. 3) included in the motion determining device 1. The input / output device 5 also includes an operation function for acquiring operation information performed by a user by touching the touch panel, and outputting the acquired operation information to the control device 10 (see FIG. 3) included in the motion determining device 1.

[0014] The reader 6 is an acquisition device that acquires identification information that identifies a user. For example, the reader 6 acquires identification information (such as an ID) that identifies a user from a medium (such as an IC card or an RFID (radio frequency identification) tag) that the user possesses. The reader 6 acquires the identification information from the medium by connecting to the medium via a wired or wireless connection. The reader 6 may also read codes such as barcodes or two-dimensional codes. The identification information may be information that identifies an individual user, or may indicate the user's position (such as a member of the cooking department or a plating worker).

[0015] The configuration of the motion determination device is not limited to the example in Fig. 1. Fig. 2 shows an example of a motion determination device 1' having another form. Like the motion determination device 1, the motion determination device 1' is composed of a camera 3, an input / output device 5, a reader 6, a sink 20, a faucet 21, and the like. Note that the motion determination device 2 is an example of an information processing device in the present disclosure.

[0016] In particular, in the motion determining device 1', the camera 3 is installed on the left side as viewed from the sink 20. The camera 3 captures an image of an area including the user's fingers from the left side. Also, in the motion determining device 2, the input / output device 5 is installed in the left corner of the sink 20. Other configurations are similar to those of the motion determining device 1, and therefore description thereof will be omitted.

[0017] In this way, the motion determining device allows various modifications depending on the location where the device is installed.

[0018] (Hardware configuration of the operation determination device) The hardware configuration of the movement determining device 1 will be described with reference to Fig. 3. Fig. 3 is a hardware block diagram showing an example of the hardware configuration of the movement determining device of the first embodiment. Note that since the hardware configuration of the movement determining device 1 is the same as the hardware of the movement determining device 1', only the movement determining device 1 will be described here.

[0019] 3, the movement determining device 1 includes a control device 10, a camera 3, an input / output device 5, and a reader 6. The control device 10, the camera 3, the input / output device 5, and the reader 6 are connected to each other so as to be able to communicate with each other.

[0020] The control device 10 includes a processor 11, a ROM 12, a RAM 13, a memory 14, a communication I / F 15, a camera I / F 16, an input / output I / F 18, and a reader I / F 19. The control device 10 is a desktop PC, a notebook PC, a tablet PC, a smartphone, or the like.

[0021] The processor 11, the ROM 12, the RAM 13, the memory 14, the communication I / F 15, the camera I / F 16, the input / output I / F 18, and the reader I / F 19 are communicatively connected to each other.

[0022] The camera I / F 16 is communicatively connected to the camera 3. The input / output I / F 18 is communicatively connected to the input / output device 5. The reader I / F 19 is communicatively connected to the reader 6. The functions of the camera 3, the input / output device 5, and the reader 6 are as described above.

[0023] The processor 11 controls the overall operation of the control device 10. The processor 11 may include an internal cache and various interfaces. The processor 11 executes control programs stored in advance in the internal cache, the ROM 12, or the memory 14, thereby implementing various processes.

[0024] Some of the various functions realized by the processor 11 executing the control program may be realized by a hardware circuit. In this case, the processor 11 controls the functions executed by the hardware circuit.

[0025] The ROM 12 is a non-volatile memory in which control programs, control data, etc. are stored in advance. The control programs and control data stored in the ROM 12 are pre-installed in accordance with the specifications of the control device 10. The ROM 12 stores, for example, a program for controlling a circuit board of the control device 10.

[0026] The RAM 13 is a volatile memory that temporarily stores data being processed by the processor 11. The RAM 13 also functions as a work area for expanding and executing a control program read from the ROM 12 or memory 14.

[0027] The memory 14 is a non-volatile memory in which data can be written and rewritten. The memory 14 is composed of, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The memory 14 stores a control program P that operates the control device 10 and various data required to operate the control program P.

[0028] The memory 14 also stores in advance a pattern setting table 22 indicating a plurality of hand-washing patterns, a feature model table 23 indicating feature models used to determine hand-washing classes, an action class table 24 indicating action classes, an identification information table 25 indicating hand-washing patterns for each user, an area information table 26 indicating the movement history of the user, update history data 27, and feature models 28. The contents of each table will be described in detail later.

[0029] The memory 14 also stores in advance a feature model 28 for determining a hand motion class. The feature model 28 is, for example, a network obtained by machine learning or the like. Since the technology for constructing a network that identifies an input pattern based on data obtained by machine learning is well known, an explanation of an example of the feature model 28 will be omitted.

[0030] The communication I / F 15 is an interface for transmitting and receiving data to and from an external device. The communication I / F 15 connects to the external device via a network, etc. The communication I / F 15 supports, for example, a wired or wireless LAN (Local Area Network) connection.

[0031] The camera I / F 16 is an interface for transmitting and receiving data to and from the camera 3. Based on an instruction from the processor 11, the camera I / F 16 transmits a signal instructing the camera 3 to capture an image. The camera I / F 16 also acquires an image captured by the camera 3. The camera I / F 16 may be one that supports a USB (Universal Serial Bus) connection, or one that supports a connection via Camera Link.

[0032] The input / output I / F 18 is an interface for transmitting and receiving data to and from the input / output device 5. The input / output I / F 18 receives a signal indicating an operation accepted from a user from the input / output device 5. The input / output I / F 18 transmits the signal received from the input / output device 5 to the processor 11. In addition, the input / output I / F 18 transmits information indicating a screen to be displayed to the user to the input / output device 5 based on an instruction from the processor 11. The input / output I / F 18 may support a USB connection or a connection via a parallel interface.

[0033] The reader I / F 19 is an interface for transmitting and receiving data to and from the reader 6. The reader I / F 19 transmits a signal to start the reader 6 based on an instruction from the processor 11. The reader I / F 19 also transmits identification information received from the reader 6 to the processor 11. The reader I / F 19 may support a USB connection.

[0034] 3, the control device 10 may include other components as necessary, or certain components may be excluded from the control device 10. Furthermore, the communication I / F 15, the camera I / F 16, the input / output I / F 18, and the reader I / F 19 (or a part of these) may be integrally configured.

[0035] (Hand-washing pattern explanation) The hand-washing pattern will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the hand-washing pattern.

[0036] The hand-washing pattern is a pattern of hand-washing performed by a user associated with the shooting environment, the application location, and the type, order, and duration of hand-washing actions. The action determination device 1 determines whether the hand-washing action performed by the user matches the set hand-washing pattern.

[0037] FIG. 4 shows examples of three types of hand-washing patterns, namely, hand-washing pattern A, hand-washing pattern B, and hand-washing pattern C.

[0038] Hand-washing pattern A is used to determine the hand-washing procedure in factory "A". Hand-washing pattern A indicates that the hand-washing procedure is performed in the order of action classes C3, C4, and C5, each lasting for 5 seconds. Hand-washing pattern A is also applied when camera 3 captures the user's hands from above (see FIG. 1).

[0039] Hand-washing pattern B is used to determine the hand-washing procedure in factory "A". Like hand-washing pattern A, hand-washing pattern B indicates that the hand-washing procedure is performed in the order of action classes C3, C4, and C5, each lasting for 5 seconds. Hand-washing pattern B is also used when camera 3 captures the user's hands from the side (here, the left) (see FIG. 2).

[0040] Hand-washing pattern C is used to determine the hand-washing procedure in factory "I". Hand-washing pattern C indicates that the hand-washing procedure continues for a total of 20 seconds in any order of action classes C3, C4, C5, and C6. Hand-washing pattern C is also used when camera 3 captures the user's hands from above (see FIG. 1).

[0041] Although Figure 4 shows an example of three hand-washing classes, the number of hand-washing classes is not limited to three.

[0042] (Pattern setting table explanation) The pattern setting table 142 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the pattern setting table.

[0043] 5 in the memory 14. The pattern setting table 142 stores a pattern ID 221, a movement sequence ID 222, a movement class ID 223, a movement duration 224, a feature quantity model ID 225, a total hand-washing time 226, and a pattern update content 227 in association with each other.

[0044] Pattern ID 221 is an identification number (ID) for identifying a hand-washing pattern. Pattern setting table 22 shown in Fig. 5 stores four types of hand-washing patterns: a "default" hand-washing pattern, hand-washing pattern A, hand-washing pattern B, and hand-washing pattern C.

[0045] The hand-washing pattern "default" indicates the hand-washing pattern when no hand-washing pattern is specified.

[0046] Hand-washing patterns A, B, and C are all as described above.

[0047] "Operation order ID" indicates the execution order of the operation class. For example, in the pattern setting table 22, in the hand-washing pattern A, "1" is stored as the operation order ID 222 corresponding to "3" as the operation class ID 223 (i.e., operation class C3). That is, in the hand-washing pattern A, the pattern setting table 22 stores "1" as the execution order of the operation class C3.

[0048] Similarly, pattern setting table 22 stores, as the action sequence ID 222 in hand-washing pattern A, "2" as the execution order of action class C4 ("4" as action class ID 223), "3" as the execution order of action class C5 ("5" as action class ID 223), and "4" as the execution order of action class C6 ("6" as action class ID 223). That is, hand-washing pattern A is defined as the progress of hand-washing actions in the order of action class C3, action class C4, action class C5, and action class C6.

[0049] Similarly, the pattern setting table 22 stores, as the action sequence ID 222 for the hand-washing pattern B, the same information as the action sequence ID 222 for the hand-washing pattern A.

[0050] Furthermore, in the hand-washing pattern C, the pattern setting table 22 stores "0" as the action order ID 222 corresponding to each action class ID 223. That is, the pattern setting table 22 indicates that in the hand-washing pattern C, the action classes are executed in random order.

[0051] The action class ID 223 in the pattern setting table 22 indicates an action class to be executed in a hand-washing pattern. In this embodiment, the action class ID 223 stores any one of "1" representing action class C1 to "6" representing action class C6. That is, in this embodiment, action classes Ci (i=1 to 6) are defined. Note that the total number of action classes is not limited to this example.

[0052] Action class C1 represents the action of "wetting hands with water" when washing hands.

[0053] Action class C2 represents the action of "applying detergent to hands" when washing hands.

[0054] Action class C3 represents the action of "lathering soap well" when washing hands.

[0055] Action class C4 represents the action of "rubbing the back of the hand" when washing hands.

[0056] Action class C5 represents the action of "rubbing between the fingers" when washing hands.

[0057] Action class C6 represents the action of "rubbing the thumbs" when washing hands.

[0058] Action duration 224 indicates the duration of the corresponding action class. For example, in hand-washing pattern A, pattern setting table 22 stores "5s" as action duration 224 corresponding to "3" (action class C3) as action class ID 223. That is, pattern setting table 22 indicates that in hand-washing pattern A, action class C3 lasts for 5 seconds.

[0059] Furthermore, the pattern setting table 22 stores "0s" as the action duration 224 corresponding to each action class ID 223 in the hand-washing pattern C. This indicates that in the hand-washing pattern C, the duration of each of the action classes C3, C4, C5, and C6 does not matter.

[0060] Furthermore, the pattern setting table 22 stores "20s" as the final action duration 224 for the hand-washing pattern C. This indicates that the total value of the duration of each action class in the hand-washing pattern C is 20 seconds.

[0061] The feature model ID 225 is an ID for identifying the feature model 28 used to determine the action class. The feature model ID 225 corresponds to the direction in which the camera 3 captures an image of the hand. In this embodiment, when the camera 3 captures an image of the hand from above (see FIG. 1), the feature model ID 225 stores "H1." When the camera 3 captures an image of the hand from the side (see FIG. 2), the feature model ID 225 stores "H2."

[0062] Total hand-washing time 226 indicates the upper limit of the time a user may spend washing their hands. For example, pattern setting table 22 stores "30 seconds" as total hand-washing time 226 for hand-washing pattern A. That is, pattern setting table 22 indicates that the upper limit of the time a user may spend washing their hands in hand-washing pattern A is 30 seconds. In this embodiment, "30 seconds" is also stored as total hand-washing time 226 for hand-washing pattern B. Note that total hand-washing time 226 may be set to "no upper limit" as in hand-washing pattern C.

[0063] In addition, for the hand washing pattern "default", the pattern setting table 22 stores "1" as the operation sequence ID 222 corresponding to the operation class ID 223 "3" (operation class C3), stores "2" as the operation sequence ID 222 corresponding to the operation class ID 223 "4" (operation class C4), and stores "3" as the operation sequence ID 222 corresponding to the operation class ID 223 "5" (operation class C5).

[0064] Furthermore, the pattern setting table 22 stores "10 seconds" as the action duration 224 corresponding to each action class ID 223 in the hand-washing pattern "default."

[0065] Furthermore, in the hand-washing pattern "default," the pattern setting table 22 stores, in the feature amount model ID 225, "H1," which indicates the feature amount when the camera 3 photographs the hand from above.

[0066] Furthermore, the pattern setting table 22 stores "35 seconds" as the total hand-washing time 226 in the "default" hand-washing pattern.

[0067] The pattern update content 227 stores the change content (update content) of the set pattern when a predetermined condition is satisfied.

[0068] For the hand washing pattern "default", the pattern update contents 227 store that the action duration of each action class is extended by 5 seconds only the first time, the total hand washing time is extended by 10 seconds, and the number of updates is unlimited.

[0069] For hand-washing pattern A, pattern update content 227 stores that the total hand-washing time is to be extended by 20 seconds and that the number of updates is to be limited to two.

[0070] For hand washing pattern B, the pattern update contents 227 store that the action duration of each action class is extended by 5 seconds only the first time, that the total hand washing time is extended by 20 seconds, and that the number of updates is limited to 3 times.

[0071] Then, for the hand washing pattern C, the information that the pattern will not be updated is stored.

[0072] The pattern setting table 22 may be updated as appropriate in accordance with an operation by an operator.

[0073] (Feature model table explanation) The feature amount model table 23 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the feature amount model table.

[0074] The motion determining device 1 stores a feature amount model table 23 shown in Fig. 6 in the memory 14. The feature amount model table 23 stores a feature amount model ID 231, a corresponding motion class ID 232, and a shooting environment 233 in association with each other.

[0075] The feature amount model ID 231 is an ID for identifying the feature amount model 28. The feature amount model ID 231 is the same as the feature amount model ID 225 described above.

[0076] The corresponding action class ID 232 indicates an action class ID that can be determined by the feature model 28. Here, it indicates that both H1 and H2 stored in the feature model ID 231 can determine action classes corresponding to the action classes C1 to C6.

[0077] The shooting environment 233 indicates the shooting environment corresponding to the feature model ID 231. Here, it is shown that H1 stored in the feature model ID 231 in the feature model table 23 corresponds to an image shot from above. Also, it is shown that H2 stored in the feature model ID 231 corresponds to an image shot from the side (left and right).

[0078] The feature quantity model table 23 may be updated as appropriate in accordance with an operation by an operator.

[0079] (Explanation of the Action Class Table) The operation class table 24 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the operation class table.

[0080] The action determining device 1 stores an action class table 24 shown in Fig. 7 in the memory 14. The action class table 24 stores an action class ID 241, an action class display name 242, and an action class display image 243 in association with each other.

[0081] The action class ID 241 is an ID for identifying an action class. The action class ID 241 is the same as the above-mentioned action class ID 223. Note that Fig. 7 shows, as an example, only the cases where the action class ID 241 is "3" representing the action class C3, "4" representing the action class C4, and "5" representing the action class C5.

[0082] The action class display name 242 is a character string indicating an action class. For example, the action class display name 242 indicates "Lather well" as the action class display name of the action class C3. The action class display name 242 indicates "Knead the back of the hand" as the action class display name of the action class C4. The action class display name 242 indicates "Knead between the fingers" as the action class display name of the action class C4.

[0083] The action class display image 243 is an image showing an action class. For example, as shown in FIG. 7, the action class display image 243 is configured with an action class display name 242 superimposed on an illustration of the action class.

[0084] The action class table 24 may be updated as appropriate in accordance with an operation by an operator.

[0085] (Description of the identification information table) The identification information table 25 will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the identification information table.

[0086] The movement determination device 1 stores an identification information table 25 shown in Fig. 8 in the memory 14. The identification information table 25 indicates changes made to the set hand-washing pattern for each user. The identification information table 25 stores, in association with each other, identification information 251, pattern change type 252, movement sequence ID 253, movement class ID 254, movement duration 255, feature quantity model ID 256, total hand-washing time 257, and description of change condition 258.

[0087] The identification information 251 is identification information for identifying a user. The identification information 251 may indicate a specific user (such as a worker A) or may indicate a job title (such as a member of the cooking department or a person engaged in plating).

[0088] The pattern change type 252 indicates a method for changing the hand-washing pattern of the user indicated by the corresponding identification information. The pattern change type 252 is, for example, "difference to default pattern" or "overwrite to default pattern."

[0089] "Difference to default pattern" indicates that the hand-washing pattern is changed by applying difference information to the set hand-washing pattern (default pattern).

[0090] "Overwrite to default pattern" refers to changing the hand-washing pattern by overwriting the default pattern with override information.

[0091] The action order ID 253 indicates the order of the action classes. When the pattern change type 252 is "difference to default pattern", the action order ID 253 indicates addition or deletion to the order of the action classes in the default pattern. When the pattern change type 252 is "overwrite to default pattern", the action order ID 253 indicates the order of the action classes. Note that the action order ID 253 is the same as the action order ID 222 described above.

[0092] The action class ID 254 indicates an action class. When the pattern change type 252 is "difference to default pattern", the action class ID 254 indicates an action class corresponding to the added or deleted action sequence ID 253. When the pattern change type 252 is "overwrite to default pattern", the action class ID 254 indicates an action class in the corresponding action sequence ID 253. The action class ID 254 is the same as the action class ID 223 and the action class ID 241 described above.

[0093] The action duration 255 indicates the duration of the corresponding action class. When the pattern change type 252 is "difference to default pattern", the action duration 255 indicates an extension or shortening time for the action duration of the action class in the default pattern. Also, the action duration 255 indicates the action duration of the action class indicated by the added action class ID 254.

[0094] Furthermore, when the pattern change type 252 is “overwrite to default pattern”, the action duration 255 indicates the action duration of the action class indicated by the corresponding action class ID 254. Note that the action duration 255 is the same as the action duration 224 described above.

[0095] The feature amount model ID 256 is an ID for identifying the feature amount model 28 used to determine the action class. The feature amount model ID 256 indicates the feature amount model ID after the change (or no change). Note that the feature amount model ID 256 is the same as the feature amount model ID 225 and the feature amount model ID 231 described above.

[0096] The total hand-washing time 257 indicates the upper limit of the time for the user to wash their hands. When the pattern change type 252 is "difference to default pattern", the total hand-washing time 257 indicates an extension or shortening of the total hand-washing time in the default pattern. When the pattern change type 252 is "overwrite to default pattern", the total hand-washing time 257 indicates the total hand-washing time after the change.

[0097] The change condition explanation 258 is information indicating the content of the change for each user. Fig. 8 shows, as an example, the content of the change condition explanation 258 when the set default pattern is hand-washing pattern A.

[0098] When the pattern change type 252 is "difference to default pattern", the change condition description 258 indicates the content of the change to the default pattern. When the pattern change type 252 is "overwrite to default pattern", the change condition description 258 indicates the content of the hand washing pattern after the change.

[0099] The identification information table 25 may include configurations other than those shown in FIG. 8 as necessary, and specific configurations may be excluded from the identification information table 25.

[0100] Furthermore, the identification information table 25 may be updated as appropriate in accordance with an operation by an operator.

[0101] (Description of the area information table) The area information table 26 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of the area information table.

[0102] The movement determination device 1 stores in the memory 14 an area information table 26 shown in Fig. 9. The area information table 26 indicates changes to the hand-washing pattern according to the area information and the identification information. The area information table 26 stores area information 261, identification information 262, pattern change type 263, movement sequence ID 264, movement class ID 265, movement duration 266, feature model ID 267, total hand-washing time 268, and explanation of change condition 269 in association with each other.

[0103] The area information 261 indicates the movement history of the user. The area information table 26 shown in Fig. 9 indicates changes to the hand-washing pattern of a user who has moved from a non-clean area to a clean area. The action determination device 1 recognizes that the user has moved from a non-clean area to a clean area, for example, by the reader 6 installed at the entrance to the clean area reading the user's identification information via the reader I / F 19.

[0104] The identification information 262 is identification information for identifying a user. Here, the identification information 262 may indicate a specific user (such as a worker A) or may indicate a job title (such as a member of the cooking department or a person engaged in plating). In addition, the identification information 262 may indicate "no limitation (all targets)" which indicates all users.

[0105] The pattern change type 263 indicates how to change the hand-washing pattern of the user of the corresponding area information and identification information. Here, the pattern change type 263 is "difference to default pattern", "difference by identification information to default pattern and difference to specific identification information in area information", or "overwrite".

[0106] "Difference to default pattern" indicates that the hand-washing pattern is changed by applying difference information to the set hand-washing pattern (default pattern).

[0107] "The difference based on the identification information relative to the default pattern, and the difference relative to specific identification information in the area information" indicates that the hand-washing pattern is changed by further applying difference information to the hand-washing pattern obtained by changing the default pattern according to the identification information.

[0108] "Overwrite" indicates that the hand-washing pattern is changed by overwriting the default pattern with override information.

[0109] The action order ID 264 indicates the order of the action classes. When the pattern change type 263 is "difference to default pattern" or "difference based on identification information from the default pattern, and difference from specific identification information in the area information", the action order ID 264 indicates addition or deletion to or from the order of the action classes in the default pattern or the hand-washing pattern changed according to the identification information. When the pattern change type 263 is "overwrite", the action order ID 264 indicates the order of the action classes.

[0110] The action class ID 265 indicates an action class. When the pattern change type 263 is "difference to default pattern" or "difference based on identification information to default pattern, and difference to specific identification information in area information," the action class ID 265 indicates an action class corresponding to the added or deleted action order ID 264. When the pattern change type 263 is "overwrite," the action class ID 265 indicates an action class in the corresponding action order ID 264.

[0111] Action duration 266 indicates the duration of the corresponding action class. When pattern change type 263 is "difference to default pattern" or "difference based on identification information from default pattern, and difference from specific identification information in area information," action duration 266 indicates an extension or shortening time for the action duration of the action class in the default pattern or hand-washing pattern after change based on the identification information. Action duration 266 also indicates the action duration of the action class indicated by added action class ID 265.

[0112] When the pattern change type 263 is “overwrite”, the action duration 266 indicates the action duration of the action class indicated by the corresponding action class ID 265 .

[0113] The feature amount model ID 267 is an ID for identifying the feature amount model 28 used for determining the action class. The feature amount model ID 267 indicates the feature amount model ID after the change, or indicates "no change".

[0114] The total hand-washing time 268 indicates the upper limit of the time for a user to wash their hands. When the pattern change type 263 is "difference to default pattern" or "difference based on identification information for default pattern, and difference based on specific identification information in area information", the total hand-washing time 268 indicates the extension or shortening of the total hand-washing time in the default pattern or hand-washing pattern after the change based on the identification information. When the pattern change type 263 is "overwrite", the total hand-washing time 268 indicates the total hand-washing time after the change.

[0115] The explanation of the change condition 269 is information indicating the change content of the pattern. As an example, Fig. 9 shows the content of the change condition when the set default pattern is hand-washing pattern A.

[0116] When the pattern change type 263 is “difference to default pattern”, the change condition description 269 indicates the content of the change to the default pattern. When the pattern change type 263 is “overwrite”, the change condition description 269 indicates the content of the hand washing pattern after the change.

[0117] In addition to the configuration shown in FIG. 9, the area information table 26 may include other configurations as necessary, or specific configurations may be excluded from the area information table 26.

[0118] Furthermore, the area information table 26 may be updated as appropriate in accordance with an operation by an operator.

[0119] (Explanation of update history data) The update history data 27 is data in which the update history of the motion duration and the total hand-washing time acquired by the motion determining device 1 is stored in association with the user's identification information. The update history data 27 may further store the update date and time.

[0120] (Functional configuration of the motion determination device) The functional configuration of the movement determining device 1 will be described with reference to Fig. 10. Fig. 10 is a functional block diagram showing an example of the functional configuration of the movement determining device of the first embodiment.

[0121] The processor 11 reads out the control program P stored in the memory 14, expands it in the RAM 13, and executes it, thereby realizing as functional parts the hand-washing pattern input unit 31, the identification information acquisition unit 32, the area information acquisition unit 33, the pattern setting unit 34, the image acquisition unit 35, the motion identification unit 36, the duration measurement unit 37, the pattern update unit 38, the update history storage unit 39, the motion determination unit 40, the display control unit 41, and the operation control unit 42 shown in Fig. 10. Note that all or part of these functional parts may be realized by dedicated hardware.

[0122] The hand-washing pattern input unit 31 acquires the input hand-washing pattern. The hand-washing pattern input unit 31 acquires the hand-washing pattern input from the input / output device 5 via the input / output I / F 18, for example.

[0123] The identification information acquisition unit 32 acquires the identification information 262 for identifying a user. Specifically, the identification information acquisition unit 32 acquires, by the reader 6, the identification information (such as an ID) for identifying a user from a medium possessed by the user.

[0124] The area information acquisition unit 33 acquires area information 261 indicating the movement history of the user.

[0125] The pattern setting unit 34 sets the pattern setting table 22, in which hand-washing patterns including the order of multiple hand-washing actions, the duration of each of the hand-washing actions, and the total hand-washing time, which have been prepared in advance, in the form registered in the area information table 26 based on the identification information acquired by the identification information acquisition unit 32 and the area information acquired by the area information acquisition unit 33.

[0126] The image acquisition unit 35 controls the camera 3 to acquire an image including the user's fingers.

[0127] The action identifying unit 36 ​​identifies, from the image acquired by the image acquiring unit 35, which of a plurality of hand-washing actions the user is performing, that is, the action class Ci (i=0 to 6).

[0128] The duration measurement unit 37 measures the duration of the hand-washing action identified by the action identification unit 36. Note that the duration measurement unit 37 measures the duration for each action class ID 223.

[0129] When the duration measured by the duration measuring unit 37 is longer than the duration set by the pattern setting unit 34, the pattern updating unit 38 updates the duration and total hand-washing time set by the pattern setting unit 34 based on the pattern update content 227 (see FIG. 5). In addition, the pattern updating unit 38 updates the duration and total hand-washing time set by the pattern setting unit 34 for the same user within a range of a predetermined upper limit value.

[0130] The update history storage unit 39 stores the update history by the pattern update unit 38 in the update history data 27 in association with the user identification information.

[0131] The action determination unit 40 determines whether the steps, duration, and total hand-washing time of the user's hand-washing action are appropriate based on the hand-washing pattern set by the pattern setting unit 34 or the hand-washing pattern updated by the pattern update unit 38.

[0132] The display control unit 41 causes the input / output device 5 to display an instruction screen 50 or the like showing the hand-washing procedure and the determination result of the movement determination device 1. The instruction screen 50 will be described in detail later (see FIG. 11).

[0133] The operation control unit 42 acquires operation information for the input / output device 5 (for example, information indicating that an operator 54 (see FIG. 11), which will be described later, has been pressed), and outputs the information to the processor 11. The processor 11 controls the motion determining device 1 in accordance with the acquired operation information.

[0134] (Instruction screen display) The contents of the instruction screen 50 displayed on the input / output device 5 by the movement determining device 1 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of an instruction screen displayed on the input / output device by the movement determining device of the first embodiment.

[0135] The movement determining device 1 displays an instruction screen 50 shown in Fig. 11 on the display screen of the monitor of the input / output device 5. The instruction screen 50 includes an icon 51, an icon 52, and an operator 54.

[0136] The icon 51 displays an action class display image 243 (see FIG. 7). The icon 51 also includes achievement information 53 indicating whether the action class corresponding to the action class display image has been completed. FIG. 11 shows an example in which the icon 51 displays "◯" as achievement information 53 indicating that the action class has been completed, or "X" as achievement information 53 indicating that the action class has not been completed. Furthermore, the icon 51 may display an order corresponding to the action class.

[0137] Furthermore, the instruction screen 50 displays the same number of icons 51 as the number of action classes indicated by the hand-washing pattern.

[0138] The icon 52 indicates the progress of the action class. In Fig. 11, the icon 52 is an example that displays the number of action classes indicated by the hand-washing pattern and the number of completed action classes.

[0139] The operators 54 are various operation buttons displayed on the instruction screen 50. The operators 54 shown in Fig. 11 are operation buttons for instructing to return the display contents of the instruction screen 50 to the initial state.

[0140] Note that the movement determining device 1 may additionally display information on the instruction screen 50 as necessary in addition to the configuration shown in FIG.

[0141] (Processing flow performed by the motion determination device) The flow of processing performed by the movement determining device 1 of the first embodiment will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the first embodiment. Fig. 13 is a second flowchart showing an example of the flow of processing performed by the movement determining device of the first embodiment.

[0142] The hand-washing pattern input unit 31 inputs a hand-washing pattern from the input / output device 5 via the input / output I / F 18 (step S11).

[0143] The pattern setting unit 34 determines whether there is a pattern setting table 22 that matches the hand washing pattern input in step S11 (step S12). If it is determined that there is a pattern setting table 22 that matches the hand washing pattern (step S12: Yes), the process proceeds to step S13. On the other hand, if it is determined that there is not a pattern setting table 22 that matches the hand washing pattern (step S12: No), the process proceeds to step S16.

[0144] If it is determined in step S12 that there is a pattern setting table 22 that matches the hand-washing pattern, the pattern setting unit 34 refers to the feature amount model table 23 and acquires the feature amount model 28 that corresponds to the hand-washing pattern (step S13).

[0145] Next, the pattern setting unit 34 constructs a determination logic for determining whether the hand-washing order is appropriate based on the action sequence ID 222, the action class ID 223, the action duration 224, and the like (step S14).

[0146] Next, the display control unit 41 displays the instruction screen 50 on the input / output device 5 through the input / output I / F 18 (step S15). After that, the process proceeds to step S19.

[0147] On the other hand, if it is determined in step S12 that there is no pattern setting table 22 that meets the determination condition, the pattern setting unit 34 refers to the feature quantity model table 23 and acquires the default feature quantity model 28 (step S16).

[0148] Next, the pattern setting unit 34 constructs a default determination logic for determining whether the hand-washing order is appropriate based on the action sequence ID 222, the action class ID 223, the action duration 224, and the like (step S17).

[0149] Next, the display control unit 41 displays the default instruction screen 50 on the input / output device 5 through the input / output I / F 18 (step S15). After that, the process proceeds to step S19.

[0150] Following step S15 or step S18, the identification information acquisition unit 32 determines whether or not the identification information has been acquired through the reader 6 (step S19). If it is determined that the identification information has been acquired (step S19: Yes), the process proceeds to step S20. On the other hand, if it is not determined that the identification information has been acquired (step S19: No), step S19 is repeated.

[0151] If it is determined in step S19 that the identification information has been acquired, the pattern setting unit 34 determines whether or not it is necessary to change the hand-washing pattern according to the identification information (step S20). If it is determined that it is necessary to change the hand-washing pattern (step S20: Yes), the process proceeds to step S21. On the other hand, if it is not determined that it is necessary to change the hand-washing pattern (step S20: No), the process proceeds to step S22.

[0152] If it is determined in step S20 that the hand-washing pattern needs to be changed, the pattern setting unit 34 changes the hand-washing pattern to one corresponding to the identification information (step S21).

[0153] Next, the area information acquisition unit 33 acquires the area information through the reader 6 (step S22).

[0154] The pattern setting unit 34 determines whether the hand-washing pattern needs to be changed according to the area information (step S23). If it is determined that the hand-washing pattern needs to be changed (step S23: Yes), the process proceeds to step S24. On the other hand, if it is not determined that the hand-washing pattern needs to be changed (step S23: No), the process proceeds to step S25 in FIG. 13.

[0155] If it is determined in step S23 that the hand-washing pattern needs to be changed, the pattern setting unit 34 updates the determination logic, and the display control unit 41 updates the instruction screen 50 (step S24).

[0156] Thereafter, the movement determining device 1 performs the process according to the flowchart of FIG.

[0157] The duration measurement unit 37 determines whether the total hand-washing time exceeds the total hand-washing time stored in the pattern setting table 22 (step S25). If it is determined that the total hand-washing time has exceeded (step S25: Yes), the process proceeds to step S36. On the other hand, if it is determined that the total hand-washing time has not exceeded (step S25: No), the process proceeds to step S26.

[0158] If it is determined in step S25 that the total hand-washing time has not been exceeded, duration measurement unit 37 acquires the action duration corresponding to the top unprocessed action sequence ID 222 (step S26).

[0159] Next, the motion identification unit 36 ​​determines which of the motion classes Ci (i=0 to 8) the user's hand belongs to, based on the captured image and the feature amount model 28 (step S27).

[0160] When the action class Ci is determined, the action determination unit 40 determines whether the determined action class Ci is consistent with the action class corresponding to the action order ID 222 of the action class Ci (step S28). If it is determined that the two are consistent (step S28: Yes), the process proceeds to step S29. On the other hand, if it is not determined that the two are consistent (step S28: No), the process returns to step S27.

[0161] If it is determined in step S28 that the determined action class Ci matches the action class corresponding to the action order ID 222 of the action class Ci, the duration measurement unit 37 adds the action time (step S29).

[0162] Next, the duration measurement unit 37 judges whether the operation time has exceeded the operation duration (step S30). If it is judged that the operation time has exceeded the operation duration (step S30: Yes), the process proceeds to step S31. On the other hand, if it is not judged that the operation time has exceeded the operation duration (step S30: No), the process returns to step S27.

[0163] When it is determined in step S30 that the action time has exceeded the action duration time, the display control unit 41 updates the instruction screen 50 (step S31).

[0164] When the update of the instruction screen 50 is completed, the pattern setting unit 34 judges whether the next operation sequence ID 222 exists (step S32). If it is judged that the next operation sequence ID 222 exists (step S32: Yes), the process proceeds to step S33. On the other hand, if it is not judged that the next operation sequence ID 222 exists (step S32: No), the process proceeds to step S34.

[0165] If it is determined in step S32 that the next operation sequence ID 222 exists, the pattern setting unit 34 updates the operation sequence ID 222 (step S33), and then returns to step S25.

[0166] If it is determined in step S32 that the next operation sequence ID 222 does not exist, the display control unit 41 displays the determination result on the instruction screen 50 (step S34).

[0167] Next, the operation control unit 42 determines whether the user has instructed to end the determination of the hand-washing motion (Step S35). If it is determined that the user has instructed to end the determination of the hand-washing motion (Step S35: Yes), the motion determination device 1 ends the process of FIG.

[0168] Returning to step S25, if it is not determined in step S25 that the total hand-washing time has exceeded the total hand-washing time stored in the pattern setting table 22, the action identification unit 36 ​​determines whether the hand-washing action is continuing (step S36). If it is determined that the hand-washing action is continuing (step S36: Yes), the process proceeds to step S37. On the other hand, if it is not determined that the hand-washing action is continuing (step S36: No), the process proceeds to step S34.

[0169] If it is determined in step S36 that the hand-washing action is continuing, the update history storage unit 39 determines whether the number of updates has reached the upper limit. If it is determined that the number of updates has reached the upper limit (step S37: Yes), the process proceeds to step S34. On the other hand, if it is determined that the number of updates has not reached the upper limit (step S37: No), the process proceeds to step S38.

[0170] If it is determined in step S37 that the number of updates has not reached the upper limit, the pattern update unit 38 updates the action duration and the total hand-washing time (step S38).

[0171] Next, the pattern update unit 38 increments the number of updates at that time (step S39).

[0172] Furthermore, the update history storage unit 39 stores the update information in the update history data 27 in association with the user identification information (step S40). After that, the process returns to step S26.

[0173] (Effects of the first embodiment) As described above, the movement determination device 1 of the first embodiment includes an identification information acquisition unit 32 that acquires identification information 251 that identifies a user, a pattern setting unit 34 that sets a hand washing pattern including a pre-prepared sequence of multiple hand washing actions, the duration of each of the hand washing actions, and a total hand washing time in a form corresponding to the identification information 251, an image acquisition unit 35 that acquires an image including the user's fingers, a movement identification unit 36 ​​that identifies which of the multiple hand washing actions the user is performing from the image acquired by the image acquisition unit 35, a duration measurement unit 37 that measures the duration of the hand washing action identified by the movement identification unit 36, a pattern update unit 38 that updates the duration and total hand washing time set by the pattern setting unit 34 if the duration measured by the duration measurement unit 37 is longer than the duration set by the pattern setting unit 34, and a movement determination unit 40 that determines whether the sequence, duration, and total hand washing time of the user's hand washing action are appropriate, based on the hand washing pattern set by the pattern setting unit 34 or the hand washing pattern updated by the pattern update unit 38. Therefore, even if an action is performed that does not follow a pre-prepared pattern, such as when the duration of a particular action pattern exceeds a set duration, it is possible to determine whether hand washing has been performed appropriately.

[0174] Furthermore, in the movement determining device 1 of the first embodiment, the pattern updating unit 38 updates the duration and total hand-washing time set by the pattern setting unit 34 within a range of a predetermined upper limit value for the same user. Therefore, even if the duration of a specific movement pattern exceeds the set duration, it is possible to determine whether hand-washing has been performed appropriately.

[0175] Moreover, the movement determining device 1 of the first embodiment further includes an update history storage unit 39 that stores the update history by the pattern update unit 38 in association with the user identification information 251. Therefore, it is possible to keep an update history for each user. This makes it possible to keep a pattern update history, which can be useful for statistical analysis of hand-washing patterns, etc.

[0176] Moreover, the movement determining device 1 of the first embodiment further includes an area information acquiring unit 33 that acquires area information 261 indicating the movement history of the user, and a pattern setting unit 34 sets a hand-washing pattern, which includes a pre-prepared sequence of a plurality of hand-washing actions, the duration of each hand-washing action, and a total hand-washing time, in a form corresponding to the area information 261. Therefore, a hand-washing pattern corresponding to the movement pattern of the user can be set.

[0177] The scope of application of the present disclosure is not limited to the hand-washing action described above. The present disclosure can be applied to an action determination device (information processing device) that determines whether a "series of actions" in which multiple different actions are performed consecutively is performed appropriately.

[0178] That is, the action determination device (information processing device) may include an identification information acquisition unit that acquires identification information that identifies a user, a pattern setting unit that sets a previously prepared action pattern including a sequence of multiple actions, the duration of each of the actions, and a total action time in a form corresponding to the identification information, an image acquisition unit that acquires an image in which the action performed by the user can be identified, an action identification unit that identifies which of the multiple actions the user is performing from the image acquired by the image acquisition unit, a duration measurement unit that measures the duration of the action identified by the action identification unit, a pattern update unit that updates the duration and total action time set by the pattern setting unit if the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit, and an action determination unit that determines whether the user's action sequence, duration, and total action time are appropriate based on the action pattern set by the pattern setting unit or the action pattern updated by the pattern update unit.

[0179] Second Embodiment A motion determining device 2 (not shown) according to a second embodiment of the present disclosure will be described below with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0180] The hardware configuration of the movement determining device 2 is the same as that of the above-described movement determining device 1, and therefore will not be described again.

[0181] The pattern setting table 29 included in the movement determining device 2 will be described with reference to Fig. 14. Fig. 14 is a diagram showing an example of a pattern setting table used by the movement determining device of the second embodiment.

[0182] The pattern setting table 29 of the movement determining device 2 differs from the pattern setting table 22 (see FIG. 5) of the movement determining device 1 described above in that it estimates the total hand-washing time from the tendency of the user's hand-washing session and allows an extension of the total hand-washing time. That is, the pattern setting table 29 stores, for example, contents that allow a total hand-washing time that exceeds the estimated total hand-washing time for a user who takes time to wash his / her hands carefully.

[0183] More specifically, the pattern setting table 29 has pattern update content 228 instead of the pattern update content 227 of the pattern setting table 22. The pattern update content 228 in Fig. 14 stores, when the pattern ID 221 is the hand-washing pattern A, that the total hand-washing time is estimated from the hand-washing session tendency of the user and added, and that the number of updates is limited to two.

[0184] (Functional configuration of the motion determination device) The functional configuration of the movement determining device 2 will be described with reference to Fig. 15. Fig. 15 is a functional block diagram showing an example of the functional configuration of the movement determining device of the second embodiment.

[0185] The movement determining device 2 further includes a duration estimation unit 44 in addition to the functions of the movement determining device 1 described above. Moreover, the movement determining device 2 includes a pattern setting unit 43 instead of the pattern setting unit 34 included in the movement determining device 1 described above. Moreover, the movement determining device 2 includes a pattern updating unit 45 instead of the pattern updating unit 38 included in the movement determining device 1 described above.

[0186] When the duration of any one of the multiple hand-washing actions exceeds the standard time, the duration estimation unit 44 estimates the total hand-washing time of the user. Specifically, the duration estimation unit 44 estimates the total hand-washing time based on the duration of each action pattern currently being measured, the duration of each past action pattern of the user stored in the update history storage unit 39, etc.

[0187] The pattern setting unit 43 sets the pattern setting table 29, in which hand-washing patterns prepared in advance and including the sequence of a plurality of hand-washing actions, the duration of each of the hand-washing actions, and the total hand-washing time, in the form registered in the area information table 26, based on the identification information acquired by the identification information acquisition unit 32 and the area information acquired by the area information acquisition unit 33. As described above, the pattern setting table 29 allows the total hand-washing time to be estimated and added based on the user's hand-washing session tendency.

[0188] When the duration measured by the duration measuring unit 37 is longer than the duration set by the pattern setting unit 43, the pattern updating unit 45 updates the duration and total hand-washing time set by the pattern setting unit 43 based on the pattern update content 228 (see FIG. 14). In addition, the pattern updating unit 45 updates the duration and total hand-washing time set by the pattern setting unit 43 within a range of a predetermined upper limit value for the same user.

[0189] (Processing flow performed by the motion determination device) The flow of processing performed by the movement determining device 2 of the second embodiment will be described with reference to Fig. 16 and Fig. 17. Fig. 16 is a first flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment. Fig. 17 is a second flowchart showing an example of the flow of processing performed by the movement determining device of the second embodiment.

[0190] The processes from step S51 to step S64 shown in Fig. 16 are the same as the processes from step S11 to step S24 shown in Fig. 12, so a repeated description will be omitted. Furthermore, the processes from step S65 to step S77 shown in Fig. 17 are the same as the processes from step S25 to step S37 shown in Fig. 13, so a repeated description will be omitted.

[0191] In step S77 of FIG. 17, if it is determined that the update count does not reach the upper limit (step S77: No), the duration estimation unit 44 estimates the update values ​​of the movement duration and the total hand-washing time (step S78).

[0192] Next, the pattern update unit 45 updates the action duration and the total hand-washing time (step S79).

[0193] Next, the pattern update unit 45 increments the number of updates at that time (step S80).

[0194] Furthermore, the update history storage unit 39 stores the update information in the update history data 27 in association with the user identification information (step S81). After that, the process returns to step S66.

[0195] (Effects of the second embodiment) As described above, the movement determining device 2 of the second embodiment further includes a duration estimation unit 44 that estimates the duration when the duration of any of a plurality of hand-washing movements exceeds a standard time, and the pattern updating unit 45 updates the duration and the total hand-washing time based on the estimation result of the duration estimation unit 44. Therefore, by estimating an appropriate duration from the tendency or past history of the hand-washing session of the person in question, it is possible to determine whether hand-washing has been performed appropriately even when a hand-washing movement exceeds an expected time.

[0196] Although the embodiments of the present invention have been described above, these embodiments are merely examples and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0197] 1,1',2 Motion determination device (information processing device) 3. Camera 5 Input / Output Devices 6. Leader 10 Control device 11 Processors 22,29 Pattern setting table 23 Feature Model Table 24 Action Class Table 25 Identification Table 26 Area Information Table 27 Update history data 28 Feature Model 31 Hand-washing pattern input section 32 Identification information acquisition unit 33 Area Information Acquisition Department 34,43 Pattern setting section 35 Image acquisition unit 36 Operation specific part 37 Duration measurement section 38,45 Pattern Update Section 39 Update history memory section 40 Operation judgment section 41 Display control unit 42 Operation control section 44 Duration Estimation Unit 50 Instruction screen 51,52 Icons 53 Achievement information 54 Operator 221 Pattern ID 222,253,264 Operation order ID 223,241,254,265 Operation Class ID 224,255,266 Operation duration 225,231,256,267 Feature model ID 226,257,268 Total hand washing time 227,228 Pattern Update Contents 232 Supported Action Class ID 233 Shooting Environment 242 Action Class Display Name 243 Operation Class Display Image 251 Identification Information 252,263 Pattern change type 258 Explanation of Change Conditions 261 Area information 262 Identification Information 269 ​​Explanation of Change Conditions A, B, C hand washing patterns C3, C4, C5, C6, Ci operation class [Prior art documents] [Patent documents]

[0198] [Patent Document 1] JP 2020-140678 A

Claims

1. an identification information acquisition unit that acquires identification information for identifying a user; a pattern setting unit that sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, a duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information; an image acquisition unit that acquires an image including the user's fingers; an action identification unit that identifies which of the plurality of hand-washing actions the user is performing from the image acquired by the image acquisition unit; a duration measurement unit that measures a duration of the hand-washing action identified by the action identification unit; a pattern update unit that updates the duration and total hand-washing time set by the pattern setting unit when the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit; and an action determination unit that determines whether the procedure, duration, and total hand-washing time of the user's hand-washing action are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern update unit. Information processing device.

2. a duration estimation unit configured to estimate a duration of any one of the plurality of hand-washing actions when the duration of the any one of the plurality of hand-washing actions exceeds a standard time, The pattern update unit updates the duration and the total hand-washing time based on the estimation result of the duration estimation unit. The information processing device according to claim 1 .

3. the pattern update unit updates the duration and total hand-washing time set by the pattern setting unit for the same user within a range of a predetermined upper limit value.

3. The information processing device according to claim 1 or 2.

4. The method further includes an update history storage unit that stores an update history by the pattern update unit in association with user identification information.

3. The information processing device according to claim 1 or 2.

5. The system further includes an area information acquisition unit that acquires area information indicating the movement history of the user, the pattern setting unit sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, a duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the area information.

3. The information processing device according to claim 1 or 2.

6. Computer, an identification information acquisition unit that acquires identification information for identifying a user; a pattern setting unit that sets a hand-washing pattern, which includes a sequence of a plurality of hand-washing actions, a duration of each of the hand-washing actions, and a total hand-washing time, in a form corresponding to the identification information; an image acquisition unit that acquires an image including the user's fingers; an action identification unit that identifies which of the plurality of hand-washing actions the user is performing from the image acquired by the image acquisition unit; a duration measurement unit that measures a duration of the hand-washing action identified by the action identification unit; a pattern update unit that updates the duration and total hand-washing time set by the pattern setting unit when the duration measured by the duration measurement unit is longer than the duration set by the pattern setting unit; and functioning as an action determination unit that determines whether the sequence, duration, and total hand-washing time of the user's hand-washing action are appropriate based on the hand-washing pattern set by the pattern setting unit or the hand-washing pattern updated by the pattern update unit. program.

Images