Hand washing judging system, information processing device, and information processing program

Abstract

To efficiently achieve improvement in the quality of hand washing according to past hand washing performance.SOLUTION: A hand washing judging system includes identification means, imaging means, judging means, recording means, determination means, and guiding means. The identification means identifies a hand washing person. The imaging means acquires a moving image showing the state of hand washing by the hand washing person. The judging means judges hand washing performance on the basis of the moving image acquired by the imaging means. The recording means records the performance judged by the judging means in association with the hand washing person identified by the identification means. The determination means determines contents of a guiding operation for guiding the hand washing based on the performance recorded by the recording means in association with the hand washing person identified by the identification means. Start means performs the guiding operation of the contents determined by the determination means before the start of the hand washing.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] An embodiment of the present invention relates to a hand-washing determination system, an information processing device, and an information processing program. [Background technology]

[0002] A hand-washing assessment system that assesses hand-washing performance for each part of a body based on a video of the hand-washing process is already known. This hand-washing assessment system notifies the hand-washer of his / her hand-washing achievements each time he / she finishes washing his / her hands. For this reason, there is concern that the results of the test will not be used for the next hand-washing. For these reasons, it has been desirable to be able to efficiently improve the quality of hand-washing based on past hand-washing results. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-186412 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to provide a hand-washing determination system, an information processing device, and an information processing program that can efficiently improve the quality of hand-washing based on past hand-washing results. [Means for solving the problem]

[0005] The hand washing judgment system of the embodiment includes an identification means, an imaging means, a judgment means, a recording means, a decision means, and an instruction means. The identification means identifies a person washing their hands. The imaging means obtains a video showing the state of the person washing their hands. The judgment means judges the hand washing performance based on the video obtained by the imaging means. The recording means records the performance judged by the judgment means in association with the person washing their hands identified by the identification means. The decision means determines the content of an instruction action for hand washing instruction based on the performance recorded by the recording means in association with the person washing their hands identified by the identification means. The start means executes the instruction action of the content determined by the decision means before the start of hand washing. [Brief description of the drawings]

[0006] [Figure 1] A block diagram showing the general configuration of a hand-washing determination system according to one embodiment and the main circuit configuration of the washing area terminal and collection and processing device that constitute this hand-washing determination system. [Diagram 2] FIG. 11 is a sequence diagram showing the procedures of a determination process and a collection process and the cooperation between the two processes. [Diagram 3] FIG. 4 is a diagram illustrating an example of a top screen. [Figure 4] FIG. 13 is a diagram illustrating an example of a track record screen. [Diagram 5] FIG. 13 is a diagram illustrating an example of a teaching screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] An example of an embodiment will be described below with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a hand-washing determination system 1 according to this embodiment, and the main circuit configuration of a washing area terminal 100 and a collection and processing device 200 that constitute this hand-washing determination system.

[0008] The hand-washing determination system 1 is configured to enable communication between the washing area terminal 100 and the collection and processing device 200 via a communication network 2. The communication network 2 may be the Internet, a VPN (virtual private network), a LAN, a public communication network, a mobile communication network, or the like, either alone or in combination as appropriate. As an example of the communication network 2, a wireless LAN is used.

[0009] The washing area terminal 100 is an information processing device provided in a washing area where hand washing is performed, and performs information processing such as a determination process for determining hand washing results or a user interface process with a hand-washing user. Only one washing area terminal 100 is shown in FIG. 1. However, multiple washing area terminals 100 may be included in the hand-washing determination system 1. When multiple faucets are provided in a washing area, hand-washing spaces corresponding to each of the multiple faucets are formed. Multiple washing area terminals 100 may be provided corresponding to each of the multiple hand-washing spaces. Alternatively, the hand-washing determination system 1 may include one or more washing area terminals 100 provided in each of multiple washing areas.

[0010] The collection and processing device 200 is an information processing device for collecting and recording the results of hand washing performed multiple times at one or more washing area terminals 100 included in the hand washing assessment system 1. The collection and processing device 200 also determines the instruction content for a new hand washing session based on the recorded results.

[0011] The washing area terminal 100 includes a processor 101, a main memory unit 102, an auxiliary memory unit 103, a touch panel 104, a card reader 105, a camera 106, a light 107, a timer sensor 108, a hand-washing sensor 109, a communication unit 110, and a transmission path 111. The processor 101, the main memory unit 102, the auxiliary memory unit 103, the touch panel 104, the card reader 105, the camera 106, the light 107, the timer sensor 108, the hand-washing sensor 109, and the communication unit 110 are capable of communicating with each other via the transmission path 111.

[0012] The processor 101, the main memory unit 102, and the auxiliary memory unit 103 are connected via a transmission line 111 to configure a computer that performs information processing for controlling the washing area terminal 100. The processor 101 corresponds to the central part of the computer. The processor 101 executes information processing for controlling each part to realize various functions of the washing area terminal 100 according to information processing programs such as an operating system and application programs.

[0013] The main memory unit 102 corresponds to the main memory portion of the computer. The main memory unit 102 includes a read-only memory area and a rewritable memory area. The main memory unit 102 stores a part of the information processing program in the read-only memory area. The main memory unit 102 may also store data required for the processor 101 to execute processes for controlling each part in the read-only memory area or the rewritable memory area. The main memory unit 102 uses the rewritable memory area as a work area for the processor 101.

[0014] The auxiliary storage unit 103 corresponds to the auxiliary storage portion of the computer. The auxiliary storage unit 103 may be, for example, an EEPROM (electric erasable programmable read-only memory), a HDD (hard disk drive), an SSD (solid state drive), or any other known storage device. The auxiliary storage unit 103 stores data used by the processor 101 in performing various processes and data generated by the processes in the processor 101. The auxiliary storage unit 103 may also store the information processing program. In this embodiment, the auxiliary storage unit 103 stores a terminal program PRA, which is one of the information processing programs. The terminal program PRA is an application program in which the procedure of information processing for realizing various functions of the washing area terminal 100 is described. A part of the storage area of ​​the auxiliary storage unit 103 is used as an area for storing a video file group FIA. The video file group FIA includes a plurality of video files. Each video file included in the video file group FIA is associated with a part of the hand. The video file represents a video for instructing how to wash the associated body part.

[0015] Touch panel 104 displays a screen for presenting information to an operator. In other words, touch panel 104 is an example of a display device. Furthermore, touch panel 104 inputs instructions by an operator touching the screen. In other words, touch panel 104 is an example of an input device.

[0016] The card reader 105 reads data recorded on a card. It is assumed that a well-known device using a close-proximity wireless communication method is used as the card reader 105. The card reader 105 may be another type of well-known device using a contact communication method or a magnetic method.

[0017] Camera 106 captures the associated hand-washing space. When a person washes his / her hands by placing them in the hand-washing space, camera 106 captures a video showing the state of hand-washing. In other words, camera 106 is an example of a capturing means. The light 107 illuminates the shooting range of the camera 106 . The timer sensor 108 detects the proximity of a hand to start a timer. The hand-washing sensor 109 detects hands placed in the hand-washing space.

[0018] The communication unit 110 executes communication processing for wirelessly performing data communication via the communication network 2. If a wireless LAN is used as the communication network 2 as described above, an existing wireless communication device for the wireless LAN can be used as the communication unit 110. Note that a wired communication device may be used instead of or in addition to the wireless communication device. The transmission path 111 includes an address bus, a data bus, and a control signal line, and transmits data and control signals between the connected components. As the basic hardware of the washing area terminal 100, it is assumed that the hardware of a tablet-type information processing device, for example, is used.

[0019] The collection and processing device 200 includes a processor 201, a main memory unit 202, an auxiliary memory unit 203, a display unit 204, an input unit 205, a communication unit 206, and a transmission path 207. The processor 201, the main memory unit 202, the auxiliary memory unit 203, the display unit 204, the input unit 205, and the communication unit 206 are capable of communicating with each other via the transmission path 207.

[0020] The processor 201 , the main storage unit 202 and the auxiliary storage unit 203 are connected via a transmission line 207 to constitute a computer that performs information processing for controlling the collection and processing device 200 . The processor 201 corresponds to the central part of the computer. The processor 201 executes information processing for controlling each part to realize various functions of the collection and processing device 200 in accordance with an operating system and information processing programs such as application programs.

[0021] The main memory unit 202 corresponds to the main memory portion of the computer. The main memory unit 202 includes a read-only memory area and a rewritable memory area. The main memory unit 202 stores a part of the information processing program in the read-only memory area. The main memory unit 202 may also store data required for the processor 201 to execute processes for controlling each part in the read-only memory area or the rewritable memory area. The main memory unit 202 uses the rewritable memory area as a work area for the processor 201.

[0022] The auxiliary storage unit 203 corresponds to the auxiliary storage part of the computer. The auxiliary storage unit 203 may be, for example, an EEPROM, a HDD, an SSD, or any other known storage device. The auxiliary storage unit 203 stores data used by the processor 201 in performing various processes and data generated by the processes in the processor 201. The auxiliary storage unit 203 may also store the information processing program. In this embodiment, the auxiliary storage unit 203 stores a collection processing program PRB, which is one of the information processing programs. The collection processing program PRB is an application program in which the procedure of information processing for realizing various functions of the collection and processing device 200 is described. A part of the storage area of ​​the auxiliary storage unit 203 is used as an area for storing a record database DBA. The record database DBA is a database that collects and records records determined by one or more washing place terminals 100 included in the hand-washing determination system 1. The record database DBA stores hand-washing records in association with the person washing the hand.

[0023] The display unit 204 displays a screen for presenting information to the operator. The display unit 204 is, for example, a display device provided on a touch panel. The display unit 204 may be an external liquid crystal display or the like. The display unit 204 may include a plurality of types of display devices. The operator of the collection and processing device 200 is, for example, a person who monitors the implementation status of hand-washing.

[0024] The input unit 205 inputs instructions from an operator. The input unit 205 is, for example, a touch sensor provided on a touch panel. The input unit 205 may be another type of input device such as a full keyboard. The input unit 205 may also include multiple types of input devices.

[0025] The communication unit 206 executes communication processing for wirelessly performing data communication via the communication network 2. If a wireless LAN is used as the communication network 2 as described above, an existing wireless communication device for the wireless LAN can be used as the communication unit 206. Note that a wired communication device may be used instead of or in addition to the wireless communication device. The transmission path 207 includes an address bus, a data bus, and control signal lines, and transmits data and control signals between the connected components. As the basic hardware of the collection and processing device 200, it is assumed that various general-purpose information processing devices such as a book type or a tower type, or the hardware of a general-purpose information processing device for a server, may be used.

[0026] Next, the operation of the hand-washing determination system 1 configured as above will be described. FIG. 2 is a sequence diagram showing the procedure of the determination process by the processor 101 and the collection process by the processor 201, and how the two processes work together. The processor 101 executes the determination process shown in Fig. 2 based on the terminal program PRA. The processor 201 executes the collection process shown in Fig. 2 based on the collection process program PRB. Note that the contents of the processes described below are merely examples, and it is possible to change the order of some of the processes, omit some of the processes, or add other processes as appropriate. In addition, only the main processes in the determination process and collection process are described below, and descriptions of some of the processes are omitted.

[0027] As ACT 101, the processor 101 displays a top screen on the touch panel 104. The top screen is a screen that guides a person who is about to wash their hands through a procedure for starting a hand-washing judgment. Fig. 3 is a diagram showing an example of a top screen. Note that in various screen examples shown in Fig. 3 and other figures, some display objects may be omitted from illustration. The top screen shown in FIG. 3 includes text messages and images that provide guidance on the procedure.

[0028] A person washing his / her hands holds an ID (identification) card on which his / her identifier (hereinafter referred to as a user identifier) ​​is recorded over card reader 105. When the ID card comes close to card reader 105, card reader 105 wirelessly communicates with an IC (integrated circuit) chip built into the ID card and reads out the user identifier stored in the IC chip.

[0029] 2, the processor 101 waits for the ID card to be read. Then, if the user identifier is read by the card reader 105 as described above, the process proceeds to ACT103. As ACT103, the processor 101 notifies the collection and processing device 200 of the user identifier read by the card reader 105 as described above. For example, the processor 101 causes the communication unit 110 to transmit notification data including the corresponding user identifier to the communication network 2, addressed to the collection and processing device 200.

[0030] When this notification data is transmitted to the collection and processing device 200 via the communication network 2, it is received by the communication unit 206 in the collection and processing device 200. In response to this, the processor 201 proceeds to ACT201. The processor 201 as ACT 201 temporarily stores the notified user identifier in the main storage unit 202 or the auxiliary storage unit 203 . A part of the processing performed thereafter by the processor 101 and the processor 201 will be described later.

[0031] After holding up the ID card, the customer holds his / her hand over a predetermined position to start the timer. When the hand comes close to the timer sensor 108, the timer sensor 108 turns on. In ACT 105, the processor 101 waits for an instruction to start the timer. Then, when the processor 101 confirms that the timer sensor 108 has been turned on as described above, it proceeds to ACT 106, assuming that an instruction to start the timer has been received. Note that the instruction to start the timer may be received by another operation, such as tapping a button displayed on the touch panel 104. As ACT 106, processor 101 starts a timer for measuring the time required for hand-washing. The timer may be a software timer realized by processor 101 through a separate process, or a hardware timer using a timer circuit not shown in FIG.

[0032] After the timer is started, the customer starts washing his / her hands. That is, the customer washes his / her hands by, for example, putting his / her hands in the hand-washing space corresponding to the washing place terminal 100 and washing the hands. When the customer puts his / her hands out to wash in this way, the hand-washing sensor 109 is turned on. In ACT 107, the processor 101 waits for hand-washing to start. Then, for example, if the processor 101 can confirm that the hand-washing sensor 109 has been turned on as described above, it proceeds to ACT 108, assuming that hand-washing has started.

[0033] As ACT108, the processor 101 starts a determination process. The determination process is, for example, a process of analyzing a video obtained by photographing the hand-washing process by the camera 106 using an AI (artificial intelligence) algorithm to determine the hand-washing performance for each part of the hand. As the determination process, for example, existing well-known processes can be applied as they are. Thus, the processor 101 executes information processing based on the terminal program PRA, and the computer with the processor 101 as the central part functions as a determination means.

[0034] When the person washes their hands and removes their hands from the hand-washing space, the hand-washing sensor 109 turns off. In ACT 109, processor 101 waits for hand washing to be completed. Then, for example, if processor 101 can confirm that hand washing sensor 109 has been turned off as described above, it proceeds to ACT 110, assuming that hand washing has been completed. In ACT 110, the processor 101 ends the determination process.

[0035] As ACT 111, the processor 101 displays a record screen on the touch panel 104. The record screen is a screen showing the judgment result in the judgment process. The process for generating the record screen can be the same as that of an existing hand-washing judgment system, for example. FIG. 4 is a diagram showing an example of the results screen. The results screen shown in FIG. 4 displays the evaluation results of the hand washing condition for each body part, which are determined in the determination process.

[0036] 2, the processor 101 notifies the collection and processing device 200 of performance data representing the determination result in the determination process. For example, the processor 101 generates performance data representing the determination result in the determination process in a predetermined form, and transmits notification data including this performance data from the communication unit 110 to the communication network 2, addressed to the collection and processing device 200.

[0037] When this notification data is transmitted to the collection and processing device 200 via the communication network 2, it is received by the communication unit 206 in the collection and processing device 200. In response to this, the processor 201 proceeds to ACT205. As ACT205, processor 201 records the results represented by the notified result data in association with the hand-washing person identified by the user identifier temporarily stored in ACT 201. That is, processor 201 updates the result database DBA so as to make it possible to extract the results represented by the notified result data, and to determine that this result is a result related to hand-washing by the hand-washing person identified by the user identifier temporarily stored in ACT 201. Thus, processor 201 executes information processing based on the collection processing program, and the computer with processor 201 as its central part functions as a recording means.

[0038] Now, hand washing in one hand washing space may be performed repeatedly by the same person. Hand washing in one hand washing space may be performed sequentially by multiple people. When one person repeatedly washes their hands, it is not necessary to use the same hand washing space, and different hand washing spaces may be used. Thus, each time one or more people wash their hands and a judgment regarding the hand washing is made by one or more washing area terminals 100, the performance data is notified to the collection and processing device 200, and the performance regarding the multiple hand washings is collected and recorded in the performance database DBA.

[0039] Here, the postponed processing will be described. After temporarily storing the user identifier in ACT201, the processor 201 proceeds to ACT202. The processor 201 executes an analysis process as ACT 202. For example, the processor 201 analyzes the hand-washing record of a hand-washing user identified by a user identifier temporarily stored in ACT 201, and determines the content of guidance to be given based on the hand-washing tendency of the hand-washing user.

[0040] In ACT203, the processor 201 determines an instruction screen to be displayed on the washing area terminal 100. For example, the processor 201 selects an instruction screen that matches the instruction content determined in ACT202 from among a plurality of predetermined instruction screens, and determines the selected instruction screen as the instruction screen to be displayed on the washing area terminal 100.

[0041] In ACT204, the processor 201 instructs the washing area terminal 100 to display the instruction screen determined in ACT203. For example, the processor 201 causes the communication unit 206 to transmit instruction data including a screen identifier for identifying the instruction screen determined in ACT203 to the washing area terminal 100 via the communication network 2.

[0042] When this instruction data is transmitted to the washing area terminal 100 via the communication network 2, it is received by the communication unit 110 in the washing area terminal 100. In response to this, the processor 101 proceeds to ACT104. The processor 101 as ACT 104 displays the specified instruction screen on the touch panel 104. The instruction screen is a screen for instructing hand washing. FIG. 5 is a diagram showing an example of the instruction screen. The instruction screen shown in FIG. 5 includes a text message and video for hand washing instruction.

[0043] The processor 101 selects a video file that is pre-associated with the designated instruction screen from among the video files included in the video file group FIA, and includes a video based on the selected video file in the instruction screen. It is assumed that the video shows a recommended washing method for a part that has been poorly evaluated in the past. The video may be streamed by downloading it from the collection and processing device 200 or another video server.

[0044] Displaying the instruction screen is an example of an instruction operation. Thus, by processor 101 executing information processing based on terminal program PRA, the computer having processor 101 as its central part functions as an instruction means. Determining the instruction screen corresponds to determining the content of the instruction operation, and processor 201 has determined the content of the instruction operation for the hand-washing person identified by the notified user identifier. Thus, by processor 201 executing information processing based on collection processing program PRB, the computer having processor 201 as its central part functions as an identification means and a determination means. Then, the processor 101 thereafter transitions to the above-mentioned standby state as ACT 105.

[0045] As described above, the hand washing judgment system 1 records the results of hand washing that have already been performed judged by the washing place terminal 100 in the collection and processing device 200, and displays an instruction screen on the washing place terminal 100 based on the hand washing person's past hand washing results before starting a new hand washing. In this way, the hand washing person can check the points that need attention based on the instruction screen before starting to wash their hands, and can use the information for the new hand washing. In other words, it is possible to efficiently improve the quality of hand washing according to the past hand washing results. Furthermore, the hand-washing assessment system 1 includes video in the instruction screen, making it possible for the person washing his / her hands to accurately recognize how they should wash their hands.

[0046] This embodiment can be modified in various ways as follows. Instead of or in addition to displaying the instruction screen, an instruction operation may be performed by another method such as playing back a voice message. In this case, the washing place terminal 100 is provided with a sound unit for playing back the voice message.

[0047] The instruction action may be any action for instruction based on the recorded past performance of the same hand-washing person, such as displaying a screen showing the performance of the same hand-washing person's previous hand-washing, that is, for example, a screen similar to the performance screen displayed at the end of the previous hand-washing.

[0048] A part of the processing executed by the processor 101 in the above embodiment may be executed by the processor 201 or a processor provided in another information processing device. For example, a video captured by the camera 106 may be transmitted to the collection processing device 200, and the processor 201 may execute the determination processing. Alternatively, for example, a video captured by the camera 106 may be transmitted to another image processing server, and the determination processing may be executed by a processor provided in the image processing server. Also, for example, the processor 201 may generate a guidance screen.

[0049] In the above embodiment, a part of the processing executed by the processor 201 may be executed by the processor 101 or a processor provided in another information processing device. For example, the performance database DBA may be stored in the auxiliary storage unit 103, and the performance database DBA may be updated by the processor 101. Alternatively, for example, the performance database DBA may be stored in a storage unit provided in another data management server, and the performance database DBA may be updated by a processor provided in the data management server. In addition, the instruction screen may be determined by the processor 101 or a processor provided in another information processing device.

[0050] Each function realized by the processor 101, 201 through information processing can be realized in part or in whole by hardware that executes information processing not based on a program, such as a logic circuit, etc. Also, each of the above functions can be realized by combining the above hardware, such as the logic circuit, with software control.

[0051] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0052] 1...hand-washing determination system, 2...communication network, 100...washing area terminal, 200...collection and processing device, 101, 201...processor, 102, 202...main memory unit, 103, 203...auxiliary memory unit, 104...touch panel, 105...card reader, 106...camera, 107...light, 108...timer sensor, 109...hand-washing sensor, 110, 206...communication unit, 111, 207...transmission path, 204...display unit, 205...input unit.

Claims

1. An identification means for identifying a person washing their hands; A photographing means for capturing a video showing the state of the person washing his / her hands; A determination means for determining hand-washing performance based on the video captured by the imaging means; a recording means for recording the results determined by the determination means in association with the hand-washing person identified by the identification means; a determination means for determining the content of an instruction action for hand washing instruction based on the hand washing record recorded by the recording means in association with the hand washing person identified by the identification means; an instruction means for executing an instruction action having contents determined by the determination means before starting hand washing; A hand washing judgment system comprising:

2. The determining means evaluates the quality of hand washing for each of a plurality of parts of the hand, and regards the evaluation results as achievements; The instruction means displays, as the instruction operation, an instruction screen on a display device, which instructs the hand-washing person identified by the identification means on how to wash a part of the hand-washing person that is poorly rated based on the results recorded by the recording means in association with the hand-washing person. The hand washing determination system according to claim 1 .

3. The instruction means displays a video on the instruction screen showing a recommended washing method for the area with a poor evaluation. The hand washing determination system according to claim 2 .

4. An identification means for identifying a person washing their hands; A determination means for determining hand-washing performance based on a video showing the hand-washing behavior of the hand-washer; a recording means for recording the results determined by the determination means in association with the hand-washing person identified by the identification means; a determination means for determining the content of an instruction action for hand washing instruction based on the hand washing record recorded by the recording means in association with the hand washing person identified by the identification means; An information processing device comprising:

5. Computer, An identification means for identifying a person washing their hands; A determination means for determining hand-washing performance based on a video showing the hand-washing behavior of the hand-washer; a recording means for recording the results determined by the determination means in association with the hand-washing person identified by the identification means; a determination means for determining the content of an instruction action for hand washing instruction based on the hand washing record recorded by the recording means in association with the hand washing person identified by the identification means; An information processing program that enables the system to function as such.

Images