Information processing programs and information processing devices

Abstract

This invention provides an information processing program and information processing device that can accurately grasp the situation of users when they leave the facility to engage in activities outside the facility. [Solution] In an information processing program according to one embodiment, an authentication procedure and a processing procedure are performed on a computer. The authentication procedure includes authenticating a facility user according to an captured facial image, and authenticating a user according to a facial image included in a group image taken of users who have moved from the facility to outside the facility. The processing procedure performs a process to update status information indicating the status of a user's movement from the facility to outside the facility or from outside the facility to the facility, according to the user's authentication result.

Description

Technical Field

[0001] The disclosed embodiments relate to an information processing program and an information processing apparatus.

Background Art

[0002] For example, in various facilities such as daycare centers and nursing homes, it is important to accurately grasp the users (such as children and the elderly) who come to the facility. Conventionally, for example, in daycare centers, there have been proposed techniques for displaying a list of absent children based on absence information from guardians, and techniques for notifying passengers on a bus for pick-up and drop-off of information such as the names of children who do not board the bus and the boarding locations by email (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in facilities such as daycare centers, users may go outside the facility to engage in activities (off-campus activities). In the prior art, it has been impossible to accurately grasp users who go out of the facility to the outside, users outside the facility, and users who return to the facility from outside the facility.

[0005] One aspect of the embodiment has been made in view of the above, and an object thereof is to provide an information processing program and an information processing apparatus capable of accurately grasping the situation of a user when the user who comes to the facility goes out to engage in activities outside the facility.

Means for Solving the Problems

[0006] To solve the above problems and achieve the objective, an information processing program according to one embodiment of the system causes a computer to execute an authentication procedure and a processing procedure. The authentication procedure includes authenticating a facility user according to an captured facial image, and authenticating a user according to a facial image included in a group image taken of the user after they have moved from the facility to outside the facility. The processing procedure executes a process to update status information indicating the status of the user's movement from the facility to outside the facility or from outside the facility to the facility, according to the user's authentication result. [Effects of the Invention]

[0007] In one embodiment of the information processing program, user authentication is performed based on the facial image included in a group image of facility users who have moved from the facility to outside the facility. The information processing program updates status information indicating the user's movement from the facility to outside the facility or from outside the facility to the facility, according to the user authentication result. This allows for accurate tracking of the user's status when a user who has come to the facility leaves the facility to engage in activities. [Brief explanation of the drawing]

[0008] [Figure 1A] Figure 1A is a diagram (part 1) showing an overview of the information processing according to the embodiment. [Figure 1B] Figure 1B is a diagram (part 2) showing an overview of the information processing according to the embodiment. [Figure 1C] Figure 1C is a diagram (part 3) showing an overview of the information processing according to the embodiment. [Figure 1D] Figure 1D is a diagram (part 4) showing an overview of the information processing according to the embodiment. [Figure 2] Figure 2 is a block diagram showing an example configuration of an information processing system according to the embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of an information processing apparatus according to the embodiment. [Figure 4] Figure 4 shows an example of authentication information. [Figure 5] Figure 5 shows an example of situation information. [Figure 6] Figure 6 shows the processing sequence for when children arrive at and leave the daycare center. [Figure 7] Figure 7 shows an example of a screen for entering schedule information. [Figure 8] Figure 8 shows an example of a screen displaying status information. [Figure 9] Figure 9 shows an example of a screen displaying unauthenticated information. [Figure 10] Figure 10 shows the processing sequence during off-site activities. [Figure 11A] Figure 11A is an example (part 1) of a screen showing the status of off-site activities. [Figure 11B] Figure 11B is a diagram (part 2) showing an example of a screen for checking the status of off-site activities. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the information processing program and information processing apparatus disclosed in this application will be described in detail with reference to the attached drawings. However, the present invention is not limited to the embodiments described below.

[0010] <Overview of Information Processing> First, an overview of the information processing implemented by the information processing program, etc., according to the embodiment will be explained using Figures 1A to 1D. Figures 1A to 1D are diagrams illustrating an overview of the information processing according to the embodiment.

[0011] As shown in Figure 1A, the information processing system 1 according to this embodiment comprises an information processing device 10, a management terminal device 200, a camera 300, and a terminal device 400. The information processing program according to this embodiment is executed by the information processing device (computer) 10.

[0012] The information processing device 10 is realized by, for example, a server device. The information processing device 10 may be configured as a cloud server that provides cloud services via a communication network such as the Internet or a mobile phone line network, or may be configured to perform distributed processing using a plurality of servers. The information processing device 10 has a communication function for communicating with a management terminal device 200, a camera 300, a terminal device 400, etc. via a communication network.

[0013] The information processing device 10 executes various processes such as processes related to the user B of the facility A. Here, an example is shown where the facility A is a childcare facility such as a nursery or kindergarten, and the user B is a child in the facility. Therefore, hereinafter, the facility A may be described as the "childcare facility A", and the user B may be described as the "child B in the facility". In the example of FIG. 1A etc., there are a plurality of children B, but it is not limited thereto. Further, the facility A is not limited to the above-described childcare facility, and may be other types of facilities such as a nursing facility, a company, a school, a sports facility, etc.

[0014] The management terminal device 200 is a terminal device used by the administrator D who manages the attendance of the child B in the childcare facility A which is a facility, and the situation of activities (activities outside the facility, off-campus activities) going out to the outside X of the facility. The administrator D is, for example, a childcare worker who takes care of the child B in the childcare facility A. Hereinafter, the administrator D may be described as the "childcare worker D".

[0015] The camera 300 is installed in the childcare facility A. Specifically, the camera 300 is installed in places such as the entrance and exit, the front door of the childcare facility A, where the child B passes when entering the childcare facility A, going out from the childcare facility A, returning, and leaving the facility. Note that the camera 300 may be one or a plurality of cameras. The camera 300 images the child B entering the childcare facility A, the child B going out from the childcare facility A towards the outside X of the facility, the child B returning from the outside X to the childcare facility A, and the child B leaving the childcare facility A. Specifically, the camera 300 images the face of the child B entering the facility, the face of the child B going out towards the outside X of the facility, the face of the child B returning from the outside X to the childcare facility A, and the face of the child B leaving the childcare facility A.

[0016] Terminal device 400 is used by accompanying person C who accompanies child B when B goes outside the facility X to engage in activities. Accompanying person C can also be described as a chaperone who leads child B. Accompanying person C is a childcare worker at childcare facility A, but is not limited to this. Terminal device 400 has an imaging function and, as described later, captures images of child B's face when B arrives outside the facility X, and of child B's face when B departs from outside the facility X towards childcare facility A.

[0017] In the information processing device 10 according to this embodiment, when a child (user) B who has come to the childcare facility (facility) A goes outside the facility X to engage in activities, the situation of child B can be accurately grasped.

[0018] To explain in more detail, the information processing device 10 acquires a facial image of child (user) B captured by the camera 300 (step S1). More specifically, the information processing device 10 acquires a facial image of child B as they leave childcare facility A towards outside facility X.

[0019] Next, the information processing device 10 authenticates child (user) B according to the acquired facial image of child B (step S2). In other words, the information processing device 10 authenticates child B according to the facial image of child B as they move from childcare facility A to outside facility X. More specifically, the information processing device 10 authenticates child B according to the facial image captured when child B leaves childcare facility A to outside facility X.

[0020] To explain in more detail, the information processing device 10 has pre-registered facial information representing the face of child B. The information processing device 10 compares the registered facial information with the facial image of child B acquired from the camera 300 and performs authentication processing for child B. If the facial information of child B and the facial image of child B match, the information processing device 10 authenticates (identifies) that child B who is going out is the registered child B.

[0021] Next, the information processing device 10 performs a process to update status information indicating the status of child B outside the facility X, according to the authentication result of child B (step S3). The status information is information indicating the status of child B's movement from childcare facility (facility) A to outside the facility X or from outside the facility X to childcare facility A. The status information includes, for example, the name of child B, the time when child B left for outside the facility X, the time when child B arrived at outside the facility X, the time when child B left outside the facility X, and the time when child B returned to childcare facility A. The status information will be explained in detail later using Figure 5.

[0022] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S4). The status information displayed on the management terminal device 200 will be explained in detail later using Figure 8.

[0023] Next, as shown in Figure 1B, child B and accompanying person C arrive at an external location X. External location X is a place where off-site activities are possible, such as a park or amusement park. Upon arrival at external location X, accompanying person C uses terminal device 400 to capture an image of child B's face. Specifically, accompanying person C captures a group image of all the children B who have arrived at external location X using terminal device 400. The information processing device 10 then acquires the group image of child B captured by terminal device 400 (step S5). In other words, the information processing device 10 acquires the facial images of child B who have arrived at external location X.

[0024] Next, the information processing device 10 authenticates child B according to the acquired collective image (face image) of child B (step S6). That is, the information processing device 10 authenticates child B according to the face image captured when child B arrives outside facility X.

[0025] Next, the information processing device 10 performs a process to update the status information according to the authentication result of child B (step S7). The information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S8).

[0026] Next, as shown in Figure 1C, the off-site activity ends, and child B and accompanying person C depart from outside facility X towards childcare facility A. At the time of departure, accompanying person C uses terminal device 400 to capture an image of child B's face as they depart for childcare facility A. Specifically, accompanying person C captures a group image of all the children B who are departing for childcare facility A using terminal device 400. The information processing device 10 then acquires the group image of child B captured by terminal device 400 (step S9). In other words, the information processing device 10 acquires the facial image of child B as they depart for childcare facility A.

[0027] Next, the information processing device 10 authenticates child B according to the acquired collective image (face image) of child B (step S10). That is, the information processing device 10 authenticates child B according to the face image taken when child B departs from outside facility X towards childcare facility A.

[0028] Next, the information processing device 10 performs a process to update the status information according to the authentication result of child B (step S11). The information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S12).

[0029] Next, as shown in Figure 1D, child B and accompanying person C return to (arrive at) childcare facility A from outside the facility X. The information processing device 10 acquires a facial image of child B captured by the camera 300 (step S13). More specifically, the information processing device 10 acquires a facial image of child B returning to childcare facility A from outside the facility X.

[0030] Next, the information processing device 10 authenticates child B according to the acquired facial image of child B (step S14). That is, the information processing device 10 authenticates child B according to the facial image taken when child B returns to childcare facility A from outside facility X.

[0031] Next, the information processing device 10 performs a process to update the status information according to the authentication result of child B (step S15). The information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S16).

[0032] The above example shows the status information being transmitted to and displayed on the management terminal device 200, but the system is not limited to this. The status information may also be transmitted to and displayed on the terminal device 400, in addition to or instead of the management terminal device 200.

[0033] As described above, the information processing device 10 according to this embodiment authenticates child B according to the facial image included in the group image of child B who has moved from childcare facility A to outside facility X, and updates the status information according to the authentication result. As a result, for example, when childcare worker D looks at the status information displayed on the management terminal device 200, the information processing device 10 enables childcare worker D to accurately understand the status of child B who is active outside facility X.

[0034] In addition, although the above example shows the situation information being transmitted to and displayed on the management terminal device 200, the system is not limited to this, and the situation information may be transmitted to and displayed on the terminal device 400 in addition to, or instead of, the management terminal device 200. In such a case, by having accompanying person C view the situation information displayed on the terminal device 400, the information processing device 10 can enable accompanying person C to accurately understand the situation of child B who is outside the facility X and engaged in activities.

[0035] Furthermore, since the information processing device 10 updates the status information according to the authentication result using the facial image of child B, the workload of accompanying person C, who checks whether child B is present and whether they have become separated during outings or off-site activities, can be reduced.

[0036] Furthermore, since the information processing device 10 is configured to authenticate user B according to the facial image included in the aggregate image of user B, the authentication process can also be performed early. In other words, even if there are multiple users B who have moved to a location X outside the facility, for example, the information processing device 10 can easily and quickly obtain the facial images of multiple users B from the aggregate image, and as a result, the authentication process can also be performed early.

[0037] <Information Processing System> Next, with reference to Figure 2, the configuration of the information processing system 1 according to the embodiment will be described. Figure 2 is a block diagram showing an example of the configuration of the information processing system 1 according to the embodiment. Note that block diagrams such as Figure 2 only show the components necessary to explain the features of the embodiment, and descriptions of general components are omitted.

[0038] As shown in Figure 2, the information processing system 1 comprises the information processing device 10, a guardian terminal device 100, a management terminal device 200, a camera 300, and a terminal device 400. The information processing device 10, the guardian terminal device 100, the management terminal device 200, the camera 300, and the terminal device 400 are connected to each other via a communication network N.

[0039] The parent terminal device 100 is a terminal device used by the parent of child B, who is the user. The parent can also be said to be a person related to child B. The parent terminal device 100 can be, but is not limited to, a smartphone, tablet, or PC (Personal Computer). The parent terminal device 100 is equipped with a display device 101 (see Figure 7), such as a touch panel display, and can display various types of information, such as a screen for inputting schedule information (described later) or a screen for information transmitted from the information processing device 10.

[0040] The management terminal device 200 is used by childcare worker D to manage child B's attendance and other usage status at childcare facility A, as well as the status of activities conducted outside the facility X (off-site activities). The management terminal device 200 can be, but is not limited to, a tablet, smartphone, or PC. The management terminal device 200 is equipped with a display device 201 (see Figures 8 and 9), such as a touch panel display, and can display various types of information, such as status information transmitted from the information processing device 10, and the facial image of unauthenticated child B, which will be described later.

[0041] Camera 300 is installed in childcare facility A and captures images of child B arriving at and leaving the facility. Camera 300 outputs the captured facial images (image data) of child B to the information processing device 10. The image data may be a moving image or a still image. Camera 300 is, for example, a camera equipped with a lens and an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), but is not limited to this.

[0042] The terminal device 400 is used by accompanying person C who accompanies child B when B goes outside the facility X for activities. The terminal device 400 is carried by accompanying person C during off-site activities. The terminal device 400 is equipped with a camera (not shown) and has an imaging function. The terminal device 400 can be, but is not limited to, a smartphone, tablet, or PC. The terminal device 400 is equipped with a display device 401 (see Figures 11A and 11B), such as a touch panel display, and can display various information, such as a screen for checking the status of off-site activities.

[0043] In addition to the status of off-site activities described above, the information processing device 10 also updates status information such as the attendance status of child B at childcare facility A, or in other words, the usage status of child B at childcare facility A. The information processing device 10 will be explained with reference to Figure 3. Figure 3 is a block diagram showing an example configuration of the information processing device 10 according to this embodiment.

[0044] As shown in Figure 3, the information processing device 10 comprises a communication unit 11, a controller (control unit) 20, and a storage unit 30. The communication unit 11 is an interface for data communication between the guardian terminal device 100, the management terminal device 200, the camera 300, and the terminal device 400. The communication unit 11 is, for example, a NIC (Network Interface Card), but is not limited to this.

[0045] The storage unit 30 is a storage unit composed of storage devices such as RAM (Random Access Memory), data flash, or a hard disk drive. Authentication information 31, status information 32, unauthenticated information 33, and information on various programs are stored in this storage unit 30. The information processing device 10 may also acquire the above-mentioned programs and various information via other computers or portable recording media connected by wired or wireless networks.

[0046] Authentication information 31 is information used for the authentication process of child B who uses childcare facility A, which is a facility. Authentication information 31 is stored in the storage unit 30 in advance before the authentication process is performed. Now, let's explain authentication information 31 using Figure 4. Figure 4 is a diagram showing an example of authentication information 31.

[0047] As shown in Figure 4, the authentication information 31 includes items such as "User ID," "Name," "Class," and "Facial Information," and the data for each item is linked to each other.

[0048] The "User ID" is identification information that identifies child B, who is the user. The "Name" is information indicating child B's name. In the example shown in Figure 4, for convenience, the "Name" is abstractly represented as "F01," but "F01" will store specific information. Other information may also be described abstractly below.

[0049] "Class" is information indicating the name of the class to which child B belongs at childcare facility A. Note that "Class" may also be "Group," indicating the name of the group to which the user belongs, for example, if the facility is a nursing home or sports facility, or "Department," indicating the name of the department to which the user belongs, if the facility is a company, etc., and can be set arbitrarily. "Face information" is information indicating the face of child B.

[0050] In the example shown in Figure 4, the authentication information 31 for child B, identified by user ID "E01", indicates that the name is "F01", the class is "G01", and the facial information is "H01".

[0051] Continuing the explanation of Figure 3, situation information 32 is information showing the usage status of child B at childcare facility A. Now, let's explain situation information 32 using Figure 5. Figure 5 is a diagram showing an example of situation information 32.

[0052] As shown in Figure 5, the status information 32 includes items such as "User ID," "Name," "Class," "Face Image," "Arrival Time," "Leaving Time," "Arrival Time Outside Facility," "Departure Time Outside Facility," "Return Time," "Departure Time," "Leaving Facility," "Absence / Lateness," and "Contact Details," and the data for each item is linked to each other.

[0053] The "User ID," "Name," and "Class" have already been explained. The "Facial Image" is a facial image (image data) of child B captured by camera 300 and terminal device 400.

[0054] "Arrival Time" indicates the time when child B arrives at the nursery. "Leaving Time" indicates the time when child B leaves the nursery facility A for location X. "Arrival Time Outside Facility" indicates the time when child B arrives at location X. "Departure Time Outside Facility" indicates the time when child B leaves location X for nursery facility A. "Return Time" indicates the time when child B returns to nursery facility A from location X. "Departure Time" indicates the time when child B leaves the nursery.

[0055] "Leave / Lateness" is information indicating whether or not child B has been notified of being absent or late. Specifically, if the parent's terminal device 100 receives information indicating that child B will be absent from childcare facility A (taking leave), "Leave" will be registered in "Leave / Lateness". Also, if the parent's terminal device 100 receives information indicating that child B will be late for childcare facility A, "Late" will be registered in "Leave / Lateness".

[0056] "Communication details" is information indicating the content of communication from the parent or guardian. Specifically, if child B is absent from or late to childcare facility A, the parent or guardian enters the reason as communication details in the parent terminal device 100 within the schedule information. When schedule information including communication details is received from the parent or guardian terminal device 100, the entered communication details are registered in "Communication details".

[0057] In the example shown in Figure 5, the status information 32 for child B, identified by user ID "E01", indicates that the name is "F01", the class is "G01", the face image is "J01", the arrival time is "9:00", the departure time is "10:00", the arrival time outside the facility is "10:20", the departure time outside the facility is "11:10", the return time is "11:30", and the departure time is "18:00". In addition, the status information for child B, identified by user ID "E02", indicates that the name is "F02", the class is "G02", the absence / lateness is "on leave", and the contact content is "K02". Furthermore, the status information for child B, identified by user ID "E03," indicates that the name is "F03," the class is "G03," the facial image is "J03," the arrival time is "9:05," and the departure time is "17:30." It should be noted that, in this context, child B, identified by user IDs "E02" and "E03," is assumed to be a child who does not participate in off-site activities; in other words, a child who does not participate in outings from childcare facility A.

[0058] Continuing the explanation of Figure 3, the unauthenticated information 33 is information indicating the face images that were not authenticated by the authentication process among the multiple face images captured by the camera 300 and terminal device 400, that is, information indicating the face images that were not authenticated.

[0059] The controller 20 includes a microcomputer with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM, and various circuits. The controller 20 controls the operation of the entire information processing device 10 by having the CPU execute a program (e.g., an information processing program) stored in ROM, using RAM as a workspace. The controller 20 may be partially or entirely composed of hardware such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0060] Controller 20 performs various processes, including authenticating child B based on the child's facial image, receiving schedule information from parents or guardians, and updating status information based on the authentication result and schedule information of child B. Controller 20 performs information processing according to the processing sequences shown in Figures 6 and 10, including the various processes. Figure 6 shows the processing sequence during arrival and departure from the facility, and Figure 10 shows the processing sequence during off-site activities.

[0061] <Information processing in information processing systems> First, the information processing performed by the information processing device 10, the parent terminal device 100, and the management terminal device 200 during arrival and departure will be explained with reference to Figure 6.

[0062] As shown in Figure 6, the information processing device 10 (controller 20) acquires facial images of child B captured by the camera 300 installed at childcare facility A (step S100). The child B captured may be, for example, child B arriving at the facility, child B leaving the facility, etc., but is not limited to these. The camera 300 also captures facial images of child B leaving the facility X and child B returning from outside X, but this will be described later.

[0063] Next, the information processing device 10 reads the authentication information 31 from the storage unit 30 and performs an authentication process using the face information of child B contained in the authentication information 31 and the acquired face image of child B (step S101). Specifically, the information processing device 10 analyzes the face image of child B and extracts the characteristic points of child B's face (e.g., eyes, nose, mouth, etc.) from the face image. If the extracted characteristic points of child B's face match or nearly match the characteristic points of child B's face information, the information processing device 10 authenticates (identifies) the captured child B as child B registered in the authentication information 31. On the other hand, if the extracted characteristic points of child B's face do not match any of the multiple face information of child B contained in the authentication information 31 and authentication fails, the information processing device 10 registers the unauthenticated face image as unauthenticated information 33 in the storage unit 30.

[0064] Furthermore, in the authentication process, the information processing device 10 excludes authenticated children B from the authentication process among the multiple children B. Specifically, in the authentication process, the information processing device 10 excludes the face information of authenticated children B from the face information of multiple children B included in the authentication information 31. Then, the information processing device 10 compares the face image of child B captured by the camera 300 with the face information of authentication information 31 from which the face information of authenticated children B has been excluded, and performs the authentication process.

[0065] In this way, by excluding the already authenticated child B from the authentication process, it is possible to prevent the results of any misauthentication that may occur in subsequent authentication processes from being reflected in the status information. Furthermore, excluding the already authenticated child B from the authentication process reduces the processing load on subsequent authentication processes.

[0066] Furthermore, for the image analysis in the authentication process described above, an image recognition model can be used, for example. The image recognition model is an AI (Artificial Intelligence) model for image recognition. The image recognition model is, for example, a DNN (Deep Neural Network) model trained using a deep learning algorithm, and is configured to detect facial feature points when a facial image of child B is input. However, image analysis may also be performed by methods other than the image recognition model.

[0067] The parent terminal device 100 receives scheduled information indicating whether or not child B is scheduled to use childcare facility A, through the parent's operation (step S102). Specifically, for example, if child B is absent from childcare facility A due to illness, etc. (taking leave) or is late, the parent operates the parent terminal device 100 and inputs information indicating that child B will be absent or late from childcare facility A as scheduled information. Figure 7 shows an example of the scheduled information input screen.

[0068] As shown in Figure 7, on the input screen displayed on the display device 101 of the parent terminal device 100, the name of child B is entered in input field 110, the date of absence or lateness is entered in input field 111, and the details of the planned use of childcare facility A (absence, lateness, etc.) are entered in input field 112. In addition, on the input screen, the reason for absence or lateness is entered in input field 113. When the parent presses the send button 114 on the input screen, the parent terminal device 100 sends the entered schedule information to the information processing device 10.

[0069] Let's continue the explanation of Figure 6. The information processing device 10 receives the schedule information transmitted from the parent terminal device 100 (step S103). Although the above explanation described the process in the order of authentication processing and schedule information reception processing, it is not limited to this order. For example, the order could be schedule information reception processing and authentication processing, or the authentication processing and schedule information reception processing could be performed simultaneously.

[0070] Next, the information processing device 10 performs a process to update status information indicating the usage status of child B at childcare facility A, according to the authentication result and schedule information of child B (step S104). Specifically, according to the authentication result and schedule information of child B, the information processing device 10 registers information from each item of the status information 32 (see Figure 5) in the storage unit 30 that corresponds to child B who was authenticated in this authentication process.

[0071] For example, if the authentication result indicates that child B has been authenticated, the information processing device 10 registers information such as "name," "class," "face image," and "arrival time" from the status information 32 for the authenticated child B. Also, if the information processing device 10 receives schedule information, it registers information such as "name," "class," "vacancy / late arrival," and "contact details" from the status information 32 for child B corresponding to the received schedule information.

[0072] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S105). Figure 8 shows an example of a screen displaying the status information.

[0073] As shown in Figure 8, the display device 201 of the management terminal device 200 displays a status confirmation screen for childcare workers D and others to check the status information. On the status confirmation screen, the content of the status information is displayed in the display field 210.

[0074] The status confirmation screen is equipped with a leave confirmation button 211 for checking the absence of child B. Specifically, when the leave confirmation button 211 is pressed by childcare worker D, the management terminal device 200 requests the information processing device 10 to send the contents of the received schedule information. Although not shown in the diagram, the management terminal device 200 displays the contents of the schedule information sent from the information processing device 10 in response to the request (for example, a list of children B who will be absent or late, the content of the contact, etc.). By viewing the contents of this schedule information, childcare worker D can confirm which children B will be absent or late from childcare facility A, the reasons for their absence or lateness, etc.

[0075] Let's continue the explanation of Figure 6. If unauthenticated information 33 is registered in the storage unit 30, the information processing device 10 sends the unauthenticated information 33 to the management terminal device 200 for display (step S106). Specifically, the information processing device 10 sends the face images of the multiple children B that were not authenticated by the authentication process (i.e., unauthenticated face images) to the management terminal device 200 for display. Figure 9 is a diagram showing an example of a screen displaying unauthenticated information.

[0076] As shown in Figure 9, the display device 201 of the management terminal device 200 displays an unauthenticated confirmation screen for childcare worker D to check unauthenticated information. On the unauthenticated confirmation screen, facial images that were not authenticated during the authentication process are displayed in the display area 220. This makes it possible for childcare worker D to be aware that there is an unauthenticated child B. Note that the unauthenticated confirmation screen shown in Figure 9 and the status confirmation screen shown in Figure 8 may be displayed on the same screen of the display device 201, or they may be displayed on separate screens.

[0077] Continuing the explanation of Figure 6, if there are any corrections to the status information and unauthenticated information displayed on the display device 201 in the management terminal device 200, the corrections to each piece of information are entered by the childcare worker D (step S107). Once the corrections to each piece of information are entered, the management terminal device 200 sends a correction request for each piece of information to the information processing device 10, and the information processing device 10 accepts the correction request for each piece of information (step S108). The information processing device 10 updates (corrects) the status information 32, etc. in the storage unit 30 according to the content of the corrections to each piece of information (step S109). The information processing device 10 sends the updated status information, etc. to the management terminal device 200 for display (step S110). Thus, in this embodiment, the status information, etc. can be corrected by manual operation in steps S107 to S110.

[0078] Here, the correction process in steps S107 to S110 will be explained in detail. For example, among the face images displayed on the unauthenticated confirmation screen (see Figure 9), there may be cases where, although not authenticated during the authentication process, childcare worker D can identify which child B's face image it is by looking at the face image. In such cases, childcare worker D inputs corrections to the unauthenticated information on the unauthenticated confirmation screen. For example, the identifiable face image is selected in the selection field 221, the class of child B in the selected face image is entered in the input field 222, the name of child B is entered in the input field 223, and the usage status of child B at the time the face image was taken (e.g., arrival, departure) is entered in the input field 224. Then, when childcare worker D presses the registration button 225 on the unauthenticated confirmation screen, the management terminal device 200 sends a correction request for the entered content to the information processing device 10, and the information processing device 10 accepts the correction request. The information processing device 10 updates the face image, name, and class in the status information 32 of the storage unit 30 according to the changes made. Furthermore, if, for example, the status of child B is "attended" in the changes made, the information processing device 10 updates the attendance time in the status information 32. This updated attendance time is, for example, the time when child B's face image was captured. Also, if an unauthenticated face image is registered in the status information 32, the information processing device 10 deletes the face image from the unauthenticated information 33 in the storage unit 30 and updates the unauthenticated information 33. Finally, the information processing device 10 transmits the updated status information and unauthenticated information to the management terminal device 200 for display. As a result, the changes are reflected in the status information and unauthenticated information displayed on the display device 201 of the management terminal device 200.

[0079] Next, we will explain the process of correcting the status information on the status confirmation screen (see Figure 8). For example, when childcare worker D is taking attendance of child B while checking the status information displayed on the status confirmation screen, there may be cases where child B is present but not registered in the status information. This can occur, for example, if camera 300 is unable to capture an image of child B and a facial image cannot be obtained. In such cases, in this embodiment, the status information is corrected on the status confirmation screen. Specifically, the status confirmation screen is provided with a correction button 212 for correcting the status information. When the correction button 212 is pressed by childcare worker D, the management terminal device 200 switches to correction mode and accepts corrections to the status information displayed on the status confirmation screen. Here, the attendance time of child B who is not registered is entered (corrected). The management terminal device 200 sends a correction request for the entered content to the information processing device 10, and the information processing device 10 accepts the correction request. The information processing device 10 updates the status information 32 (in this case, the arrival time) in the storage unit 30 according to the changes made. The information processing device 10 then transmits the updated status information to the management terminal device 200 for display. As a result, the status information displayed on the display device 201 of the management terminal device 200 reflects the changes made.

[0080] Furthermore, for example, when childcare worker D takes attendance of child B while checking the status information displayed on the status confirmation screen, there may be cases where the displayed face image and the name of child B corresponding to that face image are incorrect. This can occur if a misauthentication occurs during the authentication process. In such cases, childcare worker D presses the correction button 212, and the management terminal device 200 accepts the correction of the status information displayed on the status confirmation screen in correction mode. Here, corrections are made such as moving the misauthenticated face image to the face image field corresponding to child B that matches the face image (in other words, the correct child B). At this time, if the time the image was taken is registered as the arrival time, the arrival time may also be moved as part of the correction. The management terminal device 200 sends a correction request for the input content to the information processing device 10, and the information processing device 10 accepts the correction request. The information processing device 10 updates the status information 32 (here, face image, arrival time) in the storage unit 30 according to the correction content. The information processing device 10 then transmits the updated status information to the management terminal device 200 for display. As a result, the modified content is reflected in the status information displayed on the display device 201 of the management terminal device 200.

[0081] Furthermore, regarding the status information of child B, whose incorrectly authenticated facial image was registered, the facial image, arrival time, etc. will no longer be registered as a result of the above-mentioned migration. Therefore, for example, if child B is identified during roll call, the arrival time, etc., may be registered (corrected) by childcare worker D.

[0082] The status information and unauthenticated information may be transmitted to and displayed on the terminal device 400. If there are any corrections to the status information or unauthenticated information displayed on the terminal device 400, the information processing device 10 may receive the corrections entered into the terminal device 400 by the companion C and update the status information 32, etc., according to the corrections.

[0083] Let's continue the explanation of Figure 6. Next, if the content of the authentication result for child B differs from the content of the schedule information, the information processing device 10 notifies the parent's terminal device 100 (step S111). For example, if there is a child B who has not been authenticated in the content of the authentication result (for example, child B whose attendance is not registered), and if child B's absence (vacancy) or lateness is not registered in the content of the schedule information, the information processing device 10 notifies the parent's terminal device 100. Such notification is made using a notification function such as email or message notification, and notifies that child B has not attended school and prompts the parent to register schedule information in the case of absence (vacancy) or lateness. If child B is absent or late, the parent who receives the notification enters the schedule information via the parent's terminal device 100 (see Figure 7). As a result, the information processing device 10 can reflect the entered schedule information in the status information and send this status information to the management terminal device 200 for display.

[0084] Furthermore, if Facility A is a nursing home, company, etc., the above-mentioned notification may be sent to the user of Facility A themselves. In other words, the information processing device 10 will send a notification to user B or someone related to user B.

[0085] This ensures that, for example, if there is an unauthenticated user B (e.g., user B whose attendance is not registered) in the authentication results, and if user B's leave or other absence is not registered in the schedule information, user B or related parties (parents / guardians) can be reliably notified. Furthermore, by having the information processing device 10 send notifications, the workload of the administrator (childcare worker) D in contacting user B or related parties can be reduced, and the possibility of missed communications can be suppressed.

[0086] Next, the information processing performed by the information processing device 10, the management terminal device 200, and the terminal device 400 during off-site activities will be explained with reference to Figure 10. Figure 10 shows the information processing at the time of departure from the facility, arrival at an off-site location, departure from an off-site location, and arrival at the facility.

[0087] As shown in Figure 10, the information processing device 10 (controller 20) acquires a facial image of child B captured by a camera 300 installed at childcare facility A (step S200). Here, the information processing device 10 acquires a facial image of child B as they leave (depart) from childcare facility A to outside X.

[0088] Next, the information processing device 10 reads the authentication information 31 from the storage unit 30 and performs an authentication process using the facial information of child B contained in the authentication information 31 and the acquired facial image of child B (step S201).

[0089] Furthermore, in the authentication process of step S201, and the authentication processes of steps S206, S211, and S216 described later, the information processing device 10 excludes children B who do not participate in outings from childcare facility A from the authentication process. Children B who do not participate include, for example, children B who are absent or late, or children B who attend but do not go out (children B who do not participate in off-site activities), but are not limited to these (see children B identified by user IDs "E02" and "E03" in Figure 5).

[0090] Specifically, in the authentication process, the information processing device 10 excludes the facial information of children B who do not participate in outings from childcare facility A (i.e., children B who do not participate in off-site activities) from the facial information of multiple children B included in the authentication information 31. Then, the information processing device 10 compares the captured facial image of child B with the facial information of the authentication information 31 from which the facial information of non-participating children B has been excluded, and performs the authentication process.

[0091] Furthermore, as described above, the information processing device 10 may register unauthenticated facial images in the storage unit 30 as unauthenticated information 33. In addition, the information processing device 10 may exclude authenticated children B from the authentication process among the multiple children B.

[0092] Next, the information processing device 10 performs a process to update the status information according to the authentication result of child B at the time of departure from the facility (step S202). Specifically, according to the authentication result of child B, the information processing device 10 registers the information of the items in the status information 32 (see Figure 5) of the storage unit 30 that correspond to child B who was authenticated in this authentication process. Since the authentication result here indicates that child B has been authenticated to leave child facility A to outside facility X, the information processing device 10 registers information such as "name," "class," "face image," and "time of departure" from the status information 32 for the authenticated child B.

[0093] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S203; see Figure 8). The status information may be modified by the childcare worker D, as described above.

[0094] Next, the information processing device 10 notifies the terminal device 400 of the results of the authentication process at the time of departure from the facility (step S204). Figures 11A and 11B show examples of screens for confirming the status of off-site activities, including the authentication results.

[0095] As shown in Figure 11A, if the authentication result indicates that all children B scheduled for off-site activities have been authenticated, a message such as "Departure from facility: Departure of all children has been registered." will be displayed in the display field 410 on the status confirmation screen displayed on the display device 401 of the terminal device 400. Note that children B scheduled for off-site activities are, for example, children B who are attending the nursery school but excluding children B who will not be participating in off-site activities, but are not limited to this.

[0096] On the other hand, as shown in Figure 11B, if the authentication result indicates that there are unauthenticated children B among those scheduled for off-site activities, a message such as "Departure from facility: XX's departure from the facility is not registered. Please check." will be displayed in the display area 410 on the status confirmation screen. In more detail, the information processing device 10 performs authentication processing at the time of arrival and departure from the facility. The information processing device 10 then notifies the user that the authentication results for child B differ between the time of arrival and departure from the facility. Here, the information processing device 10 performs notification processing if the authentication results differ for child B who has arrived at the facility and is scheduled for off-site activities, such as being authenticated at arrival but not at departure from the facility.

[0097] In this way, the information processing device 10 notifies the terminal device 400 of the authentication result, allowing accompanying person C to accurately understand the situation of child B at the time of departure from the facility. Furthermore, if child B is not authenticated, the information processing device 10 can make accompanying person C aware early that child B may have become separated from the facility before departure.

[0098] Although the above example shows that the authentication result notification is sent to the terminal device 400, the method is not limited to this, and the authentication result notification may be sent to the management terminal device 200 in addition to, or instead of, the terminal device 400.

[0099] Next, when child B and accompanying person C arrive outside the facility at X, accompanying person C uses terminal device 400 to capture an image of child B's face upon arrival at X, specifically an image of the group of children B who have arrived at X. The information processing device 10 then acquires the group image of child B captured by terminal device 400 (step S205). Here, the information processing device 10 acquires the facial images of child B upon arrival at X.

[0100] Next, the information processing device 10 reads the authentication information 31 from the storage unit 30 and performs authentication processing using the facial information of child B included in the authentication information 31 and the facial image of child B included in the acquired aggregate image (step S206).

[0101] The information processing device 10 performs a process to update the status information according to the authentication result of child B upon arrival outside the facility (step S207). Since the authentication result here indicates that child B has been authenticated upon arrival outside facility X, the information processing device 10 registers information such as "face image" and "time of arrival outside facility" from the status information 32 of the storage unit 30 for the authenticated child B.

[0102] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S208). Then, the information processing device 10 notifies the terminal device 400 of the results of the authentication process upon arrival outside the facility (step S209).

[0103] For example, if the authentication result indicates that all children B who are scheduled to arrive outside the facility at location X have been authenticated, the status confirmation screen displayed on the terminal device 400 will show a message such as "Arrival outside the facility: Arrival outside the facility for all children has been registered." in the display field 410 (illustration omitted).

[0104] On the other hand, if the authentication result indicates that there is a child B who is scheduled to arrive outside the facility X but has not been authenticated, the status confirmation screen will display a message such as "Arrival outside facility: Child B's arrival outside the facility has not been registered. Please check." in the display area 410. More specifically, the information processing device 10 performs authentication processing when departing from the facility and when arriving outside the facility. The information processing device 10 then notifies the user that the authentication results for child B differ between the time of departure from the facility and the time of arrival outside the facility. In this case, the information processing device 10 performs notification processing if the authentication results for child B differ, such as being authenticated when departing from the facility but not when arriving outside the facility.

[0105] In this way, the information processing device 10 notifies the terminal device 400 of the authentication result, allowing accompanying person C to accurately understand the situation of child B upon arrival outside the facility. Furthermore, if child B is not authenticated, the information processing device 10 can make accompanying person C aware early on that child B may have become separated from the childcare facility A between leaving the facility and arriving at X outside the facility.

[0106] Next, the off-site activity ends, and child B and accompanying person C depart from outside facility X towards childcare facility A. Accompanying person C uses terminal device 400 to capture an image of child B's face as they depart from outside facility X, specifically capturing a group image of all the children B as they depart from outside facility X. The information processing device 10 then acquires the group image of child B captured by terminal device 400 (step S210). Here, the information processing device 10 acquires the facial image of child B as they depart from outside facility X.

[0107] Next, the information processing device 10 reads the authentication information 31 from the storage unit 30 and performs authentication processing using the facial information of child B included in the authentication information 31 and the facial image of child B included in the acquired aggregate image (step S211).

[0108] The information processing device 10 performs a process to update the status information according to the authentication result of child B when leaving the facility (step S212). Since the authentication result here indicates that child B has been authenticated when leaving facility X, the information processing device 10 registers information such as "face image" and "time of departure from facility" from the status information 32 of the storage unit 30 for the authenticated child B.

[0109] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S213). Then, the information processing device 10 notifies the terminal device 400 of the results of the authentication process when departing from the facility (step S214).

[0110] For example, if the authentication result indicates that all children B who are scheduled to depart from outside the facility X have been authenticated, the status confirmation screen displayed on the terminal device 400 will show a message such as "Departure from outside the facility: Departure from outside the facility has been registered for all children" in the display field 410 (illustration omitted).

[0111] On the other hand, if the authentication result indicates that there is a child B who is scheduled to depart from outside the facility X but has not been authenticated, the status confirmation screen will display a message such as "Departure from outside the facility: Child B's departure from outside the facility is not registered. Please check." in the display area 410. More specifically, the information processing device 10 performs authentication processing at the time of arrival and departure from outside the facility. The information processing device 10 then notifies the user that the authentication results for child B differ between the time of arrival and departure from outside the facility. In this case, the information processing device 10 performs notification processing if the authentication results for child B differ, such as being authenticated at the time of arrival but not at the time of departure from outside the facility.

[0112] In this way, the information processing device 10 notifies the terminal device 400 of the authentication result, allowing accompanying person C to accurately understand the situation of child B when leaving the facility. Furthermore, if child B is not authenticated, the information processing device 10 can make accompanying person C aware early on that child B may have become separated from the facility between arriving at X and leaving X.

[0113] Next, child B and accompanying person C arrive at childcare facility A. The information processing device 10 acquires a facial image of child B captured by a camera 300 installed at childcare facility A (step S215). Here, the information processing device 10 acquires a facial image of child B upon arrival at childcare facility A.

[0114] Next, the information processing device 10 reads the authentication information 31 from the storage unit 30 and performs an authentication process using the facial information of child B contained in the authentication information 31 and the acquired facial image of child B (step S216).

[0115] The information processing device 10 performs a process to update the status information according to the authentication result of child B upon arrival at the facility (step S217). Since the authentication result here indicates that child B has been authenticated upon arrival at childcare facility A, the information processing device 10 registers information such as "face image" and "return time" from the status information 32 of the storage unit 30 for the authenticated child B.

[0116] Next, the information processing device 10 transmits the updated status information to the management terminal device 200 for display (step S218). Then, the information processing device 10 notifies the terminal device 400 of the results of the authentication process upon arrival at the facility (step S219).

[0117] For example, if the authentication result indicates that all children B scheduled to arrive at childcare facility A have been authenticated, the status confirmation screen displayed on terminal device 400 will show a message such as "Arrival at facility: Arrival of all children at the facility has been registered." in the display field 410 (illustration omitted).

[0118] On the other hand, if the authentication result indicates that there is a child B who is scheduled to arrive at childcare facility A but has not been authenticated, a message such as "Arrival at facility: Child B's arrival at facility has not been registered. Please check." will be displayed in the display area 410 on the status confirmation screen. In more detail, the information processing device 10 performs authentication processing when leaving the facility and when arriving at the facility. The information processing device 10 then notifies the user that the authentication results for child B differ between when leaving the facility and when arriving at the facility. Here, the information processing device 10 performs notification processing if the authentication results for child B differ, such as being authenticated when leaving the facility but not when arriving at the facility.

[0119] In this way, the information processing device 10 notifies the terminal device 400 of the authentication result, allowing accompanying person C to accurately understand the situation of child B upon arrival at the facility. Furthermore, if child B is not authenticated, the information processing device 10 makes it possible for accompanying person C to realize early on that child B may have become separated from the facility between leaving X and arriving at childcare facility A.

[0120] As described above, the information processing program according to the embodiment causes the computer to execute an authentication procedure and a processing procedure. The authentication procedure includes authenticating a user of facility (childcare facility) A according to the captured face image, and authenticating user B according to the face image included in a group image taken of users (children) B who have moved from facility A to outside facility X. The processing procedure executes a process to update status information indicating the status of user B's movement from facility A to outside facility X or from outside facility X to facility A, according to the authentication result of user B.

[0121] Thus, in this embodiment, user authentication is performed according to the facial image included in the collective image of user B who has moved from facility A to outside facility X. In this embodiment, status information indicating the status of user B's movement from facility A to outside facility X or from outside facility X to facility A is updated according to the authentication result of user B. Therefore, when user B who has come to facility A goes outside facility X to engage in activities, the administrator (childcare worker) D can accurately grasp the status of user B.

[0122] Furthermore, the information processing device 10 is configured to update status information according to the authentication result using the facial image of child B. This reduces the workload of accompanying person C in taking attendance to confirm whether child B is present and whether they have become separated, for example, when leaving the facility, when arriving outside the facility, when leaving the facility, and when arriving back at the facility.

[0123] Furthermore, the information processing device 10 is configured to authenticate user B based on the facial image included in the aggregate image of user B. As a result, even if there are multiple users B who have moved to a location outside the facility X, for example, the information processing device 10 can easily and quickly obtain the facial images of multiple users B from the aggregate image, and as a result, the authentication process can be performed early.

[0124] Furthermore, the authentication procedure authenticates user B based on the facial image captured when user B arrives outside facility X.

[0125] This means that status information will be updated according to the results of the authentication process upon arrival outside the facility. Therefore, in this embodiment, it becomes possible for administrator D to accurately understand the status of user B upon arrival outside the facility.

[0126] Furthermore, the authentication procedure authenticates user B based on a facial image captured when user B departs from outside facility X towards facility A.

[0127] This means that status information will be updated according to the results of the authentication process when leaving the facility. Therefore, in this embodiment, it becomes possible for administrator D to accurately understand the status of user B when leaving the facility.

[0128] Furthermore, the authentication procedure further includes authenticating user B based on the facial image captured at facility A.

[0129] This allows for user B's authentication based on facial images captured when departing from facility A to outside facility X and when arriving back at facility A from outside facility X. Status information is then updated according to the authentication result. Therefore, in this embodiment, administrator D can accurately grasp user B's status at times such as departure from the facility and arrival at the facility.

[0130] Furthermore, the authentication procedure authenticates user B based on the facial image captured when user B leaves facility A for outside facility X.

[0131] This means that status information will be updated according to the results of the authentication process at the time of departure from the facility. Therefore, in this embodiment, it becomes possible for administrator D to accurately understand the status of user B at the time of departure from the facility.

[0132] Furthermore, the authentication procedure authenticates user B based on the facial image captured when user B returns to facility A from outside facility X (at the time of arrival).

[0133] This means that status information will be updated according to the results of the authentication process upon arrival at the facility. Therefore, in this embodiment, it becomes possible for administrator D to accurately understand the status of user B upon arrival at the facility.

[0134] Furthermore, the authentication procedure involves performing authentication processing to authenticate user B at different points in time. If the authentication results for user B obtained at these different points in time differ, the processing procedure executes a notification process to inform the user that the authentication results are different.

[0135] As a result, the information processing device 10 can, for example, notify accompanying person C if the authentication results differ between arrival at the facility and departure from the facility, thereby enabling them to accurately understand the user B's situation at the time of departure from the facility. Furthermore, the information processing device 10 can, for example, notify accompanying person C if the authentication results differ between departure from the facility and arrival outside the facility, thereby enabling them to accurately understand the user B's situation at the time of arrival outside the facility. Furthermore, the information processing device 10 can, for example, notify accompanying person C if the authentication results differ between arrival at the facility and departure from the facility, thereby enabling them to accurately understand the user B's situation at the time of departure from the facility. Furthermore, the information processing device 10 can, for example, notify accompanying person C if the authentication results differ between departure from the facility and arrival at the facility, thereby enabling them to accurately understand the user B's situation at the time of arrival from the facility.

[0136] Furthermore, the authentication procedure excludes users B who do not participate in the outing from facility A from the authentication process.

[0137] Thus, in this embodiment, by excluding user B who does not participate in outings from facility A (i.e., user B who does not participate in off-site activities) from the authentication process, the processing load in authentication processes performed, for example, during off-site activities, can be reduced.

[0138] Further effects and modifications can be readily derived by those skilled in the art. Therefore, broader aspects of the present invention are not limited to the specific details and representative embodiments expressed and described above. Accordingly, various modifications are possible without departing from the spirit or scope of the overall concept of the invention as defined by the appended claims and their equivalents. [Explanation of symbols]

[0139] 1. Information Processing System 10 Information Processing Devices 20 controllers 31 Authentication Information 32 Situation Information 33 Unverified Information 200 Management terminal device 300 Cameras 400 terminal devices

Claims

1. An authentication procedure for authenticating facility users based on captured facial images, the procedure including authenticating users based on facial images included in a group image taken of the users gathered together after they have moved from the facility to outside the facility, A processing procedure that performs a process to update status information indicating the status of the user's movement from the facility to outside the facility or from outside the facility to the facility, according to the user's authentication result. An information processing program that causes a computer to execute an action.

2. The aforementioned authentication procedure is: The user is authenticated based on the facial image captured when the user arrives outside the facility. The information processing program according to claim 1.

3. The aforementioned authentication procedure is: Authentication of the user is performed based on the facial image captured when the user departs from outside the facility toward the facility. The information processing program according to claim 1.

4. The aforementioned authentication procedure is: The further includes authenticating the user based on the facial image captured at the aforementioned facility. The information processing program according to claim 1.

5. The aforementioned authentication procedure is: Authentication of the user is performed based on the facial image captured when the user leaves the facility and goes outside the facility. The information processing program according to claim 4.

6. The aforementioned authentication procedure is: The user is authenticated based on the facial image captured when the user returns to the facility from outside the facility. The information processing program according to claim 4.

7. The aforementioned authentication procedure is: The authentication process for authenticating the aforementioned user is performed at a different time. The aforementioned processing procedure is: If the authentication results of the aforementioned user, performed at different times, differ, a notification process is executed to notify the user that the authentication results differ. The information processing program according to claim 1.

8. The aforementioned authentication procedure is: Among the multiple users, those who do not participate in leaving the facility are excluded from the authentication process. The information processing program according to claim 1.

9. An information processing device equipped with a controller, The aforementioned controller, The system authenticates facility users based on captured facial images, and then authenticates users based on facial images included in a group image taken of the users who have moved from the facility to outside the facility. In accordance with the user's authentication result, the system performs a process to update status information indicating the user's movement from the facility to outside the facility or from outside the facility to the facility. Information processing device.

Images