Server device, server device control method and program

Abstract

Provided is a server device that enables staff and the like of a predetermined facility to easily learn about the existence of a subject whose whereabouts are unknown. The server device is provided with a storage means, a detection means, an attendance control means, and a control means. The storage means stores the status of each of a plurality of subjects who belong to a predetermined facility and whose whereabouts need to be confirmed. The detection means detects, by means of biometric authentication using biometric information, a first subject who has attended the predetermined facility, and sets the status of the detected first subject to as being in attendance. The attendance control means sets the status of a second subject whose absence has been notified to the predetermined facility to as being absent. If, at a predetermined timing, there is a third subject whose status has not been changed from an initial value to as being in attendance or being absent, the control means notifies concerned personnel of the prescribed facility of the existence of the third subject.

Description

Server device, server device control method and storage medium

[0001] The present invention relates to a server device, a control method for a server device, and a storage medium.

[0002] 2. Description of the Related Art When a child enters or leaves a designated facility, a technique exists for notifying the parent or guardian of the child of the entry time or exit time.

[0003] For example, Patent Document 1 describes an information distribution system that uses facial image authentication to notify guardians (parents) of their children's return home and outing status without both parents and children having to be aware of the time or the need for communication.

[0004] Japanese Patent Application Laid-Open No. 2006-107187

[0005] Staff at kindergartens, nurseries, and other facilities that look after young children are required to keep track of the whereabouts of the children at all times. If children whose whereabouts (attendance or absence at kindergarten, etc.) are left unattended, there is a risk of unexpected accidents occurring. Therefore, if there are children whose attendance or absence has not been confirmed, staff at kindergartens, etc. must be aware of this fact.

[0006] The above problem cannot be solved by applying the technology disclosed in Patent Document 1. Patent Document 1 merely discloses a technology for notifying parents of the status of their children.

[0007] The main object of the present invention is to provide a server device, a control method for a server device, and a storage medium that will enable staff at a designated facility to easily become aware of the presence of a person whose whereabouts are unknown.

[0008] According to a first aspect of the present invention, there is provided a server device comprising: a storage means for storing the status of each of a plurality of subjects who belong to a specified facility and whose whereabouts need to be confirmed; a detection means for detecting a first subject who has attended the specified facility by biometric authentication using biometric information and setting the status of the detected first subject to "present"; an attendance control means for setting the status of a second subject whose absence has been notified to the specified facility to "absent"; and a control means for, if there is a third subject whose status does not change from the initial value to "present" or "absent" at a specified timing, notifying relevant persons at the specified facility of the presence of the third subject.

[0009] According to a second aspect of the present invention, there is provided a control method for a server device, in which the server device stores the status of each of a plurality of subjects who belong to a specified facility and whose whereabouts need to be confirmed, detects a first subject who attends the specified facility by biometric authentication using biometric information, sets the status of the detected first subject to present, sets the status of a second subject whose absence has been notified to the specified facility to absent, and, if there is a third subject whose status does not change from the initial value to present or absent at a specified timing, notifies relevant parties at the specified facility of the presence of the third subject.

[0010] According to a third aspect of the present invention, there is provided a computer-readable storage medium that stores a program for causing a computer mounted on a server device to execute the following processes: storing the status of each of multiple subjects who belong to a specified facility and whose whereabouts need to be confirmed; detecting a first subject who has attended the specified facility by biometric authentication using biometric information and setting the status of the detected first subject to present; setting the status of a second subject whose absence has been notified to the specified facility to absent; and, if there is a third subject whose status does not change from the initial value to present or absent at a specified timing, notifying relevant persons at the specified facility of the presence of the third subject.

[0011] According to each aspect of the present invention, a server device, a control method for a server device, and a storage medium are provided that contribute to enabling staff members of a predetermined facility or the like to easily grasp the presence of a target person whose whereabouts are unknown. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above.

[0012] FIG. 1 is a diagram illustrating an overview of an embodiment. FIG. 2 is a flowchart illustrating an overview of the operation of an embodiment. FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to a first embodiment. FIG. 4 is a diagram illustrating an example of a configuration within a kindergarten according to the first embodiment. FIG. 5 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 6 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 7 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 8 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 9 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 10 is a diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 11 is a diagram illustrating an example of the processing configuration of a server device according to the first embodiment. FIG. 12 is a diagram illustrating an example of a display of a parent terminal according to the first embodiment. FIG. 13 is a diagram illustrating an example of a child management database according to the first embodiment. FIG. 14 is a flowchart illustrating an example of the operation of a child detection unit according to the first embodiment. FIG. 15 is a sequence diagram illustrating an example of the operation of the information processing system according to the first embodiment. Fig. 16 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. Fig. 17 is a diagram illustrating an example of a schematic configuration of an information processing system according to a modified example of the present disclosure.

[0013] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0014] A server device 100 according to one embodiment includes a storage unit 101, a detection unit 102, an attendance control unit 103, and a control unit 104 (see FIG. 1 ). The storage unit 101 stores the status of each of multiple subjects who belong to a specific facility and whose presence needs to be confirmed (step S1 in FIG. 2 ). The detection unit 102 detects a first subject who attends the specific facility through biometric authentication using biometric information and sets the status of the detected first subject to "present" (step S2). The attendance control unit 103 sets the status of a second subject whose absence has been notified to the specific facility to "absent" (step S3). If there is a third subject whose status does not change from the initial value to "present" or "absent" at a specific timing, the control unit 104 notifies relevant personnel at the specific facility of the presence of the third subject (step S4).

[0015] The server device 100 manages the status (condition) of individuals whose whereabouts are to be confirmed (for example, children at a kindergarten or nursery school) through biometric authentication and notifications from guardians. If there is a child whose presence at the school has not been confirmed through biometric authentication and who has not been notified of absence, the server device 100 notifies kindergarten staff (those involved in the designated facility) of this fact. This notification allows staff at the designated facility to easily know that there is an individual (child) whose whereabouts are unknown.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] First Embodiment The first embodiment will be described in more detail with reference to the drawings.

[0018] The information processing system according to the first embodiment performs location confirmation for children who belong to a predetermined facility such as a kindergarten or a nursery school and whose whereabouts need to be confirmed. In the first embodiment, a description will be given of a case where kindergarten children who belong to a kindergarten are set as subjects of location confirmation.

[0019] [System Configuration] Fig. 3 is a diagram showing an example of a schematic configuration of an information processing system according to embodiment 1. As shown in Fig. 3, the information processing system includes a server device 10, at least one camera device 20 installed in the kindergarten, and a shuttle bus 30.

[0020] The server device 10 manages the names of kindergarten children, attendance status, etc. The server device 10 may be installed in the kindergarten building or on a network (cloud).

[0021] The camera devices 20 are installed in various locations inside and outside the kindergarten. For example, as shown in Fig. 4, the camera devices 20 are installed in the entrance hall, corridors, nursery rooms, etc. of the kindergarten.

[0022] For example, camera device 20-1 is installed so that it can capture images of kindergarten children and staff entering through the entrance. Camera device 20-2 is installed so that it can capture images of kindergarten children walking down the hallway. Camera devices 20-3, 20-4, and 20-5 are each installed so that they can capture images of the inside of a nursery room.

[0023] The shuttle bus 30 shown in Fig. 3 is used to transport kindergarten children and the like. Although not shown in Fig. 3 and other figures, a camera device 20 is also installed inside the shuttle bus 30. The camera device 20 installed inside the shuttle bus 30 is installed so as to be able to photograph at least the users (kindergarten children, staff, etc.) boarding the shuttle bus 30.

[0024] 4, an office terminal 40 is installed in the office. Staff members can operate the office terminal 40 to access the server device 10 and obtain information about the kindergarten children and their parents.

[0025] Each staff member has a staff terminal 41. The staff member operates the staff terminal 41 to access the server device 10 and obtain information about the kindergarten children.

[0026] The devices (server device 10, camera device 20, etc.) shown in FIG. 3 are connected by wired or wireless communication means and are configured to be able to communicate with each other.

[0027] The configuration of the information processing system shown in Figure 3 is an example and is not intended to be limiting. For example, the system may include multiple server devices 10. Furthermore, the camera device 20 may be installed not only inside a building but also in an outdoor playground or the like.

[0028] [Overall Operation] Next, an overall operation of the information processing system according to the first embodiment will be described.

[0029] <Kindergartener Registration> Parents of kindergarteners register information about their children attending kindergarten in the system. For example, the parents operate the parent terminal 42 they own to access the server device 10 (see FIG. 5). The parents register information about themselves (e.g., name, address, telephone number, email address, etc.) and their children (e.g., name, date of birth, etc.) in the server device 10.

[0030] Furthermore, the guardian registers the biological information of the child (kindergartener) in the server device 10 .

[0031] Examples of the child's biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, the biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes an individual's physical characteristics. In the first embodiment, the biometric information is a person's face image or features generated from a face image.

[0032] The server device 10 stores the acquired information in a child management database. The server device 10 uses the child management database to manage information (e.g., name) and status of the kindergarteners. The initial status is "unconfirmed." Details of the child management database will be described later.

[0033] <Identifying Children> Kindergarten children go to kindergarten on foot or by shuttle bus 30 .

[0034] As described above, the camera device 20 is installed inside the shuttle bus 30. The camera device 20 is installed so that it can photograph kindergarten children and the like getting on the shuttle bus 30. The camera device 20 inside the shuttle bus 30 periodically or at a predetermined timing transmits image data obtained by photographing the boarding gate and a camera ID to the server device 10 (see FIG. 6 ).

[0035] The camera ID is an ID for identifying each camera device 20. The MAC (Media Access Control) address or IP (Internet Protocol) address of the camera device 20 can be used as the camera ID.

[0036] The camera ID is shared by any method between the server device 10 and the camera device 20. For example, a system administrator determines a camera ID and sets the determined camera ID in the server device 10 and the camera device 20.

[0037] The server device 10 extracts a face image from the image data and identifies the kindergarten child who boarded the shuttle bus 30 through biometric authentication. The server device 10 sets the status of the identified kindergarten child to "on bus" and stores it in the kindergarten child management database.

[0038] Kindergarten children who get off the bus or who walk to the kindergarten are photographed by a camera device 20-1 installed in the entrance hall. The camera device 20-1 periodically or at a predetermined timing photographs the kindergarten entrance and transmits the image data and camera ID obtained by photographing the entrance to the server device 10 (see FIG. 7).

[0039] In this case, the server device 10 also identifies the kindergartener who has arrived at the kindergarten through biometric authentication. The server device 10 sets the status of the kindergartener who has arrived at the kindergarten to "attending (or attending)" and stores this in the kindergartener management database. When the kindergartener gets off the shuttle bus 30 and enters the kindergarten, the status changes from "boarding the bus" to "attending."

[0040] Like camera device 20-1, camera devices 20-2 to 20-5 installed outside the entrance hall also transmit image data to server device 10 periodically or at predetermined times. Server device 10 identifies kindergarteners who appear in the image data using biometric authentication. Server device 10 sets the status of the identified kindergarteners to "attend" and stores the status in the kindergartener management database. Note that the status of kindergarteners who board shuttle bus 30 and are not photographed by camera devices 20 within the kindergarten remains "on bus" (the status of the kindergartener does not change to "attend").

[0041] The server device 10 notifies the parents of kindergarten children whose statuses have been set to "attend" that their children have attended kindergarten. Specifically, the server device 10 transmits a "kindergarten attendance notification" to the parent terminal 42 of each parent (see FIG. 8).

[0042] This notification will ensure that parents are aware that their child has been successfully admitted to the kindergarten.

[0043] When a child is absent from kindergarten, the guardian notifies the kindergarten. Specifically, the guardian operates the guardian terminal 42 to send an "absence notice" to the server device 10 (see FIG. 9). More specifically, the guardian terminal 42 sends the absence notice to the server device 10, including information identifying the absent child (kindergartener) (for example, the name or a combination of the name and date of birth).

[0044] The server device 10 identifies absent kindergarteners based on the above information. The server device 10 sets the status of the identified kindergarteners to "absent" and stores the status in the kindergartener management database.

[0045] <Notification of Missing Children> The server device 10 accesses the child management database at a predetermined timing (for example, a predetermined time after the start of school) and checks the status of each child. If the checked status includes a status other than "attended" or "absent," the server device 10 notifies (reports, warns) kindergarten staff or the like that there is a child whose whereabouts are unknown.

[0046] Specifically, if there is a kindergartener whose status is set to "unconfirmed" or "boarding the bus," the server device 10 notifies staff etc. The server device 10 notifies the existence of kindergarteners whose whereabouts are unknown via an office terminal 40 installed in the office or a staff terminal 41 carried by each staff member.

[0047] The server device 10 sends a "missing child notification" including the name of the kindergarten child whose whereabouts are unknown (kindergarten child whose status is unconfirmed or set to board the bus) to the office terminal 40 and the staff terminal 41 (see Figure 10).

[0048] The office terminal 40 or staff terminal 41 that receives the missing child notification displays a warning message or the like including the name of the kindergarten child included in the notification. Staff who see the warning message will check (search for) the whereabouts of the missing kindergarten child. For example, the staff may contact the parents or check whether the kindergarten child has been left behind on the shuttle bus 30.

[0049] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0050] 11 is a diagram showing an example of the processing configuration (processing modules) of the server device 10 according to the first embodiment. Referring to FIG. 11, the server device 10 includes a communication control unit 201, a child management unit 202, a child detection unit 203, an attendance control unit 204, a missing child control unit 205, and a storage unit 206.

[0051] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the office terminal 40. The communication control unit 201 also transmits data to the office terminal 40. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0052] The kindergartener management unit 202 is a means for controlling and managing kindergarteners. When a parent or guardian operates the parent terminal 42 to access the server device 10, the child management unit 202 displays a GUI (Graphical User Interface) on the parent terminal 42 to acquire information about the parent or guardian and the child.

[0053] After acquiring the guardian's information (e.g., name, address, email address, etc.), the child management unit 202 displays, for example, a GUI such as that shown in Fig. 12 on the guardian terminal 42. The child management unit 202 acquires the kindergartener's name, date of birth, biometric information (e.g., face image), etc. in response to the guardian's operation.

[0054] When the kindergartener's facial image is acquired, the kindergartener management unit 202 generates a feature amount from the acquired facial image.

[0055] The child management unit 202 can use existing technology for generating feature quantities, so detailed explanations will be omitted. For example, the child management unit 202 extracts the eyes, nose, mouth, etc. from the face image as feature points. The child management unit 202 then calculates the positions of each feature point and the distances between each feature point as feature quantities (generating a feature vector consisting of multiple feature quantities).

[0056] Thereafter, the child management unit 202 generates a child ID for identifying the kindergartener. The child ID may be any information that can uniquely identify the kindergartener. For example, the child management unit 202 may assign a unique number each time a child is registered and use this number as the child ID. The child management unit 202 may transmit the child ID to the parent / guardian terminal 42 of the parent / guardian as necessary.

[0057] The child management unit 202 stores user information (name, address, email address, etc.) and kindergartener information (child ID, name, date of birth) in a child management database (see FIG. 13).

[0058] The child management database shown in FIG. 13 is merely an example and is not intended to limit the items stored therein. For example, facial images may be registered as biometric information in the child management database. Alternatively, the child management database may also include biometric information (facial images, feature values) of guardians.

[0059] 13, the child management database also has a status field for managing the status of the children. That is, the child management database stores the status of each of multiple individuals (kindergarteners) who belong to a specific facility and whose whereabouts need to be confirmed. The initial value of the status field is "unconfirmed."

[0060] The child detection unit 203 is a means for detecting a child using biometric authentication.

[0061] The kindergartener detection unit 203 detects kindergarteners who attend a predetermined facility (kindergarten) by biometric authentication using biometric information, and sets the status of the detected kindergarteners to "attended."

[0062] The kindergartener detection unit 203 also detects kindergarteners who board the transportation means (shuttle bus 30) that transports users to a predetermined facility (kindergarten) by biometric authentication using biometric information acquired on the transportation means. The kindergartener detection unit 203 sets the status of the detected kindergartener to "bus boarding (boarding transportation means)."

[0063] 14 is a flowchart showing an example of the operation of the child detection unit 203 according to the first embodiment. The operation of the child detection unit 203 will be described with reference to FIG.

[0064] The child detection unit 203 periodically or at a predetermined timing receives image data and a camera ID from the camera device 20 (step S101). Based on the camera ID, the child detection unit 203 identifies the installation location (e.g., shuttle bus 30, entrance hall, nursery room) of the camera device 20 that is the sender of the image data.

[0065] The child detection unit 203 attempts to extract face images from the acquired image data (step S102). For example, if 10 people appear in the image data, 10 face images are extracted.

[0066] Note that the facial image extraction process by the child detection unit 203 can use existing technology, and therefore detailed description thereof will be omitted. For example, the child detection unit 203 may extract facial images (facial regions) from image data using a learning model trained by a convolutional neural network (CNN). Alternatively, the child detection unit 203 may extract facial images using a method such as template matching.

[0067] If a face image is not extracted from the image data (step S103, No branch), the child detection unit 203 ends the process.

[0068] If face images are extracted from the image data (step S103, Yes branch), the kindergartener detection unit 203 identifies the kindergartener corresponding to each extracted face image. Specifically, the kindergartener detection unit 203 performs one-to-N matching (N is a positive integer, the same applies below) using the extracted face images (step S104).

[0069] First, the child detection unit 203 generates features from the extracted face image. The child detection unit 203 sets the generated features on the matching side and the features stored in the child management database on the registration side, and performs one-to-many matching.

[0070] The child detection unit 203 calculates the similarity between the feature to be matched and each of the multiple feature values ​​on the registration side. If there is no feature value among the multiple feature values ​​registered in the child management database that has a similarity to the feature value to be matched that is equal to or greater than a predetermined value, the child detection unit 203 determines that the matching process has failed.

[0071] The kindergartener detection unit 203 determines that the matching process is successful if there is a feature among the multiple feature amounts registered in the kindergartener management database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value. The kindergartener detection unit 203 determines the kindergartener with the entry with the highest similarity as the kindergartener corresponding to the facial image to be matched.

[0072] If the matching process fails (step S105, No branch), the child detection unit 203 ends the process.

[0073] If the matching process is successful (step S105, Yes branch), the kindergartener detection unit 203 updates the status of the kindergartener identified by the matching process (step S106).

[0074] Specifically, the child detection unit 203 sets the status of a kindergartener identified from image data captured by the camera device 20 inside the shuttle bus 30 to "on the bus" and reflects this in the child management database. The child detection unit 203 sets the status of a kindergartener identified from image data captured by another camera device 20 to "attending" and reflects this in the child management database. The other camera devices 20 are camera devices 20-1 to 20-5 installed in various locations within the kindergarten.

[0075] The kindergartener detection unit 203 notifies the attendance control unit 204 of the kindergartener IDs of the kindergarteners whose statuses have been set to "attend".

[0076] The kindergartener detection unit 203 determines whether or not there is a face image for which one-to-N matching has not been performed (determines whether or not there is a face image for which a kindergartener has not been identified).

[0077] If there are any facial images for which one-to-N matching has not been performed (facial images remain; step S107, Yes branch), the kindergartener detection unit 203 returns to step S104 and continues the process. That is, the kindergartener detection unit 203 repeats the kindergartener identification process and the status update process for each facial image included in the image data acquired from the camera device 20.

[0078] If there is no face image for which one-to-N matching has not been performed (step S107, No branch), the kindergartener detection unit 203 ends the process.

[0079] When the kindergarten closes, the child detection unit 203 initializes the status of each child to "unconfirmed."

[0080] The attendance control unit 204 is a means for controlling the attendance and absence of kindergarten children.

[0081] When the child ID of a kindergartener whose presence in the kindergarten has been confirmed is acquired from the child detection unit 203, the attendance control unit 204 transmits a "kindergarten attendance notice" to the guardian of the kindergartener, etc. For example, the child detection unit 203 transmits the kindergarten attendance notice including the name of the kindergartener to a pre-registered email address (an email address that can be received by the guardian terminal 42 of the guardian).

[0082] In this way, the attendance control unit 204 notifies those related to the kindergartener who attended the kindergarten (for example, guardians, grandparents, relatives, etc.) that the kindergartener attended the kindergarten. It is sufficient to notify guardians once a day.

[0083] The attendance control unit 204 receives an "absence notice" from the parent / guardian terminal 42. The attendance control unit 204 searches the child management database using information identifying the child contained in the notice (for example, the child ID or the child's name) as a key to identify the corresponding entry. The attendance control unit 204 sets "absent" in the status field of the identified entry.

[0084] In this way, the attendance control unit 204 sets the status of the kindergartener whose absence has been notified to the kindergarten to absent.

[0085] The missing child control unit 205 is a means for controlling kindergarten children whose whereabouts are unknown.

[0086] The missing child control unit 205 accesses the child management database at a predetermined timing (for example, after a predetermined time has elapsed since the start of school) and checks the status of each child. The missing child control unit 205 identifies entries from the child management database that have a status other than "present" or "absent."

[0087] If there is a kindergartener whose status is other than present or absent (a kindergartener whose status is set to unconfirmed or boarding the bus), the missing child control unit 205 treats the kindergartener as a "missing child." The missing child control unit 205 notifies kindergarten staff or the like that there is a missing child.

[0088] Specifically, the missing child control unit 205 reads the name, etc. of the missing child from the child management database. The missing child control unit 205 sends a "missing child notification" including the read name, etc. to the office terminal 40 and the staff terminal 41.

[0089] In this way, if there is a kindergartener whose status does not change from the initial value to "attending" or "absent" at a predetermined timing, the missing child control unit 205 notifies kindergarten officials (e.g., staff) of the presence of the kindergartener. Furthermore, if there is a kindergartener whose status does not change from "boarding the bus" at a predetermined timing, the missing child control unit 205 notifies kindergarten officials of the presence of the kindergartener.

[0090] The storage unit 206 is a means for storing information necessary for the operation of the server device 10 .

[0091] [Office Terminal, Staff Terminal, Parent Terminal] Detailed explanations of the processing configurations (processing modules) of the office terminal 40, staff terminal 41, and parent terminal 42 will be omitted. Examples of the office terminal 40 include mobile terminal devices such as smartphones, mobile phones, game consoles, and tablets, as well as computers (personal computers, laptop computers). The office terminal 40 can be any equipment or device that can accept user operations and communicate with the server device 10.

[0092] [Camera Device] Detailed description of the processing configuration (processing module) of the camera device 20 will be omitted. The camera device 20 periodically or at a predetermined timing captures images of a predetermined area and acquires image data. The camera device 20 transmits the acquired image data and a camera ID to the server device 10.

[0093] [System Operation] Next, a description will be given of the operation of the information processing system according to the first embodiment. Fig. 15 is a sequence diagram showing an example of the operation of the information processing system according to the first embodiment.

[0094] Each camera device 20 transmits image data and a camera ID to the server device 10 periodically or at a predetermined timing (step S01).

[0095] The server device 10 identifies the kindergarten child appearing in the image data through biometric authentication using the acquired image data and the biometric information stored in the child management database (step S02).

[0096] The server device 10 updates the status of the identified kindergartener (step S03).

[0097] The camera device 20 and the server device 10 repeat the processes of steps S01 to S03.

[0098] The server device 10 detects whether there is a missing child at a predetermined timing (time) (step S04). Specifically, the server device 10 detects kindergarten children whose status is set to "unidentified" or "boarding the bus."

[0099] If there is a missing child, the server device 10 transmits a "missing child notification" to the office terminal 40 and the staff terminal 41 (step S05).

[0100] Upon receiving the missing child notification, the staff terminal 41 or the like outputs a warning message including the name of the missing child (step S06). The staff member who receives the warning message checks the whereabouts of the missing child. The server device 10 may also transmit a missing child notification including a facial image of the missing child to the staff terminal 41 or the like. In this case, the staff terminal 41 or the like may display a facial image of the kindergarten child along with the warning message to make it easier for the staff member to recognize the missing child. The facial image of the missing child transmitted by the server device 10 may be a pre-registered facial image or the most recent facial image. In other words, the staff terminal 41 or the like may display a pre-registered facial image or a recently photographed facial image along with the warning message.

[0101] Next, a modification of the first embodiment will be described.

[0102] <Variation 1> The server device 10 (missing child control unit 205) may distinguish between the presence of a kindergartener whose status is the initial value (unconfirmed) and the presence of a kindergartener whose status is "boarding the bus" and notify relevant parties at the kindergarten. For example, the server device 10 transmits the above-mentioned "missing child notification" to the office terminal 40, etc., for a kindergartener whose status has not changed from the initial value (unconfirmed). On the other hand, the server device 10 transmits an "abandoned bus warning" to the office terminal 40, etc., for a kindergartener whose status has not changed from "boarding the bus."

[0103] The office terminal 40 or the like may change the content of the warning message to be displayed depending on whether a missing child notification has been received or an abandoned bus warning has been received. Alternatively, the office terminal 40 or the like may output a loud warning sound or the like from a speaker when an abandoned bus warning has been received.

[0104] Alternatively, if the server device 10 detects at a predetermined timing a kindergarten child whose status is the initial value (unconfirmed) and a kindergarten child whose status is "boarding the bus" at the same time, it may notify (instruct) kindergarten officials to prioritize the location of the latter over the former.

[0105] In this way, when a kindergartener whose status has not changed from "boarding the bus" is detected even when the kindergarten's start time arrives, the server device 10 may instruct kindergarten staff, etc. to make checking the whereabouts of the kindergartener a top priority.

[0106] That is, for kindergarten children whose status remains unchanged from the initial value, there is a possibility that their parents have forgotten to notify the kindergarten of their absence. On the other hand, for kindergarten children whose boarding the shuttle bus 30 is recorded but whose presence within the kindergarten has not been confirmed, there is a high possibility that they have been left behind on the shuttle bus 30. Taking such a situation into consideration, when the server device 10 detects a kindergarten child whose status has not changed since boarding the bus, it instructs kindergarten staff and the like to make checking the whereabouts of that kindergarten child a top priority.

[0107] <Modification 2> The server device 10 may detect that a kindergartener has left the kindergarten through biometric authentication. For example, if a kindergartener is captured in image data acquired from the camera device 20 in the shuttle bus 30 or from a camera device 20 installed so as to be able to capture an exit after the kindergarten closes, the server device 10 (child detection unit 203) sets the status of the kindergartener to “left the kindergarten.”

[0108] The server device 10 may also calculate the length of time each kindergartener stays at the kindergarten based on the time the kindergartener's status is set to "attend" and the time the status is set to "leave." The server device 10 may automatically calculate extended childcare fees based on the length of time each kindergartener stays at the kindergarten. The server device 10 may also execute a settlement process for the calculated extended childcare fees.

[0109] As described above, the server device 10 according to the first embodiment stores and manages the status of each child based on biometric authentication and notifications from parents. If there is a child whose presence at the kindergarten has not been confirmed by biometric authentication and who has not been notified of their absence (a child whose status remains unchanged from unconfirmed), the server device 10 treats the child as a missing child. The server device 10 notifies kindergarten staff and other personnel that a missing child exists. Staff and other personnel at a designated facility are aware of the presence of a target person (child) whose whereabouts are unknown and can promptly take necessary action.

[0110] The server device 10 also notifies kindergarten staff and the like of the presence of a child whose status does not change from "boarding the bus." The fact that the status does not change from "boarding the bus" indicates that there is a high possibility that the child is left behind inside the shuttle bus 30. When the server device 10 detects such a situation, it issues a stronger warning to kindergarten staff and the like (a stronger warning than the warning issued for a child whose initial status value does not change). By taking appropriate action in accordance with the notification, serious accidents can be prevented.

[0111] Furthermore, during peak hours when many kindergarten children enter the building at the same time, there is a possibility that biometric authentication (identification of kindergarten children) using image data from camera device 20-1 installed in the entrance hall will fail. However, server device 10 performs biometric authentication using image data from camera device 20 installed in the nursery room or other location to identify the children. Therefore, even if biometric authentication at the entrance (kindergarten entrance) fails, server device 10 can reliably detect children who have arrived at the kindergarten. In other words, by installing numerous camera devices 20 inside and outside the kindergarten, server device 10 can reliably detect children who have arrived at the kindergarten. In other words, there will be no children whose status remains unchanged from "unconfirmed" or "boarding the bus" despite attending the kindergarten.

[0112] Next, the hardware of each device constituting the information processing system will be described. Fig. 16 is a diagram showing an example of the hardware configuration of the server device 10.

[0113] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 16. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0114] However, the configuration shown in Fig. 16 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 16, and for example, the server device 10 may include multiple processors 311.

[0115] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0116] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0117] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display, etc. The input device is, for example, a device that accepts user operations, such as a keyboard or a mouse.

[0118] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0119] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. Furthermore, the processing modules can be realized by semiconductor chips.

[0120] The office terminal 40 and the like can also be configured by an information processing device in the same way as the server device 10, and the basic hardware configuration is the same as that of the server device 10, so a description thereof will be omitted.

[0121] The server device 10, which is an information processing device, is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.

[0122] [Modification] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0123] In the above embodiment, a case has been described in which a shuttle bus 30 is used to commute to kindergarten. However, the information processing system disclosed herein can also be applied to kindergartens in urban areas where a shuttle bus 30 is not used. In this case, the server device 10 only needs to detect kindergarteners whose whereabouts cannot be confirmed (kindergarteners whose status does not change from the initial value).

[0124] In the above embodiment, the configuration, operation, etc. of the information processing system are described assuming that the subjects who belong to a specific facility and whose whereabouts need to be confirmed are kindergarten children (nursery school children). However, the subjects whose whereabouts need to be confirmed are not limited to kindergarten children, and patients suffering from dementia may also be set as subjects whose whereabouts need to be confirmed.

[0125] In the above embodiment, it has been described that the camera device 20 periodically or at a predetermined timing transmits image data to the server device 10. When biometric information (face image) is included in the acquired image data, the camera device 20 may transmit the image data including the biometric information and the camera ID to the server device 10.

[0126] The server device 10 may transmit a missing child notification or a bus abandonment warning including a facial image of the missing child to the office terminal 40 or the staff terminal 41. Alternatively, the server device 10 may transmit a missing child notification or a bus abandonment warning including a facial image of the missing child including information about the guardian (name and telephone number of the guardian) to the office terminal 40 or the like so that kindergarten staff or the like can immediately contact the guardian of the missing child.

[0127] The server device 10 (missing child control unit 205) may accept reports (reports from staff, etc.) regarding missing children. Specifically, the office terminal 40 or the staff terminal 41 may send the status of the missing child's whereabouts (checking within the nursery, checking with the guardian) to the server device 10 in response to staff operation. When the whereabouts of a missing child are confirmed within the nursery, the server device 10 sets the status of the missing child to "present" and stores the status in the child management database. When the whereabouts of a missing child are confirmed through a guardian's notification of absence, the server device 10 sets the status of the missing child to "absent" and stores the status in the child management database. The server device 10 may also notify the office terminal 40 or the staff terminal 41 (e.g., an office terminal 40 different from the terminal that notified the status of the missing child's whereabouts) that the whereabouts of the missing child have been confirmed.

[0128] The child management database may store information about the staff member (nursery teacher) in charge of each kindergarten child. The server device 10 (missing child control unit 205) may send a missing child notification to the staff member in charge of the missing child (the staff terminal 41 carried by that staff member). The server device 10 may send a "bus abandoned child warning" to all staff members in the kindergarten (all office terminals 40 and staff terminals 41).

[0129] The server device 10 may provide an interface that allows kindergarten staff and the like to check the status of kindergarten children. The server device 10 provides staff with a list of the status of each kindergarten child (unconfirmed, present, absent, boarding the bus). If there is a kindergarten child whose status is not set to "unconfirmed" or "boarding the bus" even after the kindergarten's start time, the kindergarten staff and the like may check the whereabouts of the child.

[0130] In kindergartens, not only the surveillance camera type camera device 20 (camera for non-active authentication) shown in FIG. 4 but also a camera device 20-6 for active authentication such as a kiosk terminal may be installed (see FIG. 17). In this case, children stand in front of the camera device 20-6. The camera device 20-6 photographs the children in front of it and acquires their biometric information. The biometric information (face image) acquired by the camera device 20-6 is used for authentication to confirm the children's attendance, just like the biometric information acquired by the camera device 20-1, etc.

[0131] In the above embodiment, the case where the child management database is configured inside the server device 10 has been described, but the database may also be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented on another server. More specifically, the above-described "child detection unit (child detection means)", "missing child control unit (missing child control means)", etc. may be implemented on any of the devices included in the system.

[0132] The format of data transmission between each device (server device 10, office terminal 40, etc.) is not particularly limited, but data transmitted and received between these devices may be encrypted. Information such as names of kindergarten children is transmitted and received between these devices, and in order to properly protect this information, it is desirable to transmit and receive encrypted data.

[0133] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the drawings can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0134] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0135] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information processing system for checking the whereabouts of kindergarten children and the like.

[0136] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes: [Supplementary Note 1] A server device comprising: a storage means for storing the status of each of a plurality of subjects who belong to a predetermined facility and whose whereabouts need to be confirmed; a detection means for detecting a first subject who has attended the predetermined facility by biometric authentication using biometric information and setting the status of the detected first subject to "present"; an attendance control means for setting the status of a second subject whose absence has been notified to the predetermined facility to "absent"; and a control means for, if there is a third subject whose status does not change from the initial value to "present" or "absent" at a predetermined timing, notifying relevant persons at the predetermined facility of the presence of the third subject. [Supplementary Note 2] The server device according to Supplementary Note 1, wherein the detection means detects a fourth subject who boards the transportation means by biometric authentication using biometric information acquired on the transportation means transporting the user of the specified facility to the specified facility and sets the status of the detected fourth subject to "on transportation means," and the control means, if there is a fifth subject whose status has not changed since boarding the transportation means at the specified timing, notifies officials at the specified facility of the presence of the fifth subject. [Supplementary Note 3] The server device according to Supplementary Note 2, wherein the control means distinguishes between the third subject and the fifth subject and notifies officials at the specified facility. [Supplementary Note 4] The server device according to Supplementary Note 3, wherein, if there is a fifth subject, notifies officials at the specified facility to check the whereabouts of the fifth subject before the third subject. [Supplementary Note 5] The server device according to Supplementary Note 4, wherein the control means, if there is a fifth subject, notifies officials at the specified facility to check the whereabouts of the fifth subject before the third subject. [Supplementary Note 6] The server device according to any one of Supplementary Note 1 to Supplementary Note 5, wherein the predetermined facility is a kindergarten or a nursery school, and the target person is a kindergartener. [Supplementary Note 7] The server device according to Supplementary Note 6, wherein the biometric information is a facial image or a feature amount generated from the facial image.[Supplementary Note 8] A control method for a server device, the control method comprising: storing the status of each of a plurality of subjects who belong to a specified facility and whose whereabouts need to be confirmed; detecting a first subject who has attended the specified facility by biometric authentication using biometric information; setting the status of the detected first subject to "present"; setting the status of a second subject whose absence has been notified to the specified facility to "absent"; and, if there is a third subject whose status does not change from the initial value to "present" or "absent" at a specified timing, notifying relevant persons at the specified facility of the presence of the third subject. [Supplementary Note 9] A computer-readable storage medium storing a program for causing a computer mounted on a server device to execute the following processes: a process of storing the status of each of multiple subjects who belong to a specified facility and whose whereabouts need to be confirmed; a process of detecting a first subject who has attended the specified facility by biometric authentication using biometric information and setting the status of the detected first subject to "present"; a process of setting the status of a second subject whose absence has been notified to the specified facility to "absent"; and a process of notifying relevant persons at the specified facility of the presence of a third subject whose status does not change from the initial value to "present" or "absent" at a specified timing.

[0137] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof.

[0138] 10 Server device 20 Camera device 20-1 Camera device 20-2 Camera device 20-3 Camera device 20-4 Camera device 20-5 Camera device 20-6 Camera device 30 Shuttle bus 40 Office terminal 41 Staff terminal 42 Parent terminal 100 Server device 101 Storage means 102 Detection means 103 Attendance control means 104 Control means 201 Communication control unit 202 Child management unit 203 Child detection unit 204 Attendance control unit 205 Missing child control unit 206 Storage unit 311 Processor 312 Memory 313 Input / output interface 314 Communication interface

Claims

1. a storage means for storing the status of each of a plurality of subjects who belong to a predetermined facility and whose location needs to be confirmed; a detection means for detecting a first subject who has attended the predetermined facility by biometric authentication using biometric information and setting a status of the detected first subject to "attended"; attendance control means for setting the status of a second subject whose absence has been notified to the predetermined facility to "absent"; a control means for notifying a person involved in the predetermined facility of the presence of a third subject whose status does not change from the initial value to present or absent at a predetermined timing; A server device comprising:

2. the detection means detects a fourth subject who has boarded the transportation means by biometric authentication using biometric information acquired on the transportation means that transports the user of the specified facility to the specified facility, and sets the status of the detected fourth subject to "board transportation means"; The server device according to claim 1, wherein, if there is a fifth subject whose status has not changed since boarding the means of transportation at the specified timing, the control means notifies relevant persons at the specified facility of the presence of the fifth subject.

3. 3. The server device according to claim 2, wherein the control means notifies the third target person and the fifth target person separately to the relevant person at the predetermined facility.

4. 4. The server device according to claim 3, wherein the control means notifies personnel at the predetermined facility to confirm the whereabouts of the fifth subject person in priority to the third subject person when the fifth subject person is present.

5. The server device according to claim 4 , wherein the attendance control means notifies a person related to the first subject that the first subject has attended the predetermined facility.

6. The server device according to claim 1 , wherein the predetermined facility is a kindergarten or a nursery school, and the target persons are kindergarten children.

7. The server device according to claim 6 , wherein the biometric information is a facial image or a feature amount generated from the facial image.

8. In the server device, The system memorizes the status of each of multiple individuals who belong to a specific facility and whose location needs to be confirmed, Detecting a first subject who has attended the predetermined facility through biometric authentication using biometric information, and setting a status of the detected first subject to "attend"; Setting the status of the second subject whose absence has been notified to the specified facility to "absent"; A control method for a server device that, if there is a third subject whose status does not change from the initial value to present or absent at a specified timing, notifies relevant parties at the specified facility of the presence of the third subject.

9. The computer installed in the server device A process of storing the status of each of a plurality of subjects who belong to a predetermined facility and whose location needs to be confirmed; a process of detecting a first subject who has attended the predetermined facility by biometric authentication using biometric information, and setting the status of the detected first subject to "attend"; A process of setting the status of a second subject whose absence has been notified to the predetermined facility to "absent"; If there is a third target person whose status does not change from the initial value to present or absent at a predetermined timing, a process of notifying relevant persons at the predetermined facility of the presence of the third target person; A program to execute.