Terminal, server device, terminal control method and program
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Filing Date
- 2025-12-16
- Publication Date
- 2026-03-18
AI Technical Summary
Existing human authentication systems face challenges in efficiently processing a large number of authentication subjects, particularly in environments like factories, where a single worker struggles to manage numerous authentication tasks effectively.
A terminal and server device system that acquires biometric information from a camera attached to an authentication worker, transmits it to a server for biometric authentication, and updates a cumulative count of successfully authenticated individuals, reducing the worker's burden by providing real-time information on the number of authenticated subjects.
This system streamlines the authentication process, allowing a single worker to efficiently manage multiple authentication tasks by providing timely updates on successful authentications, thereby reducing the workload and improving operational efficiency.
Abstract
Description
Terminal, server device, terminal control method, and storage medium
[0001] The present invention relates to a terminal, a server device, a terminal control method, and a storage medium.
[0002] There are technologies for authenticating and identifying people.
[0003] For example, Patent Document 1 describes a system that quickly notifies police officers of the presence of a suspicious person in the vicinity. In Patent Document 1, the wearable camera detects the face of a person included in an image captured by an imaging unit, cuts out a rectangular image including the face (i.e., a facial image) from the captured image, and transmits the cut-out data including the facial image to a backend server. The backend server receives the cut-out data from the wearable camera and compares the facial image included in the received cut-out data with facial images registered in a suspicious person database. If the comparison shows that the received facial image matches the registered facial image, the backend server notifies the wearable camera of information about the person corresponding to the registered facial image. The wearable camera then notifies the police officer of the information about the notified person.
[0004] JP 2017-060148 A
[0005] As disclosed in Patent Document 1, a person to be authenticated is identified using a facial image of the user. Here, when there are only a few people to be authenticated (persons to be authenticated), it is sufficient to provide information on the identified people to the worker performing the authentication work, as disclosed in Patent Document 1.
[0006] However, when workers entering and leaving a factory are the subjects of authentication, it is difficult for one authentication worker to process many subjects of authentication using the authentication method described in Patent Document 1.
[0007] The main object of the present invention is to provide a terminal, a server device, a terminal control method, and a storage medium that contribute to reducing the burden on workers who perform authentication work for a large number of people to be authenticated.
[0008] According to a first aspect of the present invention, there is provided a terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; and an authentication control means for storing biometric information of each of a plurality of persons to be authenticated and transmitting the acquired biometric information to a server device that performs biometric authentication using the stored biometric information, thereby receiving an authentication result of the person to be authenticated and the number of the plurality of persons to be authenticated from the server device, notifying the authentication worker of the number of the plurality of persons to be authenticated, and, if the authentication result of the person to be authenticated is successful, updating the cumulative number of persons who have been determined to have been successfully authenticated by the server device and notifying the authentication worker of the updated number.
[0009] According to a second aspect of the present invention, there is provided a terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; a list control means for acquiring a list including the user IDs of a plurality of persons to be authenticated from a management server; and an authentication control means for acquiring the user ID of the person to be authenticated by transmitting the acquired biometric information to an authentication server that stores the user IDs and biometric information of at least the plurality of persons to be authenticated and performs biometric authentication using the stored plurality of pieces of biometric information, and determining that the authentication of the person to be authenticated has been successful if the user ID of the person to be authenticated is included in the list, updating the cumulative number of persons who have been successfully authenticated and notifying the authentication worker of the update.
[0010] According to a third aspect of the present invention, there is provided a terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; a list control means for acquiring from a management server a first list including the user IDs of a plurality of persons to be authenticated; and an authentication control means for acquiring from a terminal carried by a representative of the predetermined space a second list consisting of the user IDs and biometric information of a plurality of persons present in the predetermined space, identifying the user ID of the person to be authenticated by a matching process using the acquired biometric information and the biometric information included in the second list, determining that the authentication of the person to be authenticated has been successful if the user ID of the identified person to be authenticated is included in the first list, updating the cumulative number of persons who have been successfully authenticated and notifying the authentication worker of the updated number.
[0011] According to a fourth aspect of the present invention, there is provided a server device comprising: a receiving means for receiving biometric information of a person to be authenticated, acquired from a camera worn by an authentication worker, from a terminal connected to the camera; a storage means for storing the biometric information of each of a plurality of persons to be authenticated; and an authentication means for performing biometric authentication using the plurality of pieces of stored biometric information, wherein the authentication means transmits the authentication result of the person to be authenticated and the number of the plurality of persons to be authenticated to the terminal.
[0012] According to a fifth aspect of the present invention, there is provided a terminal control method including: an acquisition step of acquiring, in a terminal, biometric information of a person to be authenticated from a camera worn by an authentication worker; and an authentication control step of receiving an authentication result of the person to be authenticated and the number of the plurality of persons to be authenticated from the server device, by storing biometric information of each of a plurality of persons to be authenticated and transmitting the acquired biometric information to a server device that performs biometric authentication using the plurality of pieces of biometric information stored, and notifying the authentication worker of the number of the plurality of persons to be authenticated; and, if the authentication result of the person to be authenticated is successful, updating the cumulative number of persons who have been successfully authenticated by the server device and notifying the authentication worker of the updated number.
[0013] According to a sixth aspect of the present invention, there is provided a computer-readable storage medium that stores a program for causing a computer mounted on a terminal to execute the following steps: an acquisition process for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; and an authentication control process for receiving an authentication result of the person to be authenticated and the number of the plurality of people to be authenticated from the server device, notifying the authentication worker of the number of the plurality of people to be authenticated, and, if the authentication result of the person to be authenticated is successful, updating the cumulative number of people who have been successfully authenticated by the server device and notifying the authentication worker of the updated number.
[0014] According to each aspect of the present invention, a terminal, a server device, a terminal control method, and a storage medium are provided that contribute to reducing the burden on an operator who performs authentication work for a large number of authentication targets. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above.
[0015] FIG. 1 is a diagram illustrating an overview of an embodiment. FIG. 2 is a flowchart illustrating an overview of the operation of an embodiment. FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to the present disclosure. FIG. 4 is a diagram illustrating the operation of the information processing system according to the present disclosure. FIGS. 5A and 5B are diagrams illustrating an example of a display of a terminal according to the present disclosure. FIG. 6 is a diagram illustrating an example of a processing configuration of a terminal according to the present disclosure. FIG. 7 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 8 is a diagram illustrating an example of a processing configuration of a server device according to the present disclosure. FIG. 9 is a diagram illustrating an example of an authentication target database according to the present disclosure. FIG. 10 is a flowchart illustrating an example of the operation of an authentication unit according to the present disclosure. FIG. 11 is a sequence diagram illustrating an example of the operation of an information processing system according to the present disclosure. FIG. 12 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 13 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 14 is a diagram illustrating an example of a schematic configuration of an information processing system according to the present disclosure. FIG. 15 is a diagram illustrating an example of a processing configuration of a management server according to the present disclosure. FIG. 16 is a diagram illustrating an example of a processing configuration of an authentication server according to the present disclosure. FIG. 17 is a diagram illustrating an example of a processing configuration of a terminal according to the present disclosure. FIG. 18 is a diagram illustrating an example of an attendee management database according to the present disclosure. FIG. 19 is a diagram illustrating an example of a user management database according to the present disclosure. FIG. 20 is a sequence diagram illustrating an example of the operation of an information processing system according to the present disclosure. FIG. 21 is a diagram illustrating an example of a schematic configuration of an information processing system according to the present disclosure. FIG. 22 is a diagram for explaining the operation of the information processing system according to the present disclosure. FIG. 23 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 24 is a diagram for explaining the operation of the information processing system according to the present disclosure. FIG. 25 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 26 is a diagram for explaining the operation of the information processing system according to the present disclosure. FIG. 27 is a diagram for explaining the operation of the information processing system according to the present disclosure. FIG. 28 is a diagram illustrating an example of a display of a terminal according to the present disclosure. FIG. 29 is a diagram illustrating an example of the hardware configuration of a terminal according to the present disclosure.
[0016] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.
[0017] A terminal 100 according to one embodiment includes an acquisition unit 101 and an authentication control unit 102 (see FIG. 1). The acquisition unit 101 acquires biometric information of a person to be authenticated from a camera worn by the authentication worker (step S1 in FIG. 2). The authentication control unit 102 stores biometric information for each of a plurality of people to be authenticated and transmits the acquired biometric information to a server device that performs biometric authentication using the stored biometric information (step S2). The authentication control unit 102 receives the authentication result of the person to be authenticated and the number of people to be authenticated from the server device (step S3). The authentication control unit 102 notifies the authentication worker of the number of people to be authenticated, and if the authentication result of the person to be authenticated is successful, updates the cumulative number of people who have been successfully authenticated by the server device and notifies the authentication worker of the updated number (notifying the authentication worker of the information; step S4).
[0018] The terminal 100 acquires biometric information of the person to be authenticated from a camera worn by the authentication worker and transmits the acquired biometric information to a server device, thereby requesting authentication of the person to be authenticated from the server device. The terminal 100 acquires the authentication result and the total number of people to be authenticated from the server device. The terminal 100 uses the information acquired from the server device to notify the authentication worker of information that supports the authentication worker's work. For example, the terminal 100 notifies the authentication worker of the total number of people to be authenticated and the number of people to be authenticated who have already been authenticated. For example, when the authentication worker visually recognizes the face of the person to be authenticated, the terminal 100 notifies the authentication worker of the authentication result and information that supports the authentication work, allowing the authentication worker to easily make a decision regarding the person to be authenticated in front of them (for example, whether or not to allow the person to enter a specified facility). In other words, the burden on the worker performing the authentication work is reduced.
[0019] Specific embodiments will be described in more detail below with reference to the drawings.
[0020] First Embodiment The first embodiment will be described in more detail with reference to the drawings.
[0021] In an information processing system (authentication system) according to the first embodiment, a person such as a security guard determines whether or not a person attempting to enter a predetermined facility such as a factory is permitted to enter. In the first embodiment, the security guard at the entrance of the factory, etc., who is responsible for the authentication of workers (entrants) who work in the factory, is set as an "authentication worker," and the operation of the information processing system will be described.
[0022] [System Configuration] Fig. 3 is a diagram showing an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. As shown in Fig. 3, the information processing system includes a server device 10.
[0023] The server device 10 stores biometric information for each of a plurality of authentication subjects and performs biometric authentication using the stored biometric information. For example, the server device 10 is managed and operated by a company, organization, or the like that provides an authentication system. The server device 10 may be installed in a building of the company, or may be installed on a network (on the cloud).
[0024] A security guard (authentication worker) wears a wearable camera 20. For example, the security guard wears a hat to which the wearable camera 20 is attached. The security guard also carries a terminal 30. The terminal 30 is, for example, a mobile terminal such as a smartphone or a tablet.
[0025] Wearable camera 20 and terminal 30 are connected to each other so as to be able to communicate with each other via wire or wirelessly. For example, wearable camera 20 and terminal 30 are configured to be able to communicate with each other via short-range wireless communication means such as Bluetooth (registered trademark).
[0026] Workers who will be performing work in the factory board a microbus 40 and enter the factory. When the microbus 40 arrives at the entrance to the factory, it stops at the instruction of a security guard. If each worker on board the microbus 40 has the qualifications (authority) to enter the factory, the security guard will allow the microbus 40 to move into the factory. If at least one worker on board the microbus 40 does not have the qualifications to enter the factory, the security guard will refuse to allow the microbus 40 to move into the factory.
[0027] The configuration of the information processing system shown in Fig. 3 is an example and is not intended to be limiting. For example, the system may include multiple server devices 10. Also, Fig. 3 illustrates a microbus 40 as a means of transportation for transporting workers, but this is not intended to limit the means of transportation for workers.
[0028] [Overall Operation] Next, an overall operation of the information processing system according to the first embodiment will be described.
[0029] <Registration of Permitted Entry Persons> The server device 10 acquires information on workers who have the qualifications (authority) to enter the factory. For example, a factory operations manager or the like registers in the server device 10 a list containing information on workers who are permitted to enter the factory for each operating day of the factory.
[0030] Specifically, a factory operations manager or the like registers an "allowed entry list" containing biometric information, name, affiliation (company), work purpose, etc. of workers working in the factory in the server device 10. Based on the acquired allowed entry list, the server device 10 stores information on the person to be authenticated in an authentication subject database. The authentication subject database will be described in detail later.
[0031] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, or iris pattern. Alternatively, the biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes the user's physical characteristics. In the embodiment disclosed herein, a case where biometric information related to a person's "face" (a face image or features generated from a face image) is used will be described.
[0032] <Biometric authentication> When the microbus 40 arrives at the entrance to the factory, the security guard performs work related to the authentication of the workers aboard the microbus 40. Specifically, the security guard looks around the interior of the microbus 40 to confirm the face of each worker aboard the microbus 40. If necessary, the security guard opens the doors and windows of the microbus 40 to look around the interior. Note that the workers aboard the microbus 40 do not need to get off the microbus 40.
[0033] Wearable camera 20 constantly captures an image of a predetermined range (in front of the security guard). Wearable camera 20 transmits image data obtained by capturing images to terminal 30 periodically or at predetermined timings.
[0034] The terminal 30 determines whether the acquired image data includes at least one face image.
[0035] If the image data does not include a facial image, the terminal 30 does not perform any particular process.
[0036] If the image data includes a facial image, the terminal 30 transmits an "authentication request" including the facial image included in the image data to the server device 10 (see FIG. 4). Note that if one piece of image data includes multiple facial images, the terminal 30 transmits an authentication request for each of the multiple facial images to the server device 10.
[0037] The server device 10 performs biometric authentication of the person to be authenticated (the worker on board the microbus 40) photographed by the wearable camera 20 using the biometric information (facial image) included in the authentication request and the biometric information stored in the authentication subject database.
[0038] If the biometric information of the person to be authenticated is stored in the authentication subject database, the server device 10 determines that the authentication of the person to be authenticated has been successful. When the server device 10 succeeds in authenticating the person to be authenticated for the first time, it sets "authenticated" to the corresponding entry in the authentication subject database.
[0039] Furthermore, if the authentication is successful the first time, the server device 10 notifies the terminal 30 of information about the person who has been successfully authenticated (the person to be authenticated who has been determined to have been successfully authenticated). Specifically, the server device 10 transmits to the terminal 30 an affirmative response including "information about the person who has been successfully authenticated," which includes a facial image of the person who has been successfully authenticated (the facial image received from the terminal 30), and the name, affiliation, purpose of work, etc. stored in the authentication target database.
[0040] If the biometric information of the person to be authenticated is not stored in the authentication subject database, the server device 10 determines that the authentication of the person to be authenticated has failed. In this case, the server device 10 notifies the terminal 30 of information on the person who failed authentication (the person who was determined to have failed authentication). Specifically, the server device 10 transmits a negative response to the terminal 30, which includes "authentication failed person information" that includes a facial image of the person who failed authentication (the facial image received from the terminal 30).
[0041] Here, if the biometric information of the person to be authenticated is registered in the authentication subject database and the entry for the person to be authenticated identified by biometric authentication is set to "authenticated," the server device 10 notifies the terminal 30 that the person to be authenticated has been authenticated. Specifically, the server device 10 transmits to the terminal 30 an affirmative response including "authenticated person information" that includes a facial image of the worker who has already been authenticated.
[0042] When responding to the authentication request, the server device 10 notifies the terminal 30 of the total number of workers who can enter the factory on the processing date of the authentication request (the number of people expected to enter per day). The server device 10 transmits to the terminal 30 a positive or negative response including the total number of entries in the authentication target database that correspond to the processing date of the authentication request.
[0043] The terminal 30 updates the screen display at least each time it acquires information about a person who has been successfully authenticated. For example, when the terminal 30 first receives information about a person who has been successfully authenticated, the terminal 30 displays a screen such as that shown in Fig. 5A. As shown in Fig. 5A, the terminal 30 displays the number of people expected to enter the facility that day, the number of workers who have been determined to have been successfully authenticated (the number of confirmed workers), and information about the person who has been successfully authenticated (facial image, name, affiliation, and purpose of work).
[0044] When the terminal 30 acquires the information about the second successfully authenticated worker, it updates the display as shown in FIG. 5B . Specifically, the terminal 30 increments the number of confirmed workers and adds and displays information about the second successfully authenticated worker. When the terminal 30 updates the screen display of the number of confirmed workers, etc., it may highlight the updated display portion. For example, the terminal 30 may blink the number of confirmed workers or change the color.
[0045] The security guard checks the situation inside the microbus 40 and the information presented by the terminal 30 (displays in Figures 5A and 5B), and if there is no contradiction between the situation inside the vehicle and the authentication results, allows the microbus 40 to move around the factory.
[0046] For example, if there are three workers on board the microbus 40 and the terminal 30 displays information about the three workers (facial images, names, affiliations, work purposes, etc.), the security guard will allow the microbus 40 to move.
[0047] On the other hand, if there is a discrepancy between the status inside the microbus 40 and the display on the terminal 30, the security guard will not allow the microbus 40 to move (move into the factory).
[0048] Next, details of each device included in the information processing system according to the first embodiment will be described.
[0049] [Terminal] Examples of terminal 30 include mobile terminal devices such as smartphones, mobile phones, game consoles, tablets, etc. Terminal 30 can be any equipment or device that can accept user operations and communicate with wearable camera 20 and server device 10.
[0050] 6 is a diagram illustrating an example of a processing configuration (processing module) of the terminal 30 according to an embodiment of the present disclosure. Referring to FIG. 6, the terminal 30 includes a communication control unit 201, a biometric information acquisition unit 202, an authentication control unit 203, and a storage unit 204.
[0051] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.
[0052] Communication control unit 201 supports short-range wireless communication such as Bluetooth (registered trademark), and communicates with wearable camera 20 via the short-range wireless communication. Note that the pairing process required when terminal 30 and wearable camera 20 communicate via Bluetooth (registered trademark) is performed, for example, when a security guard starts work.
[0053] Biometric information acquisition unit 202 is a means for acquiring biometric information of the person to be authenticated. Biometric information acquisition unit 202 acquires the biometric information of the person to be authenticated from a camera (wearable camera 20) worn by the authentication worker. Biometric information acquisition unit 202 acquires image data from wearable camera 20 periodically or at a predetermined timing.
[0054] The biometric information acquisition unit 202 passes the acquired image data to the authentication control unit 203 .
[0055] The authentication control unit 203 is a means for controlling the authentication work performed by an authentication worker (security guard).
[0056] When the image data is acquired from the biometric information acquisition unit 202, the authentication control unit 203 attempts to extract a face image from the acquired image data.
[0057] Note that since existing technology can be used for the facial image extraction process by the authentication control unit 203, detailed description thereof will be omitted. For example, the authentication control unit 203 may extract a facial image (face area) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the authentication control unit 203 may extract a facial image using a technique such as template matching.
[0058] If a face image is not extracted, the authentication control unit 203 does not perform any particular process.
[0059] When a facial image is extracted, the authentication control unit 203 transmits an authentication request including the extracted facial image to the server device 10. When multiple facial images are extracted from one piece of image data, the authentication control unit 203 transmits an authentication request for each of the multiple facial images to the server device 10.
[0060] The authentication control unit 203 receives responses to the authentication request (positive responses including information on authenticated individuals, negative responses including information on unsuccessful individuals, and positive responses including information on individuals who have already been authenticated). Upon acquiring the information on successfully authenticated individuals, the authentication control unit 203 displays, for example, the information shown in Figures 5A and 5B. For example, the authentication control unit 203 displays the total number of workers scheduled to enter the factory, the number of workers who have been determined to have been successfully authenticated, and information on those who have been successfully authenticated.
[0061] As described above, the authentication control unit 203 increments (counts up) the number of confirmed workers each time it receives information about a successful authentication individual. That is, the authentication control unit 203 updates the cumulative number of successful authentication individuals who have been determined to have been successfully authenticated by the server device 10. The authentication control unit 203 displays the number of people expected to enter the facility and the number of confirmed workers on the same screen each day, allowing security guards to compare the number of people expected to enter the facility with the number of people who have actually entered the facility.
[0062] Here, when authentication failure information is acquired, the authentication control unit 203 may display a screen as shown in Fig. 7. Fig. 7 shows an example of a case where the terminal 30 acquires authentication failure information from the situation shown in Fig. 5B. As shown in Fig. 7, when authentication failure information is acquired, the authentication control unit 203 does not increment the number of confirmed workers.
[0063] As shown in Fig. 7, the authentication control unit 203 may notify a security guard of the fact that authentication has failed along with a facial image of the person who has failed authentication. The security guard will prohibit the person from entering the factory and will talk to the person if necessary. Note that the way security guards and others handle the person who has failed authentication is not within the scope of the present disclosure, so a detailed description will be omitted.
[0064] Note that when the authenticated person information is acquired, the authentication control unit 203 may discard (ignore) the information, or may notify the security guard that the authenticated person information has been acquired. By discarding the authenticated person information, the authentication control unit 203 prevents the security guard from being notified of the authentication results of the authenticated person who appears in multiple image data in duplicate. In other words, when the authentication control unit 203 receives a notification from the server device 10 that the authentication of the authenticated person has already been successful, it does not update the cumulative number of successfully authenticated persons (number of confirmed workers).
[0065] In this way, the authentication control unit 203 transmits the acquired biometric information to the server device 10, thereby receiving the authentication result of the person to be authenticated and the number of people to be authenticated (the number of people expected to enter in a day) from the server device 10. The authentication control unit 203 notifies the authentication worker of the number of people to be authenticated. Furthermore, if the authentication result of the person to be authenticated is successful, the authentication control unit 203 updates the cumulative number of people who have been successfully authenticated by the server device 10 (the number of confirmed workers) and notifies the authentication worker of the update.
[0066] Furthermore, when the server device 10 has successfully authenticated the person to be authenticated, the authentication control unit 203 receives information about the person who has been successfully authenticated (successfully authenticated person information) from the server device 10. In this case, the authentication control unit 203 displays at least some of the information about the person to be authenticated (successfully authenticated person information) that has been received (for example, a facial image, a name, etc.).
[0067] The storage unit 204 is a means for storing information necessary for the operation of the terminal 30 .
[0068] 8 is a diagram illustrating an example of a processing configuration (processing module) of the server device 10 according to an embodiment of the present disclosure. Referring to FIG. 8, the server device 10 includes a communication control unit 301, a registration control unit 302, an authentication unit 303, and a storage unit 304.
[0069] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the terminal 30. The communication control unit 301 also transmits data to the terminal 30. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.
[0070] The registration control unit 302 is a means for controlling the registration of persons who are the subject of authentication processing (workers who are permitted to enter a factory or the like).
[0071] The registration control unit 302 acquires a list of workers who are permitted to enter the factory (an authorized entry list) for each factory operating day. For example, the registration control unit 302 acquires the authorized entry list from a factory operations manager or the like. For example, the registration control unit 302 acquires the authorized entry list via an external storage medium such as a Universal Serial Bus (USB) memory. Alternatively, the registration control unit 302 may provide an interface that enables the operations manager or the like to register the authorized entry list on a predetermined web page or the like.
[0072] The list of permitted entry includes biometric information (face image), name, affiliation, work purpose, etc. of each worker permitted to enter the factory.
[0073] When the admission permitted person list is acquired, the registration control unit 302 generates feature amounts from each face image included in the list.
[0074] Since existing technology can be used for the feature generation process, a detailed description thereof will be omitted. For example, the registration control unit 302 extracts the eyes, nose, mouth, etc. from the face image as feature points. Then, the registration control unit 302 calculates the positions of the feature points and the distances between the feature points as feature amounts (generating a feature vector consisting of multiple feature amounts).
[0075] After generating the feature amounts, the registration control unit 302 stores the information of the workers listed on the permitted entry list in the authentication target database (see FIG. 9).
[0076] As shown in Fig. 9, the authentication subject database stores, for each operating day of the factory, the biometric information (feature amounts), name, affiliation (name of the company to which the worker belongs), work purpose, etc. of workers permitted to enter the factory in association with each other. Note that the authentication subject database shown in Fig. 9 is an example and is not intended to limit the items to be stored. For example, a "facial image" may be registered in the authentication subject database as biometric information.
[0077] The authentication unit 303 is a means for authenticating the person to be authenticated who is on board the microbus 40 .
[0078] The operation of the authentication unit 303 will be described with reference to FIG.
[0079] When receiving an authentication request, the authentication unit 303 executes a matching process using the biometric information (face image) included in the authentication request and the biometric information (feature amount) stored in the authentication target database (step S101).
[0080] More specifically, the authentication unit 303 generates features from the facial image included in the authentication request. The authentication unit 303 sets the generated features as a match target and performs a match process (one-to-N match; N is a positive integer, the same applies hereinafter) between the features stored in the authentication target database and the features of the entry corresponding to the processing date of the authentication request.
[0081] The authentication unit 303 calculates the similarity between the feature to be matched and each of the multiple feature values on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.
[0082] The authentication unit 303 determines that the matching process has failed if there is no feature among the multiple feature amounts stored in the authentication target database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value.
[0083] The authentication unit 303 determines that the matching process is successful if there is a feature among the multiple feature amounts stored in the authentication target database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value. In this case, the authentication target of the entry with the highest similarity is identified as the person to be authenticated.
[0084] If the matching process fails (step S102, No branch), the authentication unit 303 generates authentication failure individual information (step S103). Specifically, the authentication unit 303 generates authentication failure individual information including the face image received from the terminal 30.
[0085] If the matching process is successful (step S102, Yes branch), the authentication unit 303 determines whether the worker identified by the matching process has been authenticated (authenticated determination; step S104). Specifically, the authentication unit 303 determines whether "authenticated" is set in the status field of the person to be authenticated identified by the matching process.
[0086] If the person to be authenticated has already been authenticated (step S105, Yes branch), the authentication unit 303 generates authenticated person information (step S106). Specifically, the authentication unit 303 generates authenticated person information including the face image received from the terminal 30.
[0087] If the person to be authenticated has not been authenticated (step S105, No branch), the authentication unit 303 generates information on the person who has been successfully authenticated (step S107). Specifically, the authentication unit 303 generates information on the person who has been successfully authenticated, including the face image of the person who has been successfully authenticated (the face image received from the terminal 30), and the name, affiliation, purpose of work, etc. stored in the entry identified by the matching process (the entry in the authentication target database).
[0088] When authentication of a person to be authenticated is successful for the first time, authentication unit 303 sets "authenticated" in the status field of the person to be authenticated.
[0089] The authentication unit 303 transmits a response to the authentication request to the terminal 30 (step S108). Specifically, the authentication unit 303 transmits an affirmative response including information on the person who was successfully authenticated to the terminal 30. Alternatively, the authentication unit 303 transmits a negative response including information on the person who failed to be authenticated to the terminal 30. Alternatively, the authentication unit 303 transmits an affirmative response including information on the person who has already been authenticated to the terminal 30. By transmitting an affirmative response including information on the person who has already been authenticated to the terminal 30, the authentication unit 303 notifies the terminal 30 that the authentication of the person to be authenticated has already been successful.
[0090] When responding to the authentication request, the authentication unit 303 transmits the total number of workers who can enter the factory on the processing date of the authentication request (the number of workers expected to enter per day) to the terminal 30. The authentication unit 303 transmits to the terminal 300 the number of entries in the authentication target database that correspond to the processing date of the authentication request.
[0091] The storage unit 304 is a means for storing information necessary for the operation of the server device 10 .
[0092] [System Operation] Next, the operation of the information processing system according to the first embodiment will be described.
[0093] 11 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment of the present disclosure. The operation of the information processing system according to the first embodiment will be described with reference to FIG.
[0094] Terminal 30 transmits an authentication request including biometric information of the person to be authenticated to server device 10 (step S01).
[0095] The server device 10 performs biometric authentication using the biometric information included in the authentication request and the biometric information stored in the authentication target database (step S02).
[0096] The server device 10 transmits a response to the authentication request in accordance with the result of the authentication process, etc. (Step S03). For example, if the initial authentication is successful, the server device 10 transmits an affirmative response including information about the successful authentication user to the terminal 30.
[0097] The terminal 30 updates the screen display in response to the received response (step S04). For example, when the terminal 30 acquires the information on the person who has been successfully authenticated, the terminal 30 increments the number of confirmed workers and displays information on the person who has been determined to have been successfully authenticated.
[0098] The security guard visually checks the number of people to be authenticated in front of him / her and the number of people who have been successfully authenticated displayed on the terminal 30, and if there is no discrepancy in the numbers, he / she allows the people to pass through and completes the authentication process. At this time, the security guard may operate the terminal 30 and store the confirmation results.
[0099] Next, a modification of the first embodiment will be described.
[0100] <Modification 1> In the first embodiment, the operation of the information processing system has been described using an example in which a worker enters a factory. The information processing system according to the present disclosure can also be used for other applications.
[0101] For example, the information processing system disclosed in the present application may be applied to confirming passengers getting on and off a bus when picking up or dropping off kindergarten or nursery school children.
[0102] In this case, the server device 10 stores information about children who commute to school by bus. Specifically, the server device 10 stores the children's biometric information, name, class, bus usage (used to commute to school, used to commute to school), etc. in the authentication target database.
[0103] A childcare worker or the like wears a wearable camera 20 and carries a terminal 30. The terminal 30 uses the wearable camera 20 to take a picture of the child getting on the bus and transmits an authentication request including the facial image. As in the first embodiment, the server device 10 transmits information on successful authentication recipients and unsuccessful authentication recipients to the terminal 30. Each time the terminal 30 acquires information on successful authentication recipients, it updates the number of confirmed children (number of confirmed children per day). The terminal 30 also displays information on successfully authenticated children (such as facial images, names, classes, and bus usage patterns) (see FIG. 12 ).
[0104] When the authentication of a child is successful, the server device 10 may notify the parent of the child of the successful authentication. The server device 10 may store the contact information (email address) of the parent in the authentication target database and transmit a notification of successful authentication to the parent's terminal every time authentication is successful.
[0105] Note that the childcare worker or the like may move around inside the bus after the child has boarded the bus and take a picture of the child (person to be authenticated). Because the childcare worker or the like is wearing wearable camera 20, the childcare worker or the like can flexibly respond by taking a picture of the child before the child gets on the bus or after the child gets on the bus.
[0106] A childcare worker or the like may take a photograph of a child getting off the bus. The terminal 30 may request authentication of the child getting off the bus from the server device 10 as the subject of authentication. In this case, if a child set as "authenticated" in the authentication subject database is not successfully authenticated when getting off the bus, the server device 10 may determine that the child who was not successfully authenticated when getting off the bus is left behind on the bus. In other words, the server device 10 may authenticate the child getting off the bus, compare it with a list of children who have boarded the bus, and detect any child who has been left behind on the bus. The server device 10 may notify the terminal 30 carried by the childcare worker of the authentication result, along with the fact that there is a child left behind on the bus and that all children have gotten off.
[0107] <Modification 2> The information processing system disclosed in the present application may be applied to participants getting on and off a bus on a sightseeing tour.
[0108] In this case, the server device 10 stores information about the tour participants. Specifically, the server device 10 stores the biometric information, name, and name of the tour that the tour participant is participating in in the authentication subject database.
[0109] The tour conductor or the like wears a wearable camera 20 and carries a terminal 30. The terminal 30 uses the wearable camera 20 to take pictures of participants boarding the bus and transmits an authentication request including the facial image. As in the first embodiment, the server device 10 transmits information on successful authentication participants and unsuccessful authentication participants to the terminal 30. Each time the terminal 30 acquires information on successful authentication participants, it updates the number of confirmed participants. In addition, the terminal 30 displays information on participants who have been successfully authenticated (such as facial images, names, and the name of the tour they are participating in).
[0110] If there is a tour participant whose status has not changed to authenticated even when a predetermined time (bus departure time) arrives, the server device 10 may notify (warn) the tour participant that the departure time is approaching. The server device 10 may store the contact information (email addresses) of the tour participants in the authentication target database, and may send a departure announcement to the terminals of tour participants who have not been determined to have been successfully authenticated even after a predetermined time has passed.
[0111] The tour conductor or the like may move around the bus after the tour participants have boarded the bus and take pictures of the tour participants (persons to be authenticated). Because the tour conductor or the like is wearing wearable camera 20, the tour conductor or the like can flexibly respond by taking pictures of the tour participants before they board the bus or after they board the bus.
[0112] <Modification 3> The information processing system disclosed herein may be applied to roll calls of employees who have evacuated due to a disaster. Alternatively, the information processing system disclosed herein may be applied to roll calls of local residents or students attending elementary schools, etc. The following description will be given using an employee roll call as an example.
[0113] In this case, the server device 10 stores information about the employees. Specifically, the server device 10 stores the employee's biometric information, name, department, etc. in an authentication target database.
[0114] Disaster prevention personnel, etc., wear wearable cameras 20 and carry terminals 30. Terminals 30 use wearable cameras 20 to capture images of employees gathered at evacuation shelters and transmit authentication requests including facial images. As in the first embodiment, server device 10 transmits information on successful authentication recipients and unsuccessful authentication recipients to terminal 30. Each time it receives information on successful authentication recipients, terminal 30 updates the number of confirmed evacuees. Terminal 30 also displays information on employees who have been successfully authenticated (facial images, names, and departments).
[0115] Regarding the evacuation of local residents, an "evacuation plan" containing information such as evacuation destinations is registered with the local government in advance. Residents create evacuation plans by specifying the evacuation shelters to which they will evacuate in advance. The local government can generate a list of evacuees (those planning to evacuate to evacuation shelters) who will evacuate to each evacuation shelter based on the evacuation plans created by the residents. Disaster prevention personnel at the local government wear wearable cameras 20 and patrol the evacuation shelters. The server device 10 identifies residents who have evacuated to evacuation shelters based on an authentication request received from the terminal 30 carried by the disaster prevention personnel. Furthermore, the server device 10 can identify residents who have not evacuated to evacuation shelters. The server device 10 may contact the contact information registered in the evacuation plan or contact local government personnel, etc., regarding unconfirmed individuals whose presence has not been confirmed at an evacuation shelter.
[0116] <Modification 4> In the above embodiment, the case where authentication unit 303 of server device 10 generates feature amounts from a facial image has been described. However, terminal 30 may generate feature amounts from a facial image. Alternatively, wearable camera 20 may generate feature amounts from a facial image.
[0117] In this case, the terminal 30 transmits an authentication request including the feature amount to the server device 10. The server device 10 executes biometric authentication using the feature amount included in the authentication request and the feature amount included in the authentication target database.
[0118] <Modification 5> In the above embodiment, the terminal 30 notifies an authentication worker such as a security guard of the number of people expected to enter in one day (the total number of workers who can enter a factory or the like in one day). Instead of or in addition to the number of people expected to enter in one day, the terminal 30 may notify the authentication worker of the number of people riding on a bus or the like (the total number of people to be authenticated detected by the authentication worker).
[0119] In this case, biometric information acquisition unit 202 of terminal 30 acquires image data of a bird's-eye view of the interior of the bus in response to an operation by the authentication worker. Biometric information acquisition unit 202 instructs wearable camera 20 to acquire image data using a wide-angle lens.
[0120] The biometric information acquisition unit 202 extracts face images (face areas) from the acquired image data. The biometric information acquisition unit 202 sets the number of extracted face images to the number of workers on the bus. The biometric information acquisition unit 202 notifies the authentication control unit 203 of the acquired number of workers.
[0121] For example, the authentication control unit 203 converts the notified number of workers (total number of workers on the bus; total number of detected workers) into the number of people expected to enter in one day and displays the result as shown in Figure 13.
[0122] Alternatively, the server device 10 may store information (vehicle information) about the bus on which each worker appears as attribute information about the person to be authenticated. When the server device 10 successfully authenticates the person to be authenticated, the server device 10 may notify the terminal 30 of the total number of workers riding on the bus with the successfully authenticated person, based on vehicle information (e.g., vehicle number) stored in association with the successfully authenticated person. That is, the terminal 30 may obtain the number of expected passengers linked to the attribute information (vehicle number) of the first successfully authenticated person, and use the number to display a display such as that shown in FIG. 13 .
[0123] Alternatively, vehicle information (for example, a vehicle number) and the number of people expected to ride may be registered in the terminal 30. The terminal 30 may obtain the vehicle number from the server device 10 and obtain the number of workers expected to ride in the vehicle corresponding to the vehicle number (license plate) (total number of detected workers).
[0124] The authentication control unit 203 initializes the total number of persons to be authenticated (the total number of workers detected inside the bus) in response to an operation by a security guard, etc. For example, when the security guard, etc., has completed the authentication work on the bus workers and allowed the bus to pass, he or she operates the terminal 30 to clear the total number of detected workers.
[0125] In this way, the terminal 30 may notify the authentication worker of the total number of people (total number of workers) detected in a predetermined space (e.g., the microbus 40). The terminal 30 may treat the number of face images extracted from image data captured within the predetermined space, or the number of people (planned number of passengers) present in the predetermined space associated with information about the predetermined space (e.g., the vehicle number), as the total number of people detected in the predetermined space.
[0126] <Modification 6> The terminal 30 may generate and store a log (maintenance log) or evidence of the authentication work performed by the authentication worker.
[0127] In this case, the authentication control unit 203 stores information such as the biometric information (facial image or feature amount), name, affiliation, work purpose, authentication date and time, and authentication location of the successfully authenticated person as a maintenance log. The authentication control unit 203 also stores the name, affiliation, work purpose, authentication date and time, authentication location, and worker confirmation status (entry, exit) of the successfully authenticated person as evidence. In this way, the authentication control unit 203 generates evidence that does not include biometric information.
[0128] The authentication control unit 203 submits the maintenance log and evidence to the system administrator or the like in response to an instruction from the system administrator or the like.
[0129] As described above, in the information processing system according to the first embodiment, an authentication worker, such as a security guard, photographs a person to be authenticated using wearable camera 20 and requests authentication of the person to server device 10. Server device 10 authenticates the person to be authenticated and notifies the security guard, etc., via terminal 30 of the authentication result, along with information on the authenticated person and the authentication status (e.g., the number of people expected to enter per day and the cumulative number of people successfully authenticated per day). The security guard, etc., can quickly and accurately make a decision regarding the authentication worker's admission permission, etc., based on the situation he or she has confirmed (the situation inside microbus 40) and the information notified by terminal 30. In other words, in the first embodiment, by linking wearable camera 20 with terminal 30 that confirms the authentication result, an authentication worker wearing wearable camera 20 can smoothly perform authentication work for the person to be authenticated in front of him or her. In other words, the information processing system disclosed herein enhances the authentication worker's operations.
[0130] Furthermore, when performing authentication work, authentication workers such as security guards and nursery teachers can simply look around the interior of the microbus 40 and greet the children as they board the bus. In other words, by utilizing the wearable camera 20, authentication workers do not need to request that workers or children undergo authentication procedures. In this regard, existing authentication systems require workers (entrants to a factory) to line up in front of fixed cameras installed at the entrance to a factory, preventing smooth authentication procedures. The information processing system according to the first embodiment does not require such operations (face-to-face operations) such as on-site guidance, thereby reducing the burden on authentication workers.
[0131] Furthermore, existing authentication systems using fixed cameras have not been widely adopted due to concerns about the quality of the captured images (e.g., image blur) and the need to protect privacy associated with camera surveillance. In this regard, with the information processing system according to the first embodiment, even if authentication fails due to a problem with the image used for authentication, a security guard or other person can simply visually inspect the person again, allowing the person to be easily re-authenticated. Furthermore, because security guards or other people can turn off wearable camera 20 in situations unrelated to authentication, privacy issues arising from the continued capture of unrelated images do not arise.
[0132] The information processing system disclosed herein also contributes to improving the efficiency of security operations for buildings in general, as well as in the educational sector (kindergarten and nursery school buses, school trips), and tourism (bus tours). For example, security operations at buildings, etc., require workers to get out of their vehicles and undergo authentication at the entrance. Such visitor verification is required at ports, factories, etc., due to requirements such as the SOLUS Convention. While facial recognition is an effective means of preventing impersonation, the procedure of having workers get out of their vehicles and verify each visitor individually is time-consuming and labor-intensive. In contrast, the information processing system disclosed herein enables visitor verification without the visitor getting out of their vehicle, enabling efficient system operation. Thus, the information processing system disclosed herein utilizes a wearable camera 20 to achieve faster identity verification than visual verification by security guards, etc. Furthermore, the information processing system allows security guards, etc., to verify the identity of visitors based on the matching results from the server device 10, thereby reducing on-site identity verification operations.
[0133] Second Embodiment Next, a second embodiment will be described in detail with reference to the drawings.
[0134] In the first embodiment, the server device 10 has been described as having a function for managing the authentication target and a function for authenticating the authentication target. In the second embodiment, a case will be described in which these functions are realized by different devices.
[0135] The following description will focus on the differences between the first and second embodiments.
[0136] As shown in FIG. 14, the information processing system according to the second embodiment includes a management server 11 and an authentication server 12 .
[0137] The management server 11 is a server that manages those to be authenticated. For example, the management server 11 realizes an entrance / exit management system that manages the entrance / exit of workers entering and leaving a factory, etc. The authentication server 12 realizes an authentication infrastructure that authenticates those to be authenticated.
[0138] FIG. 15 is a diagram illustrating an example of a processing configuration (processing module) of the management server 11 according to an embodiment of the present disclosure.
[0139] FIG. 16 is a diagram illustrating an example of a processing configuration (processing module) of the authentication server 12 according to an embodiment of the present disclosure.
[0140] FIG. 17 is a diagram illustrating an example of a processing configuration (processing module) of the terminal 30 according to an embodiment of the present disclosure.
[0141] 15 to 17, descriptions of processing modules having the same functions as the processing modules described in the first embodiment will be omitted. Specifically, detailed descriptions of the communication control unit 321 and memory unit 324 of the management server 11 will be omitted. Detailed descriptions of the communication control unit 331 and memory unit 334 of the authentication server 12 will be omitted. Detailed descriptions of the communication control unit 211 and memory unit 215 of the terminal 30 will be omitted.
[0142] The registration control unit 322 of the management server 11 acquires information on workers who are allowed to enter a factory, etc. (information on permitted visitors) from the factory manager, etc. Specifically, the registration control unit 322 acquires the user ID, name, affiliation, work purpose, etc. of permitted visitors for each working day. The registration control unit 322 stores the acquired information in the visitor management database (see FIG. 18 ).
[0143] The registration control unit 332 of the authentication server 12 acquires the user ID and biometric information (facial image) of each person to be authenticated from a system administrator or the like. The registration control unit 332 generates features from the acquired facial image. The registration control unit 332 associates the user ID with the biometric information (feature) and stores them in the user management database (see FIG. 19 ).
[0144] The same user ID is registered in the management server 11 and the authentication server 12 for the same person.
[0145] The list control unit 214 of the terminal 30 is a means for controlling the list of admitted persons. The list control unit 214 requests the management server 11 to provide the list of admitted persons in response to an operation by an authentication worker such as a security guard. The list control unit 214 sends a "list provision request" to the management server 11. For example, when starting work for the day, the security guard or the like operates the terminal 30 to request the access control system to provide the list of admitted persons.
[0146] In response to receiving the list provision request, the list control unit 323 of the management server 11 transmits the latest permitted entry list (a list including the user IDs, names, affiliations, work purposes, etc. of the workers) as of the date the list provision request was received to the terminal 30. The list control unit 323 accesses the visitor management database and transmits to the terminal 30 the permitted entry list including the user IDs, names, affiliations, work purposes, etc. of the workers who are registered as permitted entry on the date the list provision request was received.
[0147] The terminal 30 stores the received admission permitted person list. The list control unit 214 stores the acquired admission permitted person list in the storage unit 215.
[0148] In addition, after sending the list of permitted persons in response to a request from the terminal 30, the list control unit 323 of the management server 11 may send the latest list of permitted persons or an additional list to the terminal 30 if the list of permitted persons is updated.
[0149] When an authentication worker such as a security guard looks around the inside of the bus, biometric information acquisition unit 212 of terminal 30 acquires image data showing a facial image from wearable camera 20. Biometric information acquisition unit 212 extracts the facial image from the image data. Biometric information acquisition unit 212 generates feature amounts from the extracted facial image. Biometric information acquisition unit 212 passes the generated feature amounts to authentication control unit 213.
[0150] The authentication control unit 213 stores the feature amount acquired from the biometric information acquisition unit 212 in the storage unit 215 .
[0151] When a feature is acquired from the biometric information acquisition unit 212, if there is no feature already stored, the authentication control unit 213 sends an "authentication request" including the acquired feature (biometric information) to the authentication server 12.
[0152] When a feature is acquired from the biometric information acquisition unit 212, if a feature already stored exists, the authentication control unit 213 determines whether a feature substantially identical to the newly acquired feature has already been stored.
[0153] The authentication control unit 213 sets the acquired feature amount on the matching side and the already stored feature amount on the registration side, and executes one-to-N matching.
[0154] If the matching process is successful, the authentication control unit 213 determines that an authentication request for the newly acquired feature has already been sent to the authentication server 12, and does not perform any special process.
[0155] If the matching process fails, the authentication control unit 213 determines that an authentication request for the newly acquired features has not been sent to the authentication server 12, and sends an authentication request including the acquired features to the authentication server 12.
[0156] The authentication unit 333 of the authentication server 12 executes a matching process using the biometric information (feature amount) included in the authentication request and the biometric information (feature amount) stored in the user management database.
[0157] If the matching process is successful, the authentication unit 333 transmits an affirmative response including the user ID of the entry identified by the matching process to the terminal 30 .
[0158] If the matching process fails, the authentication unit 333 transmits a negative response to that effect to the terminal 30.
[0159] If the authentication control unit 213 of the terminal 30 receives a negative response, it does not execute any particular process, or, if necessary, the authentication control unit 213 displays a message as shown in FIG.
[0160] When a positive response is received, if the user ID included in the positive response is included in the permitted entry list, the authentication control unit 213 determines that authentication of the person appearing in the image data has been successful. In this case, the authentication control unit 213 increments the number of confirmed workers and displays a screen such as that shown in Fig. 5A. The authentication control unit 213 also reads information about successfully authenticated workers (workers whose user IDs are included in the permitted entry list obtained from the management server 11 and whose authentication server 12 has successfully authenticated) from the permitted entry list, and displays a screen such as that shown in Fig. 5A.
[0161] If the user ID included in the positive response is not included in the permitted entry list, the authentication control unit 213 determines that authentication of the person in the image data has failed. In this case, the authentication control unit 213 does not increment the number of confirmed workers. The authentication control unit 213 displays a message as shown in FIG. 7 as necessary.
[0162] The authentication control unit 213 periodically or at a predetermined timing deletes the feature amounts (feature amounts generated from the face image extracted from the image data by the biometric information acquisition unit 212) stored in the storage unit 215. For example, the authentication control unit 213 deletes the feature amounts stored in the storage unit 215 when the security guard finishes the authentication work or when the date changes.
[0163] The operation of the information processing system according to the second embodiment can be summarized as shown in the sequence diagram of FIG.
[0164] The terminal 30 transmits a list provision request to the management server 11 in response to an operation by a security guard or the like (step S11).
[0165] The management server 11 transmits the list of admitted persons as of the date on which the request for providing the list was received to the terminal 30 (step S12).
[0166] When the security guard looks around the inside of the bus and acquires biometric information (facial image), the terminal 30 transmits an authentication request including the biometric information (feature amount) to the authentication server 12 (step S13).
[0167] The authentication server 12 executes a matching process using the feature amount included in the authentication request and the feature amount stored in the user management database (step S14).
[0168] The authentication server 12 transmits a response to the authentication request (step S15). If the verification process is successful, the authentication server 12 transmits an affirmative response to the terminal 30, including the user ID of the admitted person identified by the verification process.
[0169] The terminal 30 makes a determination using the acquired user ID and the admission permitted person list (step S16). If the acquired user ID is stored in the admission permitted person list, the terminal 30 determines that the authentication is successful. If the acquired user ID is not stored in the admission permitted person list, the terminal 30 determines that the authentication is unsuccessful.
[0170] The terminal 30 updates the display in accordance with the authentication result (step S17).
[0171] In this way, terminal 30 acquires biometric information of the person to be authenticated from a camera (wearable camera 20) worn by the authentication worker. Terminal 30 also acquires a list (admission permitted person list) containing the user IDs of multiple people to be authenticated from management server 11. Terminal 30 stores the user IDs and biometric information of at least multiple people to be authenticated, and acquires the user ID of the person to be authenticated by transmitting the acquired biometric information to authentication server 12, which performs biometric authentication using the stored biometric information. Terminal 30 determines that authentication of the person to be authenticated has been successful if the user ID of the person to be authenticated is included in the list. Terminal 30 updates the cumulative number of people who have been successfully authenticated and notifies the authentication worker of the update.
[0172] As described above, the information processing system according to the second embodiment includes management server 11 and authentication server 12. Management server 11 manages permitted persons. Authentication server 12 authenticates persons to be authenticated. Terminal 30 determines that authentication of the worker on the bus is successful if the permitted persons list acquired from management server 11 includes a user ID identified by authentication server 12 through biometric authentication. Terminal 30 determines that authentication of the worker on the bus is unsuccessful if the permitted persons list acquired from management server 11 does not include a user ID identified by authentication server 12 through biometric authentication. In the second embodiment as well, cooperation between wearable camera 20 and terminal 30 allows an authentication worker wearing wearable camera 20 to smoothly perform authentication work for persons to be authenticated in front of them.
[0173] Third Embodiment Next, a third embodiment will be described in detail with reference to the drawings.
[0174] In the third embodiment, an information processing system not including an authentication server 12 will be described.
[0175] The following description will focus on the differences between the first to third embodiments.
[0176] 21 , the information processing system according to the third embodiment includes a management server 11. A representative of the bus (for example, a driver) has a representative terminal 50.
[0177] The representative terminal 50 stores the user ID and biometric information (feature amount) of each worker on the bus. The representative terminal 50 stores a "passenger list" consisting of the user ID and biometric information of the workers on the bus.
[0178] When the bus arrives at the factory, the representative operates the representative terminal 50 to transmit the passenger list to the terminal 30 carried by the security guard, etc. For example, the representative terminal 50 transmits the passenger list to the terminal 30 using a communication means such as Bluetooth (registered trademark).
[0179] The terminal 30 acquires the admission permitted person list from the management server 11 in the same manner as in the second embodiment.
[0180] When the security guard looks around the inside of the bus, terminal 30 acquires biometric information (feature amounts) of each worker inside the bus via wearable camera 20. Authentication control unit 213 of terminal 30 performs a matching process (authentication process) using the acquired feature amounts and the biometric information included in the passenger list.
[0181] If the matching process fails, authentication control unit 213 determines that authentication of the worker (person to be authenticated) photographed by wearable camera 20 has failed.
[0182] If the matching process is successful, the authentication control unit 213 determines whether the user ID identified by the matching process is included in the entry permitted person list.
[0183] If the user ID is included in the permitted entry list, authentication control unit 213 determines that authentication of the worker (person to be authenticated) photographed by wearable camera 20 has been successful. If the user ID is not included in the permitted entry list, authentication control unit 213 determines that authentication of the worker (person to be authenticated) photographed by wearable camera 20 has failed.
[0184] If the authentication is successful, the authentication control unit 213 displays a message such as that shown in Fig. 5A or 5B. If the authentication is unsuccessful, the authentication control unit 213 displays a message such as that shown in Fig. 7 as necessary.
[0185] In this manner, the terminal 30 acquires biometric information of the person to be authenticated from a camera (wearable camera 20) worn by the authentication worker. The terminal 30 acquires a first list (allowed entry list) including the user IDs of multiple authentication targets from the management server 11. The terminal 30 acquires a second list (passenger list) including the user IDs and biometric information of multiple people present in a specified space (e.g., a microbus 40) from a terminal carried by a representative of the specified space (e.g., the driver of the microbus 40). The terminal 30 identifies the user ID of the person to be authenticated by performing a matching process using the acquired biometric information and the biometric information included in the second list. The terminal 30 determines that the authentication of the identified person to be authenticated has been successful if the user ID of the identified person to be authenticated is included in the first list. The terminal 30 updates the cumulative number of people who have been successfully authenticated and notifies the authentication worker of the update.
[0186] As described above, in the information processing system according to the third embodiment, terminal 30 performs authentication processing using the passenger list acquired from representative terminal 50, the permitted entry list acquired from management server 11, and biometric information acquired via wearable camera 20. In the third embodiment, too, cooperation between wearable camera 20 and terminal 30 allows an authentication worker wearing wearable camera 20 to smoothly perform authentication work for a person to be authenticated in front of them.
[0187] Fourth Embodiment Next, a fourth embodiment will be described in detail with reference to the drawings.
[0188] The terminal 30 carried by an authentication worker (such as a security guard, a nursery teacher, a tour guide, or a disaster prevention officer) may have a function for re-authentication of an authentication target who has not been determined to have been successfully authenticated. In the fourth embodiment, re-authentication of an unauthenticated target (a target who is an authentication target but has not been set as authenticated) will be described.
[0189] The following description will focus on the differences between the first to fourth embodiments.
[0190] In the fourth embodiment, the operation of the information processing system will be described by taking as an example a case where a nursery teacher or kindergarten teacher checks attendance in a class at a kindergarten or the like.
[0191] In the information processing system, nursery teachers and kindergarten teachers check the attendance of children. Specifically, the server device 10 stores information about children (such as facial images, names, and classes) for each class in an authentication target database.
[0192] As described in the first embodiment, terminal 30 uses wearable camera 20 to capture an image of a child entering a class and transmits an authentication request to server device 10. At that time, terminal 30 transmits to server device 10 an authentication request including information specifying the class for which attendance is to be confirmed (e.g., classroom number, class name, etc.) and biometric information.
[0193] The server device 10 identifies a target class (entry of the target class) for biometric authentication from the information for identifying the class. The server device 10 performs biometric authentication using the biometric information included in the authentication request and the biometric information stored in the entry of the specified class. As in the first embodiment, the server device 10 transmits information on the authenticated individual and the like to the terminal 30.
[0194] When the terminal 30 receives the information on the successfully authenticated children, it updates the number of confirmed children and displays information on the children who have been successfully authenticated.
[0195] When a nursery teacher or the like cannot confirm the attendance of all the children (when the number of children enrolled in a class does not match the number of confirmed children), the nursery teacher or the like operates the terminal 30 to request the server device 10 to provide a list of unauthenticated children who have not been determined to have been successfully authenticated.
[0196] Specifically, the terminal 30 transmits a "request to provide an unauthenticated person list" to the server device 10 (see FIG. 22). At that time, the terminal 30 specifies the class for which the unauthenticated person list is to be generated, and transmits the request to provide an unauthenticated person list to the server device 10. The terminal 30 can obtain the name of the class for which the unauthenticated person list is to be generated from a nursery teacher, kindergarten teacher, or the like.
[0197] When the server device 10 receives the request to provide an unauthenticated person list, it extracts entries in the authentication target database that are not set as authenticated from the entries corresponding to the class specified by the terminal 30. The authentication unit 303 transmits to the terminal 30 an unauthenticated person list made up of information contained in the extracted entries (for example, facial images, names, etc. of the children).
[0198] When the unauthenticated user list is received, the authentication control unit 203 of the terminal 30 displays a screen as shown in FIG.
[0199] After checking the display, the nursery teacher will call out the name of the child on the list and ask for a show of hand. For example, the nursery teacher might say, "Yamada Taro, please raise your hand."
[0200] Terminal 30 instructs wearable camera 20 to take a video in response to an operation by a childcare worker or the like. Terminal 30 acquires video data from wearable camera 20. Terminal 30 identifies (detects) the child who raised his / her hand by analyzing the video data. Terminal 30 utilizes a "gesture check function" using the video to identify the child who raised his / her hand from among multiple children. Authentication control unit 203 sends a "re-authentication request" including biometric information (facial image) of the identified child to server device 10 (see FIG. 24).
[0201] The terminal 30 may use a learning model obtained by machine learning to detect a child who has made a specific gesture (raising a hand in the above example).
[0202] The server device 10 processes the re-authentication request in the same way as the authentication request. If the authentication is successful, the server device 10 transmits information about the successfully authenticated child to the terminal 30. If the authentication fails, the server device 10 may transmit information about the unsuccessful child to the terminal 30, or may simply transmit a negative response to the terminal 30 indicating that the authentication failed.
[0203] The terminal 30 identifies the child who was on the unauthenticated child list from the child's name included in the authentication success information, and updates the status of the child who was notified of the authentication success information to "authenticated." For example, as shown in FIG. 25, the terminal 30 sets the status of the child who was successfully re-authenticated to "attended" and updates the display. Note that the "number of unconfirmed children" shown in FIG. 25 is the number of children on the unauthenticated child list. Furthermore, when the terminal 30 receives a positive response including authentication success information in response to the re-authentication request, the terminal 30 increments the "number of confirmed children."
[0204] The nursery school teacher repeatedly calls out the names of the children whose attendance they want to check and asks them to raise their hands.
[0205] If the authentication or re-authentication is successful, the server device 10 may notify the parent or guardian of the success.
[0206] As described above, the authentication control unit 203 of the terminal 30 according to the fourth embodiment acquires from the server device 10 an unauthenticated person list containing information about unauthenticated persons who have not yet been authenticated among multiple persons to be authenticated. The authentication control unit 203 displays information about the unauthenticated persons listed in the unauthenticated person list (see FIG. 23 ). Furthermore, the biometric information acquisition unit 202 of the terminal 30 acquires video data from the wearable camera 20. The authentication control unit 203 uses the video data to detect an unauthenticated person who performed a predetermined action from among the unauthenticated persons listed in the unauthenticated person list, and requests the server device 10 to re-authenticate the detected person. As a result, even a childcare worker who does not fully recognize the face of the person to be authenticated (child) can reliably confirm the attendance of the child.
[0207] In the fourth embodiment, a nursery teacher or kindergarten teacher compares the number of people to be authenticated in front of them with the number of people to be authenticated who have been determined to have been successfully authenticated. If a discrepancy occurs, the nursery teacher or kindergarten teacher operates the terminal 30 to request the server device 10 to provide a list of unauthenticated people. The nursery teacher or kindergarten teacher checks the list of unauthenticated people displayed on the terminal 30 and performs tasks related to re-authentication of the unauthenticated people.
[0208] Fifth Embodiment Next, a fifth embodiment will be described in detail with reference to the drawings.
[0209] In the fifth embodiment, authentication (detection) of a VIP such as a business partner at a technology exhibition or the like will be described. In the fifth embodiment, information about the VIP is registered in advance in the server device 10, and when the VIP arrives at the venue, the authentication result is displayed on the terminal 30 carried by a person in charge of reception or the like. This is the same as in the first embodiment.
[0210] In the fifth embodiment, a person in charge of guiding (attending) a VIP who arrives at a venue is predetermined, and when a VIP is detected, the person in charge is notified of the VIP's arrival.
[0211] The following description will focus on the differences between the first to fifth embodiments.
[0212] The server device 10 stores information on VIPs among the exhibition participants. Specifically, the server device 10 stores the VIPs' biometric information, name, company, name of the booth that the VIPs plan to visit, etc. in the authentication target database.
[0213] Furthermore, the authentication target database stores information on a group (a group consisting of at least one person) in charge of guiding the VIP along with the VIP's biometric information, etc. The authentication target database stores the VIP's biometric information in association with the name, email address, etc. of each person in the group.
[0214] Exhibitors (exhibit explainers) and receptionists wear wearable cameras 20 and carry terminals 30. Terminals 30 use wearable cameras 20 to capture images of visitors to the exhibition and transmit authentication requests including facial images. As in the first embodiment, server device 10 transmits information on successful authentication recipients and unsuccessful authentication recipients to terminal 30. Each time it receives information on successful authentication recipients, terminal 30 updates the number of confirmed visitors (number of confirmed VIPs). Terminal 30 also displays information on VIPs who have been successfully authenticated (such as facial images, names, and affiliated companies).
[0215] Furthermore, when a VIP is detected (authenticated), the server device 10 transmits a "VIP arrival notification" to the person in charge terminal 60 of each person in charge of guiding (receiving) the VIP (see FIG. 26). The server device 10 transmits the VIP arrival notification, including the biometric information, name, company name, etc. of the VIP, to the person in charge terminal 60 of each person in charge.
[0216] The person in charge terminal 60 displays the information included in the VIP arrival notification. When the person in charge sees this display, he or she heads toward the VIP. When the person in charge meets the VIP, the person in charge inputs the VIP's name and other information into the person in charge terminal 60, along with a message that the person in charge has begun guiding the VIP.
[0217] In response to the input, the person in charge terminal 60 transmits to the server device 10 a "notice of start of guidance" including the name of the VIP, the name of the person in charge, and the like.
[0218] The server device 10 identifies an entry stored in the authentication target database based on the name of the important person included in the guidance start notification, and stores the name of the person in charge who started guiding (receiving) the important person in the person in charge field of the identified entry.
[0219] A person in charge of guiding a VIP can know the status of the VIP's arrival and the status of guidance by other persons. In this case, the person in charge operates the person in charge terminal 60 to send a request for providing the latest status to the server device 10 (see FIG. 27).
[0220] When receiving the request for providing the latest status, the server device 10 transmits information (such as a face image, name, and company) of the VIP who is registered in the authentication target database and has already arrived, as well as the "guidance status information" of the VIP to the person in charge terminal 60. The guidance status information includes whether or not there is a person in charge guiding (serving) the VIP, the name of the person in charge, and the like.
[0221] Upon receiving the VIP information and the guidance status information, the staff member terminal 60 displays a screen as shown in FIG. 28. The staff member checks the displayed information, and if there is a VIP that the staff member is not currently serving, the staff member goes to guide the VIP. At this time, the staff member operates the staff member terminal 60 to send a guidance start notification to the server device 10. Note that in FIG. 28, the number of VIP attendees is the number of VIPs attending the venue, and is the number of VIPs notified by the server device 10. Furthermore, although not shown in FIG. 28, the staff member terminal 60 may also display the time when the information of the staff member guiding the VIP was updated (information update time).
[0222] Furthermore, the staff member terminal 60 may display the name of the booth where each staff member is serving an important person and the details of the service (contents of the exhibition or demonstration) in response to an operation by the staff member. Alternatively, the staff member terminal 60 may provide an interface through which a memo, such as a message, for other staff members can be input, and the acquired memo may be shared with the other staff members. In this case, the server device 10 may accept a memo (message) from each staff member terminal 60 and transmit the memo to the other staff member terminal 60 in response to a request from the staff member terminal 60 or at the timing of acquiring the memo. Alternatively, if the staff member terminal 60 stores the email addresses, etc., of the staff member terminals 60 owned by the other staff members, the staff member terminal 60 may directly transmit the acquired message, etc. to the other staff member terminal 60.
[0223] The request for information on the status of the VIP may be made from the terminal 30 of a receptionist, an exhibitor, or the like. In this case, the authentication control unit 203 of the terminal 30 may receive information about the person guiding the person to be authenticated (VIP) from the server device 10 and display the received information about the person. The terminal 30 may display a screen as shown in FIG.
[0224] As described above, in the information processing system according to the fifth embodiment, when a VIP registered in advance in the server device 10 visits an exhibition or the like, a notice to that effect is sent to the person in charge of guiding the VIP, thereby improving the efficiency of the VIP guidance work.
[0225] Next, the hardware of each device constituting the information processing system will be described. Fig. 29 is a diagram showing an example of the hardware configuration of the terminal 30.
[0226] The terminal 30 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 29. For example, the terminal 30 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.
[0227] However, the configuration shown in Fig. 29 is not intended to limit the hardware configuration of the terminal 30. The terminal 30 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the terminal 30 is not intended to be limited to the example shown in Fig. 29, and for example, multiple processors 311 may be included in the terminal 30. Furthermore, the terminal 30 may be provided with a camera for photographing the person to be authenticated.
[0228] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).
[0229] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.
[0230] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a keyboard, a mouse, a touch panel, or the like that accepts user operations.
[0231] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).
[0232] The functions of the terminal 30 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by a semiconductor chip.
[0233] The server device 10 can also be configured by an information processing device, similar to the terminal 30, and its basic hardware configuration is no different from that of the terminal 30, so a description thereof will be omitted.
[0234] The terminal 30 is equipped with a computer, and functions of the terminal 30 can be realized by causing the computer to execute a program. The terminal 30 also executes a control method for the terminal 30 using the program. Similarly, the server device 10 is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 using the program.
[0235] [Modifications] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.
[0236] In the first embodiment, it has been described that the information processing system disclosed herein can be applied to various applications, including modified examples. It goes without saying that the information processing system disclosed herein can be applied to applications other than the applications described above. For example, the information processing system disclosed herein may be applied to security at commercial facilities.
[0237] In the above embodiment, a case has been described in which the authentication worker's work is supported by cooperation between the wearable camera 20 worn by the authentication worker and the terminal 30 carried by the authentication worker. The authentication worker may perform authentication work using a device such as a head-mounted display in which a camera and a terminal are integrated.
[0238] In the above embodiment, the terminal 30 notifies the authentication worker of information such as the successful authentication information by displaying the information on a display or the like. The terminal 30 may notify the authentication worker of information such as the successful authentication information by voice or the like. In this case, the terminal 30 may notify the authentication worker of the information by earphones, an alarm, or the like.
[0239] The server device 10 may store a so-called blacklist. For example, the server device 10 may store information on complainers who repeatedly make unreasonable requests to store clerks. If the server device 10 detects a complainer using biometric information received from the terminal 30 carried by the store clerk, the server device 10 may notify the store clerk of the detection. In this way, the information processing system disclosed herein can prevent customer harassment.
[0240] The server device 10 may store biometric information of the person who has failed authentication. The server device 10 may use the stored biometric information of the person who has failed authentication to prevent the authentication result (information about the person who has failed authentication) of the person who has failed authentication once from being repeatedly transmitted to the terminal 30.
[0241] In the above embodiment, the server device 10 stores information (biometric information, name, etc.) of the person to be authenticated for each day. However, the server device 10 may store information of the person to be authenticated for each day and time period. In this case, if the person to be authenticated visits the authentication location on an authorized day and in an authorized time period, the person to be authenticated is determined to have been successfully authenticated.
[0242] In the above embodiment, the case where the authentication target database is configured inside the server device 10 has been described, but the database may also be configured in an external database server or the like. That is, some of the functions of the server device 10 may be implemented in another device. More specifically, it is sufficient that the above-described "authentication unit (authentication means)" and the like are implemented in any of the devices included in the system.
[0243] The form of data transmission and reception between the devices (terminal 30, server device 10) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Biometric information and the like is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.
[0244] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the drawings can be changed to the extent that the content is not affected, such as by executing each process in parallel.
[0245] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.
[0246] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information processing system for authenticating a user.
[0247] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. [Supplementary Note 1] A terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; and an authentication control means for receiving an authentication result of the person to be authenticated and the number of the plurality of people to be authenticated from the server device, by storing biometric information of each of a plurality of people and transmitting the acquired biometric information to a server device that performs biometric authentication using the plurality of pieces of biometric information stored, and notifying the authentication worker of the number of the plurality of people to be authenticated, and, if the authentication result of the person to be authenticated is successful, updating the cumulative number of people who have been successfully authenticated by the server device and notifying the authentication worker of the updated number. [Supplementary Note 2] The terminal according to Supplementary Note 1, wherein, if the server device succeeds in authenticating the person to be authenticated, the authentication control means receives information about the successfully authenticated person from the server device, and displays at least a portion of the received information about the person to be authenticated. [Supplementary Note 3] The terminal according to Supplementary Note 2, wherein the authentication control means does not update the cumulative number of successfully authenticated persons when notified from the server device that the authentication of the person to be authenticated has already been successful. [Supplementary Note 4] The terminal according to Supplementary Note 3, wherein the authentication control means acquires from the server device an unauthenticated person list including information about unauthenticated persons who have not yet been authenticated among the plurality of persons to be authenticated, and displays information about the unauthenticated persons listed on the unauthenticated person list. [Supplementary Note 5] The terminal according to Supplementary Note 4, wherein the acquisition means acquires video data from the camera, and the authentication control means detects an unauthenticated person who has performed a predetermined action using the video data from among the unauthenticated persons listed on the unauthenticated person list, and requests the server device to re-authenticate the detected person to be authenticated. [Supplementary Note 6] The terminal according to any one of Supplements 1 to 5, wherein the authentication control means, when receiving from the server device information about a person guiding the person to be authenticated, displays the received information about the person in charge. [Supplementary Note 7] The terminal according to Supplementary Note 1, wherein the authentication control unit notifies the authentication worker of the total number of people detected within a predetermined space.[Supplementary Note 8] The terminal according to Supplementary Note 7, wherein the authentication control unit notifies the authentication worker of the number of face images extracted from image data captured within the predetermined space, or the number of people present in the predetermined space associated with information about the predetermined space, as the total number of people detected in the predetermined space. [Supplementary Note 9] A terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by the authentication worker; a list control means for acquiring a list including user IDs of multiple people to be authenticated from a management server; and an authentication control means for acquiring the user ID of the person to be authenticated by transmitting the acquired biometric information to an authentication server that stores the user IDs and biometric information of at least the multiple people to be authenticated and performs biometric authentication using the stored multiple pieces of biometric information, and determining that the authentication of the person to be authenticated has been successful if the user ID of the person to be authenticated is included in the list, updating the cumulative number of people who have been successfully authenticated and notifying the authentication worker of the update. [Supplementary Note 10] A terminal comprising: an acquisition means for acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; a list control means for acquiring from a management server a first list including the user ID of each of a plurality of persons to be authenticated; and an authentication control means for acquiring from a terminal carried by a representative of the predetermined space a second list consisting of the user ID and biometric information of each of a plurality of persons present in the predetermined space, specifying the user ID of the person to be authenticated by a matching process using the acquired biometric information and the biometric information included in the second list, determining that the authentication of the person to be authenticated is successful if the user ID of the specified person to be authenticated is included in the first list, updating the cumulative number of persons who have been successfully authenticated and notifying the authentication worker of the update. [Supplementary Note 11] A server device comprising: a receiving means for receiving biometric information of a person to be authenticated, acquired from a camera worn by an authentication worker, from a terminal connected to the camera; a storage means for storing the biometric information of each of a plurality of persons to be authenticated; and an authentication means for performing biometric authentication using the plurality of pieces of stored biometric information, wherein the authentication means transmits the authentication result of the person to be authenticated and the number of the plurality of persons to be authenticated to the terminal.[Supplementary Note 12] A terminal control method including: an acquisition step, in a terminal, of acquiring biometric information of a person to be authenticated from a camera worn by an authentication worker; and an authentication control step, in a terminal, of receiving an authentication result of the person to be authenticated and the number of the plurality of persons to be authenticated from the server device, by storing biometric information of each of a plurality of persons to be authenticated and transmitting the acquired biometric information to a server device that performs biometric authentication using the plurality of pieces of biometric information stored, and notifying the authentication worker of the number of the plurality of persons to be authenticated, and, if the authentication result of the person to be authenticated is successful, updating a cumulative number of persons who have been successfully authenticated by the server device and notifying the authentication worker of the updated number. [Supplementary Note 13] The terminal control method according to Supplementary Note 12, wherein the authentication control step, if the server device succeeds in authenticating the person to be authenticated, receives information about the successfully authenticated person from the server device, and displays at least a part of the received information about the person to be authenticated. [Supplementary Note 14] The terminal control method according to Supplementary Note 13, wherein the authentication control step does not update the cumulative number of successfully authenticated persons when notified from the server device that the authentication of the person to be authenticated has already been successful. [Supplementary Note 15] The terminal control method according to Supplementary Note 14, wherein the authentication control step acquires from the server device an unauthenticated person list including information about unauthenticated persons who have not yet been authenticated among the multiple persons to be authenticated, and displays information about the unauthenticated persons listed on the unauthenticated person list. [Supplementary Note 16] The terminal control method according to Supplementary Note 15, wherein the acquisition step acquires video data from the camera, and the authentication control step detects an unauthenticated person who has performed a predetermined action using the video data from among the unauthenticated persons listed on the unauthenticated person list, and requests the server device to re-authenticate the detected person to be authenticated. [Supplementary Note 17] The terminal control method according to any one of Supplements 12 to 16, wherein the authentication control step, when receiving from the server device information about a person in charge guiding the person to be authenticated, displays the received information about the person in charge. [Supplementary Note 18] The terminal control method according to Supplementary Note 12, wherein the authentication control step notifies the authentication worker of the total number of people detected within a predetermined space.[Supplementary Note 19] The control method for a terminal according to Supplementary Note 18, wherein the authentication control step notifies the authentication worker of the number of face images extracted from image data captured within the predetermined space, or the number of people present in the predetermined space associated with information about the predetermined space, as the total number of people detected in the predetermined space. [Supplementary Note 20] A computer-readable storage medium storing a program for causing a computer mounted on the terminal to execute the following: an acquisition process for acquiring biometric information of a person to be authenticated from a camera worn by the authentication worker; and an authentication control process for receiving an authentication result of the person to be authenticated and the number of the plurality of people to be authenticated from the server device, which stores biometric information of each of a plurality of people and transmits the acquired biometric information to a server device that stores biometric information of each of a plurality of people and performs biometric authentication using the stored biometric information, thereby notifying the authentication worker of the number of the plurality of people to be authenticated, and if the authentication result of the person to be authenticated is successful, updating the cumulative number of people who have been successfully authenticated by the server device and notifying the authentication worker of the updated number. [Supplementary Note 21] The storage medium of Supplementary Note 20, wherein the authentication control process, when the server device successfully authenticates the authenticated person, receives information about the successfully authenticated person from the server device and displays at least a portion of the received information about the authenticated person. [Supplementary Note 22] The storage medium of Supplementary Note 21, wherein the authentication control process, when notified by the server device that the authentication of the authenticated person has already been successful, does not update the cumulative number of successfully authenticated persons. [Supplementary Note 23] The storage medium of Supplementary Note 22, wherein the authentication control process, when notified by the server device that the authentication of the authenticated person has already been successful, acquires from the server device an unauthenticated person list including information about unauthenticated persons among the multiple authentication targets who have not yet been authenticated, and displays information about the unauthenticated persons listed in the unauthenticated person list. [Supplementary Note 24] The storage medium of Supplementary Note 23, wherein the acquisition process acquires video data from the camera, and the authentication control process, when notifying the unauthenticated persons listed in the unauthenticated person list who have performed a predetermined action using the video data, and requests the server device to re-authenticate the detected authenticated person.[Supplementary Note 25] The storage medium according to any one of Supplements 20 to 24, wherein, when information about a person in charge guiding the person to be authenticated is received from the server device, the authentication control process displays the received information about the person in charge. [Supplementary Note 26] The storage medium according to Supplementary Note 20, wherein the authentication control process notifies the authentication worker of the total number of people detected in a predetermined space. [Supplementary Note 27] The storage medium according to Supplementary Note 26, wherein the authentication control process notifies the authentication worker of the number of face images extracted from image data captured within the predetermined space, or the number of people present in the predetermined space associated with information about the predetermined space, as the total number of people detected in the predetermined space.
[0248] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof.
[0249] REFERENCE SIGNS LIST 10 Server device 11 Management server 12 Authentication server 20 Wearable camera 30 Terminal 40 Microbus 50 Representative terminal 60 Person in charge terminal 100 Terminal 101 Acquisition means 102 Authentication control means 201 Communication control unit 202 Biometric information acquisition unit 203 Authentication control unit 204 Storage unit 211 Communication control unit 212 Biometric information acquisition unit 213 Authentication control unit 214 List control unit 215 Storage unit 301 Communication control unit 302 Registration control unit 303 Authentication unit 304 Storage unit 311 Processor 312 Memory 313 Input / output interface 314 Communication interface 321 Communication control unit 322 Registration control unit 323 List control unit 324 Storage unit 331 Communication control unit 332 Registration control unit 333 Authentication unit 334 Storage unit
Claims
1. A means of acquiring biometric information of the person being authenticated from a camera attached to the authentication worker, Authentication control means that stores the biometric information of multiple individuals to be authenticated, and transmits the acquired biometric information to a server device that performs biometric authentication using the stored biometric information, thereby receiving the authentication result of the person to be authenticated and the number of the multiple individuals to be authenticated from the server device, notifying the authentication operator of the number of the multiple individuals to be authenticated, and if the authentication result of the person to be authenticated is successful, updating the cumulative number of successful authentications determined by the server device and notifying the authentication operator, A terminal equipped with the following features.
2. The authentication control means is The terminal according to claim 1, wherein if the server device successfully authenticates the person to be authenticated, the terminal receives information about the authenticated person from the server device and displays at least some of the information about the authenticated person that was received.
3. The authentication control means is The terminal according to claim 2, which, when it receives notification from the server device that the authentication of the person to be authenticated has already been successful, does not update the cumulative number of people who have been successfully authenticated.
4. The authentication control means obtains an unauthenticated person list from the server device, which includes information about unauthenticated persons among the multiple persons to be authenticated whose authentication has not been completed. The terminal according to claim 3, which displays information about an unauthenticated person listed in the unauthenticated person list.
5. The acquisition means acquires video data from the camera, The terminal according to claim 4, wherein the authentication control means detects an authenticated person who has performed a predetermined action using the video data from among the unauthenticated persons listed in the unauthenticated persons list, and requests the server device to re-authenticate the detected authenticated person.
6. A means of acquiring biometric information of the person being authenticated from a camera attached to the authentication worker, A list control means that retrieves a list containing the user IDs of multiple authenticated individuals from a management server, Authentication control means that stores the user IDs and biometric information of at least the multiple persons to be authenticated, and transmits the acquired biometric information to an authentication server that performs biometric authentication using the multiple stored biometric information to obtain the user ID of the person being authenticated, determines that the authentication of the person being authenticated has been successful if the user ID of the person being authenticated is included in the list, updates the cumulative number of people whose authentication has been determined to be successful and notifies the authentication operator, A terminal equipped with the following features.
7. A means of acquiring biometric information of the person being authenticated from a camera attached to the authentication worker, A list control means that obtains a first list containing the user IDs of multiple authenticated individuals from a management server, Authentication control means that obtains a second list consisting of the user IDs and biometric information of multiple persons present in a predetermined space from a terminal held by a representative of the predetermined space, identifies the user ID of the person to be authenticated by matching the obtained biometric information with the biometric information included in the second list, determines that the authentication of the person to be authenticated has been successful if the identified user ID of the person to be authenticated is included in the first list, updates the cumulative number of people whose authentication has been determined to be successful and notifies the authentication operator, A terminal equipped with the following features.
8. A receiving means that receives biometric information of the person being authenticated, acquired from a camera attached to the authentication worker, from a terminal connected to the camera, A storage means for storing the biometric information of multiple individuals to be authenticated, An authentication means that performs biometric authentication using the multiple biometric pieces of information stored, Equipped with, The authentication means is a server device that transmits the authentication result of the person to be authenticated and the number of the multiple persons to be authenticated to the terminal.
9. On the device, The acquisition process involves obtaining the biometric information of the person being authenticated from a camera attached to the authentication worker, and Authentication control step: Stores the biometric information of multiple individuals to be authenticated, transmits the acquired biometric information to a server device that performs biometric authentication using the stored biometric information, receives the authentication result of the person to be authenticated and the number of the multiple individuals to be authenticated from the server device, notifies the authentication worker of the number of the multiple individuals to be authenticated, and if the authentication result of the person to be authenticated is successful, updates the cumulative number of successful authentications determined by the server device and notifies the authentication worker; A method for controlling a terminal, including the control of the terminal.
10. On the computer installed in the terminal, The acquisition process involves obtaining the biometric information of the person being authenticated from a camera attached to the authentication worker, and Authentication control processing includes storing the biometric information of multiple individuals to be authenticated, transmitting the acquired biometric information to a server device that performs biometric authentication using the stored biometric information, receiving the authentication result of the person being authenticated and the number of individuals to be authenticated from the server device, notifying the authentication operator of the number of individuals to be authenticated, and, if the authentication result of the person being authenticated is successful, updating the cumulative number of successful authentications determined by the server device and notifying the authentication operator. A program to execute.