Information processing system, information processing method, and information processing program

Abstract

To efficiently manage the entry and exit of visitors by simple entrance / exit authentication and registration using communication terminal carried by the visitors.SOLUTION: An information processing system includes: an information acquisition unit that acquires, from a communication terminal that has captured an entering / exiting person, location and time information of a communication terminal associated with each other and facial information of the entering / exiting person; a recording unit that records the entry / exit record of the entering / exiting person by associating the location and the time information with the entering / exiting person based on the result of performing facial recognition using the facial information; and an output unit that outputs the entry / exit record to a terminal different from the communication terminal.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] In the above technical field, Patent Document 1 discloses a technology for authenticating the entry and exit of people by comparing pre-registered facial image data with facial image data of people obtained by a facial recognition device installed at the gate of a construction site. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-058015 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in the above document requires a face recognition device to be installed at the gate of the construction site, making it impossible to efficiently manage the entry and exit of people entering and leaving the site.

[0005] An object of the present invention is to provide a technique for solving the above-mentioned problems. [Means for solving the problem]

[0006] In order to achieve the above object, the system according to the present invention comprises: an information acquisition unit that acquires, from a communication terminal that has captured an image of a person entering or leaving the venue, position and time information of the communication terminal and face information of the person entering or leaving the venue, the position and time information being associated with each other; a recording unit that records the location and the time information as a record of the entry and exit of the person based on a result of execution of face authentication using the face information, in association with the person; an output unit that outputs the entry / exit record to a terminal different from the communication terminal; It is an information processing system equipped with the above.

[0007] In order to achieve the above object, the method according to the present invention comprises: acquiring, from the communication terminals that have captured the images of the people entering and leaving the venue, location and time information of the communication terminals that are associated with each other, and face information of the people entering and leaving the venue; based on a result of performing face authentication based on the face information, record the location and the time information as a record of the entry and exit of the person entering and exiting the venue in association with the person; The information processing method further comprises outputting the entry and exit records to a terminal different from the communication terminal.

[0008] In order to achieve the above object, the program according to the present invention comprises: A process of acquiring, from a communication terminal that has captured an image of a person entering or leaving the venue, location and time information of the communication terminal and face information of the person entering or leaving the venue, which are associated with each other; a process of recording the location and the time information associating with the entering / exiting person as a record of the entering / exiting person based on a result of performing face authentication based on the face information; A process of outputting the entry and exit record to a terminal different from the communication terminal; It is a program that causes a computer to execute the above. Effect of the Invention

[0009] According to the present invention, the entrance and exit of people entering and leaving a venue can be efficiently managed by simple authentication and registration of the entrance and exit using a communication terminal carried by the people entering and leaving the venue. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first embodiment of the present invention. [Figure 2A] FIG. 11 is a diagram showing an outline of the operation of an entrance / exit management system including an information processing device according to a second embodiment of the present invention. [Figure 2B] FIG. 11 is a diagram showing an outline of an operation of a communication terminal that communicates with an information processing device according to a second embodiment of the present invention. [Figure 2C] FIG. 11 is a diagram showing on-site information based on a QR code (registered trademark) and location information based on a GPS according to a second embodiment of the present invention. [Figure 2D] FIG. 11 is a diagram illustrating an outline of an operation of an administrator terminal that communicates with an information processing device according to the second embodiment of the present invention. [Diagram 3] FIG. 11 is a block diagram showing a configuration of an entrance / exit management system including an information processing device according to a second embodiment of the present invention. [Figure 4A] FIG. 11 is a sequence diagram showing a registration procedure of an entrance / exit management system including an information processing device according to a second embodiment of the present invention. [Figure 4B] FIG. 11 is a sequence diagram showing an entrance / exit management procedure of an entrance / exit management system including an information processing device according to a second embodiment of the present invention. [Diagram 5] FIG. 11 is a block diagram showing a functional configuration of an information processing device according to a second embodiment of the present invention. [Figure 6A] FIG. 11 is a diagram showing a configuration of a site information database according to a second embodiment of the present invention. [Figure 6B] FIG. 11 is a diagram showing the configuration of a worker face image database according to the second embodiment of the present invention. [Figure 6C] FIG. 11 is a diagram showing a configuration of a worker entrance / exit database according to the second embodiment of the present invention. [Figure 6D] FIG. 11 is a diagram showing the configuration of a viewing / report template according to the second embodiment of the present invention. [Figure 7A] FIG. 11 is a diagram showing the configuration of a face image authentication table according to the second embodiment of the present invention. [Figure 7B] FIG. 11 is a diagram showing a configuration of a position information authentication table according to the second embodiment of the present invention. [Figure 8] FIG. 11 is a block diagram showing a hardware configuration of an information processing device according to a second embodiment of the present invention. [Figure 9] 10 is a flowchart showing a processing procedure of an information processing device according to a second embodiment of the present invention. [Figure 10] FIG. 11 is a block diagram showing a functional configuration of a communication terminal according to a second embodiment of the present invention. [Figure 11] FIG. 11 is a diagram showing a configuration of a site information table according to the second embodiment of the present invention. [Figure 12] FIG. 11 is a block diagram showing a hardware configuration of a communication terminal according to a second embodiment of the present invention. [Figure 13] 10 is a flowchart showing a processing procedure of a communication terminal according to a second embodiment of the present invention. [Figure 14] FIG. 11 is a block diagram showing a functional configuration of an administrator terminal according to the second embodiment of the present invention. [Figure 15] 10 is a flowchart showing a processing procedure of an administrator terminal according to the second embodiment of the present invention. [Figure 16] FIG. 13 is a diagram showing an outline of an operation of liveness check in a communication terminal communicating with an information processing device according to the third embodiment of the present invention. [Figure 17] FIG. 13 is a diagram showing the configuration of a face image authentication table according to the third embodiment of the present invention. [Figure 18] 13 is a flowchart showing a processing procedure of an information processing device according to a third embodiment of the present invention. [Figure 19A] FIG. 13 is a diagram showing an outline of an operation of simultaneous imaging during face image registration in an administrator terminal that communicates with an information processing device according to a fourth embodiment of the present invention. [Figure 19B] FIG. 13 is a diagram showing an outline of an operation of simultaneous imaging at the time of entrance / exit registration in an administrator terminal communicating with an information processing device according to a fourth embodiment of the present invention. [Figure 20A] FIG. 13 is a sequence diagram showing a registration procedure of an entrance / exit management system including an information processing device according to a fourth embodiment of the present invention. [Figure 20B] FIG. 13 is a sequence diagram showing an entrance / exit management procedure of an entrance / exit management system including an information processing device according to a fourth embodiment of the present invention. [Figure 21] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a fourth embodiment of the present invention. [Figure 22] 13 is a flowchart showing a processing procedure of an information processing device according to a fourth embodiment of the present invention. [Figure 23]FIG. 13 is a sequence diagram showing an entrance / exit management procedure including deletion of site information in an entrance / exit management system including an information processing device according to a fifth embodiment of the present invention. [Figure 24] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a fifth embodiment of the present invention. [Diagram 25] 13 is a flowchart showing a processing procedure of an information processing device according to the fifth embodiment of the present invention. [Figure 26] FIG. 13 is a sequence diagram showing an entrance / exit management procedure including deletion of site information in an entrance / exit management system including an information processing device according to a sixth embodiment of the present invention. [Figure 27] FIG. 13 is a block diagram showing a functional configuration of a communication terminal according to a sixth embodiment of the present invention. [Figure 28] 13 is a flowchart showing a processing procedure of a communication terminal according to the sixth embodiment of the present invention. [Figure 29] FIG. 23 is a diagram showing the configuration of a worker entrance / exit database according to the seventh embodiment of the present invention. [Diagram 30] 13 is a flowchart showing a processing procedure of an information processing device according to the seventh embodiment of the present invention. [Diagram 31] FIG. 13 is a block diagram showing a configuration of an entrance / exit management system including an information processing device according to an eighth embodiment of the present invention. [Diagram 32] FIG. 23 is a sequence diagram showing a registration procedure of an entrance / exit management system including an information processing device according to the eighth embodiment of the present invention. [Diagram 33] FIG. 13 is a diagram showing an outline of the operation of a site management system including an information processing device according to a ninth embodiment of the present invention. [Diagram 34] FIG. 13 is a diagram showing a configuration of a site management database according to the ninth embodiment of the present invention. [Diagram 35] FIG. 16 is a block diagram showing the configuration of an entrance / exit management system including an information processing device according to a tenth embodiment of the present invention. [Diagram 36] FIG. 23 is a sequence diagram showing the operation procedure of an entrance / exit management system including an information processing device according to a tenth embodiment of the present invention. [Figure 37]FIG. 23 is a block diagram showing the functional configuration of an information processing device according to a tenth embodiment of the present invention. [Figure 38] FIG. 23 is a diagram showing a configuration of a position information authentication table according to the tenth embodiment of the present invention. [Figure 39] 23 is a flowchart showing a processing procedure of an information processing device according to a tenth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. However, the components described in the following embodiment are merely examples, and are not intended to limit the technical scope of the present invention.

[0012] [First embodiment] An information processing device 100 according to a first embodiment of the present invention will be described with reference to Fig. 1. The information processing device 100 is a device that manages the entrance and exit of users.

[0013] As shown in FIG. 1, the information processing device 100 includes a face information registration unit 101, an information acquisition unit 102, a user authentication unit 103, and an entrance / exit recording unit 104. The face information registration unit 101 registers face information of a user who enters or exits a predetermined location as face information of a registered user in association with the location. The information acquisition unit 102 acquires, from the communication terminal 110, location information of the communication terminal 110, face information of an application user who applies for entry or exit from the location, and application information for entry or exit. The user authentication unit 103 performs user authentication by comparing the face information of the application user acquired from the communication terminal 110 by the information acquisition unit 102 with the face information of the registered user registered in the face information registration unit 101. When the user authentication is successful, the entrance / exit recording unit 104 records the entry or exit of the application user from the location corresponding to the location information.

[0014] According to this embodiment, the entry and exit of persons entering and exiting a venue can be efficiently managed through simple authentication and registration of entry and exit using the communication terminal carried by the persons entering and exiting the venue using the communication terminal's location information and facial recognition.

[0015] [Second embodiment] Next, an information processing device according to a second embodiment of the present invention will be described. The information processing device according to this embodiment is provided as a cloud server, and performs management processing by undertaking various entrance and exit management. In this embodiment, time information is further acquired from the communication terminal, and the entrance time or exit time of the applying user is recorded based on the time information. Also, in this embodiment, face information associated with a place corresponding to the position information of the communication terminal is searched from the registered face information, and is compared with the face information of the applying user for authentication. Furthermore, in this embodiment, during user authentication, the position information of the communication terminal is further compared with the position information of the place to authenticate the position information. Also, in this embodiment, during registration of face information, a place identification code for the communication terminal to acquire and hold the place is issued, and the place acquired and held by the communication terminal from the position identification code and the face information of the user captured by the communication terminal are received, and the face information of the user is registered in association with the place. In this case, the position information of the communication terminal, the face information of the applying user, and the application information are acquired from the communication terminal that holds the place.

[0016] In this embodiment, in response to a viewing request, a record of entry or exit from a location is provided to the source of the viewing request in a predetermined format, or in response to a report request, a report of entry or exit of the applicant user is created using the history information of entry or exit from a location.

[0017] 《Entrance / Exit Management System》 Hereinafter, an outline of the entrance / exit management system including an information processing device as a cloud server of this embodiment will be described with reference to FIGS. 2A to 4B.

[0018] (System operation overview) Fig. 2A is a diagram showing an outline of the operation of the entrance / exit management system 200 including the information processing device 210 according to this embodiment. Note that Fig. 2A is an image of the outline of the operation, and the details will be described later.

[0019] 2A, an entrance / exit management system 200 manages the entrance / exit of workers who are users of this system by connecting a construction site 201 and a site office 204. A communication terminal 220 of a worker used at the construction site 201, a manager terminal 230, and a prime contractor manager terminal 240 arranged at the site office 204 are communicatively connected to an information processing device (cloud server) 210 to manage the entrance / exit of workers.

[0020] In the entry and exit registration 202 of the construction site 201, position information from the GPS, a facial image, and time information are sent from the worker's communication terminal 220 to the information processing device 210, and identity authentication is performed using the facial image in the information processing device 210. If the facial authentication is successful, the entry and exit times of the worker at the construction site are registered.

[0021] In addition, in the site work management 203 of the construction site 201, a list of workers' entry and exit statuses and the qualifications and licenses of workers can be viewed on the manager's terminal 230, making it easy for the site work manager to check the work.

[0022] In addition, in the entry / exit file output 205 of the site office 204, the prime contractor manager terminal 240 requests the information processing device 210 to create documents to be submitted regarding the entry / exit history of workers, and outputs the files in a CSV (Comma Separated Value) format with quick and simple operations, which can be used for creating various reports and for checking documents submitted by cooperating companies 206.

[0023] (Overview of communication terminal operation) FIG. 2B is a diagram showing an outline of the operation of the communication terminal 220 that communicates with the information processing device 210 according to this embodiment.

[0024] The upper part of FIG. 2B shows the transition of the display screen of the communication terminal 220 in the process of registering the face image of the worker associated with the site information. The display screen 221 of the communication terminal 220 shows a state in which an entrance / exit management application is started. The display screen 222 of the communication terminal 220 shows a state in which the entrance / exit management application reads a QR (Quick Response) code (registered trademark) 207 generated from the site information to restore the site information, and the site name is displayed. The display screen 223 of the communication terminal 220 shows a state in which an image of the worker whose face image is to be registered is captured, and a face image extracted from the image is transmitted to the information processing device 210. The site information and position information are also transmitted together with the face image. The display screen 223 of the communication terminal 220 is a screen that notifies the user that the face image of the worker has been registered in association with the site information.

[0025] The lower part of FIG. 2B shows the transition of the display screen of the communication terminal 220 in the entry / exit registration process for performing face authentication and position confirmation of the worker when entering and exiting the site. The display screen 225 of the communication terminal 220 shows a state in which the entry / exit management application is started. The display screen 226 of the communication terminal 220 is a screen in which the site name from the site information already held at the time of registering the face image is displayed by the entry / exit management application, and entry / exit is selected. In FIG. 2B, entry is selected. The display screen 227 of the communication terminal 220 shows a state in which an image of a worker who is registering entry and exit to the site is captured, and a face image extracted from the image is transmitted to the information processing device 210. In addition to the face image, application information, position information of the communication terminal 220, and time information are also transmitted. The display screen 228 of the communication terminal 220 is a screen informing that the face authentication and position confirmation of the worker have been completed and the entry and exit of the site has been registered.

[0026] (Site and location information) FIG. 2C is a diagram showing on-site information by a QR code (registered trademark) 207 and location information by GPS according to this embodiment.

[0027] In this embodiment, the site information 208 included in the QR code (registered trademark) 207 includes a server access key and location information. The site information 208 included in the QR code (registered trademark) 207 also includes, as the location information of the site, a location name, a location ID, a longitude of the site center, a latitude of the site center, and a radius from the site center.

[0028] 2C shows an authentication relationship 209 between the site information and the location information of the communication terminal 220. Whether the location information acquired by GPS indicates the site information is determined based on whether the location information is within the site range of a circle indicated by a dashed line having a radius centered on the latitude and longitude. If the location information is within the site range, it is considered that the location information is authenticated.

[0029] The site information 208 is not limited to that shown in FIG. 2C. For example, the site range may be set by a rectangle, or a more accurate site range may be set by using information on more inflection points. However, this is subject to limitations in response to the process of notifying the communication terminal 220 of the site information.

[0030] (Overview of administrator terminal operation) 2D is a diagram showing an outline of the operation of the administrator terminal 230 / 240 that communicates with the information processing device 210 according to this embodiment. Note that Fig. 2D shows screen transitions in viewing and report creation on the administrator terminal 230 / 240.

[0031] A screen 231 is a login screen for the entrance / exit management application of this embodiment. Once logged in, the screen transitions to a site selection screen of screen 232. When a specific site is selected on screen 232, the screen transitions to each of the following viewing screens and report screens for the target site.

[0032] Screen 233 is a screen showing the current entry status of workers at the target site. Screen 234 is a screen displaying a list of the status of workers at the target site, created from the entry and exit registration of workers. Screen 235 is a screen displaying a list of attributes such as the status and qualifications of workers. When a worker is selected on screen 235, detailed information about the worker is displayed as screen 236, and the worker information can be corrected, changed, deleted, or added. Screen 237 is a screen for outputting CSV data that has been viewed or reported to another system. Screen 238 is a screen for changing passwords, etc., which is accessed from screen 233.

[0033] (System Configuration) FIG. 3 is a block diagram showing the configuration of an entrance / exit management system 200 including an information processing device 210 according to this embodiment.

[0034] The entrance / exit management system 200 comprises an information processing device 210, a manager terminal 230 disposed at each site 301-30n, a communication terminal 220 carried by a worker, and a prime contractor manager terminal 240 for managing the entire work, all of which are connected via a network 350.

[0035] The information processing device 210 has an entrance / exit management database 311, and registers the entrance / exit times of workers carrying the communication terminal 220 to the sites 301-30n to manage the entrance / exit of the workers. The manager terminal 230 is used by the site manager to manage the work at each site 301-30n. The manager terminal 230 is also used to view the work status and entrance / exit status of each site 301-30n and to create a work report for each site 301-30n. The prime contractor manager terminal 240 is also used to manage each site 301-30n in total, to view the work status and entrance / exit status of the entire site 301-30n, and to create a work report for the entire site 301-30n.

[0036] (Operation sequence) FIG. 4A is a sequence diagram showing a registration procedure of the entrance / exit management system 200 including the information processing device 210 according to this embodiment.

[0037] In step S401, the information processing device 210 provides an appropriate entrance / exit management application to each of the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240 in response to a download request for the entrance / exit management application from each of them. In steps S403, S405, and S407, the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240 start up the entrance / exit management application.

[0038] In step S409, the manager terminal 230 of each site requests and acquires a QR code (registered trademark) as a location identification code that encodes the site information and is used when registering the face images of workers who have participated in the new entrant training. In step S411, in response to the request for the QR code (registered trademark), the information processing device 210 acquires the corresponding site information, generates a QR code (registered trademark), and transmits it, thereby issuing the QR code (registered trademark).

[0039] Step S413 is a facial image registration process of this embodiment. Such facial image registration process is usually preferably performed at the time of new entrant education. In step S431, the manager terminal 230 displays a QR code (registered trademark) on the display screen or prints it. In step S433, each communication terminal 220 reads the displayed QR code (registered trademark) or the printed QR code (registered trademark). In step S435, each communication terminal 220 analyzes the acquired QR code (registered trademark) using an entrance / exit management application to extract site information and retain it in the entrance / exit management application.

[0040] When the site information is acquired from the QR code (registered trademark), in step S437, each communication terminal 220 captures an image of the worker and acquires the position information of the communication terminal 220 using a Global Positioning System (GPS) or the like. In step S439, each communication terminal 220 transmits the face image of the worker associated with the site information and the position information to the manager terminal 230.

[0041] The manager terminal 230 collects face images of the workers who participated in the new entrant education, and in step S440, transmits the face images, position information, and worker information of the workers associated with the site information to the information processing device 210 all at once. In step S441, the information processing device 210 associates the face images, position information, and worker information of the workers received from the manager terminal 230 with the site information and stores them in the entrance / exit management database 311. In step S443, the information processing device 210 notifies the manager terminal 230 and each communication terminal 220 that the registration of the face images has been completed. In step S445, the manager terminal 230 and each communication terminal 220 notify the site manager and each worker that the registration of the face images has been completed. Note that, although the position information is registered in this example, the position information is also used to record the participation in the new entrant education, and is not essential information for the registration process of the workers.

[0042] FIG. 4B is a sequence diagram showing the entrance / exit management procedure of the entrance / exit management system 200 including the information processing device 210 according to this embodiment.

[0043] Step S415 is the entry / exit registration process of this embodiment. The entry / exit registration process is performed when the worker enters and exits the work site. Since the entry and exit processes are similar, only the entry registration is shown in FIG. 4B. In step S451, each communication terminal 220 starts an entry / exit management application. In step S453, the entry / exit management application of each communication terminal 220 displays the work site information previously stored at the time of face image registration, and allows the user to select if there are multiple pieces of information. In step S455, the entry / exit management application of each communication terminal 220 acquires location information (GPS) and the current time. In step S457, the entry / exit management application of each communication terminal 220 captures an image of the worker. Then, in step S461, the entry / exit management application of each communication terminal 220 transmits the acquired location information, the face image of the worker, and the time to the information processing device 210.

[0044] In step S463, the information processing device 210 searches the face image database for a face image associated with the site information corresponding to the position information received from each communication terminal 220. Then, in step S465, the information processing device 210 performs authentication by collating the face information received from each communication terminal 220 with the face image searched from the face image database. If the authentication is successful, in step S467, the information processing device 210 registers the site entry of the authenticated worker in the entrance / exit management database 311 based on the location and the entry time. Then, in step S468, the information processing device 210 transmits an entrance registration completion notification to the communication terminal 220 that has made the entrance application. In step S469, the communication terminal 220 that has made the entrance application notifies the received entrance registration completion. Note that, if the entrance / exit management application of the communication terminal 220 has a function of converting position information into site information, the converted site information may be transmitted instead of the position information to perform the entrance / exit registration.

[0045] Step S417 is the viewing process or report creation process of this embodiment. Such viewing process or report creation process is performed as needed by a request from each manager terminal 230 or the prime contractor manager terminal 240. Note that viewing and report creation are similar processes except for the template that determines the format, so they are explained together in FIG. 4B. Each manager terminal 230 requests the information processing device 210 to display a screen to be viewed or create a report in step S471, or the prime contractor manager terminal 240 requests the information processing device 210 to display a screen to be viewed or create a report in step S471. In step S475, the information processing device 210 generates a screen to be viewed or a report using a template prepared in advance in accordance with the request. Then, in step S477, the information processing device 210 transmits the generated screen to be viewed or report to the requester as information provided to each manager terminal 230 or the prime contractor manager terminal 240. In step S479, each manager terminal 230, or in step S481, the prime contractor manager terminal 240 outputs (displays or prints) the received viewing screen or report creation.

[0046] <Functional configuration of information processing device> FIG. 5 is a block diagram showing the functional configuration of an information processing device 210 according to this embodiment.

[0047] The information processing device 210 includes a communication control unit 501, an application providing unit 502, a QR code (registered trademark) generating unit 503, a QR code (registered trademark) transmitting unit 504, a registration face image receiving unit 505, a face image registration unit 506, and a face image registration completion notifying unit 507. The information processing device 210 also includes a face image matching unit 508, a site / position matching unit 509, an entrance / exit face image receiving unit 510, an authentication unit 511, an entrance / exit registration unit 512, and an entrance / exit registration completion notifying unit 513. The information processing device 210 also includes a viewing / report creation request receiving unit 514, a viewing screen / report generating unit 515, a viewing image / report transmitting unit 516, and an entrance / exit management database 311.

[0048] The communication control unit 501 controls communication between the information processing device 210 and the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240 via the network 350. The application providing unit 502 provides the corresponding entrance and exit management application in response to download requests from the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240.

[0049] The QR code (registered trademark) generating unit 503 generates a QR code (registered trademark) from the site information of each site acquired from the site information database 521 included in the entrance / exit management database 311. Then, the QR code (registered trademark) transmitting unit 504, as an issuing unit of the QR code (registered trademark), transmits the generated QR code (registered trademark) to the manager terminal 230 of each site corresponding to the site information. The registration face image receiving unit 505 receives the registration face image from the communication terminal 220 carried by the worker together with the site information and position information acquired from the QR code (registered trademark). The face image registering unit 506 registers the received registration face image and position information in the worker face image database 522 included in the entrance / exit management database 311 in association with the received site information. The received position information is also stored in the worker entrance / exit database 523 in association with the worker as new entrant training attendance. The face image registration completion notifying unit 507 notifies the administrator terminal 230 or the communication terminal 220 that is the source of the registration request that the registration of the face image for registration in the worker face image database 522 has been completed.

[0050] The entrance / exit face image receiving unit 510 receives the entrance / exit face image from the communication terminal 220 together with the position information of the communication terminal 220 and the current time information. The face image matching unit 508 has a face image authentication table 581, and matches the face image captured and received by the communication terminal 220 at the time of entrance / exit with the face image registered in the worker face image database 522 in advance. It is preferable that the face image to be matched, which is registered in the worker face image database 522, is searched for and matched with the face image registered in association with the site information corresponding to the position information from the communication terminal 220 (registered face image of the same site). The site / position matching unit 509 optionally checks whether the received position information is included in any site information registered in the site information database 521. In other words, if the received position information is not included in any site information registered in the site information database 521, it is determined that the worker carrying the communication terminal 220 is not at the appropriate site, and the entrance / exit is not authenticated. The authentication unit 511 authenticates the entry / exit application from the communication terminal 220 based on the matching result from the face image matching unit 508 and the matching result from the site / position matching unit 509. When the authentication unit 511 outputs a successful authentication, the entry / exit registration unit 512 registers the location information and time information of the worker as entry / exit registration information in the worker entry / exit database 523 in association with the worker. The entry / exit registration completion notification unit 513 notifies the communication terminal 220 that made the entry / exit application of the completion of registration of the entry / exit registration information in the worker entry / exit database 523.

[0051] The viewing / report creation request receiving unit 514 receives a viewing request or a report creation request from the manager terminal 230 and the prime contractor manager terminal 240. The viewing screen / report generating unit 515, as a viewing screen / report creating unit, acquires a template corresponding to the viewing request or report creation request from the viewing / report template storage unit 524 included in the entrance / exit management database 311, and generates a viewing screen or a report. The viewing image / report transmitting unit 516, as an information providing unit, transmits the generated viewing screen or report to the requesting manager terminal 230 or prime contractor manager terminal 240.

[0052] The entrance / exit management database 311 includes a site information database 521, a worker face image database 522, a worker entrance / exit database 523, and a viewing / report template storage unit 524. The site information database 521 registers site information of the site where work is currently being performed. The worker face image database 522 registers face images of workers in association with each piece of site information. The worker entrance / exit database 523 registers location information and time information of the worker as entrance / exit registration information in association with the worker. The viewing / report template storage unit 524 stores viewing templates and report templates in association with viewing requests and report creation requests.

[0053] (Site information database) Fig. 6A is a diagram showing the configuration of the site information database 521 according to this embodiment. The site information database 521 stores site information for generating a QR code (registered trademark) which is a location identification code. Note that the configuration of the site information database 521 is not limited to that shown in Fig. 6A.

[0054] The site information database 521 stores at least one contractor 613, work period 614, location information 615, and position information 616 in association with a site ID 611 and a site name 612. Here, the work period 614 includes a start date and an end date. The location information 615 is, for example, a site area represented by the longitude / latitude of a center position and a radius, and the position information 616 is, for example, the longitude / latitude of a center position.

[0055] (Worker face image database) Fig. 6B is a diagram showing the configuration of the worker face image database 522 according to this embodiment. The worker face image database 522 stores face images of workers registered in association with each piece of site information. Note that the configuration of the worker face image database 522 is not limited to that shown in Fig. 6B.

[0056] The worker face image database 522 stores a plurality of worker information 622 registered at the work site and face images 623 of the registered workers in association with work site information 621. Here, the work site information 621 includes the name of the work site and its location. The worker information 622 includes the worker's name, qualifications, license, attributes, and the like. The attributes include blood type in consideration of safety in relation to the work and in preparation for accidents. The worker's face image 623 also includes feature amount data that is advantageous for matching with the image data.

[0057] (Worker entry / exit database) Fig. 6C is a diagram showing the configuration of the worker entrance / exit database 523 according to this embodiment. The worker entrance / exit database 523 stores the entrance / exit information registered in association with the worker. Note that the configuration of the worker entrance / exit database 523 is not limited to that shown in Fig. 6C.

[0058] The worker entrance / exit database 523 stores a worker entrance / exit history 633 in association with a worker ID 631 and worker information 632. The worker entrance / exit history 633 includes the entrance / exit date and time, site information of the entry / exit, the entry / exit time, and the work content.

[0059] (Template storage for viewing / report) Fig. 6D is a diagram showing the configuration of viewing / report template storage unit 524 according to this embodiment. Viewing / report template storage unit 524 stores viewing templates and report templates corresponding to requests to view information stored in entrance / exit management database 311, in particular, worker entrance / exit information registered in worker entrance / exit database 523, or requests to create a report based thereon. Note that the configuration of viewing / report template storage unit 524 is not limited to that shown in Fig. 6D.

[0060] The viewing / report template storage unit 524 stores a plurality of viewing / report request sources 642 in association with the viewing / report screen IDs 641. Furthermore, the viewing / report request source 643 is stored in association with the viewing / report request sources 642. Then, the viewing / report template 644 is stored in association with the viewing / report contents 643.

[0061] (Facial image recognition table) 7A is a diagram showing the configuration of a face image authentication table 581 according to this embodiment. The face image authentication table 581 is used by the face image matching unit 508 to match the face image of the worker received from the communication terminal 220 at the time of entering or leaving the work site with the face image of the worker registered in advance in association with the work site information, and generate an authentication result of the face image.

[0062] The face image authentication table 581 stores an entrance / exit face image 711, a registered face image 712, a match degree 713 based on a comparison of these face images, a match degree threshold value 714 indicating whether authentication is successful or unsuccessful, and an authentication result 715.

[0063] (Location authentication table) 7B is a diagram showing the configuration of a position information authentication table 591 according to this embodiment. The position information authentication table 591 is used by the site / position collation unit 509 to determine whether or not the position information received from the communication terminal 220 at the time of entering or leaving the site is included in the site information of entry and exit, and to generate an authentication result of the position information.

[0064] The location information authentication table 591 stores entry / exit location information 721 acquired by the communication terminal 220 using GPS or the like, site information 722 including the site location information, a determination 723 as to whether the entry / exit location information 721 is included in the site information 722, and a location information authentication result 724.

[0065] <Hardware configuration of information processing device> FIG. 8 is a block diagram showing the hardware configuration of an information processing device 210 according to this embodiment.

[0066] In Fig. 8, a CPU (Central Processing Unit) 810 is a processor for arithmetic control, and realizes the functional components in Fig. 5 by executing a program. There may be one or more CPUs 810. A ROM (Read Only Memory) 820 stores fixed data and programs such as initial data and programs. A network interface 830 controls communication with the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240 via a network.

[0067] The RAM (Random Access Memory) 840 is a random access memory used by the CPU 810 as a work area for temporary storage. The RAM 840 has an area reserved for storing data necessary for implementing this embodiment. The site information 841 represented by a QR code (registered trademark) is a QR code (registered trademark) as a location identification code distributed to each site. The information received at the time of registration 842 is information received when a worker registers a face image from a communication terminal, and includes site information, position information, and face image information. The information received at the time of entry and exit 843 is information received when a worker registers entry and exit from a communication terminal, and includes position information, time information, and face image information. The registered face image information 844 is a face image that is registered in the worker face image database 522 in advance, and is authenticated against a face image received when registering entry and exit. The face image authentication table 581 is a table used for face image authentication shown in FIG. 7A. The position information authentication table 591 is a table used for position information authentication shown in FIG. 7B. Worker entrance / exit data (site, time) 845 is data that is registered in the worker entrance / exit database 523 when an entrance / exit application is approved. Viewing / report data 846 is data for a viewing screen or report generated in response to a viewing request or a report creation request. Transmission / reception data 847 is data that is transmitted / received to / from the communication terminal 220, the manager terminal 230, and the prime contractor manager terminal 240 via the network interface 830.

[0068] The storage 850 stores databases and various parameters used by the CPU 810, or the following data or programs required to realize this embodiment. The entrance / exit management database 311 stores data for entrance / exit management, including the site information database 521, the worker face image database 522, the worker entrance / exit database 523, and the viewing / report template storage unit 524 shown in Figs. 6A to 6D.

[0069] The storage 850 stores the following programs. An information processing program 851 is a program that controls the entire information processing device 210. A face image registration module 852 is a module for registering face images of workers in association with the site. An entry / exit registration module 853 is a module for registering the entry and exit of workers by face image authentication and position confirmation at the time of entry and exit to the site. A viewing / report control module 854 is a module that responds to a viewing request or a report creation request and provides a viewing screen or creates a report.

[0070] It should be noted that the RAM 840 and storage 850 in FIG. 8 do not include programs and data related to the general-purpose functions of the information processing device 210 as a cloud server or other feasible functions.

[0071] <<Processing Procedure of Information Processing Device>> 9 is a flowchart showing the processing procedure of the information processing device 210 according to this embodiment. This flowchart is executed by the CPU 810 in FIG. 8 using the RAM 640, and realizes the functional configuration units in FIG.

[0072] In step S911, the information processing device 210 determines whether or not a QR code (registered trademark) generated from on-site information is to be distributed. If it is determined that a QR code (registered trademark) is to be distributed, in step S913, the information processing device 210 acquires the on-site information from the on-site information database 521. In step S915, the information processing device 210 generates a QR code (registered trademark) based on the acquired on-site information. Then, the generated QR code (registered trademark) is transmitted to the manager terminal 230 of the target site.

[0073] If it is determined that the request is not for distribution of a QR code (registered trademark), the information processing device 210 determines in step S921 whether or not the request is for registration of a face image. If it is determined that the request is for registration of a face image, the information processing device 210 receives the site information, the face image of the registered worker, the worker information, and the location information from the communication terminal in step S923. Then, in step S925, the information processing device 210 registers the face image, creator information, and location information in the worker face image database 522 in association with the site information.

[0074] If it is determined that the request is not for distribution of a QR code (registered trademark) and not for registration of a face image, the information processing device 210 determines in step S931 whether or not the request is for registration of entrance / exit information. If it is determined that the request is for registration of entrance / exit information, the information processing device 210 receives position information, a face image of the applicant worker, and a current time from the communication terminal in step S933. In step S935, the information processing device 210 compares the registered face image with the application face image. Then, in step S937, the information processing device 210 determines whether or not face authentication has been successful. If it is determined that face authentication has failed, the processing ends without registering the entrance / exit information. If it is determined that face authentication has been successful, the information processing device 210 determines in step S939 whether or not position information is included in the site information as an option. If it is determined that position information is not included in the site information, the processing ends without registering the entrance / exit information. If it is determined that the location information is included in the site information, the information processing device 210 registers the entry and exit locations and times of the application worker in the worker entry and exit database 523 in step S941.

[0075] If it is determined that the request is not for distribution of a QR code (registered trademark), registration of a face image, or registration of entrance / exit information, the information processing device 210 determines in step S951 whether or not the request is for viewing or report creation. If it is determined that the request is for viewing or report creation, the information processing device 210 reads out a viewing template or a report template from the viewing / report template storage unit 524 in accordance with the viewing source and viewing content (report request source, report content) in step S953. In step S955, the information processing device 210 writes into the viewing template or report template based on the registered entrance / exit history. Then, in step S957, the information processing device 210 transmits the viewing screen (report) to the viewing source (request source).

[0076] <Functional configuration of communication terminal> FIG. 10 is a block diagram showing the functional configuration of a communication terminal 220 according to this embodiment.

[0077] The communication terminal 220 includes a communication control unit 1001, an input / output interface 1002, an application download unit 1003, and an application execution unit 1004. The communication control unit 1001 controls communication with the information processing device 210 via the network 350. The input / output interface 1002 interfaces with input / output devices. In this embodiment, as the input / output devices, a display unit 1021, an operation unit 1022, an audio input / output unit 1023, a GPS position calculation unit 1024, and an imaging unit 1025 are connected to the input / output interface 1002. The display unit 1021 and the operation unit 1022 may be touch panels. The application download unit 1003 downloads an entrance / exit management application for the communication terminal from the information processing device 210.

[0078] The application execution unit 1004 includes a QR code (registered trademark) extraction unit 1041, a QR code (registered trademark) analysis unit 1042, a site information storage unit 1044, a face image acquisition unit 1045, and a registration information transmission unit 1046. The application execution unit 1004 also includes a site information selection (setting) unit 1047, a position information acquisition unit 1048, a time information acquisition unit 1049, an entry / exit application information transmission unit 1050, an entry / exit authentication result reception unit 1051, and an entry / exit authentication result notification unit 1052.

[0079] The QR code (registered trademark) extraction unit 1041, as a location identification code acquisition unit, extracts a QR code (registered trademark) from an image captured by the imaging unit 1025. The QR code (registered trademark) analysis unit 1042 has a site information table 1043 that converts a QR code (registered trademark) into site information, and analyzes the extracted QR code (registered trademark) to restore the site information. The site information storage unit 1044, as a site location storage unit, stores the restored site information and holds it for the time of entry / exit registration application. When site information from the QR code (registered trademark) is newly held in the site information storage unit 1044, the face image acquisition unit 1045, as an operation control unit, acquires a face image from the image captured by the imaging unit 1025 as a possible operation thereafter, and sends it to the registration information transmission unit 1046. The registration information transmission unit 1046 transmits the registration information to the information processing device 210 in order to register the face image corresponding to the site information. The registration information includes the site information restored from the QR code (registered trademark), a face image of the worker to be registered, and the location information of the communication terminal 220.

[0080] In the case of entry / exit registration, the site information selection (setting) unit 1047 displays the site information stored in the site information storage unit 1044, and selects and sets it when there are multiple site information. When the site information selection (setting) unit 1047 sets the site information, the face image acquisition unit 1045 acquires a face image from the image captured by the imaging unit 1025 and sends it to the entry / exit application information transmission unit 1050. The position information acquisition unit 1048 acquires the position information of the communication terminal 220 calculated by the GPS position calculation unit 1024. The time information acquisition unit 1049 acquires the current time from a timer (not shown). The entry / exit application information transmission unit 1050 transmits application information for applying for entry / exit registration to the information processing device 210. The application information includes time information, a face image of the worker to be authenticated, and position information of the communication terminal 220.

[0081] The entry / exit authentication result receiving unit 1051, as an authentication result acquisition unit, receives the authentication result of the entry / exit application information in the information processing device 210. The entry / exit authentication result notifying unit 1052 notifies the authentication result of the received entry / exit application information from the display unit 1021 or the output unit of the audio input / output unit 1023. In the event of an authentication error, an alarm sound may be generated.

[0082] (Site information table) 11 is a diagram showing the configuration of a site information table 1043 according to this embodiment. The site information table 1043 is used by the QR code (registered trademark) analysis unit 1042 to acquire site information from a QR code (registered trademark).

[0083] The site information table 1043 stores a server access key 1112 and site information 1113 in association with a QR code (registered trademark) 1111. The site information 1113 includes the site name and latitude / longitude / radius as position information.

[0084] <Hardware configuration of communication terminal> FIG. 12 is a block diagram showing the hardware configuration of the communication terminal 220 according to this embodiment.

[0085] In Fig. 12, a CPU 1210 is a processor for arithmetic control, and executes a program to realize the functional components of Fig. 10. There may be one or more CPUs 1210. A ROM 1220 stores fixed data and programs, such as initial data and programs. A network interface 1230 controls communication with an information processing device 210 and an administrator terminal 230 via a network.

[0086] The RAM 1240 is a random access memory used by the CPU 1210 as a temporary storage work area. An area for storing data necessary for implementing this embodiment is secured in the RAM 1240. The site information table 1043 is a table for restoring site information from a read QR code (registered trademark) as shown in FIG. 11. The registered face image 1241 is a face image captured by the imaging unit 1025 when the face image is registered. The face image registration completion notice 1242 is a notice that the information processing device 210 has completed registration of a face image corresponding to the site information. The application position information 1243 is the position information of the communication terminal 220 transmitted to the information processing device 210 when applying for entry / exit registration. The application face image 1244 is a face image of the applying worker transmitted to the information processing device 210 when applying for entry / exit registration. The application time information 1245 is the current time transmitted to the information processing device 210 when applying for entry / exit registration. The entry / exit registration completion notification 1246 is a notification that the face authentication and the position confirmation have been successfully performed by the information processing device 210, and the entry / exit registration has been completed. The input / output data 1247 is data input / output to / from the input / output device via the input / output interface 1002. The transmission / reception data 1248 is data transmitted / received via the network interface 1230.

[0087] The storage 1250 stores a database and various parameters used by the CPU 1210, or the following data or programs required to realize this embodiment. The site information storage unit 1044 stores site information restored from a QR code (registered trademark) when a face image is registered.

[0088] The storage 1250 stores the following programs. A communication terminal control program 1251 is a program for controlling the entire communication terminal 220. A site information acquisition module 1252 is a module for reading a QR code (registered trademark), restoring site information, and storing the site information in the site information storage unit 1044. A face image registration module 1253 is a module for registering a face image in the information processing device 210 in association with the site information. An entry / exit registration module 1254 is a module for registering entry / exit by face authentication and position confirmation in the information processing device 210 at the time of entry / exit.

[0089] The input / output interface 1002 functions as an interface for controlling data input / output with input / output devices. In this embodiment, the input / output interface 1002 is connected to a display unit 1021, an operation unit 1022, a voice input / output unit 1023, a GPS position calculation unit 1024, an imaging unit 1025, and the like.

[0090] It should be noted that the RAM 1240 and storage 1250 in FIG. 12 do not show programs and data related to the general-purpose functions of the communication terminal 220 or other feasible functions.

[0091] <<Processing procedure of communication terminal>> 13 is a flowchart showing the processing procedure of the communication terminal 220 according to this embodiment. This flowchart is executed by the CPU 1210 in FIG. 12 using the RAM 1240, and realizes the functional configuration units in FIG.

[0092] In step S1311, the communication terminal 220 determines whether or not a facial image is to be registered. If it is determined that a facial image is to be registered, in step S1313, the communication terminal 220 reads a QR code (registered trademark) with the imaging unit 1025. In step S1315, the communication terminal 220 acquires and holds site information from the read QR code (registered trademark). In step S1317, the communication terminal 220 captures a facial image of the worker to be registered. In step S1319, the communication terminal 220 transmits the facial image for registration and the position information of the communication terminal to the information processing device 210 in association with the site information. Then, in step S1321, the communication terminal 220 waits for a notification from the information processing device 210 that the facial image has been registered. Upon receiving the notification that the facial image has been registered, the communication terminal 220 notifies the information processing device 210 that the facial image of the worker requesting registration has been registered in step S1323.

[0093] If it is determined that the request is not for facial image registration, the communication terminal 220 determines whether or not the request is for entrance / exit registration in step S1331. If it is determined that the request is for entrance / exit registration, the communication terminal 220 displays a list of stored site information in step S1333. If there is one site information, the site information is displayed. If multiple site information is stored, the communication terminal 220 waits for the selection of site information by the worker who applies for entrance / exit registration in step S1335. If the worker selects the site information, the communication terminal 220 acquires the position information of the communication terminal in step S1337. In step S1339, the communication terminal 220 captures a facial image of the worker who applies for entrance / exit registration. In step S1341, the communication terminal 220 transmits the position information, the facial image for application for entrance / exit registration, and time information to the information processing device 210. Then, in step S1343, the communication terminal 220 waits for a notification of the completion of entrance / exit registration from the information processing device 210. If a notification that entry / exit has been registered is received, communications terminal 220 notifies the application worker that entry / exit has been registered in step S1345. If an authentication error is received, communications terminal 220 notifies the application worker of the registration error in step S1345.

[0094] <<Functional configuration of the administrator terminal>> FIG. 14 is a block diagram showing the functional configuration of the administrator terminal 230 / 240 according to this embodiment.

[0095] The administrator terminal 230 / 240 includes a communication control unit 1401, an input / output interface 1402, an application download unit 1403, and an application execution unit 1404. The communication control unit 1401 controls communication with the information processing device 210 and the communication terminal 220 via the network 350. The input / output interface 1402 interfaces with input / output devices. In this embodiment, as the input / output devices, a display unit 1421, an operation unit 1422, an audio input / output unit 1423, and optionally, a GPS position calculation unit 1424, an imaging unit 1425, and a storage medium / printing unit 1426 are connected to the input / output interface 1402. The application download unit 1403 downloads an entrance / exit management application for the administrator communication terminal from the information processing device 210.

[0096] The application execution unit 1404 includes a QR code (registered trademark) receiving / output unit 1440, a view request acquiring unit 1441, a view request transmitting unit 1442, a viewing screen receiving unit 1443, and a viewing screen display unit 1444. The application execution unit 1404 also includes a report creation request acquiring unit 1445, a report creation request transmitting unit 1446, a report receiving unit 1447, and a report output unit 1448. The application execution unit 1404 also includes a worker information request acquiring unit 1449, a worker information request transmitting unit 1451, a worker information receiving unit 1452, a worker information display unit 1453, a registration information receiving unit 1454, a registration information storage unit 1455, and a registration information batch transmitting unit 1456.

[0097] The QR code (registered trademark) receiving / output unit 1440 receives a QR code (registered trademark) from the information processing device 210 and outputs it to the display unit 1421 or the printing unit 1426. The view request acquiring unit 1441 acquires a view request instructed by the administrator from the operation unit 1422. The view request transmitting unit 1442 transmits the acquired view request to the information processing device 210. The view screen receiving unit 1443 receives a view screen corresponding to the view request from the information processing device 210. The view screen display unit 1444 displays the received view screen on the display unit 1421. The report creation request acquiring unit 1445 acquires a report creation request instructed by the administrator from the operation unit 1422. The report creation request transmitting unit 1446 transmits the acquired report creation request to the information processing device 210. The report receiving unit 1447 receives a report corresponding to the report creation request from the information processing device 210. The report output unit 1448 outputs the received report to the display unit 1421 or the printing unit 1426. The view request sending unit 1442 sends the acquired view request to the information processing device 210.

[0098] The worker information request acquisition unit 1449 acquires a worker information request instructed by the administrator from the operation unit 1422. The worker information request can also be made by selecting a worker in a viewing screen or report displayed on the display unit 1421. The worker information request transmission unit 1451 transmits the acquired worker information request to the information processing device 210. The worker information reception unit 1452 receives worker information in response to the worker information request from the information processing device 210. The worker information display unit 1453 displays the received worker information on the display unit 1421. The registration information reception unit 1454 receives registration information from each communication terminal 220. The registration information storage unit 1455 stores the received registration information and displays it on the display unit 1421. The registration information batch transmission unit 1456 transmits the registration information registered in the registration information storage unit 1455 to the information processing device 210 in a batch in response to an instruction from the administrator from the operation unit 1422.

[0099] 《Administrator terminal processing procedure》 Fig. 15 is a flowchart showing the processing procedure of the administrator terminal 230 / 240 according to this embodiment. This flowchart is executed by a CPU (not shown) constituting the administrator terminal 230 / 240 using a RAM, and realizes the functional configuration section shown in Fig. 14. The following description will be given representatively of the administrator terminal 230.

[0100] In step S1511, the administrator terminal 230 determines whether a view request has been issued. If it is determined that a view request has been issued, the administrator terminal 230 acquires the requested view format in step S1513. In step S1515, the administrator terminal 230 generates a view request message. In step S1517, the administrator terminal 230 transmits the generated view request message to the information processing device 210. Then, in step S1519, the administrator terminal 230 waits for reception of a view screen from the information processing device 210. If a view screen has been received, the administrator terminal 230 displays the view screen on the display unit 1421 in step S1521.

[0101] If it is determined that a viewing request has not been issued, the administrator terminal 230 determines in step S1531 whether or not a report creation request has been issued. If it is determined that a report creation request has been issued, the administrator terminal 230 acquires the instructed report format in step S1533. The administrator terminal 230 generates a report request message in step S1535. The administrator terminal 230 transmits the generated report request message to the information processing device 210 in step S1537. Then, the administrator terminal 230 waits for receipt of a report from the information processing device 210 in step S1539. If a report has been received, the administrator terminal 230 displays the report on the display unit 1421 or prints it out using the print unit 1426 in step S1541.

[0102] If it is determined that a viewing request has not been instructed and if it is determined that a report creation request has not been instructed, the manager terminal 230 determines in step S1551 whether or not a worker information request has been instructed. If it is determined that a worker information request has been instructed, the manager terminal 230 acquires the instructed worker ID in step S1553. The manager terminal 230 generates a worker information request message in step S1555. The manager terminal 230 transmits the generated worker information request message to the information processing device 210 in step S1557. Then, the manager terminal 230 waits for receipt of worker information from the information processing device 210 in step S1559. If worker information has been received, the manager terminal 230 displays the worker information on the display unit 1421 in step S1561.

[0103] If it is not determined that a viewing request has been issued, if it is not determined that a report creation request has been issued, and if a worker information request has not been issued, then in step S1581, manager terminal 230 determines whether registration information has been received. If registration information has been received, in step S1573, manager terminal 230 stores the received registration information in registration information storage unit 1455. Then, in step S1575, manager terminal 230 displays the stored registration information from each communication terminal 220 on display unit 1421.

[0104] If it is not determined that a viewing request has been instructed, that a report creation request has been instructed, that a worker information request has been instructed, and that the registration information has not been received, the administrator terminal 230 determines in step S1581 whether or not transmission of the registration information stored in the registration information storage unit 1455 has been instructed. If it is determined that transmission of the registration information has been instructed, the administrator terminal 230 displays a list of the stored registration information in step S1583. In step S1585, the administrator terminal 230 transmits the registration information to the information processing device 210 in a lump. Then, in step S1587, the administrator terminal 230 waits for reception of a registration completion notification from the information processing device 210. If a registration completion notification is received, the administrator terminal 230 displays the completion of registration of the registration information (particularly the face image) on the display unit 1421 in step S1589. For the registration information in which an authentication error has occurred, a notice to that effect is provided.

[0105] In this embodiment, the site information is notified to the communication terminal using a QR code (registered trademark) as a location identification code, but a barcode or the like may be used as a location identification code that cannot be visually recognized by humans. Also, the site information may be notified to the communication terminal by short-distance communication such as short-distance communication from an IC card or infrared communication between communication terminals. Also, although the communication terminal acquires location information from GPS, there are cases where acquisition is not possible indoors, etc., and this can be replaced with acquisition of location information by receiving a beacon signal or by short-distance communication without changing the basic configuration of the embodiment.

[0106] According to this embodiment, the entrance and exit of people can be efficiently recorded by simple authentication and registration of entrance and exit using the communication terminal carried by the person who enters and exits the facility based on the position information of the communication terminal and face authentication. In addition, since the facial images of the people who enter and exit the facility are registered when a location identification code such as a QR code (registered trademark) is distributed, it is possible to prevent the registration of facial images by suspicious people. Furthermore, the entrance and exit history of the recorded people who enter and exit the facility can be viewed or created as a report, thereby reducing the burden on the site manager and the business manager.

[0107] For example, it used to take time and effort to check the schedule and performance of workers during morning meetings and on-site inspections, but this embodiment combines face recognition and location confirmation to reduce entrance and exit management costs. Also, it used to take time to organize the number of people reported by work cooperating companies and transcribe them into various reports, but this embodiment can reduce the labor required to create various reports based on entrance and exit record information. Also, because identity verification takes time and effort, the actual situation could not be grasped because the actual report from the work cooperating companies was used as the report value as is, but this embodiment can easily grasp the identity including qualification information, and can contribute to accurate payment of labor costs and reduction of social insurance premiums by recording entrance and exit. Conventional distribution of entrance and exit cards, etc., was costly due to the possibility of loss or forgetting, but since entrance and exit records are performed by face recognition, the risk of card management and loss can be reduced. In other words, by combining face recognition technology with location information confirmation using GPS, etc., it is possible to easily grasp the actual situation of workers at construction sites, for example, and contribute to improving on-site productivity.

[0108] In this way, according to this embodiment, the following requirements desired in site entrance / exit management can be satisfied. It is desirable to easily confirm whether a qualified person is working at a designated place (prevention of fraud and compliance with laws and regulations). It is also desirable to efficiently manage whether the person is certainly at the site as scheduled (work management and social insurance). It is also desirable to automatically manage the permission to start work and the confirmation of completion in a systematic manner (work management and safety management). Furthermore, it is desirable to build an inexpensive so-called attendance management system. That is, by performing face recognition with a portable communication terminal (such as a smartphone) when entering and leaving the site and knowing when and where the person is at the site, it is possible to reduce the number of people required for daily site entrance / exit management (so-called attendance management work).

[0109] [Third embodiment] Next, an information processing device according to a third embodiment of the present invention will be described. The information processing device according to this embodiment differs from the second embodiment in that it checks liveness (checks whether the person is actually being photographed) when acquiring a face image for entrance / exit registration. Other configurations and operations are the same as those of the second embodiment, so the same configurations and operations are denoted by the same reference numerals and detailed explanations thereof will be omitted.

[0110] <<Outline of Liveness Check Operation>> Fig. 16 is a diagram showing an outline of the operation of liveness confirmation in the communication terminal 220 that communicates with the information processing device according to this embodiment. Note that Fig. 16 shows the addition of liveness processing to the entry / exit registration in the lower part of Fig. 2B, and the same components as those in Fig. 2B are given the same reference numerals and descriptions thereof are omitted.

[0111] After display screen 226 in Fig. 2B, display screen 1626 is displayed on communication terminal 220, indicating that video is being captured. Thereafter, liveness determination is performed on display screen 1627. Although display screen 1627 in Fig. 16 illustrates the case where the right eye is closed, other actions may be performed if liveness can be confirmed, and multiple actions may be instructed to improve the accuracy of the confirmation. If liveness can be confirmed, a face image is transmitted from display screen 227.

[0112] (Facial image recognition table) Fig. 17 is a diagram showing the configuration of a face image authentication table 1781 according to this embodiment. The face image authentication table 1781 replaces the face image authentication table 581 in Fig. 5, and performs liveness face image authentication. In the face image authentication table 1781, the same components as those in the face image authentication table 581 in Fig. 5 are given the same reference numbers, and duplicated explanations will be omitted.

[0113] The face image authentication table 1781 has an authentication table 1710 corresponding to the face image authentication table 581, and a liveness table 1720 used for liveness judgment. The authentication table 1710 stores liveness judgment results 1724 as entrance / exit face images 1711. The liveness judgment result 1724 is generated as a comprehensive judgment result by judging a match / mismatch flag 1723 between a liveness instruction 1721 and a liveness response 1722 in the liveness table 1720.

[0114] <<Processing Procedure of Information Processing Device>> Fig. 18 is a flowchart showing the processing procedure of the information processing device 210 according to this embodiment. In Fig. 18, the same steps as those in Fig. 9 are given the same step numbers, and duplicated explanations will be omitted.

[0115] In step S1831, the information processing device 210 issues a liveness operation instruction. Then, in step S1832, the information processing device 210 determines whether the liveness is OK. If it is determined that the liveness is OK, the process proceeds to authentication processing from step S933 onward. If it is determined that the liveness is not OK, the entrance / exit registration process ends.

[0116] In this embodiment, the liveness check is performed by the information processing device, but the communication terminal may be configured to perform a simple liveness check by a downloaded application.

[0117] According to this embodiment, in addition to the effect of the second embodiment, it is possible to prevent fraud such as spoofing during authentication at the time of entry and exit.

[0118] [Fourth embodiment] Next, an information processing device according to a fourth embodiment of the present invention will be described. The information processing device according to this embodiment is different from the second and third embodiments in that the face images of the gathered workers are registered all at once by an administrator terminal, and / or the entrance and exit of the gathered workers are registered all at once by an administrator terminal. That is, when registering face images, face information of multiple users extracted from an image including the face images of multiple users is associated with a location and registered as multiple registered users. Also, when registering entrance and exit, face information of multiple application users is extracted from an image including the face images of multiple application users, and the face information of the multiple application users is compared with the face information of the registered user to perform user authentication of the multiple application users. Other configurations and operations are similar to those of the second and third embodiments, so the same configurations and operations are denoted by the same reference numerals and detailed description thereof is omitted.

[0119] <<Overview of simultaneous imaging operations>> FIG. 19A is a diagram showing an outline 1901 of an operation of simultaneous imaging during face image registration in an administrator terminal 1931 that communicates with an information processing device 1910 according to this embodiment.

[0120] 19A shows a scene where new entrant education is being conducted. The instructor of the new entrant education simultaneously captures images of multiple workers participating in the new entrant education using an imaging unit of an administrator terminal 1931, and transmits the images to an information processing device 1910. The information processing device 1910 extracts facial images of each worker from the received images and uses them for facial image registration. The imaging unit of the administrator terminal 1931 may be a front camera or a rear camera.

[0121] FIG. 19B is a diagram showing an outline 1902 of the operation of simultaneous imaging at the time of entrance / exit registration in an administrator terminal 1932 that communicates with an information processing device 1910 according to this embodiment.

[0122] 19B shows a scene where a morning assembly is being held. During the morning assembly, the manager simultaneously captures images of multiple workers participating in the morning assembly using the imaging unit of the manager terminal 1932, and transmits the images to the information processing device 1910. The information processing device 1910 extracts facial images of each worker from the received images and uses them for face authentication. The exit process in the evening assembly is similar, so a duplicated explanation will be omitted. The imaging unit of the manager terminal 1932 may be a front camera or a rear camera.

[0123] <<Operation sequence of the entrance / exit management system>> Fig. 20A is a sequence diagram showing the registration procedure of an entrance / exit management system including an information processing device 1910 according to this embodiment. In Fig. 20A, the same steps as those in Fig. 4A are given the same step numbers, and duplicated explanations are omitted. In Fig. 20A, the administrator terminals 1931 and 1932 are represented by the administrator terminal 1930.

[0124] Step S2013 is a facial image registration process of this embodiment. In step S2037, the manager terminal 1930 captures images of all the workers participating in the new entrant education at once using the imaging unit. In step S2039, the manager terminal 1930 transmits the simultaneously captured images and position information of the manager terminal 1930 together with site information, worker information, and the like to the information processing device 1910. In step S2040, the information processing device 1910 extracts facial images of each worker from the received simultaneously captured images and uses them for subsequent facial image registration.

[0125] Fig. 20B is a sequence diagram showing the entrance / exit management procedure of the entrance / exit management system including the information processing device 1910 according to this embodiment. In Fig. 20B, the same steps as those in Fig. 4B are given the same step numbers, and duplicated explanations will be omitted.

[0126] Step S2015 is the entry / exit registration process of this embodiment. In step S2057, the manager terminal 1930 simultaneously captures images of the workers participating in the morning meeting with the imaging unit. In step S2061, the manager terminal 1930 transmits the simultaneously captured images together with position information, time information, and the like to the information processing device 1910. In step S2062, the information processing device 1910 extracts face images of each worker from the received simultaneously captured images and uses them for subsequent face authentication.

[0127] <Functional configuration of information processing device> Fig. 21 is a block diagram showing the functional configuration of an information processing device 1910 according to this embodiment. In Fig. 21, the same reference numerals are used for the same functional components as in Fig. 5, and duplicated explanations will be omitted.

[0128] The information processing device 1910 includes a registration simultaneous captured image receiving unit 2105, a face image extracting unit 2106, an entrance / exit simultaneous captured image receiving unit 2110, and a face image extracting unit 2111. The registration simultaneous captured image receiving unit 2105 receives images captured simultaneously in the new visitor education transmitted from the manager terminal 230 together with site information, worker information, and the like. The face image extracting unit 2106 extracts face images from the images captured simultaneously in the new visitor education and outputs them to the face image matching unit 508. The entrance / exit simultaneous captured image receiving unit 2110 receives images captured simultaneously in the morning assembly or evening assembly transmitted from the manager terminal 230 together with location information, time information, and the like. The face image extracting unit 2111 extracts face images from the images captured simultaneously in the morning assembly or evening assembly and outputs them to the face image matching unit 508.

[0129] <<Processing Procedure of Information Processing Device>> Fig. 22 is a flowchart showing the processing procedure of the information processing device 1910 according to this embodiment. In Fig. 22, the same steps as those in Fig. 9 are given the same step numbers, and duplicated explanations will be omitted.

[0130] In step S2223, the information processing device 1910 receives the simultaneously captured image and position information of the administrator terminal 1930 from the administrator terminal 1930. In step S2224, the information processing device 1910 extracts a face image of each worker from the received simultaneously captured image, and uses it for subsequent face image registration. In addition, in step S2233, the information processing device 1910 receives the simultaneously captured image, position information of the administrator terminal 1930, and current time information from the administrator terminal 1930. In step S2234, the information processing device 1910 extracts a face image of each worker from the received simultaneously captured image, and uses it for subsequent face authentication.

[0131] According to this embodiment, in addition to the effects of the above-mentioned embodiments, facial images of workers are registered all at once, and / or the entry and exit of workers is registered all at once, thereby improving discipline in the workplace and further reducing the burden on site managers and business managers.

[0132] [Fifth embodiment] Next, an information processing device according to a fifth embodiment of the present invention will be described. The information processing device according to this embodiment differs from the second to fourth embodiments in that, when an authentication error occurs at the time of entry or exit, the site information stored in the communication terminal is deleted. In this embodiment, the information processing device instructs the communication terminal to delete the site information. Note that the communication terminal from which the site information has been deleted cannot be used for entry or exit at the site, and the site information acquisition process or face image registration process must be performed again. Other configurations and operations are the same as those in the second embodiment, and the same configurations and operations are denoted by the same reference numerals and detailed description thereof will be omitted.

[0133] <<Operation sequence of the entrance / exit management system>> Fig. 23 is a sequence diagram showing an entrance / exit management procedure including deletion of on-site information in the entrance / exit management system including the information processing device 2310 according to this embodiment. In Fig. 23, the same steps as in Fig. 4B are given the same step numbers, and duplicated explanations are omitted. Also, since step S417 of viewing / report creation is the same as in Fig. 4B, it is omitted from Fig. 23.

[0134] Step S2315 is the entrance / exit registration process of this embodiment. In step S2365, when there is a set number of authentication errors (one or more) for each communication terminal or each worker, the information processing device 2310 instructs the communication terminal 220 to delete the site information held therein. In step S2366, the communication terminal 220 that has received the instruction to delete the site information deletes the site information held at the time of facial image registration. At this time, if the authentication error is determined to be malicious, the facial image of the worker registered in the entrance / exit management database 311 may be deleted. In order to use this communication terminal 220 for entrance / exit registration at the site, the site information acquisition process or facial image registration process must be performed again.

[0135] <Functional configuration of information processing device> Fig. 24 is a block diagram showing the functional configuration of an information processing device 2310 according to this embodiment. In Fig. 24, the same reference numerals are used for the same functional components as in Fig. 5, and duplicated explanations will be omitted.

[0136] The information processing device 2310 includes an authentication unit 2491, a site information deletion instruction unit 2412, and a worker entrance / exit database 2423 included in the entrance / exit management database 2411. The authentication unit 2491 has an authentication error counter and counts the number of authentication errors that occur. When the number of authentication errors that occur exceeds a predetermined number (one or more), the authentication unit 2491 requests the site information deletion instruction unit 2412 to delete the site information. Upon receiving the request to delete the site information from the authentication unit 2491, the site information deletion instruction unit 2412 instructs the target communication terminal 220 to delete the site information of the corresponding site. The worker entrance / exit database 2423 stores the authentication error count as a threshold value of the number of authentication errors that requests the deletion of the site information.

[0137] <<Processing Procedure of Information Processing Device>> Fig. 25 is a flowchart showing the processing procedure of the information processing device 2310 according to this embodiment. In Fig. 25, the same steps as those in Fig. 9 are given the same step numbers, and duplicated explanations will be omitted.

[0138] In step S2543, the information processing device 2310 counts up the authentication error counter. Then, in step S2545, the information processing device 2310 determines whether the number of authentication errors has exceeded a predetermined number of times α. If it is determined that the number of authentication errors has exceeded the predetermined number of times α, in step S2547, the information processing device 2310 instructs the deletion of site information of the site corresponding to the target communication terminal 220.

[0139] According to this embodiment, in addition to the effects of the above embodiment, it is possible to more efficiently manage the entrance and exit of people entering and exiting the facility by restricting the use of communication terminals that cause authentication errors. Also, it is possible to reduce unnecessary costs for the authentication process and entrance and exit management process of the information processing device as the cloud server.

[0140] [Sixth embodiment] Next, a communication terminal according to a sixth embodiment of the present invention will be described. In comparison with the second to fifth embodiments, the communication terminal according to this embodiment deletes the site information by itself when an authentication error occurs at the time of entry and exit. The communication terminal that has deleted the site information cannot be used for entry and exit at the site, and the site information acquisition process or face image registration process must be performed again. In this embodiment, location information is authenticated based on the location information acquired in the communication terminal and the location information of the site information held therein, thereby reducing unnecessary face image transmission and authentication. Other configurations and operations are the same as those of the second to fifth embodiments, so the same configurations and operations are denoted by the same reference numerals and detailed description thereof will be omitted.

[0141] <<Operation sequence of the entrance / exit management system>> Fig. 26 is a sequence diagram showing an entrance / exit management procedure including deletion of on-site information in the entrance / exit management system including the communication terminal 2620 according to this embodiment. In Fig. 26, the same steps as those in Fig. 4B are given the same step numbers, and duplicated explanations will be omitted.

[0142] Step S2615 is the entry / exit registration process of this embodiment. In step S2665, the information processing device 2610 notifies the target communication terminal 220 of the authentication error that has occurred. In each communication terminal 220, when an authentication error is received from the information processing device 2610 in step S2666, the number of authentication errors is counted up. Then, when the number of authentication errors exceeds a threshold, the site information of the target site is deleted, or if there is a problem with the communication terminal 220, all site information held is deleted.

[0143] <Functional configuration of communication terminal> Fig. 27 is a block diagram showing the functional configuration of a communication terminal 2620 according to this embodiment. In Fig. 27, the same reference numerals are used for the same functional components as in Fig. 10, and duplicated explanations will be omitted.

[0144] The communication terminal 2620 includes an authentication error counting unit 2753 and a site information deletion unit 2754 in the application execution unit 2704. The authentication error counting unit 2753 counts the number of authentication errors, if any, in the authentication result received by the entrance / exit authentication result receiving unit 1051. The number of authentication errors may be counted for each site, or the total number of errors may be counted. The site information deletion unit 2754, as a location deletion unit, deletes site information from the site information storage unit 1044 when the number of authentication errors counted by the authentication error counting unit 2753 exceeds a predetermined threshold. Site information may be deleted for each site, or for each communication terminal 220.

[0145] <<Processing procedure of communication terminal>> Fig. 28 is a flowchart showing the processing procedure of the communication terminal 2620 according to this embodiment. In Fig. 28, the same steps as those in Fig. 13 are given the same step numbers, and duplicated explanations will be omitted.

[0146] In step S2849, the communication terminal 2620 counts up the authentication errors. Then, in step S2851, the communication terminal 2620 determines whether the authentication error count has exceeded threshold value α. If the authentication error count has exceeded threshold value α, the communication terminal 2620 deletes the corresponding site information in step S2853. In this case, the user cannot enter the site corresponding to the deleted site information unless the site information acquisition process or face image registration is performed again.

[0147] According to this embodiment, in addition to the effects of the above embodiment, the load on the information processing device as a cloud server can be reduced, and the entrance and exit of people can be managed more efficiently. Also, the location information is authenticated in the communication terminal, which reduces unnecessary face image transmission and authentication, and thus the load on the information processing device as a cloud server can be further reduced.

[0148] [Seventh embodiment] Next, an information processing device according to a seventh embodiment of the present invention will be described. The information processing device according to this embodiment differs from the second to sixth embodiments in that even if authentication fails at the time of entry and exit, especially at the time of entry, the person is added to the visitor count. Since the other configurations and operations are the same as those of the second to sixth embodiments, the same reference numerals are used for the same configurations and operations, and detailed explanations thereof will be omitted.

[0149] (Worker entry / exit database) Fig. 29 is a diagram showing the configuration of a worker entrance / exit database 2923 according to this embodiment. Note that the worker entrance / exit database 2923 can be replaced with the worker entrance / exit database 523 in Fig. 6C.

[0150] The worker entrance / exit database 2923 stores a worker entrance / exit history 2933 in association with a worker ID 2931 and worker information 2932. In this embodiment, an undetermined person is included as the worker ID 2931. This undetermined person is an entering / exiting person whose face image is not registered or who has experienced an authentication error in face authentication. For such undetermined people, only the number of people who have entered and exited can be identified. Also, in the worker entrance / exit history 2933, when the position information does not match, a mismatch is stored in the site information. This column is for cases where there is a record of entry and exit but the site cannot be identified.

[0151] Furthermore, even if the date and time, entry and exit times, and work content are unknown, by recording them as an entry and exit count, it is possible to prevent fraud and easily count entry and exit, and the number of entries can be counted without registering workers.

[0152] <<Processing Procedure of Information Processing Device>> Fig. 30 is a flowchart showing the processing procedure of an information processing device 3010 according to this embodiment. In Fig. 30, the same steps as those in Fig. 9 are given the same step numbers, and duplicated explanations will be omitted.

[0153] In step S3038, even if a face authentication error occurs, the information processing device 3010 registers the person as an undetermined person in the worker entrance / exit database 2923. In addition, in step S3040, even if there is a mismatch in the position information, the information processing device 3010 registers the person as an entry / exit to a mismatched work site in the worker entrance / exit database 2923.

[0154] According to this embodiment, in addition to the effects of the above embodiment, even if authentication fails because a face image is not registered, etc., location information is recorded in the entry / exit record, which makes it possible to prevent fraud and easily count the number of entries and exits. In other words, the number of entries can be counted without registering the workers.

[0155] [Eighth embodiment] Next, an information processing device according to a third embodiment of the present invention will be described. The information processing device according to this embodiment differs from the second to seventh embodiments in that, when registering a face image, the information processing device acquires worker information from a member management server in which the worker is registered as a member. Since the other configurations and operations are the same as those of the second to seventh embodiments, the same reference numerals are used for the same configurations and operations, and detailed descriptions thereof will be omitted.

[0156] <<Configuration of the entrance / exit management system>> Fig. 31 is a block diagram showing the configuration of an entrance / exit management system 3100 including an information processing device 3110 according to this embodiment. In Fig. 31, the same components as those in Fig. 3 are given the same reference numerals, and duplicated explanations will be omitted.

[0157] The entrance / exit management system 3100 includes a member management server 3160 having a member database 3161. The member management server 3160 stores and manages the worker information and history of workers who have registered as members in the member database 3161. The information processing device 3110 of the entrance / exit management system 3100 obtains and processes the worker information of workers who have registered as members from the member database 3161 without the worker having to input and process the information each time. Therefore, the administrator terminal 3130 does not need to transmit information held in the member database 3161, such as worker information, to the information processing device 3110 as in the above embodiment, and can simply transmit a face image associated with the site information.

[0158] <<Operation sequence of the entrance / exit management system>> Fig. 32 is a sequence diagram showing the registration procedure of the entrance / exit management system 3100 including the information processing device 3110 according to this embodiment. In Fig. 32, the same steps as those in Fig. 4A are given the same step numbers, and duplicated explanations will be omitted.

[0159] Step S3213 is a facial image registration process of this embodiment. In step S3240, manager terminal 3130 transmits facial images associated with site information to information processing device 3110 en masse. In step S3241, information processing device 3110 acquires worker information of workers and the like from member management server 3160. In step S3242, member management server 3160 transmits worker information of workers and the like stored in member database 3161 to information processing device 3110.

[0160] According to this embodiment, in addition to the effects of the above-described embodiment, it is possible to efficiently register face images by eliminating the need to input worker information each time a face image is registered.

[0161] [Ninth embodiment] Next, an information processing device according to a third embodiment of the present invention will be described. Unlike the second to eighth embodiments, which manage the entry and exit of workers at a specific site, the information processing device according to this embodiment manages the entry and exit of a specific worker to a plurality of sites. Other configurations and operations are the same as those of the second to eighth embodiments, and therefore the same configurations and operations are denoted by the same reference numerals and detailed description thereof will be omitted.

[0162] <<Outline of the operation of the site management system>> Fig. 33 is a diagram showing an outline of the operation of a site management system 3300 including an information processing device 3310 according to this embodiment. In Fig. 33, the communication terminal 220 is the same as in the above embodiment.

[0163] Servicemen 3301 and 3302 as a plurality of workers are moving around a plurality of sites. When entering each site, face images and position information are transmitted from the communication terminals 220 carried by the servicemen 3301 and 3302 to the information processing device 3310, and entry registration is performed in the site management database by face authentication and position confirmation. When leaving each site, face images and position information are transmitted to the information processing device 3310, and exit registration is performed in the site management database by face authentication and position confirmation. In this way, the same technical configuration as in the above embodiment in which workers gather at one site can also be applied to the case of patrolling multiple sites. Incidentally, entry and exit to multiple sites may be managed on a daily basis or over a long period of time. Incidentally, for the area 3303 including multiple sites when displaying the site patrol history, an existing map may be used, an aerial image taken using a drone 3304 or the like may be used, or a satellite photo taken using a satellite 3305 may be used.

[0164] (Site Management Database) Fig. 34 is a diagram showing the configuration of a site management database 3311 according to this embodiment. Note that Fig. 34 may be supplemented with Figs. 6A to 6D.

[0165] The site management database 3311 stores registration information 3412 and a worker entrance / exit history 3413 in association with a worker ID 3411. The registration information 3412 includes attributes of the worker, and a set of multiple pieces of site information and a face image. The worker entrance / exit history 3413 includes the date of work, arrival time, departure time, site information, location information, work content, etc.

[0166] According to this embodiment, the technical ideas described in the above embodiment can be applied as they are to the case where entry and exit to a site is managed when a given worker visits multiple sites.

[0167] [Tenth embodiment] Next, an information processing device according to a third embodiment of the present invention will be described. The information processing device according to this embodiment is different from the second to ninth embodiments in that it identifies the location and makes public the data stored in a file server or the like by performing position confirmation and face authentication. For example, when accessing highly confidential data such as drawings or product information viewed in a factory or construction site, the current location of the user is identified and whether or not the data can be viewed is controlled to prevent leakage of electronic data. Since the other configurations and operations are the same as those of the second to ninth embodiments, the same reference numerals are used for the same configurations and operations and detailed description thereof will be omitted.

[0168] <<Configuration of the entrance / exit management system>> Fig. 35 is a block diagram showing the configuration of an entrance / exit management system 3500 including an information processing device 3510 according to this embodiment. In Fig. 35, the same components as those in Fig. 3 are given the same reference numerals, and duplicated explanations will be omitted.

[0169] The entrance / exit management system 3500 includes an information management server 3570 having an information management database 3571, such as a file server. The information management server 3570 manages information stored in a confidential manner in the information management database 3571. An information processing device 3510 of the entrance / exit management system 3500 sets a disclosure permitted range 3501-350m in an information management area 3580, such as a factory, and manages entrance and exit to the disclosure permitted range 3501-350m using an entrance / exit management database 3511. That is, when a worker carrying a communication terminal 220 enters the disclosure permitted range 3501-350m, and it is determined by face authentication and position confirmation, an instruction is given to the information management server 3570 to disclose confidential information in the information management database 3571. On the other hand, even if a worker carrying communication terminal 220 enters within disclosure range 3501-350 m, if face authentication fails, disclosure of confidential information in information management database 3571 by information management server 3570 is stopped. Alternatively, if face authentication is successful but position confirmation fails (outside disclosure range 3501-350 m), disclosure of confidential information in information management database 3571 by information management server 3570 is stopped.

[0170] The information management server 3570 itself may also be responsible for managing the entrance and exit of the information processing device 3510, and the information processing device 3510 may also be responsible for managing the confidential information of the information management server 3570.

[0171] <<Operation sequence of the entrance / exit management system>> Fig. 36 is a sequence diagram showing the operation procedure of an entrance / exit management system 3500 including an information processing device 3510 according to this embodiment. In Fig. 36, the same steps as those in Fig. 4B are given the same step numbers, and duplicated explanations will be omitted.

[0172] In step S3663, the information processing device 3510 searches for a face image associated with the disclosure range corresponding to the position information of the communication terminal 220, and in step S465, collates and authenticates the face image. After collating and authenticating the face image, in step S3667, the information processing device 3510 confirms the entry of the worker authenticated by the position information of the communication terminal 220 into the disclosure range, and instructs the information management server 3570 to disclose information. In step S3668, the information management server 3570 discloses confidential data corresponding to the position of the information management database to the target communication terminal 220. In step S3669, the target communication terminal 220 acquires the public data disclosed by the information management server 3570.

[0173] <Functional configuration of information processing device> Fig. 37 is a block diagram showing the functional configuration of an information processing device 3710 according to a tenth embodiment of the present invention. In Fig. 37, the same reference numerals are given to the same functional components as in Fig. 5, and duplicated explanations will be omitted.

[0174] The information processing device 3710 includes a location matching unit 3709, a browsing (public) request receiving unit 3714, a browsing (public) permission information generating unit 3715, a browsing (public) permission information transmitting unit 3716, and a disclosure-permitted range database 3621 included in the entrance / exit management database 3511. The location matching unit 3709 has a location information authentication table 3791, and performs location authentication by matching the location information of the communication terminal of the worker who wishes to disclose confidential information with the disclosure-permitted range. The browsing (public) request receiving unit 3714 receives a browsing (public) request from the communication terminal 220. When the authentication unit 511 notifies the authentication success, the browsing (public) permission information generating unit 3715 generates browsing (public) permission information corresponding to the browsing (public) request. The browsing (public) permission information transmitting unit 3716 transmits the generated browsing (public) permission information to the information management server 3570. In the open range database 3621 included in the entrance / exit management database 3511, site information of the open range is registered.

[0175] (Location authentication table) Fig. 38 is a diagram showing the configuration of a location information authentication table 3791 according to this embodiment. The location information authentication table 3791 is used by the location collation unit 3709 to determine whether the location is a disclosure-allowed location based on the location information of the communication terminal 220 and the disclosure-allowed range. In Fig. 38, the same components as those in Fig. 7B are given the same reference numbers, and duplicated explanations will be omitted.

[0176] The position information authentication table 3791 stores the entrance / exit position information 721, the disclosure range information 3822, a comparison result 3823 as to whether the position information is within the disclosure range by comparing them, and an authentication result 3824 based on the comparison result 3823.

[0177] <<Processing Procedure of Information Processing Device>> Fig. 39 is a flowchart showing the processing procedure of the information processing device 3510 according to this embodiment. In Fig. 39, the same steps as in Fig. 9 are given the same step numbers, and duplicated explanations will be omitted. In Fig. 39, registration of a face image based on a QR code (registered trademark) is optional.

[0178] In step S3911, the information processing device 3510 acquires disclosure range information corresponding to the site information. In step S3913, the information processing device 3510 generates a QR code (registered trademark) from the disclosure range information. Then, in step S3917, the information processing device 3510 transmits the QR code (registered trademark) to the manager terminal of the target disclosure range. In step S3923, the information processing device 3510 receives the disclosure range and the face image and position information of the applicant worker from the communication terminal. In step S3925, the information processing device 3510 registers the face image in association with the disclosure range.

[0179] In step S3939, the information processing device 3510 determines whether the location information of the communication terminal is included in the disclosure range. If it is determined that the location information of the communication terminal is included in the disclosure range, the information processing device 3510 notifies the information management server 3570 of information disclosure permission information for the applicant worker in step S3941. On the other hand, if it is determined that the location information of the communication terminal is not included in the disclosure range, the information processing device 3510 notifies the application source communication terminal of information disclosure denial in step S3943.

[0180] In this embodiment, a separate information management server is provided to manage the disclosure of the confidential information. However, the confidential information may be stored in an information processing device serving as a cloud server, and the disclosure may be managed within the information processing device.

[0181] According to this embodiment, by combining position confirmation and face authentication in the same manner as in the above embodiment, access to highly confidential data can be controlled.

[0182] [Other embodiments] In the above embodiment, the information processing device that performs entrance and exit management is a cloud server that realizes various entrance and exit management, but it may be an entrance and exit management server that performs individual entrance and exit management. In addition, entrance and exit registration is performed by face recognition at the time of entrance and exit, but authentication errors or cases where a worker enters and exits without registration processing may occur. In such cases, the number of people entering and exiting may be corrected by operating forced entry processing or forced exit processing without registration processing based on viewing by the site manager from the manager terminal.

[0183] In the above embodiment, the entry and exit management of workers at a construction site has been mainly described, but the present embodiment can also be applied to other systems where unspecified people gather at a site to work, and the same effects can be obtained. In addition, the application to an embodiment in which an individual worker goes around multiple work sites has been described, but such an embodiment can also be applied to other similar systems in which an individual person goes around multiple sites, and the same effects can be obtained. Furthermore, the present invention can also be applied to other systems that combine position confirmation and face authentication to determine whether or not a specific process is permitted, and the same effects can be obtained.

[0184] Although the present invention has been described with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. Furthermore, systems or devices that combine separate features included in each embodiment in any manner are also included in the scope of the present invention.

[0185] The present invention may be applied to a system consisting of multiple devices, or to a single device. Furthermore, the present invention is also applicable to a case where an information processing program for realizing the functions of the embodiments is supplied directly or remotely to a system or device. Therefore, the scope of the present invention also includes a program installed on a computer to realize the functions of the present invention by a computer, a medium storing the program, and a WWW (World Wide Web) server for downloading the program. In particular, the scope of the present invention includes at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-mentioned embodiments.

[0186] [Other expressions of the embodiment] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) a face information registration unit that registers face information of a user who enters or leaves a predetermined location as face information of a registered user in association with the location; an information acquisition unit that acquires, from a communication terminal, location information of the communication terminal, face information of an application user who is applying to enter or leave the location, and application information for entry or exit; a user authentication unit that performs user authentication by comparing face information of the applicant user acquired by the information acquisition unit from the communication terminal with face information of the registered user registered in the face information registration unit; an entrance / exit recording unit that records the entry or exit of the applicant user to the location corresponding to the location information when the user authentication is successful; An information processing device comprising: (Appendix 2) The information acquisition unit further acquires time information from the communication terminal; The information processing device according to claim 1, wherein the entry / exit recording unit records the entry time or exit time of the application user based on the time information. (Appendix 3) The information processing device according to claim 1 or 2, wherein the user authentication unit searches for face information associated with the location corresponding to the position information from the face information registered in the face information registration unit and compares it with the face information of the applicant user. (Appendix 4) The information processing device according to any one of claims 1 to 3, wherein the user authentication unit, during the user authentication, further compares location information of the communication terminal with location information of the location to authenticate the location information. (Appendix 5) an issuing unit that issues a location identification code for the communication terminal to acquire and hold the location; the face information registration unit receives the location acquired from the location identification code and stored by the communication terminal and face information of the user captured by the communication terminal, and registers the face information of the user in association with the location; 5. The information processing device according to any one of claims 1 to 4, wherein the information acquisition unit acquires location information of the communication terminal, facial information of the application user, and the application information from the communication terminal that holds the location. (Appendix 6) 6. The information processing device according to claim 5, further comprising an instruction unit that instructs the communication terminal to delete the location information held in the communication terminal. (Appendix 7) 7. The information processing device according to claim 6, wherein the instruction unit instructs the communication terminal to delete the location information held in the communication terminal when the user authentication unit fails to authenticate the user. (Appendix 8) The information processing device according to any one of appendices 1 to 7, wherein the face information registration unit registers the face information of the multiple users extracted from an image containing the face images of the multiple users as multiple registered users in association with the location. (Appendix 9) The information acquisition unit extracts facial information of the multiple application users from an image including facial images of the multiple application users, The information processing device according to any one of claims 1 to 8, wherein the user authentication unit performs user authentication of the multiple applicant users by comparing facial information of the multiple applicant users with facial information of the registered user. (Appendix 10) a viewing request acquisition unit that acquires a viewing request for the record of entry or exit to the location recorded in the entry / exit recording unit; an information providing unit that provides a record of entry or exit to the location to a source of the request for access in a format according to the request for access; 10. The information processing device according to any one of claims 1 to 9, further comprising: (Appendix 11) The entry / exit recording unit records the entry or exit of the application user to the location as history information of the entry or exit to the location, 11. The information processing device according to any one of claims 1 to 10, further comprising a report creation unit that creates a report using the history information recorded in the entrance and exit recording unit. (Appendix 12) a face information registration step of registering face information of a user who enters or leaves a predetermined place in a face information registration unit as face information of a registered user in association with the place; an information acquisition step of acquiring, from a communication terminal, location information of the communication terminal, face information of an application user who is applying to enter or leave the location, and application information for entry or exit; a user authentication step of comparing the face information of the applicant user acquired from the communication terminal in the information acquisition step with face information of the registered user registered in the face information registration unit to perform user authentication; an entrance / exit recording step of recording, in a case where the user authentication is successful, the entry or exit of the applicant user to the place corresponding to the position information in an entrance / exit recording unit; A method for controlling an information processing device comprising: (Appendix 13) a face information registration step of registering face information of a user who enters or leaves a predetermined place in a face information registration unit as face information of a registered user in association with the place; an information acquisition step of acquiring, from a communication terminal, location information of the communication terminal, face information of an application user who is applying to enter or leave the location, and application information for entry or exit; a user authentication step of comparing the face information of the applicant user acquired from the communication terminal in the information acquisition step with face information of the registered user registered in the face information registration unit to perform user authentication; an entrance / exit recording step of recording, in a case where the user authentication is successful, the entry or exit of the applicant user to the place corresponding to the position information in an entrance / exit recording unit; A control program for an information processing device that causes a computer to execute the above. (Appendix 14) a registration information transmission unit that associates face information of a registered user who registers entry or exit from a predetermined location with the location and transmits the associated face information to an information processing device as registration of entry or exit from the location; an application information transmission unit that transmits face information of an applicant user who is applying to enter or leave the place and location information of a communication terminal to the information processing device as application information for entering or leaving the place; an authentication result acquisition unit that acquires a result of the authentication performed in the information processing device from the information processing device by comparing face information of the registered user transmitted by the registration information transmission unit and previously registered in association with the location with face information of the application user transmitted by the application information transmission unit; a notification unit that notifies whether the application for entry or exit of the applicant user has been accepted based on the obtained authentication result; A communication terminal comprising: (Appendix 15) a code acquisition unit that acquires a location identification code that identifies the location and that is issued by the information processing device; a location storage unit that acquires and stores the location from the location identification code; an operation control unit that enables the application information transmission unit when the location is stored in the location storage unit; a location deletion unit that deletes the location stored in the location storage unit when the authentication result acquisition unit acquires an authentication result indicating authentication failure; 15. The communication terminal of claim 14, further comprising: (Appendix 16) a registration information transmission step of associating face information of a registered user who registers entry or exit from a predetermined place with the place and transmitting the face information to an information processing device as registration of entry or exit from the place; an application information transmission step of transmitting face information of an applicant user who is applying to enter or leave the place and location information of a communication terminal to the information processing device as an application for entering or leaving the place; an authentication result acquisition step of acquiring, from the information processing device, a result of the authentication performed in the information processing device by comparing face information of the registered user transmitted in the registration information transmission step and previously registered in association with the location with face information of the applicant user transmitted in the application information transmission step; a notification step of notifying whether the application for entry or exit of the applicant user has been accepted based on the obtained authentication result; A method for controlling a communication terminal comprising: (Appendix 17) a registration information transmission step of associating face information of a registered user who registers entry or exit from a predetermined place with the place and transmitting the face information to an information processing device as registration of entry or exit from the place; an application information transmission step of transmitting face information of an applicant user who is applying to enter or leave the place and location information of a communication terminal to the information processing device as an application for entering or leaving the place; an authentication result acquisition step of acquiring, from the information processing device, a result of the authentication performed in the information processing device by comparing face information of the registered user transmitted in the registration information transmission step and previously registered in association with the location with face information of the applicant user transmitted in the application information transmission step; a notification step of notifying whether the application for entry or exit of the applicant user has been accepted based on the obtained authentication result; A control program for a communication terminal including: (Appendix 18) a face information registration unit that registers face information of a user who enters or leaves a predetermined location as face information of a registered user in association with the location; an information acquisition unit that acquires location information of a communication terminal, face information of an applicant user who is applying to enter or exit the location and captured by the communication terminal, and application information for entry or exit input to the communication terminal; a user authentication unit that performs user authentication by comparing the facial information of the applicant user acquired by the information acquisition unit with facial information of the registered user registered in the facial information registration unit; an entrance / exit recording unit that records the entry or exit of the applicant user to the location corresponding to the location information when the user authentication is successful; An entrance / exit management system equipped with the above. (Appendix 19) the face information registration unit registers face information of the user in association with the location acquired from the issued location identification code that identifies the location; the information acquisition unit acquires location information of the communication terminal, face information of the application user, and the application information when the acquired location is stored in the communication terminal; 19. The entrance / exit management system according to claim 18, further comprising a location deletion unit that deletes the location stored in the communication terminal when the user authentication unit fails to authenticate. (Appendix 20) a face information registration step of registering face information of a user who enters or leaves a predetermined place in a face information registration unit as face information of a registered user in association with the place; an information acquisition step of acquiring location information of a communication terminal, face information of an applicant user who is applying to enter or leave the place and captured by the communication terminal, and application information for entry or exit inputted to the communication terminal; a user authentication step of comparing the face information of the applicant user acquired in the information acquisition step with face information of the registered user registered in the face information registration unit to perform user authentication; an entrance / exit recording step of recording, in a case where the user authentication is successful, the entry or exit of the applicant user to the place corresponding to the position information in an entrance / exit recording unit; An entrance / exit management method for an entrance / exit management system comprising:

Claims

1. an information acquisition unit that acquires, from a communication terminal that has captured an image of a person entering or leaving the venue, position and time information of the communication terminal and face information of the person entering or leaving the venue, the position and time information being associated with each other; a recording unit that records the location and the time information as a record of the entry and exit of the person based on a result of execution of face authentication using the face information, in association with the person; an output unit that outputs the entry / exit record to a terminal different from the communication terminal; An information processing system comprising:

2. An authentication unit that performs the face authentication; a determination unit that determines whether the position satisfies a predetermined condition if the execution result indicates success; The information processing system according to claim 1 , further comprising:

3. The information processing system according to claim 2 , wherein the determination unit determines, as the predetermined condition, whether or not the position is within a preset range.

4. The information processing system according to claim 1 , 2 or 3 , wherein the information acquisition unit acquires the positions of the communication terminals, the time information and the face information from a plurality of the communication terminals.

5. The information processing system according to claim 1 , wherein the information acquisition unit acquires face information of people entering and leaving each of a plurality of locations in association with a position of the communication terminal and the time information.

6. acquiring, from the communication terminals that have captured the images of the people entering and leaving the venue, location and time information of the communication terminals that are associated with each other, and face information of the people entering and leaving the venue; based on a result of performing face authentication based on the face information, record the location and the time information as a record of the entry and exit of the person entering and exiting the venue in association with the person; An information processing method, comprising: outputting the entry / exit record to a terminal different from the communication terminal.

7. The information processing method according to claim 6 , further comprising acquiring face information of people entering and leaving each of a plurality of locations in association with a position of the communication terminal and the time information.

8. A process of acquiring, from a communication terminal that has captured an image of a person entering or leaving the venue, location and time information of the communication terminal and face information of the person entering or leaving the venue, which are associated with each other; a process of recording the location and the time information associating with the entering / exiting person as a record of the entering / exiting person based on a result of performing face authentication based on the face information; A process of outputting the entry and exit record to a terminal different from the communication terminal; A program that causes a computer to execute the following.

9. acquiring face information of people entering and leaving each of a plurality of locations in association with the location of the communication terminal and the time information; The program according to claim 8, further comprising:

Images