Information processing device, information processing method, and recording medium

Abstract

To provide an information processing device, information processing method, and recording medium, which allow for improving biometric information verification accuracy.SOLUTION: An information processing device provided herein comprises an information management unit configured to register boarding information pertaining to boarding of users in association with biometric information of the users, as acquired during a check-in procedure of the users, and a collation unit configured to collate target biometric information representing biometric information of one user as acquired during a procedure for boarding with registered biometric information representing biometric information registered by the information management unit. The collation unit selects registered biometric information to be collated with the target biometric information on the basis of the status of the user corresponding to the registered biometric information regarding the procedure for boarding.SELECTED DRAWING: Figure 28

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] Patent Document 1 describes that a traceability check of a passenger is performed using an identity authentication information registration unit, a behavior tracking management unit, and a network camera monitoring unit provided in an airport server, as well as a network camera installed within the airport. In the traceability check described in Patent Document 1, an image of the passenger taken by a network camera located anywhere within the airport is compared with an image including the passenger's facial image stored as identity authentication information. Furthermore, the passenger's behavior is tracked and managed using location information of the network camera installation location and the timestamp of the captured image.

[0003] Furthermore, Patent Document 2 describes an information processing method for detecting a change in pedestrians when a change in pedestrian occurs along a route traveled by the pedestrians. The information processing method described in Patent Document 1 executes a first authentication process to authenticate the pedestrian using first biometric information read from a medium carried by the pedestrian passing a first location and second biometric information acquired from an image captured of the pedestrian passing the first location. Furthermore, if authentication of the pedestrian through the first authentication process is successful, third biometric information based on the first biometric information used in the first authentication process is stored in a storage unit. Furthermore, a second authentication process is executed to authenticate the pedestrian using the third biometric information and fourth biometric information acquired from an image captured of the pedestrian passing a second location downstream of the first location in the direction of travel of the pedestrian. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2005 / 055151 [Patent Document 2] International Publication No. 2015 / 136938 Summary of the Invention [Problem to be solved by the invention]

[0005] The technologies described in Patent Documents 1 and 2 use images taken by network cameras installed in airports or images of passersby for matching. Therefore, the technologies described in Patent Documents 1 and 2 increase the number of populations for matching biometric information, which may result in a decrease in the accuracy of matching biometric information.

[0006] In view of the above-mentioned problems, an object of the present invention is to provide an information processing device, an information processing method, and a recording medium that can improve the accuracy of matching biometric information. [Means for solving the problem]

[0007] According to one aspect of the present invention, there is provided an information processing device having an information management unit that registers boarding information regarding a user's boarding, which is obtained through the user's check-in procedure, and the user's biometric information in association with each other, and a matching unit that compares target biometric information, which is biometric information obtained for one of the users during the procedures leading up to boarding, with registered biometric information, which is the biometric information registered by the information management unit, and the matching unit selects the registered biometric information to compare with the target biometric information based on the status of the user's procedures leading up to boarding, which corresponds to the registered biometric information.

[0008] According to another aspect of the present invention, there is provided an information processing device having an information management unit that registers boarding information and biometric information regarding the user's boarding obtained through the user's check-in procedure, a transmission unit that transmits to the device matching information that matches the biometric information received from the device that performs the procedures up to the user's boarding with biometric information whose status regarding the procedures is incomplete, and a status management unit that updates the status regarding the procedures when status information indicating that the procedures have been completed is received from the device.

[0009] According to yet another aspect of the present invention, there is provided an information processing method which registers boarding information regarding a user's boarding, obtained through the user's check-in procedure, and the user's biometric information in association with each other, compares target biometric information, which is the biometric information obtained for one of the users during the procedures leading up to boarding, with registered biometric information, which is the biometric information registered by the information management unit, and selects the registered biometric information to be compared with the target biometric information based on the status of the user regarding the procedures leading up to boarding, which corresponds to the registered biometric information.

[0010] According to yet another aspect of the present invention, there is provided a recording medium having recorded thereon a program that causes a computer to register boarding information regarding a user's boarding, obtained through the user's check-in procedure, and the user's biometric information in association with each other, compare target biometric information, which is the biometric information obtained for one of the users during the procedures leading up to boarding, with registered biometric information, which is the biometric information registered by the information management unit, and select the registered biometric information to be compared with the target biometric information based on the status of the user regarding the procedures leading up to boarding, which corresponds to the registered biometric information. [Effects of the Invention]

[0011] According to the present invention, the status of passengers scheduled to board can be grasped in more detail. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of an information processing system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the check-in terminal according to the first embodiment of the present invention. [Figure 3] FIG. 3 is a block diagram showing an example of the hardware configuration of the automated baggage check-in machine according to the first embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing an example of the hardware configuration of the security inspection device according to the first embodiment of the present invention. [Figure 5] FIG. 5 is a block diagram showing an example of the hardware configuration of the automated gate apparatus according to the first embodiment of the present invention. [Figure 6] FIG. 6 is a block diagram showing an example of the hardware configuration of the signage terminal according to the first embodiment of the present invention. [Figure 7] FIG. 7 is a block diagram showing an example of the hardware configuration of the boarding gate apparatus according to the first embodiment of the present invention. [Figure 8] FIG. 8 is a block diagram showing an example of the hardware configuration of the management server according to the first embodiment of the present invention. [Figure 9] FIG. 9 is a block diagram showing an example of the hardware configuration of the business terminal according to the first embodiment of the present invention. [Figure 10] FIG. 10 is a sequence diagram showing the operations of the check-in terminal and the management server in the information processing system according to the first embodiment of the present invention. [Figure 11] FIG. 11 is a sequence diagram showing the operations of the automated baggage drop machine and the management server in the information processing system according to the first embodiment of the present invention. [Figure 12] FIG. 12 is a sequence diagram showing the operations of the security inspection device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 13] FIG. 13 is a sequence diagram showing the operations of the automated gate device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 14] FIG. 14 is a sequence diagram showing the operations of the signage terminal and the management server in the information processing system according to the first embodiment of the present invention. [Figure 15] FIG. 15 is a sequence diagram showing the operations of the boarding gate device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 16] FIG. 16 is a schematic diagram showing an example of the user information database of the management server according to the first embodiment of the present invention. [Figure 17]FIG. 17 is a schematic diagram showing an example of the first matching information database of the management server according to the first embodiment of the present invention. [Figure 18] FIG. 18 is a schematic diagram showing an example of the second matching information database of the management server according to the first embodiment of the present invention. [Figure 19] FIG. 19 is a schematic diagram showing an example of the third matching information database of the management server according to the first embodiment of the present invention. [Figure 20] FIG. 20 is a schematic diagram showing an example of the fourth matching information database of the management server according to the first embodiment of the present invention. [Figure 21] FIG. 21 is a schematic diagram showing an example of the fifth matching information database of the management server according to the first embodiment of the present invention. [Figure 22] FIG. 22 is a schematic diagram showing an example of deadline times for each procedure set by the management server according to the first embodiment of the present invention. [Figure 23] FIG. 23 is a flowchart (part 1) showing the operation including the status management operation and the alert operation of the management server in the information processing system according to the first embodiment of the present invention. [Figure 24] FIG. 24 is a flowchart (part 2) showing the operation including the status management operation and the alert operation of the management server in the information processing system according to the first embodiment of the present invention. [Figure 25A] FIG. 25 is a schematic diagram showing an example of an alert displayed on the business terminal according to the first embodiment of the present invention. [Figure 25B] FIG. 25B is a schematic diagram showing an example of a status check screen displayed on the business terminal according to the first embodiment of the present invention. [Figure 25C] FIG. 25C is a schematic diagram showing an example of a status check screen displayed on the business terminal according to the first embodiment of the present invention. [Figure 26] FIG. 26 is a flowchart showing the alert operation of the management server according to the second embodiment of the present invention. [Figure 27]FIG. 27 is a block diagram showing the configuration of an information processing device according to another embodiment of the present invention. [Figure 28] FIG. 28 is a block diagram showing the configuration of an information processing device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0013] [First embodiment] An information processing system, an information processing device, and an information processing method according to a first embodiment of the present invention will be described with reference to FIGS. 1 to 25C.

[0014] First, the configuration of the information processing system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing the overall configuration of the information processing system according to this embodiment.

[0015] 1, the information processing system 1 according to this embodiment includes a management server 10, a check-in terminal 20, an automated baggage drop machine 30, a security inspection device 40, an automated gate device 50, a signage terminal 60, a boarding gate device 70, and an operations terminal 80. The information processing system 1 according to this embodiment is, for example, a tracking system that grasps and manages the situation within airport A of a user U who is scheduled to board an aircraft at airport A, and tracks the user U.

[0016] The information processing system 1 may be one that grasps and manages the situation within a facility for users who plan to board a transportation means, in addition to users U who plan to board an aircraft at airport A. For example, the information processing system 1 may be one that grasps and manages the situation within a seaport for users who plan to board a ship. Also, for example, the information processing system 1 may be one that grasps and manages the situation within a station for users who plan to board a train.

[0017] The management server 10 is installed, for example, in the facilities of an airport company, an airline, or the like that operates airport A. The check-in terminal 20 is installed in a check-in lobby P1 in airport A. The automated baggage drop machine 30 is installed at a baggage counter P2 in airport A. The security inspection device 40 is installed at a security inspection point P3 in airport A. The automated gate device 50 is installed at a departure immigration checkpoint P4 in airport A. The signage terminal 60 is installed in a passage P5 in airport A. The passage P5 is a passage connecting the departure immigration checkpoint P4 and a boarding gate P6. The boarding gate device 70 is installed at a boarding gate P6 in airport A. A user U can board an aircraft from the boarding gate P6. The business terminal 80 is carried by, for example, an employee of an airline company, an airport company, or the like. The business terminal 80 may also be installed in a business location, for example, at a counter where the employee works.

[0018] After arriving at airport A, a user U planning to board an international flight passes through various procedures or passing points, namely, check-in lobby P1, baggage counter P2, security checkpoint P3, immigration checkpoint P4, and passageway P5, in that order, before boarding the aircraft at boarding gate P6. User U checks in (boards) at check-in lobby P1 using check-in terminal 20. User U also checks in baggage at baggage counter P2 using automated baggage drop machine 30, if necessary. After check-in and baggage checkpoint P2, user U undergoes security screening at security checkpoint P3 using security screening device 40. After security screening, user U undergoes immigration screening at immigration checkpoint P4 using automated gate device 50. After leaving immigration checkpoint P4, user U passes through passageway P5, where signage terminal 60 is installed, to arrive at boarding gate P6. User U passes through boarding gate device 70 at boarding gate P6 to board the aircraft.

[0019] Note that user U may not only be a person planning to board an international flight, but may also be a person planning to board a domestic flight. In the case of user U planning to board a domestic flight, immigration inspection will not be conducted at immigration checkpoint P4.

[0020] A plurality of surveillance cameras 90 are installed in various locations within airport A. The surveillance cameras 90 are installed, for example, in check-in lobby P1, baggage counter P2, security checkpoint P3, immigration checkpoint P4, passageway P5, and boarding gate P6. Identifying the location of user U using the surveillance cameras 90 will be described in the second embodiment.

[0021] The management server 10, check-in terminals 20, automated baggage drop machines 30, security inspection devices 40, automated gate devices 50, signage terminals 60, boarding gate devices 70, and surveillance cameras 90 are connected to a network NW. The network NW is composed of a LAN (Local Area Network) including the in-house communication network of airport A, a WAN (Wide Area Network), a mobile communication network, etc. The business terminal 80 can be connected to the network NW wirelessly or by wire.

[0022] The management server 10 is capable of communicating with each of the check-in terminals 20, automated baggage drop machines 30, security inspection devices 40, automated gate devices 50, signage terminals 60, boarding gate devices 70, business terminals 80, and surveillance cameras 90 via a network NW.

[0023] Next, each component of the information processing system 1 according to this embodiment will be further described with reference to FIGS.

[0024] First, the configuration of check-in terminal 20 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the hardware configuration of check-in terminal 20.

[0025] The check-in terminal 20 is an automated check-in terminal that the user U operates to carry out the check-in procedure (boarding procedure). The check-in terminal 20 may also be a check-in terminal installed at a manned counter operated by an airline employee. The check-in procedure (boarding procedure) is a procedure for inputting information to register at least information for identifying the user U who is scheduled to board an aircraft. Specifically, for example, as described below, it is a procedure for inputting information to register user information including the user U's identity information, face information, and boarding information.

[0026] 2, the check-in terminal 20 has a CPU (Central Processing Unit) 202, a RAM (Random Access Memory) 204, a storage device 206, an input device 208, and a display 210. The check-in terminal 20 further has a medium reading device 212, a biometric information acquisition device 214, and a communication unit 216. The CPU 202, RAM 204, storage device 206, input device 208, display 210, medium reading device 212, biometric information acquisition device 214, and communication unit 216 are connected to a bus line 218.

[0027] CPU 202 operates by executing programs stored in storage device 206, and functions as a control unit that controls the overall operation of check-in terminal 20. CPU 202 also executes application programs stored in storage device 206 to perform various processes as check-in terminal 20. RAM 204 provides a memory area necessary for the operation of CPU 202.

[0028] More specifically, the CPU 202 functions as a matching unit that matches the facial image of a user U who is checking in using the check-in terminal 20. The CPU 202 as a matching unit matches a passport facial image, which is a facial image acquired from the passport of the user U by the medium reading device 212, with a captured facial image, which is a facial image captured by the biometric information acquisition device 214 during the check-in procedure. When matching the passport facial image with the captured facial image, the CPU 202 can match both facial images by matching facial feature amounts extracted from the passport facial image with facial feature amounts extracted from the captured facial image.

[0029] Instead of functioning as a matching unit, the CPU 202 can be configured to request an external server such as the management server 10 to match the face image of the user U and obtain the matching result from the external server. In this case, the CPU 202 can transmit the passport face image and the captured face image of the user U to the external server and request matching of the face images.

[0030] Furthermore, the CPU 202 functions as a user information transmission unit that transmits the user information of the user U to the management server 10. The CPU 202 as the user information transmission unit transmits the user information of the user U to the management server 10 when the passport facial image of the user U matches the captured facial image and the identity of the user U is successfully verified.

[0031] The user information of user U includes user U's identification information, face information, and boarding information, which are associated with each other.

[0032] The identity information is information about the user U, such as the user U's name, nationality, gender, date of birth, etc. The identity information is obtained from the user U's passport or airline ticket medium by the medium reading device 212. The identity information may also include passport information, such as the passport number and passport issuing country, obtained from the user U's passport by the medium reading device 212.

[0033] The face information is a captured face image or a passport face image of the user U that has been verified by the CPU 202. The face information may be either the captured face image or the passport face image, or both. The face information does not have to be the captured face image or the passport face image itself, but may be facial feature amounts extracted from the captured face image or the passport face image.

[0034] The boarding information is information about the flight that user U plans to take, such as the airline, flight number, departure point, arrival point, departure date and time, and arrival date and time of the aircraft that user U plans to board. The boarding information may also include the boarding time when boarding for user U is closed. The boarding information is obtained from user U's airline ticket medium by the medium reading device 212.

[0035] The user information of user U transmitted to management server 10 is registered in a user information database (DB) 106a in management server 10, as will be described later. The user information of user U transmitted to management server 10 is also registered in first to fifth matching information DBs 106b1, 106b2, 106b3, 106b4, and 106b5, as will be described later, and used for matching.

[0036] Furthermore, CPU 202 functions as a status information transmission unit that transmits status information, which is information regarding the status of user U. When CPU 202 as a status information transmission unit transmits user information of user U and completes the check-in procedure, it transmits status information indicating that check-in procedure of user U has been completed to management server 10. The status information is associated in management server 10 with at least one of user information of user U or facial information, passport information, and boarding information included in the user information.

[0037] The CPU 202 only needs to transmit at least information for identifying the user U who is scheduled to board the aircraft and status information regarding the check-in procedure. In this case, the boarding information of the user U only needs to be registered in advance in a database of a server such as the management server 10.

[0038] The CPU 202 also functions as a display control unit that displays screens for guidance, notifications, etc. for the user U on the display 210. For example, the CPU 202 as a display control unit causes the display 210 to display a guidance screen that provides guidance on how to use the check-in terminal 20. Furthermore, when the face image on the passport of the user U does not match the captured face image and identity verification of the user U fails, the CPU 202 causes the display 210 to display a notification screen that notifies the user U that identity verification has failed.

[0039] The storage device 206 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 206 stores programs executed by the CPU 202, data referenced by the CPU 202 when executing the programs, etc.

[0040] The input device 208 is, for example, a touch panel incorporated in the display 210. The input device 208 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the check-in terminal 20 via the input device 208.

[0041] The display 210 functions as a display unit that displays various screens to the user U who uses the check-in terminal 20. For example, the display 210 displays a guidance screen that provides guidance on how to use the check-in terminal 20 and a notification screen for the user U.

[0042] The medium reading device 212 functions as an information acquisition unit that reads the passport or airline ticket medium of the user U and acquires information recorded on the passport or airline ticket. The airline ticket medium is, for example, a paper airline ticket or a mobile terminal that displays an e-ticket receipt. The medium reading device 212 is composed of, for example, a code reader, an image scanner, a contactless IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, etc., and acquires information from various media held over the reading unit.

[0043] For example, the medium reading device 212 reads and acquires the identity information and passport information of user U displayed on the face of the passport using an OCR device. Also, for example, the medium reading device 212 reads and acquires the passport facial image of user U displayed on the face of the passport using an image scanner. Also, in the case of an ePassport, the medium reading device 212 reads and acquires the identity information, passport information, passport facial image, etc. of user U recorded in the IC chip of the ePassport using a contactless IC reader. Also, for example, the medium reading device 212 reads the barcode or QR code (registered trademark) displayed on the airline ticket medium using a code reader to acquire the identity information and boarding information of user U from the airline ticket medium.

[0044] The check-in terminal 20 can acquire the identity information and boarding information not only from the airline ticket medium but also by other methods. For example, the CPU 202 can inquire about airline ticket reservation and purchase information based on the user U's credit card number, reservation number, confirmation number, etc., to the airline server and acquire the user U's identity information and boarding information from the airline server.

[0045] The biometric information acquisition device 214 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U performing the check-in procedure. The biometric information acquisition device 214 is, for example, a digital camera that captures an image of the face of the user U standing in front of the check-in terminal 20, and captures the image of the face of the user U.

[0046] The communication unit 216 is connected to the network NW and transmits and receives data via the network NW. The communication unit 216 communicates with the management server 10 and the like under the control of the CPU 202.

[0047] In this way, check-in terminal 20 is configured.

[0048] Next, the configuration of the automated baggage check-in machine 30 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the hardware configuration of the automated baggage check-in machine 30. The automated baggage check-in machine 30 is a device that a user U operates to check in baggage that will not be carried onto an aircraft. The user U can carry out procedures to check in baggage at the automated baggage check-in machine 30 as necessary.

[0049] 3, the automated baggage drop machine 30 has a CPU 302, a RAM 304, a storage device 306, an input device 308, and a display 310. The automated baggage drop machine 30 further has a biometric information acquisition device 312, a baggage conveying device 314, an output device 316, and a communication unit 318. The CPU 302, RAM 304, storage device 306, input device 308, display 310, biometric information acquisition device 312, baggage conveying device 314, output device 316, and communication unit 318 are connected to a bus line 320.

[0050] The CPU 302 operates by executing a program stored in the storage device 306, and functions as a control unit that controls the overall operation of the automated baggage drop machine 30. The CPU 302 also executes an application program stored in the storage device 306 to perform various processes as the automated baggage drop machine 30. The RAM 304 provides a memory area necessary for the operation of the CPU 302.

[0051] More specifically, the CPU 302 functions as a matching request unit that requests matching of a facial image of a user U who is performing baggage check-in procedures using the automated baggage drop machine 30. The CPU 302 as the matching request unit requests the management server 10 to perform a 1:N matching of a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 312, with a plurality of registered facial images registered in the first matching information DB 106b1 of the management server 10. For this purpose, the CPU 302 transmits the target facial image captured by the biometric information acquisition device 312 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target facial image as the target biometric information, the CPU 302 may request matching by transmitting facial features, which are features extracted from the target facial image.

[0052] Instead of requesting the above-mentioned 1:N matching, the CPU 302 can also request the management server 10 to match the target facial image of user U with a registered facial image associated with the information on user U's passport, boarding pass, or QR code. In this case, when the management server 10 registers the photographed facial image or passport facial image of user U acquired by the check-in terminal 20 as a registered facial image in the user information DB 106a, it registers the image in association with the information on user U's passport, boarding pass, or QR code. The CPU 302 reads the information on user U's passport, boarding pass, or QR code using a medium reading device (not shown), and transmits the read information together with the target facial image to the management server 10. The management server 10 obtains from the user information DB 106a a registered facial image associated with the information on the passport, boarding pass, or QR code that matches the information on the passport, boarding pass, or QR code transmitted from the automated baggage check machine 30. The management server 10 performs a one-to-one comparison between the target face image transmitted from the automated baggage drop machine 30 and the registered information face image acquired from the user information DB 106a. The management server 10 can also acquire a registered face image associated with information on a passport, a boarding pass, or a QR code from the first matching information DB 106b1.

[0053] The CPU 302 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of the matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of the matching, a registered face image matching the target face image was found and the identity of user U performing baggage check-in procedures was successful, or that a matching registered face image was not found and the identity of user U was unsuccessful. In the case of 1:1 matching, the matching result information indicates that, as a result of the matching, the target face image matches the registered face image and the identity of user U performing baggage check-in procedures was successful, or that there was no match and the identity of user U was unsuccessful.

[0054] Note that, instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 302 can also be configured to function as a matching unit that matches the target face image with the registered face images on a 1:N or 1:1 basis as described above and outputs matching result information. In this case, the CPU 302 can perform facial image matching by referring to the first matching information DB 106b1 of the management server 10 or by referring to a matching information DB synchronized with the first matching information DB 106b1 and stored in the storage device 306.

[0055] Furthermore, if the matching result information indicates that the identity of user U has been successfully verified, CPU 302 controls baggage transport device 314 to receive and transport user U's baggage.

[0056] Furthermore, CPU 302 functions as a status information transmission unit that transmits status information, which is information regarding the status of user U. When baggage conveying device 314 has completed receipt and transportation of baggage and baggage check-in procedures have been completed, CPU 302 as the status information transmission unit transmits status information indicating that user U's baggage check-in procedures have been completed to management server 10. The status information is associated in management server 10 with user information of user U or at least one of facial information, passport information, and boarding information included in the user information.

[0057] Furthermore, the CPU 302 functions as a display control unit that causes screens for guidance, notifications, etc., for the user U to be displayed on the display 310. For example, the CPU 302 as a display control unit causes the display 310 to display a guidance screen that provides guidance on how to use the automated baggage check machine 30. Furthermore, when the matching result information indicates that identity verification of the user U has failed, the CPU 302 causes the display 310 to display a notification screen that notifies the user U that identity verification has failed.

[0058] The storage device 306 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 306 stores programs executed by the CPU 302, data referenced by the CPU 302 when executing the programs, etc.

[0059] The input device 308 is, for example, a touch panel incorporated in the display 310. The input device 308 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the automated baggage drop machine 30 via the input device 308.

[0060] The display 310 functions as a display unit that displays various screens to the user U who uses the automated baggage drop machine 30. For example, the display 310 displays a guidance screen that provides instructions on how to use the automated baggage drop machine 30 and a notification screen for the user U.

[0061] The biometric information acquisition device 312 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U who is performing the baggage check-in procedure. The biometric information acquisition device 312 is, for example, a digital camera that takes an image in front of the automated baggage drop machine 30, and when it detects the face of the user U standing in front of the automated baggage drop machine 30 in an image that it takes constantly or periodically, it takes an image of the face of the user U and acquires the facial image.

[0062] If the identity verification of user U is successful, the baggage transporting device 314 transports the baggage to be loaded onto the aircraft that user U is boarding. The baggage transporting device 314 transports the baggage that user U has placed in the receiving area and attached with a baggage tag to the baggage sorting area.

[0063] The output device 316 outputs a baggage tag to be attached to the checked baggage, and also outputs a baggage claim ticket required to collect the baggage after arrival. User U attaches the baggage tag output from the output device 316 to the checked baggage. User U also receives the baggage claim ticket output from the output device 316 in order to collect the baggage after arrival. The baggage tag is associated in the management server 10 with user information of user U or at least one of facial information, passport information, and boarding information included in the user information.

[0064] The communication unit 318 is connected to the network NW and transmits and receives data via the network NW. The communication unit 318 communicates with the management server 10 and the like under the control of the CPU 302.

[0065] In this way, the automated baggage drop machine 30 is configured.

[0066] Next, the configuration of the security inspection device 40 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the hardware configuration of the security inspection device 40. The security inspection device 40 is a device that checks whether or not the user U is carrying any metal objects that could be dangerous using a metal detector gate 414, which is a metal detector. Note that the security inspection device 40 may be a device that checks for the presence or absence of dangerous objects in carry-on baggage, etc., using an X-ray inspection device or the like, in addition to a metal detector such as the metal detector gate 414.

[0067] 4, the security inspection device 40 has a CPU 402, a RAM 404, a storage device 406, an input device 408, a display 410, a biometric information acquisition device 412, a metal detection gate 414, and a communication unit 416. The CPU 402, RAM 404, storage device 406, input device 408, display 410, biometric information acquisition device 412, metal detection gate 414, and communication unit 416 are connected to a bus line 418.

[0068] The CPU 402 operates by executing a program stored in the storage device 406, and functions as a control unit that controls the overall operation of the security inspection device 40. The CPU 402 also executes an application program stored in the storage device 406 to perform various processes as the security inspection device 40. The RAM 404 provides a memory area necessary for the operation of the CPU 402.

[0069] More specifically, the CPU 402 functions as a matching request unit that requests matching of a facial image of user U undergoing a security inspection procedure by the security inspection device 40. The CPU 402 as the matching request unit requests the management server 10 to perform a 1:N matching of a target facial image, which is a facial image of user U captured by the biometric information acquisition device 412, with a plurality of registered facial images registered in the second matching information DB 106b2 of the management server 10. For this purpose, the CPU 402 transmits the target facial image captured by the biometric information acquisition device 412 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target facial image as the target biometric information, the CPU 402 may request matching by transmitting facial features, which are features extracted from the target facial image.

[0070] Instead of requesting the above-mentioned 1:N matching, the CPU 402 can also request the management server 10 to match the target facial image of user U with a registered facial image associated with information on user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed facial image or passport facial image of user U acquired by the check-in terminal 20 as a registered facial image in the user information DB 106a, it registers the image in association with information on user U's passport, boarding pass, or code symbol. The CPU 402 reads information on user U's passport, boarding pass, or code symbol using a media reading device (not shown), and transmits the read information together with the target facial image to the management server 10. The management server 10 obtains, from the user information DB 106a, a registered facial image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the security inspection device 40. The management server 10 performs a one-to-one comparison between the target face image transmitted from the security inspection device 40 and the registered information face image acquired from the user information DB 106a. Note that the management server 10 can also acquire a registered face image associated with information on a passport, a boarding pass, or a QR code from the second matching information DB 106b2.

[0071] The CPU 402 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of the matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of the matching, a registered face image matching the target face image was found and the identity of user U undergoing security inspection procedures was successful, or that a matching registered face image was not found and the identity of user U was unsuccessful. In the case of 1:1 matching, the matching result information indicates that, as a result of the matching, the target face image matches the registered face image and the identity of user U undergoing security inspection procedures was successful, or that there was no match and the identity of user U was unsuccessful.

[0072] Note that, instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 402 can also be configured to function as a matching unit that matches the target face image with the registered face image on a 1:N or 1:1 basis as described above and outputs matching result information. In this case, the CPU 402 can perform facial image matching by referring to the second matching information DB 106b2 of the management server 10 or by referring to a matching information DB synchronized with the second matching information DB 106b2 and stored in the storage device 406.

[0073] Furthermore, if the matching result information indicates that the identity of user U has been successfully verified, CPU 402 continues the inspection using metal detection gate 414 .

[0074] The CPU 402 also functions as a status information transmission unit that transmits status information, which is information regarding the status of the user U. When the inspection through the metal detection gate 414 is completed without any abnormalities, the CPU 402 as the status information transmission unit transmits status information indicating that the security inspection procedure for the user U has been completed to the management server 10. The status information is associated in the management server 10 with the user information of the user U or at least any of the facial information, passport information, and boarding information included in the user information.

[0075] The CPU 402 also functions as a display control unit that displays on the display 410 screens for guidance, notifications, etc. for the user U. For example, the CPU 402 as a display control unit causes the display 410 to display a screen that urges the user U to pass through the metal detection gate 414. When the matching result information indicates that the identity verification of the user U has failed, the CPU 402 causes the display 410 to display a notification screen that notifies the user U that the identity verification has failed. When metal objects are detected during the inspection by the metal detection gate 414, the CPU 402 causes the display 410 to display a notification screen that instructs the user U to check whether any metal objects are present in their belongings and to pass through the metal detection gate 414 again.

[0076] The storage device 406 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 406 stores programs executed by the CPU 402, data referenced by the CPU 402 when executing the programs, etc.

[0077] The input device 408 is, for example, a touch panel incorporated in the display 410. The input device 408 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the security inspection device 40 via the input device 408.

[0078] The display 410 functions as a display unit that displays various screens to the user U undergoing the security inspection procedure by the security inspection device 40. For example, the display 410 displays a screen that prompts the user U to pass through the metal detection gate 414, and a notification screen for the user U.

[0079] The biometric information acquisition device 412 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U undergoing the security inspection procedure. The biometric information acquisition device 412 is, for example, a digital camera that takes an image in front of the metal detection gate 414, and when it detects the face of the user U standing in front of the metal detection gate 414 in an image that is constantly or periodically captured, it photographs the face of the user U and acquires the facial image.

[0080] The metal detection gate 414 is a gate-type metal detector that detects metal objects carried by a user U who passes through the metal detection gate 414.

[0081] The communication unit 416 is connected to the network NW and transmits and receives data via the network NW. The communication unit 416 communicates with the management server 10 and the like under the control of the CPU 402.

[0082] In this way, the security inspection device 40 is configured.

[0083] Next, the configuration of the automated gate device 50 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the hardware configuration of the automated gate device 50. The automated gate device 50 is a device that automatically performs the departure inspection procedure for a user U. A user U who can use the departure inspection procedure using the automated gate device 50 is, for example, a person who has been screened by prior application and registered as a user of the automated gate device 50, a person who has been granted permission to use the automated gate device 50 based on a travel history such as the number of trips made, or a person who has been registered as a user based on an agreement between countries.

[0084] 5, the automated gate device 50 has a CPU 502, a RAM 504, a storage device 506, an input device 508, a display 510, a biometric information acquisition device 512, a gate 514, and a communication unit 516. The CPU 502, RAM 504, storage device 506, input device 508, display 510, biometric information acquisition device 512, gate 514, and communication unit 516 are connected to a bus line 518.

[0085] The CPU 502 operates by executing programs stored in the storage device 506, and functions as a control unit that controls the overall operation of the automated gate device 50. The CPU 502 also executes application programs stored in the storage device 506 to perform various processes as the automated gate device 50. The RAM 504 provides a memory area necessary for the operation of the CPU 502.

[0086] More specifically, the CPU 502 functions as a matching request unit that requests matching of a facial image of a user U who undergoes immigration procedures using the automated gate device 50. The CPU 502 as the matching request unit requests the management server 10 to perform a 1:N matching of a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 512, with a plurality of registered facial images registered in the third matching information DB 106b3 of the management server 10. For this purpose, the CPU 502 transmits the target facial image captured by the biometric information acquisition device 512 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target facial image as the target biometric information, the CPU 502 may request matching by transmitting facial features, which are features extracted from the target facial image.

[0087] Instead of requesting the above-mentioned 1:N matching, the CPU 502 can also request the management server 10 to match the target facial image of user U with a registered facial image associated with information on user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed facial image or passport facial image of user U acquired by the check-in terminal 20 as a registered facial image in the user information DB 106a, it registers the image in association with information on user U's passport, boarding pass, or code symbol. The CPU 502 reads information on user U's passport, boarding pass, or code symbol using a media reading device (not shown), and transmits the read information together with the target facial image to the management server 10. The management server 10 obtains, from the user information DB 106a, a registered facial image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the automated gate device 50. The management server 10 performs a one-to-one comparison between the target face image transmitted from the automated gate device 50 and the registered information face image acquired from the user information DB 106a. The management server 10 can also acquire a registered face image associated with information on a passport, a boarding pass, or a QR code from the third matching information DB 106b3.

[0088] The CPU 502 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of the matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of the matching, a registered face image matching the target face image was found and the identity of user U undergoing immigration inspection procedures was successful, or that a matching registered face image was not found and the identity of user U was unsuccessful. In the case of 1:1 matching, the matching result information indicates that, as a result of the matching, the target face image matches the registered face image and the identity of user U undergoing immigration inspection procedures was successful, or that there was no match and the identity of user U was unsuccessful.

[0089] Note that, instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 502 can also be configured to function as a matching unit that matches the target face image with the registered face images on a 1:N or 1:1 basis as described above and outputs matching result information. In this case, the CPU 502 can perform facial image matching by referring to the third matching information DB 106b3 of the management server 10 or by referring to a matching information DB synchronized with the third matching information DB 106b3 and stored in the storage device 506.

[0090] Furthermore, if the matching result information indicates that the identity of user U has been successfully verified, CPU 502 controls gate 514 to allow user U to pass through gate 514 .

[0091] Furthermore, the CPU 502 functions as a status information transmission unit that transmits status information, which is information regarding the status of the user U. When the CPU 502 as the status information transmission unit allows the user U to pass through the gate 514 and completes the immigration procedure, it transmits status information indicating that the immigration procedure for the user U has been completed to the management server 10. The status information is associated in the management server 10 with the user information of the user U or at least any one of the facial information, passport information, and boarding information included in the user information.

[0092] The CPU 502 also functions as a display control unit that causes the display 510 to display screens for guidance, notifications, etc. for the user U. For example, the CPU 502 as a display control unit causes the display 510 to display a guidance screen that provides guidance on how to use the automated gate device 50. Furthermore, when the matching result information indicates that identity verification of the user U has failed, the CPU 502 causes the display 510 to display a notification screen that notifies the user U that identity verification has failed.

[0093] The storage device 506 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 506 stores programs executed by the CPU 502, data referenced by the CPU 502 when executing the programs, etc.

[0094] The input device 508 is, for example, a touch panel incorporated into the display 510. The input device 508 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the automated gate device 50 via the input device 508.

[0095] The display 510 functions as a display unit that displays various screens to the user U who undergoes immigration procedures using the automated gate device 50. For example, the display 510 displays a guidance screen that provides instructions on how to use the automated gate device 50, a notification screen for the user U, etc.

[0096] The biometric information acquisition device 512 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U undergoing immigration inspection procedures. The biometric information acquisition device 512 is, for example, a digital camera that takes pictures in front of the automated gate device 50, and when it detects the face of the user U standing in front of the automated gate device 50 in images that it takes constantly or periodically, it takes a picture of the face of the user U and acquires the facial image.

[0097] When the automated gate device 50 successfully verifies the identity of the user U and the user U passes through immigration, the gate 514, under the control of the CPU 502, transitions from a closed standby state that blocks the user U's passage to an open state that allows the user U to pass. The type of gate 514 is not particularly limited, and may be, for example, a flapper gate in which a flapper provided on one or both sides of the passage opens and closes, or a turnstile gate with three rotating bars.

[0098] The communication unit 516 is connected to the network NW and transmits and receives data via the network NW. The communication unit 516 communicates with the management server 10 and the like under the control of the CPU 502.

[0099] In this way, the automated gate device 50 is constructed.

[0100] Next, the configuration of the signage terminal 60 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing an example of the hardware configuration of the signage terminal 60. The signage terminal 60 is a terminal that displays route guidance to boarding gate P6, advertisements, etc.

[0101] 6, the signage terminal 60 has a CPU 602, a RAM 604, a storage device 606, a display 608, a biometric information acquisition device 610, and a communication unit 612. The CPU 602, RAM 604, storage device 606, display 608, biometric information acquisition device 610, and communication unit 612 are connected to a bus line 614.

[0102] CPU 602 operates by executing programs stored in storage device 606, and functions as a control unit that controls the overall operation of signage terminal 60. CPU 602 also executes application programs stored in storage device 606 to perform various processes as signage terminal 60. RAM 604 provides a memory area necessary for the operation of CPU 602.

[0103] More specifically, the CPU 602 functions as a face information transmitting unit that transmits a face image of a user U in front of the signage terminal 60 to the management server 10. The user U in front of the signage terminal 60 may be, for example, a user who is in front of the signage terminal 60 and checks the information displayed on the signage terminal 60, or a user U who passes in front of the signage terminal 60. The CPU 602 as a face information transmitting unit transmits a target face image, which is a face image of the user U captured by the biometric information acquisition device 610, to the management server 10 as the target biometric information. Note that instead of transmitting the target face image, the CPU 602 may transmit facial feature amounts, which are feature amounts extracted from the target face image, as the target biometric information. Upon receiving the target face image from the signage terminal 60, the management server 10 compares the received target face image with a plurality of registered face images registered in the fourth matching information DB 106b4 in a 1:N ratio.

[0104] The CPU 602 also functions as a display control unit that causes the display 608 to display screens such as route guidance to the boarding gate P6 and advertisements.

[0105] Like the CPU 302 of the automated baggage drop machine 30, the CPU 602 of the signage terminal 60 can also function as a verification request unit, a verification result acquisition unit, and a status information transmission unit, as will be described below.

[0106] More specifically, the CPU 602 can function as a matching request unit that requests matching of a facial image of a user U who is in front of the signage terminal 60 or who passes in front of the signage terminal 60. The CPU 602 as the matching request unit requests the management server 10 to perform a 1:N matching of a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 610, with a plurality of registered facial images registered in the fourth matching information DB 106b4 of the management server 10. For this purpose, the CPU 602 transmits the target facial image captured by the biometric information acquisition device 610 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target facial image as the target biometric information, the CPU 602 may request matching by transmitting facial feature amounts, which are feature amounts extracted from the target facial image.

[0107] Instead of requesting the above-mentioned 1:N matching, the CPU 602 can also request the management server 10 to match the target facial image of user U with a registered facial image associated with information on user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed facial image or passport facial image of user U acquired by the check-in terminal 20 as a registered facial image in the user information DB 106a, it registers the image in association with information on user U's passport, boarding pass, or code symbol. The CPU 602 reads information on user U's passport, boarding pass, or code symbol using a media reading device (not shown), and transmits the read information together with the target facial image to the management server 10. The management server 10 obtains from the user information DB 106a a registered facial image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the signage terminal 60. The management server 10 performs a one-to-one comparison between the target face image transmitted from the signage terminal 60 and the registered information face image acquired from the user information DB 106a. The management server 10 can also acquire a registered face image associated with information on a passport, a boarding pass, or a QR code from the fourth matching information DB 106b4.

[0108] Furthermore, CPU 602 can function as a matching result acquisition unit that acquires, from management server 10, matching result information indicating the result of matching requested to management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image was found and identity verification of user U in front of signage terminal 60 was successful, or that a matching registered face image was not found and identity verification of user U was unsuccessful. In the case of 1:1 matching, the matching result information indicates, as a result of matching, that the target face image matches the registered face image and identity verification of user U in front of signage terminal 60 was successful, or that there was no match and identity verification of user U was unsuccessful.

[0109] Note that, instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 602 can also be configured to function as a matching unit that matches the target face image with the registered face images on a 1:N or 1:1 basis as described above and outputs matching result information. In this case, the CPU 602 can perform facial image matching by referring to the fourth matching information DB 106b4 of the management server 10 or by referring to the matching information DB synchronized with the user information DB 106a and stored in the storage device 606.

[0110] Furthermore, the CPU 602 functions as a status information transmission unit that transmits status information, which is information regarding the situation of the user U. When the CPU 602 as the status information transmission unit has successfully verified the identity of the user U in front of the signage terminal 60, it transmits to the management server 10 status information indicating that the user U has completed their location or passage in front of the signage terminal 60. The status information is associated in the management server 10 with at least one of the user information of the user U or the facial information, passport information, and boarding information included in the user information.

[0111] The storage device 606 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 606 stores programs executed by the CPU 602, data referenced by the CPU 602 when executing the programs, etc.

[0112] The display 608 functions as a display unit that displays various screens. For example, the display 608 displays a screen showing a route guide to the boarding gate P6, advertisements, etc. The route guide, advertisements, etc. displayed by the display 608 correspond to an individual identified as the user U in front of the signage terminal 60, for example.

[0113] The biometric information acquisition device 610 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U in front of the signage terminal 60. The biometric information acquisition device 610 is, for example, a digital camera that takes an image in front of the signage terminal 60, and when it detects the face of the user U in front of the signage terminal 60 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0114] The communication unit 612 is connected to the network NW and transmits and receives data via the network NW. The communication unit 612 communicates with the management server 10 and the like under the control of the CPU 602.

[0115] In this way, signage terminal 60 is configured.

[0116] Next, the configuration of boarding gate device 70 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing an example of the hardware configuration of boarding gate device 70. Boarding gate device 70 is a device that verifies that user U is a passenger of an aircraft that can board through boarding gate P6 where boarding gate device 70 is installed.

[0117] 7, the boarding gate device 70 has a CPU 702, a RAM 704, a storage device 706, an input device 708, a display 710, a biometric information acquisition device 712, a gate 714, and a communication unit 716. The CPU 702, RAM 704, storage device 706, input device 708, display 710, biometric information acquisition device 712, gate 714, and communication unit 716 are connected to a bus line 718.

[0118] The CPU 702 operates by executing a program stored in the storage device 706, and functions as a control unit that controls the overall operation of the boarding gate device 70. The CPU 702 also executes an application program stored in the storage device 706 to perform various processes as the boarding gate device 70. The RAM 704 provides a memory area necessary for the operation of the CPU 702.

[0119] More specifically, the CPU 702 functions as a verification requesting unit that requests verification of the facial image and confirmation of boarding information of a user U boarding an aircraft through boarding gate P6.

[0120] The CPU 702 as a matching request unit requests the management server 10 to perform a 1:N matching of a target face image, which is a face image of user U captured by the biometric information acquisition device 712, with a plurality of registered face images registered in the fifth matching information DB 106b5 of the management server 10. For this purpose, the CPU 702 transmits the target face image captured by the biometric information acquisition device 712 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target face image as the target biometric information, the CPU 702 may transmit facial feature amounts, which are feature amounts extracted from the target face image, to request matching.

[0121] Instead of requesting the above-mentioned 1:N matching, the CPU 702 can also request the management server 10 to match the target facial image of user U with a registered facial image associated with information on user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed facial image or passport facial image of user U acquired by the check-in terminal 20 as a registered facial image in the user information DB 106a, it registers the image in association with information on user U's passport, boarding pass, or code symbol. The CPU 702 reads information on user U's passport, boarding pass, or code symbol using a medium reading device (not shown), and transmits the read information together with the target facial image to the management server 10. The management server 10 obtains, from the user information DB 106a, a registered facial image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the boarding gate device 70. The management server 10 performs a 1:1 comparison between the target face image transmitted from the boarding gate device 70 and the registered information face image acquired from the user information DB 106a. Note that the management server 10 can also acquire a registered face image associated with information on a passport, a boarding pass, or a QR code from the fifth matching information DB 106b5.

[0122] Furthermore, the CPU 702 as a matching request unit requests the management server 10 to confirm that the boarding information associated with the registered face image that matches the target face image is related to an aircraft that can be boarded from the boarding gate P6.

[0123] The CPU 702 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of the matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image was found and identity verification of the user U who will board the aircraft was successful, or that a matching registered face image was not found and identity verification of the user U failed. The matching result information also indicates that, as a result of matching, it was confirmed that the boarding information was related to the aircraft and verification of the boarding information was successful, or that it was not confirmed that the boarding information was related and verification of the boarding information failed. In the case of 1:1 matching, the matching result information indicates that, as a result of matching, the target face image matches the registered face image and identity verification of the user U who will board the aircraft was successful, or that there was no match and identity verification of the user U failed.

[0124] Note that, instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 702 can also be configured to function as a matching unit that matches the target facial image with registered facial images in the fifth matching information DB 106b5 on a 1:N or 1:1 basis as described above and outputs matching result information. The CPU 702 can also be configured to confirm that boarding information associated with the registered facial image that matches the target facial image is related to an aircraft that can be boarded from boarding gate P6. In these cases, the CPU 702 can perform facial image matching and confirm boarding information by referring to the fifth matching information DB 106b5 of the management server 10 or by referring to a matching information DB synchronized with the fifth matching information DB 106b5 and stored in the storage device 706.

[0125] Furthermore, if the matching result information indicates that user U's identity has been successfully verified and that the boarding information has been successfully confirmed, CPU 702 controls gate 714 to allow user U to pass through gate 714.

[0126] The CPU 702 also functions as a status information transmission unit that transmits status information, which is information regarding the status of the user U. When the CPU 702 as the status information transmission unit allows the user U to pass through the gate 714 and the user U has completed boarding the aircraft, the CPU 702 transmits status information indicating that the user U has completed boarding the aircraft to the management server 10. The status information is associated in the management server 10 with the user information of the user U or at least any one of the facial information, passport information, and boarding information included in the user information.

[0127] The CPU 702 also functions as a display control unit that causes the display 710 to display screens for guidance, notifications, etc. for the user U. For example, the CPU 702 as a display control unit causes the display 710 to display a guidance screen that provides guidance on how to use the boarding gate device 70. When the matching result information indicates that identity verification of the user U has failed, the CPU 702 also causes the display 710 to display a notification screen that notifies the user U that identity verification has failed. When the matching result information indicates that boarding information verification has failed, the CPU 702 also causes the display 710 to display a notification screen that notifies the user U that boarding information verification has failed.

[0128] The storage device 706 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 706 stores programs executed by the CPU 702, data referenced by the CPU 702 when executing the programs, etc.

[0129] The input device 708 is, for example, a touch panel incorporated in the display 710. The input device 708 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the boarding gate device 70 via the input device 708.

[0130] The display 710 functions as a display unit that displays various screens to the user U who boards the aircraft through the boarding gate P6. For example, the display 710 displays a guidance screen that provides guidance on how to use the boarding gate device 70, a notification screen for the user U, etc.

[0131] The biometric information acquisition device 712 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U who boards the aircraft through the boarding gate P6. The biometric information acquisition device 712 is, for example, a digital camera that takes an image in front of the boarding gate device 70, and when it detects the face of the user U standing in front of the boarding gate device 70 in an image that is constantly or periodically captured, it photographs the face of the user U and acquires the facial image.

[0132] When the boarding gate device 70 has successfully verified the identity and boarding information of the user U, the gate 714, under the control of the CPU 702, transitions from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The type of gate 714 is not particularly limited, and may be, for example, a flapper gate in which flappers installed on one or both sides of the passage open and close, or a turnstile gate in which three bars rotate.

[0133] The communication unit 716 is connected to the network NW and transmits and receives data via the network NW. The communication unit 716 communicates with the management server 10 and the like under the control of the CPU 702.

[0134] In this manner, the boarding gate device 70 is configured.

[0135] Next, the configuration of the management server 10 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing an example of the hardware configuration of the management server 10. The management server 10 is an information processing device that manages the user information and status of the user U and matches a target face image with a plurality of registered face images in any of the first to fifth matching information DBs 106b1-106b5 in response to a facial image matching request. The functions of the management server 10 may be realized by a single server or by a plurality of server devices.

[0136] 8, the management server 10 includes a CPU 102, a RAM 104, a storage device 106, and a communication unit 108. The CPU 102, the RAM 104, the storage device 106, and the communication unit 108 are connected to a bus line 110.

[0137] The CPU 102 operates by executing programs stored in the storage device 106, and functions as a control unit that controls the overall operation of the management server 10. The CPU 102 also executes application programs stored in the storage device 106 to perform various processes as the management server 10. The RAM 104 provides a memory area necessary for the operation of the CPU 102.

[0138] More specifically, the CPU 102 functions as an information management unit that records and manages the user information of the user U received from the check-in terminal 20 in the storage device 106. The CPU 102 as an information management unit registers and manages the user information received from the check-in terminal 20 in a user information DB 106a stored in the storage device 106. Each time the CPU 102 receives user information from the check-in terminal 20, it registers the received user information in the user information DB 106a. As described above, the user information of the user U includes the user U's identification information, facial information, and boarding information, which are associated with each other. The facial information is a photographed facial image or a passport facial image acquired by the check-in terminal 20. The registered facial image, which is the photographed facial image or the passport facial image registered in the user information DB 106a, is used to compare facial images for identity verification of the user U at the automated baggage check-in machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70.

[0139] The CPU 102 also functions as a status management unit that records and manages the status of the user U with respect to multiple procedures up to the time of the user U boarding the aircraft in the storage device 106. The CPU 102 as a status management unit records and manages the status of the user U in the user information DB 106a in association with the user information of the user U. The CPU 102 manages the status of each procedure of the user U based on status information received from external devices, such as the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70. The CPU 102 also manages the status of the user U with respect to the procedures of the user U, that is, the location or passage of the user U in front of the signage terminal 60, based on the matching result of the target face image received from the signage terminal 60. The CPU 102 manages the status of each procedure of the user U together with the deadline time, which is a deadline set for the multiple procedures up to the time of the user U boarding the aircraft as described below.

[0140] Specifically, CPU 102 manages the status of the check-in procedure of user U. That is, when CPU 102 receives status information indicating that the check-in procedure of user U has been completed from check-in terminal 20, CPU 102 updates the status of the check-in procedure of user U in user information DB 106a from "incomplete" to "completed."

[0141] CPU 102 also manages the status of user U's baggage check-in procedures. That is, when CPU 102 receives status information from automated baggage check-in machine 30 indicating that user U's baggage check-in procedures have been completed, it updates the status of user U's baggage check-in procedures in user information DB 106a from "incomplete" to "completed." Note that user U's baggage check-in procedures are optional procedures that are performed when baggage needs to be checked in. For this reason, the status of user U's baggage check-in procedures may remain "incomplete." This is intended for cases where some users U have little baggage and do not check in any baggage.

[0142] Furthermore, CPU 102 manages the status of the security inspection procedure for user U. That is, when CPU 102 receives status information indicating that the security inspection procedure for user U has been completed from security inspection device 40, CPU 102 updates the status of the security inspection procedure for user U in user information DB 106a from "incomplete" to "completed."

[0143] Furthermore, the CPU 102 manages the status of the immigration procedure for the user U. That is, when the CPU 102 receives status information indicating that the immigration procedure for the user U has been completed from the automated gate device 50, the CPU 102 updates the status of the immigration procedure for the user U in the user information DB 106a from "uncompleted" to "completed."

[0144] Furthermore, the CPU 102 manages the status of the user U's boarding onto the aircraft. That is, when the CPU 102 receives status information indicating that the user U has completed boarding onto the aircraft from the boarding gate device 70, the CPU 102 updates the status of the user U's boarding onto the aircraft in the user information DB 106a from incomplete to completed.

[0145] Furthermore, CPU 102 also manages the status of user U's location in front of or passage through signage terminal 60. In this case, when CPU 102 receives a target face image from signage terminal 60, it compares the received target face image with multiple registered face images in user information DB 106a. If a matching registered face image is found as a result of the comparison, CPU 102 updates the status of user U's location in front of or passage through signage terminal 60 in user information DB 106a from "incomplete" to "completed."

[0146] In this way, CPU 102, as a status management unit, manages the status of user U's multiple procedures before boarding, including check-in, baggage check-in, security inspection, immigration control, whereabouts in front of or passing through signage terminal 60, and boarding the aircraft. CPU 102 manages the status of each procedure for user U based on the results of matching a target face image acquired during each procedure with a registered face image. That is, when the target face image acquired during each procedure matches the registered face image, CPU 102 updates the status of each procedure for user U from incomplete to completed. A procedure and another procedure following the procedure included in the multiple procedures at airport A refer to, for example, two adjacent procedures in the order of the multiple procedures from check-in to boarding the aircraft, and another procedure following a procedure refers to the procedure following the procedure. For example, if security inspection is considered to be one procedure, immigration control is another procedure following the first procedure.

[0147] It should be noted that the CPU 102 does not necessarily need to manage the status of the user U with respect to all of these procedures, but can manage the status of the user U with respect to any one or more of these procedures.

[0148] Furthermore, CPU 102, functioning as an information management unit and a status management unit, registers and manages user information and status of user U in first through fifth matching information DBs 106b1-106b5, in addition to or instead of user information DB 106a. CPU 102 updates and manages user U's status registered in first through fifth matching information DBs 106b1-106b5 in the same manner as in user information DB 106a. CPU 102 registers user U's user information and status in one of first through fifth matching information DBs 106b1-106b5 in accordance with user U's status, which is updated in accordance with user U's procedures as described above. The user information registered in first through fifth matching information DBs 106b1-106b5 may have the same content as the user information registered in user information DB 106a, but may also include at least a registered facial image.

[0149] More specifically, the CPU 102 registers the user information and status of user U whose status regarding check-in procedures is complete and whose status regarding other procedures is incomplete in the first matching information DB 106b1. The status regarding other procedures here refers to the status regarding baggage check-in procedures, security inspection procedures, immigration procedures, location in front of or passing through the signage terminal 60, and boarding the aircraft.

[0150] When the status of the baggage check-in procedure for user U, whose user information is registered in the first matching information DB 106b1, is updated from incomplete to completed, the CPU 102 moves and registers the user information and status of the user U. That is, the CPU 102 moves and registers the user information and status of the user U from the first matching information DB 106b1 to the second matching information DB 106b2.

[0151] Furthermore, the CPU 102 registers the user information and status of user U whose status regarding check-in procedures and baggage drop procedures is complete but whose status regarding other procedures is incomplete in the second matching information DB 106b2. The status regarding other procedures here refers to the status regarding security inspection procedures, immigration procedures, location in front of or passing through the signage terminal 60, and boarding the aircraft.

[0152] When the status of the security inspection procedure for user U, whose user information is registered in the second verification information DB 106b2, is updated from incomplete to completed, the CPU 102 moves and registers the user information and status of the user U. That is, the CPU 102 moves and registers the user information and status of the user U from the second verification information DB 106b2 to the third verification information DB 106b3.

[0153] Furthermore, the CPU 102 registers the user information and status of user U whose status regarding check-in procedures, baggage drop-off procedures, and security inspection procedures is complete, but whose status regarding other procedures is incomplete, in the third matching information DB 106b3. The status regarding other procedures here refers to the status regarding immigration procedures, the location in front of or passing through the signage terminal 60, and boarding the aircraft.

[0154] When the status of the immigration procedure for user U, whose user information is registered in the third matching information DB 106b3, is updated from incomplete to completed, CPU 102 moves and registers the user information and status of user U. That is, CPU 102 moves and registers the user information and status of user U from the third matching information DB 106b3 to the fourth matching information DB 106b4.

[0155] Furthermore, the CPU 102 registers in the fourth matching information DB 106b4 the user information and status of user U whose status regarding check-in procedures, baggage drop-off procedures, security inspection procedures, and immigration procedures is complete, but whose status regarding other procedures is incomplete. The status regarding other procedures here refers to the status regarding the user's location in front of or passing through the signage terminal 60 and boarding the aircraft.

[0156] When the status regarding the location or passage in front of the signage terminal 60 of a user U whose user information is registered in the fourth matching information DB 106b4 is updated from incomplete to completed, the CPU 102 moves and registers the user information and status of the user U. That is, the CPU 102 moves and registers the user information and status of the user U from the fourth matching information DB 106b4 to the fifth matching information DB 106b5.

[0157] Furthermore, the CPU 102 registers the user information and status of user U whose status regarding boarding the aircraft is incomplete and whose status regarding other procedures is complete in the fifth matching information DB 106b5. The status regarding other procedures here refers to the status regarding check-in procedures, baggage drop-off procedures, security inspection procedures, immigration procedures, and the location in front of or passing through the signage terminal 60.

[0158] When the status of boarding an aircraft for a user U whose user information is registered in the fifth matching information DB 106b5 is updated from incomplete to completed, the CPU 102 deletes the user information and status of that user U from the fifth matching information DB 106b5.

[0159] In this way, CPU 102 registers user information in multiple DBs, first through fifth matching information DBs 106b1-106b5, according to the status of the procedure of user U corresponding to the user information including the registered facial image. That is, when the status of a procedure in the series of procedures after check-in is completed, CPU 102 moves and registers the user information including the registered facial image of the user from one DB corresponding to the procedure to another DB corresponding to another procedure subsequent to the first procedure. CPU 102 uses the registered facial images included in the user information registered in first through fifth matching information DBs 106b1-106b5 for matching at the baggage drop-off procedure, security inspection procedure, immigration procedure, location in front of or passing through signage terminal 60, and boarding an aircraft, respectively.

[0160] CPU 102 also functions as a deadline setting unit that sets deadlines, which are predetermined times by which user U must complete multiple procedures, including each procedure at airport A, based on user U's boarding information. The procedures for which deadlines are set are baggage drop-off procedures after check-in procedures, security inspection procedures, immigration procedures, and boarding the aircraft. CPU 102 also treats user U's location in front of or passing through signage terminal 60 as procedures for which deadlines are set. CPU 102 sets deadlines for these multiple procedures up to user U's boarding the aircraft.

[0161] The CPU 102, which serves as a time limit setting unit, calculates the boarding time at which user U is closed for boarding the aircraft from the departure time of the departure date and time included in the boarding information of user U. For example, the CPU 102 can calculate the boarding time to be 10 minutes before the departure time of the aircraft. The CPU 102 can also obtain the boarding time included in the boarding information of user U itself from the boarding information.

[0162] The CPU 102 as a deadline setting unit calculates, from the calculated or acquired boarding time, the deadline by which the user U must complete each of the procedures of baggage check-in, security inspection, immigration, being in front of or passing through the signage terminal 60, and boarding the aircraft. The CPU 102 can set deadlines for each of the multiple procedures based on the order of the multiple procedures user U will complete before boarding the aircraft and the boarding information. In other words, the closer the order of the multiple procedures user U will complete before boarding the aircraft is to the procedure for boarding the aircraft, the later the deadline the CPU 102 can set for that procedure.

[0163] For example, the CPU 102 can calculate the deadline for baggage check-in procedures to be 60 minutes before the boarding time. For example, the CPU 102 can calculate the deadline for security inspection procedures to be 30 minutes before the boarding time. For example, the CPU 102 can calculate the deadline for immigration procedures to be 20 minutes before the boarding time. For example, the CPU 102 can calculate the deadline for being in front of or passing through the signage terminal 60 to be 15 minutes before the boarding time. For example, the CPU 102 can calculate the deadline for boarding the aircraft to be 10 minutes before the boarding time. The CPU 102 can also calculate the deadline for each procedure from the departure time itself included in the boarding information. The CPU 102 can also calculate the deadline for each procedure from the flight number of the aircraft included in the boarding information by referencing a flight schedule database or the like to obtain the boarding time or departure time, and then calculate the deadline for each procedure.

[0164] The CPU 102 as a deadline setting unit can set the deadline time depending on the number of users U who have completed the check-in procedure. In other words, the CPU 102 can set a shorter time between the deadline time and the boarding time as the number of users U who have completed the check-in procedure increases.

[0165] Furthermore, CPU 102 as a deadline setting unit can appropriately change and set the deadline for each of the above-mentioned procedures according to the congestion level of airport A, which is the facility where user U boards the aircraft, in other words, according to the number of users U at airport A. CPU 102 can determine the congestion level of airport A, for example, based on the number of user information items registered per unit time in user information DB 106a. That is, it can be determined that the greater the number of user information items registered per unit time in user information DB 106a, the more congested airport A is. CPU 102 can set the deadline to an earlier time the more congested airport A is.

[0166] Furthermore, CPU 102 as a deadline setting unit can record and manage the deadline time of each procedure that has been set, for example, in user information DB 106a in association with the user information and status of user U in user information DB 106a. That is, CPU 102 as a status management unit can manage the status of each procedure of user U along with the deadline time, which is the set deadline.

[0167] As described above, the CPU 102 as a deadline setting unit sets deadline times as deadlines for the multiple procedures before user U boards the aircraft, namely, check-in procedure, security inspection procedure, immigration procedure, being in front of or passing through the signage terminal 60, and boarding the aircraft. Note that the CPU 102 does not necessarily need to set deadline times for all of these multiple procedures, and can set deadline times for any one or more of these procedures.

[0168] Furthermore, the CPU 102 functions as a determination unit that determines whether the deadline has passed with the status of each procedure up to boarding of the user U, for which a deadline has been set as described above. The CPU 102 as a determination unit can determine whether the deadline has passed regularly or improperly for an incomplete procedure, for example.

[0169] The CPU 102 also functions as an alert unit, generating and transmitting an alert indicating that a procedure of user U whose status has been determined to be incomplete and whose deadline has passed has remained incomplete after the deadline has passed. The CPU 102 as an alert unit can transmit the alert to the business terminal 80 carried by the staff member S. For example, when the location of user U is identified as described in the third embodiment, the CPU 102 can transmit an alert to the business terminal 80 carried by the staff member S who is near that location. Furthermore, the CPU 102 can notify or display the staff member S who is near the identified location of user U on the business terminal 80 carried by the staff member S and other staff members S. This allows the CPU 102 to instruct the staff member S which of the staff members S is appropriate to respond to the alert.

[0170] The alert may include, for example, some or all of the user information of the user U for whom the procedure has not been completed, some or all of the boarding information, the status of each procedure, etc. The alert may include a registered face image of the user U, preferably a registered face image that is a facial image of the user U taken by the check-in terminal 20. The staff member S who receives the alert on the business terminal 80 can use the registered face image included in the alert as a clue to search for the user U for whom the procedure has not been completed. Note that the registered face image included in the alert may be a passport face image of the user U, but is preferably a facial image taken by the check-in terminal 20 that shows the face of the user U most recently, i.e., at the time of the check-in procedure.

[0171] Furthermore, the CPU 102 functions as a matching unit that matches the facial image of user U when it receives a target facial image and a matching request or a target facial image from the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70. The CPU 102 as a matching unit matches the target facial image, which is target biometric information, with multiple registered facial images, which are registered biometric information registered in any of the first to fifth matching information DBs 106b1-106b5, in a 1:N ratio. The first to fifth matching information DBs 106b1-106b5 register user information of multiple users U who have completed check-in procedures at the check-in terminal 20 according to their status. When matching the target facial image with the registered facial image, the CPU 102 can match both facial images by matching facial features extracted from the target facial image, which is target biometric information, with facial features extracted from the registered facial image, which is registered biometric information.

[0172] The CPU 102 as a matching unit selects a plurality of registered face images to be matched with the target face image based on the status of the user U corresponding to the registered face image. That is, the CPU 102 matches the target biometric information acquired in the procedure with the registered face image of the user U whose latest status regarding the procedure for which the target face image was acquired is incomplete. To this end, the CPU 102 matches the target face image with the registered face image registered in a DB selected from the first to fifth matching information DBs 106b1-106b5.

[0173] More specifically, when the CPU 102 serving as a matching unit receives a target facial image and a matching request from the automated baggage drop machine 30, it matches the received target facial image with a plurality of registered facial images registered in the first matching information DB 106b1. The first matching information DB 106b1 stores registered facial images of users U whose status regarding check-in procedures is complete but whose status regarding other procedures is incomplete. This allows the CPU 102 to match the target facial image acquired during the baggage drop procedure with the registered facial images of users U whose status regarding check-in procedures is complete but whose status regarding baggage drop procedures is incomplete. Therefore, the CPU 102 does not perform matching with the registered facial images of users U whose check-in procedures, which are the procedures immediately prior to the baggage drop procedure, are incomplete, nor does it perform matching with the registered facial images of users U who have already completed the baggage drop procedure. Therefore, when matching the target facial image acquired during the baggage drop procedure, it is possible to avoid matching with unnecessary registered facial images.

[0174] Furthermore, when the CPU 102 as a matching unit receives a target face image and a matching request from the security inspection device 40, it matches the received target face image with multiple registered face images registered in the second matching information DB 106b2. The second matching information DB 106b2 stores registered face images of users U whose statuses regarding check-in procedures and baggage drop procedures are complete but whose statuses regarding other procedures are incomplete. This allows the CPU 102 to match the target face image acquired during security inspection procedures with registered face images of users U whose statuses regarding baggage drop procedures are complete but whose statuses regarding security inspection procedures are incomplete. Therefore, the CPU 102 does not perform matching with registered face images of users U whose statuses regarding baggage drop procedures, which are procedures immediately before security inspection procedures, are incomplete, nor does it perform matching with registered face images of users U who have already completed security inspection procedures. Therefore, when matching the target face image acquired during security inspection procedures, it is possible to avoid matching with unnecessary registered face images.

[0175] Furthermore, when the CPU 102 as a matching unit receives a target facial image and a matching request from the automated gate device 50, it matches the received target facial image with multiple registered facial images registered in the third matching information DB 106b3. The third matching information DB 106b3 stores registered facial images of users U whose statuses regarding check-in procedures, baggage check procedures, and security inspection procedures are complete, but whose statuses regarding other procedures are incomplete. This allows the CPU 102 to match the target facial image acquired during immigration procedures with registered facial images of users U whose statuses regarding security inspection procedures are complete but whose statuses regarding immigration procedures are incomplete. Therefore, the CPU 102 does not perform matching with registered facial images of users U whose security inspection procedures, which are procedures immediately prior to immigration procedures, are incomplete, nor does it perform matching with registered facial images of users U who have already completed immigration procedures. Therefore, when matching the target facial image acquired during immigration procedures, it is possible to avoid matching with unnecessary registered facial images.

[0176] Furthermore, when the CPU 102 as a matching unit receives a target facial image from the signage terminal 60, it matches the received target facial image with multiple registered facial images registered in the fourth matching information DB 106b4. The fourth matching information DB 106b4 stores registered facial images of users U whose statuses regarding check-in procedures, baggage check procedures, security inspection procedures, and immigration procedures are complete, but whose statuses regarding other procedures are incomplete. This allows the CPU 102 to match the target facial image acquired when the user is located in front of or passing through the signage terminal 60 with registered facial images of users U whose statuses regarding immigration procedures are complete but whose statuses regarding their location in front of or passing through the signage terminal 60 are incomplete. Therefore, the CPU 102 does not match the target facial image with registered facial images of users U who have not completed immigration procedures for the procedures immediately before the user is located in front of or passes through the signage terminal 60, nor does it match the target facial image with registered facial images of users U who have already completed immigration procedures for the procedures immediately before the user is located in front of or passes through the signage terminal 60. Therefore, when matching a target face image acquired when the target face image is in front of or passing by signage terminal 60, it is possible to avoid matching it with unnecessary registered face images.

[0177] Furthermore, when the CPU 102 serving as a matching unit receives a target facial image from the boarding gate device 70, it matches the received target facial image with multiple registered facial images registered in the fifth matching information DB 106b5. The fifth matching information DB 106b5 stores registered facial images of users U whose status regarding boarding the aircraft is incomplete and whose status regarding other procedures is complete. This allows the CPU 102 to match the target facial image acquired when boarding the aircraft with registered facial images of users U whose status regarding their location in front of or passing through the signage terminal 60 is complete but whose status regarding boarding the aircraft is incomplete. Therefore, the CPU 102 does not match the target facial image with registered facial images of users U whose location in front of or passing through the signage terminal 60 for procedures immediately prior to boarding the aircraft is incomplete, nor does it match the target facial image with registered facial images of users U who have already boarded the aircraft. Therefore, when matching the target facial image acquired when boarding the aircraft, it is possible to avoid matching the target facial image with unnecessary registered facial images.

[0178] A series of procedures up to boarding an aircraft includes one procedure followed by another procedure. CPU 102 as a matching unit matches a target face image acquired during the other procedure with a registered face image of user U whose status regarding one procedure is complete and whose status regarding the other procedure is incomplete.

[0179] As described above, the CPU 102 as a matching unit selectively uses the first to fifth matching information DBs 106b1-106b5, in which user information according to the status of user U is registered, as DBs of registered face images to be matched with a target face image, depending on each procedure. Therefore, according to this embodiment, it is possible to reduce the number of registered face images, which are a population to be matched with a target face image, and improve the matching accuracy of face images, which are biometric information.

[0180] The CPU 102, functioning as a matching unit, matches a target facial image with a plurality of registered facial images in each of the first through fifth matching information DBs 106b1-106b5, attempting to find a registered facial image that matches the target facial image among the plurality of registered facial images. The CPU 102 also functions as a transmission unit, transmitting matching result information indicating the matching result to each of the automated baggage check-in machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70 that sent the matching request. The matching result information indicates a match or a mismatch. That is, the matching result information indicates that a registered facial image matching the target facial image was found as a result of the matching, thereby successfully verifying the identity of the user U performing the baggage check-in procedure, or that a matching registered facial image was not found, thereby failing to verify the identity of the user U. The CPU 102 may also match the target facial image with one or more registered facial images in each of the first through fifth matching information DBs 106b1-106b5.

[0181] Furthermore, the CPU 102, instead of the CPU 202 of the check-in terminal 20, can also perform a one-to-one comparison between a captured facial image captured by the biometric information acquisition device 214 and a passport facial image acquired by the medium reading device 212. In this case, the CPU 102 receives the captured facial image and passport facial image to be compared or their facial feature amounts from the check-in terminal 20. The CPU 102 also transmits to the check-in terminal 20 comparison result information indicating the result of comparing the captured facial image with the passport facial image.

[0182] The storage device 106 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 106 stores programs executed by the CPU 102, data referenced by the CPU 102 when the programs are executed, etc.

[0183] The storage device 106 also stores a user information DB 106a and first to fifth verification information DBs 106b1-106b5. The user information DB 106a stores user information for all of the multiple users U who have completed the check-in procedure at the check-in terminal 20. The user information DB 106a also stores the status of each user U in association with the user information. The first to fifth verification information DBs 106b1-106b5 store user information and status corresponding to each status of the user U. The storage device 106 may store both the user information DB 106a and the first to fifth verification information DBs 106b1-106b5, or may store only the first to fifth verification information DBs 106b1-106b5.

[0184] The communication unit 108 is connected to the network NW and transmits and receives data via the network NW. Under the control of the CPU 102, the communication unit 108 communicates with the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the like.

[0185] In this way, the management server 10 is configured.

[0186] Next, the configuration of the business terminal 80 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing an example of the hardware configuration of the business terminal 80. The business terminal 80 is a terminal carried by an employee S, such as an airline employee or an airport company employee, to use for their work, and is, for example, a tablet terminal, a smartphone, or a mobile phone. Note that the business terminal 80 may also be, for example, a stationary information processing terminal installed at a work location such as a counter where the employee works.

[0187] 9, the business terminal 80 has a CPU 802, a RAM 804, a storage device 806, an input device 808, a display 810, a mobile communication unit 812, and a short-range wireless communication unit 814. The CPU 802, RAM 804, storage device 806, input device 808, display 810, mobile communication unit 812, and short-range wireless communication unit 814 are connected to a bus line 816.

[0188] The CPU 802 operates by executing programs stored in the storage device 806, and functions as a control unit that controls the overall operation of the business terminal 80. The CPU 802 also executes application programs stored in the storage device 806 to perform various processes as the business terminal 80. The RAM 804 provides a memory area necessary for the operation of the CPU 802.

[0189] More specifically, the CPU 802 functions as an information acquisition unit, and can access the user information DB 106a of the management server 10 to acquire the user information and status of the user U recorded in the user information DB 106a. The CPU 802 as the information acquisition unit can display the acquired user information and status on the display 810.

[0190] Furthermore, the CPU 802 functions as an alert receiving unit and can receive alerts transmitted from the management server 10. The CPU 802 as an alert receiving unit can cause the display 810 to display the received alerts.

[0191] The storage device 806 is configured with a storage medium such as a nonvolatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 806 stores programs executed by the CPU 802, data referenced by the CPU 802 when executing the programs, etc.

[0192] The input device 808 is, for example, a touch panel incorporated into the display 810. The input device 808 functions as an input unit that accepts input of instructions from the staff member S. The staff member S can input various information and instructions to execute processing to the business terminal 80 via the input device 808.

[0193] The display 810 functions as a display unit that displays various screens to the staff member S. For example, the display 810 displays a screen showing the user information and status of the user U recorded in the user information DB 106a, a screen showing the content of an alert received from the management server 10, and the like.

[0194] The mobile communication unit 812 connects to the network NW via a mobile communication network under the control of the CPU 802. The communication method of the mobile communication unit 812 is not particularly limited, but examples thereof include a third generation mobile communication method, an LTE (Long Term Evolution) method, and a fourth generation mobile communication method.

[0195] The short-range wireless communication unit 814 performs wireless communication with access points, external devices, etc. under the control of the CPU 802, and connects to the network NW, for example, via an access point within the premises of Airport A. The communication method of the short-range wireless communication unit 814 is not particularly limited, and examples thereof include a wireless LAN method such as Wi-Fi (registered trademark), a Bluetooth (registered trademark) communication method, an NFC (Near Field Communication) method, and an infrared communication method.

[0196] In this way, the business terminal 80 is configured.

[0197] In the information processing system 1 according to this embodiment, the management server 10 selectively uses first to fifth matching information DBs 106b1-106b5, in which user information according to the status of user U is registered, as DBs of registered face images to be matched with a target face image, depending on each procedure. Therefore, according to this embodiment, it is possible to reduce the number of multiple registered face images, which are the population to be matched with a target face image, and improve matching accuracy.

[0198] Furthermore, the information processing system 1 according to this embodiment sets, in the management server 10, a deadline for each procedure up to boarding for a user U who is scheduled to board an aircraft based on the boarding information acquired by the check-in terminal 20, and manages the status of each procedure for the user U. Therefore, the information processing system 1 according to this embodiment can grasp and manage the status of the user U who is scheduled to board an aircraft in more detail.

[0199] Furthermore, in the information processing system 1 according to this embodiment, if the deadline has passed and the procedure status remains incomplete, the management server 10 generates an alert indicating this and sends it to the business terminal 80. The alert also includes the registered facial image of the user U. Therefore, according to the information processing system 1 according to this embodiment, the staff member S can easily find the user U whose procedure has not been completed by using the registered facial image of the user U as a clue.

[0200] The operation of each component in the information processing system 1 according to this embodiment will be further described below with reference to FIGS. 10 to 25C.

[0201] First, the operation of check-in terminal 20 will be described together with the operation of management server 10 using Fig. 10. Fig. 10 is a sequence diagram showing the operation of check-in terminal 20 and management server 10.

[0202] Upon arriving at airport A, a user U proceeds to check-in lobby P1 and performs check-in procedures at the check-in terminal 20. The check-in terminal 20 and management server 10 execute the process shown in FIG. 10 each time each of multiple users U performs check-in procedures.

[0203] As shown in FIG. 10, the medium reader 212 of the check-in terminal 20 determines whether or not the passport of the user U is held over its reading section (step S102), and waits until the passport is held over (step S102, NO).

[0204] When the medium reading device 212 determines that a passport has been held over the passport (step S102, YES), it acquires the passport information of the user U from the held passport (step S104). The acquired passport information includes a passport face image of the user U. At this time, the medium reading device 212 can also acquire the identity information of the user U from the passport.

[0205] Next, the medium reading device 212 determines whether or not the airline ticket medium of the user U is held over its reading section (step S106), and waits until the airline ticket medium is held over (step S106, NO).

[0206] When the medium reading device 212 determines that the airline ticket medium has been held up (step S106, YES), it acquires the boarding information of the user U from the held-up passport (step S108). At this time, the medium reading device 212 can also acquire the identity information of the user U from the airline ticket medium.

[0207] The order of step S104 of acquiring passport information, step S108 of acquiring boarding information, and step S110 of acquiring a facial image is not limited to the above case. Any of steps S104, S108, and S110 may be executed in the order listed above, or all or some of steps S104, S108, and S110 may be executed simultaneously.

[0208] Next, the biometric information acquisition device 214 of the check-in terminal 20 photographs the face of the user U standing in front of the check-in terminal 20, and acquires a photographed face image that is a facial image of the user U (step S110).

[0209] Next, the CPU 202 of the check-in terminal 20 performs a one-to-one comparison between the captured face image captured by the biometric information acquisition device 214 and the passport face image acquired by the medium reading device 212 (step S112).

[0210] As a result of the comparison, if the CPU 202 determines that the captured facial image matches the passport facial image and identity verification has been successful (step S114, YES), it transmits the user information of the user U to the management server 10 via the network NW (step S116). The user information includes the user U's identification information, facial information, and boarding information, which are associated with each other.

[0211] When the CPU 102 of the management server 10 receives the user information from the check-in terminal 20, it registers the received user information in the user information DB 106a (step S118). The CPU 102 registers the photographed face image or passport face image included in the user information in the user information DB 106a as a registered face image. In this way, the check-in terminal 20 completes the check-in procedure for user U. After completing the check-in procedure, user U heads to the baggage counter P2 if he or she needs to check in his or her baggage, or heads to the security checkpoint P3 if he or she does not need to check in his or her baggage.

[0212] Furthermore, after or together with transmitting the user information, the CPU 202 of the check-in terminal 20 transmits status information to the management server 10 via the network NW indicating that the check-in procedure for user U has been completed after facial image matching (step S120).

[0213] When the CPU 102 of the management server 10 receives the status information from the check-in terminal 20, which is an external device, it updates the status of the check-in procedure of the user U in the user information DB 106a from "incomplete" to "completed" (step S122). In this way, the CPU 102 manages the status of the check-in procedure of the user U based on the result of matching the photographed face image acquired during the check-in procedure with the face image on passport. That is, when the comparison between the photographed face image acquired during the check-in procedure and the face image on passport matches, the CPU 102 updates the status of the check-in procedure of the user U from "incomplete" to "completed."

[0214] Furthermore, the CPU 102 registers the user information and status of the user U whose status regarding the check-in procedure has been updated from incomplete to complete in the first verification information DB 106b1.

[0215] On the other hand, if the CPU 202 determines that the comparison between the captured face image and the passport face image does not match and identity verification has failed (step S114, NO), it notifies the user U that identity verification has failed (step S124). At this time, the CPU 202 displays a notification screen notifying the user U that identity verification has failed on the display 210. Note that, together with or instead of displaying the notification screen, the CPU 202 can also notify the user U that identity verification has failed by, for example, audio.

[0216] In this way, the check-in procedure for user U is carried out at check-in terminal 20.

[0217] Instead of using the check-in terminal 20, the user U can also check in at a manned check-in counter. In this case, a terminal operated by a staff member at the check-in counter can execute the same process as the check-in terminal 20 described above. Also, instead of using the check-in terminal 20, the user U can use online check-in via the airline's website. In this case, for example, the user U can separately register a facial image as a registered facial image in the user information DB 106a of the management server 10 using a dedicated terminal installed at the airport A.

[0218] The CPU 102 of the management server 10 sequentially moves and registers the user information and status of the user U registered in the user information DB 106a as described above to the first to fifth matching information DBs 106b1-106b5 according to the user U's status.

[0219] Next, the operation of the automated baggage drop machine 30 will be described together with the operation of the management server 10 with reference to Fig. 11. Fig. 11 is a sequence diagram showing the operation of the automated baggage drop machine 30 and the management server 10.

[0220] After completing the check-in procedure, the user U proceeds to the baggage counter P2 as needed and performs the baggage check-in procedure at the automated baggage check-in machine 30. The automated baggage check-in machine 30 and the management server 10 execute the process shown in Fig. 11 each time each of the multiple users U performs the baggage check-in procedure.

[0221] 11, the biometric information acquisition device 312 of the automated baggage drop machine 30 constantly or periodically captures an image of the area in front of the automated baggage drop machine 30, and determines whether the face of a user U standing in front of the automated baggage drop machine 30 is detected in the captured image (step S202). The biometric information acquisition device 312 waits until the face of the user U is detected in the image (step S202, NO).

[0222] When the biometric information acquisition device 312 determines that the face of the user U has been detected (step S202, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S204).

[0223] Next, the CPU 302 of the automated baggage drop machine 30 transmits the target facial image of user U captured by the biometric information acquisition device 312 together with a matching request to the management server 10 via the network NW (step S206). As a result, the CPU 302 requests the management server 10 to perform a 1:N matching of the target facial image of user U captured by the biometric information acquisition device 312 with multiple registered facial images registered in the first matching information DB 106b1 of the management server 10.

[0224] When the CPU 102 of the management server 10 receives the target facial image and the matching request from the automated baggage drop machine 30, it matches the facial image of the user U (step S208). The CPU 102 matches the target facial image received from the automated baggage drop machine 30 with the multiple registered facial images registered in the first matching information DB 106b1 in a 1:N ratio.

[0225] Next, the CPU 102 transmits collation result information indicating the result of the collation to the automated baggage drop machine 30 via the network NW (step S210).

[0226] The CPU 302 of the automated baggage drop machine 30 receives matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and the identity of the user U performing the baggage check-in procedure has been successfully verified (step S212, YES), the CPU 302 executes a baggage check-in process for the user U (step S214). In the check-in process, the CPU 302 acquires the boarding information or passport information associated with the registered face image matching the target face image and uses it for the check-in process. The CPU 302 controls each component of the automated baggage drop machine 30. As a result, the output device 316 outputs a baggage tag and a baggage claim slip in association with the boarding information or passport information associated with the registered face image. In addition, the baggage transport device 314 transports the baggage that the user U has placed in the claim area and attached with a baggage tag to the baggage handling area. After checking in their baggage, the user U proceeds to the security checkpoint P3.

[0227] Next, the CPU 302 transmits status information indicating that the baggage deposit procedure for the user U has been completed through the facial image verification to the management server 10 via the network NW (step S216).

[0228] When the CPU 102 of the management server 10 receives the status information from the automated baggage drop machine 30, which is an external device, it updates the status of the baggage check-in procedure for the user U in the user information DB 106a from "incomplete" to "completed" (step S218). In this way, the CPU 102 manages the status of the baggage check-in procedure for the user U based on the result of matching the target face image acquired during the baggage check-in procedure with the registered face image. That is, when the target face image acquired during the baggage check-in procedure matches the registered face image, the CPU 102 updates the status of the baggage check-in procedure for the user U from "incomplete" to "completed."

[0229] Furthermore, the CPU 102 moves and registers the user information and status of the user U whose baggage deposit procedure status has been updated from incomplete to complete from the first matching information DB 106b1 to the second matching information DB 106b2.

[0230] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S212, NO), CPU 302 of automated baggage check-in machine 30 notifies user U that identity verification has failed (step S220). At this time, CPU 302 displays a notification screen notifying user U that identity verification has failed on display 310. Note that CPU 302 can notify user U that identity verification has failed, for example, by voice, in addition to or instead of displaying the notification screen. If identity verification has failed in this way, baggage check-in processing can be performed in the normal process by having a media reading device (not shown) read the boarding pass or passport.

[0231] In this way, the baggage check-in procedure is carried out at the automated baggage check-in machine 30.

[0232] Next, the operation of the security inspection device 40 will be described together with the operation of the management server 10 with reference to Fig. 12. Fig. 12 is a sequence diagram showing the operation of the security inspection device 40 and the management server 10.

[0233] After completing the check-in procedure and, if necessary, the baggage drop-off procedure, the user U proceeds to the security checkpoint P3 and undergoes the security check procedure at the security check device 40. The security check device 40 and the management server 10 execute the process shown in FIG. 12 each time each of the multiple users U undergoes the security check procedure.

[0234] 12, the biometric information acquisition device 412 of the security inspection device 40 constantly or periodically captures an image of the area in front of the metal detection gate 414, and determines whether the face of a user U standing in front of the metal detection gate 414 is detected in the captured image (step S302). The biometric information acquisition device 412 waits until the face of the user U is detected in the image (step S302, NO).

[0235] When the biometric information acquisition device 412 determines that the face of the user U has been detected (step S302, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S304).

[0236] Next, the CPU 402 of the security inspection device 40 transmits the target face image of user U captured by the biometric information acquisition device 412 together with a matching request to the management server 10 via the network NW (step S306). As a result, the CPU 402 requests the management server 10 to perform a 1:N matching of the target face image of user U captured by the biometric information acquisition device 412 with multiple registered face images registered in the second matching information DB 106b2 of the management server 10.

[0237] When the CPU 102 of the management server 10 receives the target face image and the matching request from the security inspection device 40, it matches the face image of the user U (step S308). The CPU 102 matches the target face image received from the security inspection device 40 with a plurality of registered face images registered in the second matching information DB 106b2 in a 1:N ratio.

[0238] Next, CPU 102 transmits matching result information indicating the result of the matching to security inspection device 40 via network NW (step S310).

[0239] The CPU 402 of the security inspection device 40 receives matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and that the identity of user U undergoing security inspection procedures has been successfully verified (step S312, YES), the CPU 402 executes security inspection processing for user U (step S314). In the security inspection processing, the CPU 402 controls each component of the security inspection device 40. This causes the metal detection gate 414 to detect metal objects worn by user U who passes through the metal detection gate 414. After passing through the metal detection gate 414, user U heads to the departure inspection area P4.

[0240] Next, the CPU 402 transmits status information indicating that the security inspection procedure for the user U has been completed after the facial image has been verified to the management server 10 via the network NW (step S316).

[0241] When the CPU 102 of the management server 10 receives the status information from the security inspection device 40, which is an external device, it updates the status of the security inspection procedure for the user U in the user information DB 106a from "incomplete" to "completed" (step S318). In this way, the CPU 102 manages the status of the security inspection procedure for the user U based on the result of matching the target face image acquired during the security inspection procedure with the registered face image. That is, when the target face image acquired during the security inspection procedure matches the registered face image, the CPU 102 updates the status of the security inspection procedure for the user U from "incomplete" to "completed."

[0242] Furthermore, the CPU 102 moves and registers the user information and status of the user U whose security inspection procedure status has been updated from incomplete to complete from the second verification information DB 106b2 to the third verification information DB 106b3.

[0243] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S312, NO), CPU 402 of security inspection device 40 notifies user U that identity verification has failed (step S320). At this time, CPU 402 displays a notification screen notifying user U that identity verification has failed on display 410. Note that CPU 402 can notify user U that identity verification has failed, for example, by voice, in addition to or instead of displaying the notification screen.

[0244] In this way, the security inspection procedure is carried out at the security inspection device 40.

[0245] Next, the operation of the automated gate device 50 will be described together with the operation of the management server 10 with reference to Fig. 13. Fig. 13 is a sequence diagram showing the operation of the automated gate device 50 and the management server 10.

[0246] After completing the security inspection procedure, the user U proceeds to the immigration checkpoint P4 and undergoes immigration procedures at the automated gate device 50. The automated gate device 50 and the management server 10 execute the process shown in FIG. 13 each time each of the multiple users U undergoes immigration procedures.

[0247] 13, the biometric information acquisition device 512 of the automated gate device 50 constantly or periodically captures an image in front of the automated gate device 50, and determines whether the face of a user U standing in front of the automated gate device 50 is detected in the captured image (step S402). The biometric information acquisition device 512 waits until the face of the user U is detected in the image (step S402, NO).

[0248] When the biometric information acquisition device 512 determines that the face of the user U has been detected (step S402, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S404).

[0249] Next, the CPU 502 of the automated gate device 50 transmits the target face image of the user U captured by the biometric information acquisition device 512 together with a matching request to the management server 10 via the network NW (step S406). As a result, the CPU 502 requests the management server 10 to perform a 1:N matching of the target face image of the user U captured by the biometric information acquisition device 512 with a plurality of registered face images registered in the third matching information DB 106b3 of the management server 10.

[0250] When the CPU 102 of the management server 10 receives the target face image and the matching request from the automated gate device 50, it matches the face image of the user U (step S408). The CPU 102 matches the target face image received from the automated gate device 50 with a plurality of registered face images registered in the third matching information DB 106b3 in a 1:N ratio.

[0251] Next, the CPU 102 transmits collation result information indicating the result of the collation to the automated gate device 50 via the network NW (step S410).

[0252] The CPU 502 of the automated gate device 50 receives matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and identity verification of the user U undergoing immigration inspection procedures has been successful (step S412, YES), the CPU 502 executes processing to open the gate 514 (step S414). As a result, the CPU 502 transitions the gate 514 from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The user U passes through the opened gate 514 and heads toward boarding gate P6.

[0253] Next, the CPU 502 transmits status information indicating that the immigration procedure for the user U has been completed after the facial image has been verified to the management server 10 via the network NW (step S416).

[0254] When the CPU 102 of the management server 10 receives the status information from the automated gate device 50, which is an external device, it updates the status of the immigration procedure for the user U in the user information DB 106a from "incomplete" to "completed" (step S418). In this way, the CPU 102 manages the status of the immigration procedure for the user U based on the result of matching the target face image acquired during the immigration procedure with the registered face image. That is, when the target face image acquired during the immigration procedure matches the registered face image, the CPU 102 updates the status of the immigration procedure for the user U from "incomplete" to "completed."

[0255] Furthermore, the CPU 102 moves and registers the user information and status of the user U whose immigration procedure status has been updated from incomplete to complete from the third matching information DB 106b3 to the fourth matching information DB 106b4.

[0256] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S412, NO), the CPU 502 of the automated gate device 50 notifies user U that identity verification has failed (step S420). At this time, the CPU 502 displays a notification screen notifying user U that identity verification has failed on the display 510. Note that, in addition to or instead of displaying the notification screen, the CPU 502 can also notify user U that identity verification has failed by, for example, audio.

[0257] In this way, the immigration procedure is carried out at the automated gate device 50.

[0258] Next, the operation of signage terminal 60 will be described together with the operation of management server 10 with reference to Fig. 14. Fig. 14 is a sequence diagram showing the operation of signage terminal 60 and management server 10.

[0259] After completing the immigration procedures, user U passes through passage P5 where signage terminal 60 is installed and heads toward boarding gate P6. At this time, user U passes in front of signage terminal 60 or stops in front of signage terminal 60 to check the route guidance to boarding gate P6 displayed on signage terminal 60. The signage terminal 60 and management server 10 execute the process shown in FIG. 14 each time each of the multiple users U passes in front of or is located in front of signage terminal 60.

[0260] 14, the biometric information acquisition device 610 of the signage terminal 60 constantly or periodically captures an image in front of the signage terminal 60, and determines whether the face of a user U in front of the signage terminal 60 is detected in the captured image (step S502). The user U in front of the signage terminal 60 is a user U who passes in front of the signage terminal 60 or is located in front of the signage terminal 60. The biometric information acquisition device 610 waits until the face of the user U is detected in the image (step S502, NO).

[0261] When the biometric information acquisition device 610 determines that the face of the user U has been detected (step S502, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S504).

[0262] Next, CPU 602 of signage terminal 60 transmits the target face image of user U captured by biometric information acquisition device 610 to management server 10 via network NW (step S506).

[0263] When the CPU 102 of the management server 10 receives the target face image from the signage terminal 60, which is an external device, it compares the target face image with the face image of the user U (step S508). The CPU 102 compares the target face image received from the signage terminal 60 with a plurality of registered face images registered in the fourth matching information DB 106b4 in a 1:N ratio.

[0264] The CPU 602 of the signage terminal 60 can be configured to stream the video in front of the signage terminal 60 to the management server 10. In this case, the CPU 102 of the management server 10 can detect and acquire the target face image of the user U from the video streamed from the signage terminal 60, instead of receiving the target face image from the signage terminal 60.

[0265] As a result of the matching, if a registered face image matching the target face image is found and user U in front of the signage terminal 60 is identified (step S510, YES), CPU 102 updates the status of the user U (step S512). That is, CPU 102 updates the status of the user U in the user information DB 106a regarding the user U's location in front of or passage through the signage terminal 60 from "incomplete" to "completed." In this way, CPU 102 manages the status of the user U regarding the user U's location in front of or passage through the signage terminal 60 based on the result of matching between the target face image acquired when the user was in front of or passing through the signage terminal 60 and the registered face image. That is, if the matching between the target face image acquired when the user was in front of or passing through the signage terminal 60 and the registered face image matches, CPU 102 updates the status of the user U regarding the user U's location in front of or passage through the signage terminal 60 from "incomplete" to "completed."

[0266] Furthermore, the CPU 102 moves and registers the user information and status of the user U whose status regarding the location or passage in front of the signage terminal 60 has been updated from incomplete to completed from the fourth matching information DB 106b4 to the fifth matching information DB 106b5.

[0267] On the other hand, if the result of the comparison is that no registered face image matching the target face image is found and the user U in front of the signage terminal 60 is not identified (step S510, NO), the CPU 102 terminates processing related to the target face image transmitted from the signage terminal 60.

[0268] Next, the operation of the boarding gate device 70 will be described together with the operation of the management server 10 with reference to Fig. 15. Fig. 15 is a sequence diagram showing the operation of the boarding gate device 70 and the management server 10.

[0269] A user U who has passed through passage P5 where signage terminal 60 is installed heads toward boarding gate P6 and passes through boarding gate device 70 to board the aircraft. Boarding gate device 70 and management server 10 execute the process shown in FIG. 15 each time each of multiple users U boards the aircraft.

[0270] 15, the biometric information acquisition device 712 of the boarding gate device 70 constantly or periodically captures an image in front of the boarding gate device 70, and determines whether the face of user U standing in front of the boarding gate device 70 is detected in the captured image (step S602). The biometric information acquisition device 712 waits until the face of user U is detected in the image (step S602, NO).

[0271] When the biometric information acquisition device 712 determines that the face of the user U has been detected (step S602, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S604).

[0272] Next, the CPU 702 of the boarding gate device 70 transmits the target facial image of user U captured by the biometric information acquisition device 712 together with a matching request to the management server 10 via the network NW (step S606). As a result, the CPU 702 requests the management server 10 to perform a 1:N matching of the target facial image of user U captured by the biometric information acquisition device 712 with multiple registered facial images registered in the fifth matching information DB 106b5 of the management server 10.

[0273] When the CPU 102 of the management server 10 receives the target facial image and the matching request from the boarding gate device 70, it matches the facial image of user U (step S608). The CPU 102 matches the target facial image received from the boarding gate device 70 with a plurality of registered facial images registered in the fifth matching information DB 106b5 in a 1:N ratio. Furthermore, if the CPU 102 finds a registered facial image that matches the target facial image, it confirms that the boarding information associated with the registered facial image is related to an aircraft that can be boarded from boarding gate P6.

[0274] Next, the CPU 102 transmits the verification result information indicating the result of the verification to the boarding gate device 70 via the network NW (step S610).

[0275] The CPU 702 of the boarding gate device 70 receives matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and that the identity of the boarding user U has been successfully verified, and that the boarding information has also been successfully verified (step S612, YES), the CPU 702 executes processing to open the gate 714 (step S614). As a result, the CPU 702 transitions the gate 714 from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The user U passes through the opened gate 714 to board the aircraft.

[0276] Next, the CPU 702 transmits status information indicating that the boarding of the user U to the aircraft has been completed after the facial image has been verified to the management server 10 via the network NW (step 616).

[0277] When the CPU 102 of the management server 10 receives the status information from the boarding gate device 70, which is an external device, it updates the status of the user U in the user information DB 106a regarding boarding the aircraft from incomplete to completed (step S618). In this way, the CPU 102 manages the status of the user U regarding boarding the aircraft based on the result of matching the target face image acquired when boarding the aircraft with the registered face image. That is, when the target face image acquired when boarding the aircraft matches the registered face image, the CPU 102 updates the status of the user U regarding boarding the aircraft from incomplete to completed.

[0278] Furthermore, the CPU 102 deletes the user information and status of the user U whose status regarding boarding the aircraft has been updated from incomplete to completed from the fifth matching information DB 106b5.

[0279] On the other hand, if the matching result information indicates that a matching registered face image was not found and that identity verification of user U or boarding information verification has failed (step S612, NO), the CPU 702 of the boarding gate device 70 notifies the user U (step S620). That is, the CPU 702 notifies the user U that identity verification or boarding information verification has failed. At this time, the CPU 702 displays a notification screen on the display 710 notifying the user U that identity verification or boarding information verification has failed. Note that, in addition to or instead of displaying the notification screen, the CPU 702 can also notify the user U that identity verification or boarding information verification has failed by voice, for example.

[0280] In this way, the user U who has passed through the boarding gate device 70 boards the aircraft.

[0281] As described above, the management server 10 grasps and manages the status of each of the multiple users U who have completed the check-in procedure at the check-in terminal 20 up to boarding the aircraft in the user information DB 106a.

[0282] 16 is a schematic diagram showing an example of the user information DB 106a of the management server 10. As shown in the figure, the user information DB 106a registers user information and status of each user U for each user ID (Identification), which is an identifier for identifying a plurality of users U.

[0283] The user information registered in the user information DB 106a includes mutually associated identity information such as the name and nationality of the user U, a face image which is face information, and boarding information such as the flight number, departure point, destination, departure time, boarding gate, etc. of the aircraft on which the user U is boarding. Note that the identity information and boarding information may each include information other than that shown in FIG. 16.

[0284] The status of user U registered in the user information DB 106a is recorded as completed or incomplete for each of the procedures: check-in procedure, baggage drop-off procedure, security inspection procedure, immigration procedure, location in front of or passing through the signage terminal 60, and boarding the aircraft. The status of user U is updated as needed in accordance with the processes shown in Figs. 10 to 15 described above.

[0285] Furthermore, the user information and status of user U are sequentially moved and registered in the first to fifth matching information DBs 106b1-106b5 by the CPU 102 of the management server 10 according to the status of user U. Figures 17 to 21 are schematic diagrams showing examples of the first to fifth matching information DBs 106b1-106b5, respectively.

[0286] 17, the first matching information DB 106b1 stores the user information and status of user U whose status regarding check-in procedures is complete and whose status regarding other procedures is incomplete. When the status regarding baggage drop-off procedures is updated from incomplete to complete, the user information and status of user U stored in the first matching information DB 106b1 are moved from the first matching information DB 106b1 to the second matching information DB 106b2 and stored therein.

[0287] 18, the second matching information DB 106b2 stores the user information and status of user U whose status regarding check-in procedures and baggage drop procedures is complete, but whose status regarding other procedures is incomplete. When the status regarding the security inspection procedures is updated from incomplete to complete, the user information and status of user U stored in the second matching information DB 106b2 are moved from the second matching information DB 106b2 to the third matching information DB 106b3 and stored therein.

[0288] 19, the third matching information DB 106b3 stores user information and status of user U whose status regarding check-in procedures, baggage drop-off procedures, and security inspection procedures is complete, but whose status regarding other procedures is incomplete. When the status regarding the immigration procedure is updated from incomplete to complete, the user information and status registered in the third matching information DB 106b3 are moved from the third matching information DB 106b3 to the fourth matching information DB 106b4 and registered therein.

[0289] 20, the fourth matching information DB 106b4 stores user information and status of user U whose status regarding check-in procedures, baggage drop-off procedures, security inspection procedures, and immigration procedures is complete, but whose status regarding other procedures is incomplete. When the status regarding the previous location or passage of the signage terminal 60 is updated from incomplete to complete, the user information and status registered in the fourth matching information DB 106b4 are moved from the fourth matching information DB 106b4 to the fifth matching information DB 106b5 and registered therein.

[0290] 21, the fifth verification information DB 106b5 stores user information and a status of user U whose status regarding boarding the aircraft is incomplete and whose status regarding other procedures is completed. The user information and a status registered in the fifth verification information DB 106b5 are deleted from the fifth verification information DB 106b5 when the status regarding boarding the aircraft is updated from incomplete to completed.

[0291] As described above, the CPU 102 of the management server 10 registers and manages the user information and status of the user U in the user information DB 106a and the first to fifth matching information DBs 106b1-106b5. Note that the CPU 102 can also manage the user information and status of the user U using the first to fifth matching information DBs 106b1-106b5 without using the user information DB 106a.

[0292] Furthermore, the CPU 102 of the management server 10 calculates and sets a deadline by which the user U must complete each procedure, and generates an alert if the deadline passes without the procedure being completed. FIG. 22 is a schematic diagram showing an example of the deadline for each procedure set by the CPU 102 of the management server 10. As shown in the figure, a deadline is set for each user ID for the procedures of user U: baggage check-in procedure, security inspection procedure, immigration procedure, location in front of or passing through the signage terminal 60, and boarding the aircraft. The CPU 102 of the management server 10 can record and manage the deadlines shown in FIG. 22 in the user information DB 106a in association with the user information and status of user U in the user information DB 106a shown in FIG. 16. In addition, the CPU 102 may record and manage the deadline time shown in Figure 22 in the first to fifth matching information DBs 106b1-106b5 in association with the user information and status of user U in the first to fifth matching information DBs 106b1-106b5 shown in Figures 17 to 21.

[0293] Staff member S can access management server 10 using business terminal 80 to check user information and status of user U recorded in user information DB 106a, as well as the deadlines for each procedure. In this case, CPU 802 of business terminal 80 can retrieve user information and status of user U recorded in user information DB 106a, as well as the deadlines for each procedure, from user information DB 106a and display them on display 810. CPU 802 can display some or all of the identity information included in the user information, and some or all of the boarding information included in the user information. Furthermore, CPU 802 can display user U's status using, for example, a bar-shaped or circular progress bar whose length varies depending on the progress of each procedure, i.e., how far the procedure has been completed.

[0294] The following describes operations including the status management operation and alert operation of the management server 10 with reference to Figs. 23 to 25C. Figs. 23 and 24 are flowcharts showing operations including the status management operation and alert operation of the management server 10. Fig. 25A is a schematic diagram showing an example of an alert displayed on the business terminal 80. Figs. 25B and 25C are schematic diagrams showing an example of a status confirmation screen displayed on the business terminal 80. The management server 10 executes the processing shown in Figs. 23 and 24 for each of multiple users U.

[0295] As shown in FIG. 23, CPU 102 of management server 10 determines whether or not user information has been received from check-in terminal 20 (step S702), and waits until user information is received from check-in terminal 20 (step S702, NO).

[0296] When CPU 102 determines that it has received the user information from check-in terminal 20 (step S702, YES), CPU 102 registers the received user information in user information DB 106a (step S704). Step S704 corresponds to step S118 shown in FIG.

[0297] Next, the CPU 102 calculates and sets deadlines for each procedure, including baggage check-in, security inspection, immigration, location in front of or passing through the signage terminal 60, and boarding the aircraft, from the boarding time based on the boarding information included in the user information (step S706). The CPU 102 can change and set the deadlines for each procedure as appropriate depending on the congestion situation at airport A, the facility where user U will board the aircraft. The CPU 102 can also record and manage the deadlines for each procedure that it has set in the user information DB 106a, for example, in association with the user information and status of user U in the user information DB 106a.

[0298] Next, CPU 102 determines whether or not status information has been received from check-in terminal 20 (step S708), and waits until status information has been received from check-in terminal 20 (step S708, NO).

[0299] When CPU 102 determines that it has received status information from check-in terminal 20 (step S708, YES), it updates the status of the check-in procedure for user U in user information DB 106a from "incomplete" to "completed" (step S710). Step S710 corresponds to step S122 shown in Fig. 10. CPU 102 also registers the user information and status of user U in first verification information DB 106b1.

[0300] Next, the CPU 102 determines whether or not status information has been received from the automated baggage drop machine 30 (step S712).

[0301] If the CPU 102 determines that it has not received status information from the automated baggage drop machine 30 (step S712, NO), it determines whether the deadline for baggage drop procedures has passed (step S714).

[0302] When the CPU 102 determines that the deadline for baggage check-in procedures has passed (step S714, YES), it generates an alert indicating that the deadline for baggage check-in procedures for the user U has passed and transmits the alert via the network NW (step S716). The alert is sent to the business terminal 80 of one or more staff members S.

[0303] If the CPU 102 determines that the deadline for baggage check-in procedures has not passed (step S714, NO), it determines whether or not it has received status information from the security inspection device 40 (step S718). Note that step S718 is performed assuming that there is a user U who has little baggage and will not check in any baggage. If the CPU 102 determines that it has received status information from the security inspection device 40 (step S718, YES), it proceeds to step S728, which will be described later. If the CPU 102 determines that it has not received status information from the security inspection device 40 (step S718, NO), it waits to receive status information from the automated baggage check machine 30 (step S712).

[0304] On the other hand, when CPU 102 determines that it has received status information from the automated baggage drop machine 30 (step S712, YES), it updates the status of the baggage drop procedure for user U in user information DB 106a from incomplete to completed (step S720). Step S720 corresponds to step S218 shown in Fig. 11. Furthermore, CPU 102 moves and registers the user information and status of user U from first matching information DB 106b1 to second matching information DB 106b2.

[0305] Next, the CPU 102 determines whether or not status information has been received from the security inspection device 40 (step S722).

[0306] When CPU 102 determines that it has not received status information from security inspection device 40 (step S722, NO), it determines whether the deadline for security inspection procedures has passed (step S724).

[0307] When the CPU 102 determines that the deadline for the security inspection procedure has passed (step S724, YES), it generates an alert indicating that the deadline for the security inspection procedure for the user U has passed and transmits the alert via the network NW (step S726). The alert is sent to the business terminal 80 of one or more staff members S.

[0308] If CPU 102 determines that the deadline for the security inspection procedure has not passed (step S724, NO), CPU 102 waits for reception of status information from security inspection device 40 (step S722).

[0309] On the other hand, when CPU 102 determines that it has received status information from the security inspection device 40 (step S722, YES), it updates the status of the security inspection procedure for user U in user information DB 106a from "incomplete" to "completed" (step S728). Step S728 corresponds to step S318 shown in Fig. 12. Furthermore, CPU 102 moves and registers the user information and status of user U from the second matching information DB 106b2 to the third matching information DB 106b3.

[0310] Next, as shown in FIG. 24, the CPU 102 determines whether or not status information has been received from the automated gate device 50 (step S730).

[0311] If the CPU 102 determines that it has not received status information from the automated gate device 50 (step S730, NO), it determines whether the deadline for immigration procedures has passed (step S732).

[0312] When the CPU 102 determines that the deadline for the immigration procedure has passed (step S732, YES), it generates an alert indicating that the deadline for the immigration procedure for the user has passed and transmits the alert via the network NW (step S734). The alert is sent to the business terminal 80 of one or more staff members S.

[0313] If the CPU 102 determines that the deadline for immigration procedures has not passed (step S732, NO), it waits to receive status information from the automated gate device 50 (step S730).

[0314] On the other hand, when the CPU 102 determines that it has received status information from the automated gate device 50 (step S730, YES), it updates the status of the immigration procedure for the user U in the user information DB 106a from "incomplete" to "completed" (step S736). Step S736 corresponds to step S418 shown in Fig. 13. Furthermore, the CPU 102 moves and registers the user information and status of the user U from the third verification information DB 106b3 to the fourth verification information DB 106b4.

[0315] Next, CPU 102 compares the target face image received from signage terminal 60 with multiple registered face images in user information DB 106a in a 1:N ratio to determine whether user U has been in front of or passed by signage terminal 60 (step S738). If the comparison results in a registered face image matching the target face image, it means that user U has been in front of or passed by signage terminal 60.

[0316] If CPU 102 determines that there has been no presence or passage in front of signage terminal 60 (step S738, NO), CPU 102 determines whether the time limit for the presence or passage in front of signage terminal 60 has passed (step S740).

[0317] When CPU 102 determines that the time limit for the user to be located in front of or pass through signage terminal 60 has passed (step S740, YES), CPU 102 generates an alert and transmits it via network NW (step S742). That is, CPU 102 generates an alert indicating that the time limit for the user to be located in front of or pass through signage terminal 60 has passed, and transmits it via network NW. The alert is sent to the business terminal 80 of one or more staff members S.

[0318] When CPU 102 determines that the time limit for the presence or passage in front of signage terminal 60 has not passed (step S740, NO), the process proceeds to step S738.

[0319] On the other hand, if CPU 102 determines that user U has been located in front of or passed by the signage terminal 60 (step S738, YES), it updates the status of that user U (step S744). That is, CPU 102 updates the status of that user U in user information DB 106a regarding the location of or passage of that user U in front of the signage terminal 60 from incomplete to completed. Step S744 corresponds to step S512 shown in Fig. 14. CPU 102 also moves and registers the user information and status of that user U from the fourth matching information DB 106b4 to the fifth matching information DB 106b5.

[0320] Next, the CPU 102 determines whether or not status information has been received from the boarding gate device 70 (step S746).

[0321] When CPU 102 determines that it has not received status information from boarding gate device 70 (step S746, NO), it determines whether the deadline for boarding the aircraft has passed (step S748).

[0322] When CPU 102 determines that the deadline for boarding the aircraft has passed (step S748, YES), it generates an alert indicating that the deadline for boarding the aircraft has passed for the user and transmits the alert via network NW (step S750). The alert is sent to the business terminal 80 of one or more staff members S.

[0323] When CPU 102 determines that the deadline for boarding the aircraft has not passed (step S748, NO), CPU 102 waits for the reception of status information from boarding gate device 70 (step S746).

[0324] On the other hand, when the CPU 102 determines that it has received status information from the boarding gate device 70 (step S746, YES), it updates the status of the user U's boarding to the aircraft in the user information DB 106a from incomplete to completed (step S752). Step S752 corresponds to step S618 shown in Fig. 15. In addition, the CPU 102 deletes the user information and status of the user U from the fifth verification information DB 106b5.

[0325] 23 and 24, CPU 102 sequentially determines whether the deadline for each procedure has passed in steps S714, S724, S732, S740, and S748, but this determination does not necessarily have to be sequential. CPU 102 can also determine whether the deadline for each procedure has passed independently of each other.

[0326] In this way, the management server 10 keeps track of and manages the status of each procedure for user U along with the deadline until user U boards the aircraft, and if any procedure has passed its deadline, it generates an alert and sends it to the business terminal 80.

[0327] As described above, according to this embodiment, the first to fifth matching information DBs 106b1-106b5, in which user information is registered according to the status of user U, are used as DBs of multiple registered face images to be matched with a target face image during each procedure. Therefore, according to this embodiment, the number of multiple registered face images, which are the population used for matching with a target face image, can be reduced, thereby improving the matching accuracy of face images, which are biometric information.

[0328] In the above description, the first to fifth matching information DBs 106b1-106b5 are used separately for matching with the target face image, but the present invention is not limited to this. For example, one or more of the first to fifth matching information DBs 106b1-106b5 may be used appropriately for matching with the target face image depending on the number of users U who have completed the check-in procedure, the congestion state of airport A, the processing capacity of management server 10, etc.

[0329] For example, depending on the congestion state of airport A determined as described above, the CPU 102 of the management server 10 can use fewer DBs for matching as airport A becomes more congested, and more DBs as airport A becomes less congested. Similarly, the CPU 102 can appropriately use one or more DBs out of the first to fifth matching information DBs 106b1-106b5 for matching with the target facial image depending on the number of users U who have completed the check-in procedure. That is, the CPU 102 can use fewer DBs for matching so that the number of registered facial images to be matched with the target facial image decreases as the number of users U who have completed the check-in procedure increases.

[0330] Specifically, for example, when airport A is not too crowded, the CPU 102 of the management server 10 can compare the target face image received from the security inspection device 40 with a plurality of registered face images registered in the first and second matching information DBs 106b1 and 106b2 in a 1:N ratio. The first and second matching information DBs 106b1 and 106b2 used for the comparison have registered therein user information of a user U whose status regarding the security inspection procedure is incomplete.

[0331] Furthermore, for example, in a first case where airport A is less congested, CPU 102 can also compare the target face image received from automated gate device 50 with a plurality of registered face images registered in first to third matching information DBs 106b1, 106b2, and 106b3 in a 1:N ratio. Furthermore, for example, in a second case where airport A is less congested, CPU 102 can also compare the target face image received from automated gate device 50 with a plurality of registered face images registered in second and third matching information DBs 106b2 and 106b3 in a 1:N ratio. User information of user U whose status regarding immigration procedures is incomplete is registered in first to third matching information DBs 106b1, 106b2, and 106b3 used for comparison. Note that the congestion situation at airport A is less congested in the first case than in the second case.

[0332] Furthermore, for example, in a first case where airport A is less congested, CPU 102 can also compare the target face image received from signage terminal 60 with the multiple registered face images registered in first to fourth matching information DBs 106b1, 106b2, 106b3, and 106b4 in a 1:N ratio. Furthermore, for example, in a second case where airport A is less congested, CPU 102 can also compare the target face image received from signage terminal 60 with the multiple registered face images registered in second to fourth matching information DBs 106b2, 106b3, and 106b4 in a 1:N ratio. Furthermore, for example, in a third case where airport A is less congested, CPU 102 can also compare the target face image received from signage terminal 60 with the multiple registered face images registered in third and fourth matching information DBs 106b3 and 106b4 in a 1:N ratio. The first to fourth matching information DBs 106b1, 106b2, 106b3, and 106b4 used for matching have registered therein user information of user U whose status regarding their location or passage in front of the signage terminal 60 is incomplete. Note that the congestion situation at airport A is less in the first case than in the second case, and less in the second case than in the third case.

[0333] Furthermore, for example, in a first case where airport A is less congested, the CPU 102 can also compare the target face image received from the boarding gate device 70 with the plurality of registered face images registered in the first to fifth matching information DBs 106b1, 106b2, 106b3, 106b4, and 106b5 in a 1:N ratio. Furthermore, for example, in a second case where airport A is less congested, the CPU 102 can also compare the target face image received from the boarding gate device 70 with the plurality of registered face images registered in the second to fifth matching information DBs 106b2, 106b3, 106b4, and 106b5 in a 1:N ratio. Furthermore, for example, in a third case where airport A is less congested, the CPU 102 can also compare the target face image received from the boarding gate device 70 with the plurality of registered face images registered in the third to fifth matching information DBs 106b3, 106b4, and 106b5 in a 1:N ratio. Furthermore, for example, in a fourth case in which airport A is less congested, the CPU 102 can also compare the target face image received from the boarding gate device 70 with a plurality of registered face images registered in the fourth and fifth matching information DBs 106b4 and 106b5 in a 1:N ratio. The first to fifth matching information DBs 106b1, 106b2, 106b3, 106b4, and 106b5 used for the comparison have registered therein user information of user U whose status regarding boarding onto an aircraft is incomplete. Note that the congestion situation at airport A is less congested in the first case than in the second case, less congested in the second case than in the third case, and less congested in the third case than in the fourth case.

[0334] Furthermore, when staff member S selects to display an alert on the business terminal 80, the CPU 802 of the business terminal 80 obtains the user information and status of user U, whose deadline for the procedure specified by the alert has passed, from the management server 10 via the network NW. The CPU 802 obtains the user information and status of the user U from the user information DB 106a of the management server 10.

[0335] The CPU 802 displays an alert on the display 810 based on the acquired user information and status. Fig. 25A is a schematic diagram showing an example of an alert displayed on the business terminal 80. Note that Fig. 25A shows a case where user U with user ID 10105 has not completed the security inspection procedure even though the deadline for the security inspection procedure has passed, unlike the case shown in Fig. 16.

[0336] As shown in Figure 25A, the alert AL includes a user information display field AL10 that displays user information about user U, a status display field AL12 that displays user U's status, and a facial image display field AL14 that displays user U's registered facial image.

[0337] The user information display field AL10 displays the user U's identity information such as the name and nationality, and boarding information such as the flight number of the aircraft the user U is scheduled to board. The user information display field AL10 can display part or all of the identity information, and can display part or all of the boarding information.

[0338] The status display field AL12 displays the status of each procedure of user U, whether incomplete or completed. The status display field AL12 also displays the status of procedures whose deadlines have passed. Note that when an alert is sent indicating that the deadline for a certain procedure has passed, it means that the deadlines for subsequent procedures have also passed.

[0339] The face image display field AL14 displays the photographed face image or passport face image of user U that was acquired by the check-in terminal 20 and registered in the user information DB 106a. Staff member S can easily find user U who has not completed procedures, including those at airport A, using the registered face image of user U displayed in alert AL as a clue.

[0340] Furthermore, the CPU 802 of the business terminal 80 can display a status confirmation screen on the display 810 to confirm the status of user U, regardless of whether an alert has been received from the management server 10. In this case, the CPU 802 obtains the user information and status of user U, whose status is to be confirmed, from the user information DB 106a of the management server 10 via the network NW. FIGS. 25B and 25C are schematic diagrams showing examples of status confirmation screens displayed on the business terminal 80. FIGS. 25B and 25C differ from each other in the format of the progress bar displaying the status of user U. Note that, unlike the case shown in FIG. 16, FIGS. 25B and 25C show a case in which user U, whose user ID is 10105, has not yet completed the security inspection procedure even though the deadline for the security inspection procedure has passed.

[0341] As shown in Figures 25B and 25B, the status confirmation screen ST includes a user information C display field ST10 that displays user information of user U, a status display field ST12 that displays the status of user U, and a facial image display field ST14 that displays the registered facial image of user U.

[0342] The user information display field ST10 displays the same information as the user information display field AL10 of the alert AL. The face image display field ST14 displays the same registered face image as the face image display field AL14 of the alert AL.

[0343] The status display field ST12 displays a progress bar whose length varies depending on the progress of the user U, indicating which procedures have been completed. Fig. 25B shows the status of the user U displayed using a bar-shaped progress bar. Fig. 25C shows the status of the user U displayed using a circular progress bar.

[0344] In the alert AL shown in FIG. 25A, the status of the user U can also be displayed using a progress bar, similar to FIGS. 25B and 25C.

[0345] Thus, according to this embodiment, the management server 10 sets the deadline for each procedure at airport A for user U who is scheduled to board an aircraft based on the boarding information acquired by the check-in terminal 20, and manages the status of each procedure for user U. Therefore, according to this embodiment, the status of user U who is scheduled to board an aircraft can be grasped and managed in more detail.

[0346] [Second embodiment] An information processing system, an information processing device, and an information processing method according to a second embodiment of the present invention will be described. Note that components similar to those of the information processing system, the information processing device, and the information processing method according to the first embodiment will be assigned the same reference numerals, and descriptions thereof will be omitted or simplified.

[0347] In the first embodiment, the CPU 102 of the management server 10 selects the first to fifth matching information DBs 106b1-106b5 for matching with the target facial image and uses them for matching. However, this is not limiting. The CPU 102 does not necessarily need to use the first to fifth matching information DBs 106b1-106b5. In this case, the CPU 102 can extract multiple registered facial images similar to the first to fifth matching information DBs 106b1-106b5 from the user information DB 106a based on the status of the user U and use them for matching. Hereinafter, in this embodiment, a case will be described in which multiple registered facial images are extracted from the user information DB 106a based on the status of the user U corresponding to the registered facial images and used for matching. In this embodiment, when the status of one procedure in a series of procedures after the check-in procedure is completed, the CPU 102 as a matching unit extracts a registered facial image to be matched with the target facial image from the multiple registered facial images based on the status of another procedure following the one procedure.

[0348] When the CPU 102 receives a target face image and a matching request from the automated baggage drop machine 30, it extracts a registered face image of user U from the user information DB 106a by filtering. Here, the CPU 102 extracts registered face images of users U whose status regarding check-in procedures is complete but whose status regarding other procedures is incomplete by filtering based on the user U's status. The CPU 102 matches the received target face image with the multiple registered face images extracted from the user information DB 106a. In this embodiment, too, the CPU 102 does not match the target face image with registered face images of users U who have not yet completed the check-in procedure, which is the procedure immediately before the baggage drop procedure, nor does it match the target face image with registered face images of users U who have already completed the baggage drop procedure. Therefore, in this embodiment, too, matching the target face image acquired during the baggage drop procedure with unnecessary registered face images can be avoided.

[0349] Furthermore, when the CPU 102 receives a target facial image and a matching request from the security inspection device 40, it extracts a registered facial image of user U from the user information DB 106a by filtering. Here, the CPU 102 extracts registered facial images of user U whose statuses regarding check-in procedures and baggage drop procedures are complete and whose statuses regarding other procedures are incomplete by filtering based on the user U's status. The CPU 102 matches the received target facial image with multiple registered facial images extracted from the user information DB 106a. In this embodiment, too, the CPU 102 does not match the target facial image with a registered facial image of a user U whose baggage drop procedure, a procedure immediately before the security inspection procedure, has not yet been completed, nor does it match the target facial image with a registered facial image of a user U who has already completed the security inspection procedure. Therefore, in this embodiment, too, matching of a target facial image acquired during the security inspection procedure with unnecessary registered facial images can be avoided.

[0350] Furthermore, when the CPU 102 receives a target facial image and a matching request from the automated gate device 50, it extracts a registered facial image of user U from the user information DB 106a by filtering. Here, the CPU 102 extracts registered facial images of user U whose statuses regarding check-in procedures, baggage drop-off procedures, and security inspection procedures are complete and whose statuses regarding other procedures are incomplete by filtering based on the user U's status. The CPU 102 compares the received target facial image with multiple registered facial images extracted from the user information DB 106a. In this embodiment, too, the CPU 102 does not compare the target facial image with a registered facial image of a user U who has not yet completed the security inspection procedure, which is the procedure immediately before the immigration procedure, nor does it compare the target facial image with a registered facial image of a user U who has already completed the immigration procedure. Therefore, in this embodiment, too, it is possible to avoid comparing the target facial image acquired during the immigration procedure with unnecessary registered facial images.

[0351] Furthermore, when the CPU 102 receives a target face image from the signage terminal 60, it extracts a registered face image of the user U from the user information DB 106a by filtering. Here, the CPU 102 extracts registered face images of the user U whose statuses regarding check-in, baggage drop-off, security inspection, and immigration procedures are complete and whose statuses regarding other procedures are incomplete by filtering based on the user U's status. The CPU 102 compares the received target face image with the multiple registered face images extracted from the user information DB 106a. In this embodiment, the CPU 102 does not compare the target face image with the registered face image of a user U who has not yet completed immigration procedures for the procedure immediately before the signage terminal 60 or before passing through the signage terminal 60, nor does it compare the target face image with the registered face image of a user U who has already completed the location or passage of the signage terminal 60. Therefore, in this embodiment, it is possible to avoid comparing the target face image acquired when the user was located in front of or passing through the signage terminal 60 with unnecessary registered face images.

[0352] Furthermore, when the CPU 102 receives a target face image from the boarding gate device 70, it extracts a registered face image of the user U from the user information DB 106a by filtering. Here, the CPU 102 extracts registered face images of the user U whose status regarding boarding the aircraft is incomplete and whose status regarding other procedures is complete by filtering based on the user U's status. The CPU 102 compares the received target face image with the multiple registered face images extracted from the user information DB 106a. In this embodiment, the CPU 102 does not compare the target face image with the registered face image of the user U who has not yet completed the location or passage in front of the signage terminal 60 for the procedure immediately prior to boarding the aircraft, nor does it compare the target face image with the registered face image of the user U who has already completed boarding the aircraft. Therefore, in this embodiment, it is possible to avoid comparing the target face image acquired at the time of boarding the aircraft with unnecessary registered face images.

[0353] As described above, the CPU 102 as a matching unit extracts registered face images to be matched with a target face image from the user information DB 106a according to the status of the user U for each procedure. As described above, the series of procedures up to boarding an aircraft includes one procedure and another procedure that follows it. In this embodiment, the CPU 102 also matches a target face image acquired during another procedure with a registered face image of a user U whose status for one procedure is complete and whose status for another procedure is incomplete. Therefore, as in the first embodiment, this embodiment can also reduce the number of registered face images that are the population to be matched with a target face image, thereby improving the matching accuracy of face images that are biometric information.

[0354] Furthermore, in this embodiment, it is possible to extract a registered facial image of user U from user information DB 106a according to user U's status, without having to provide DBs for each user U's status, such as the first to fifth matching information DBs 106b1-106b5, which were used in the first embodiment.

[0355] In this embodiment, the storage device 106 of the management server 10 may store only the user information DB 106a, or, as in the first embodiment, may store both the user information DB 106a and the first to fifth matching information DBs 106b1-106b5.

[0356] In this embodiment, the range of registered face images extracted from the user information DB 106a can be appropriately changed depending on, for example, the number of users U who have completed the check-in procedure, the congestion level of airport A, the processing capacity of the management server 10, etc. For example, the CPU 102 of the management server 10 can extract fewer registered face images to use for matching when airport A is more congested, and more registered face images to use for matching when airport A is less congested, depending on the congestion level of airport A determined as described above. Similarly, the CPU 102 can change the number of registered face images to extract to use for matching with the target face image depending on the number of users U who have completed the check-in procedure. That is, the CPU 102 can change the number of registered face images to extract so that the number of registered face images to be matched with the target face image decreases as the number of users U who have completed the check-in procedure increases.

[0357] Specifically, for example, when airport A is not very crowded, when the CPU 102 of the management server 10 receives a target face image and a matching request from the security inspection device 40, it can also extract a registered face image of a user U whose status at least with respect to the security inspection procedure is incomplete. The users U whose status at least with respect to the security inspection procedure is incomplete include the following users U. That is, it includes users U whose status with respect to the check-in procedure and the baggage drop-off procedure is completed, but whose status with respect to other procedures is incomplete. It may also include users U whose status with respect to the check-in procedure is completed, but whose status with respect to other procedures is incomplete.

[0358] Furthermore, for example, when airport A is not very congested, when the CPU 102 receives a target face image and a matching request from the automated gate device 50, it can extract a registered face image of a user U whose status at least with respect to immigration procedures is incomplete. The users U whose status at least with respect to immigration procedures is incomplete include the following users U. That is, it includes users U whose status with respect to check-in procedures, baggage drop-off procedures, and security inspection procedures is completed, but whose status with respect to other procedures is incomplete. It may also include users U whose status with respect to check-in procedures and baggage drop-off procedures is completed, but whose status with respect to other procedures is incomplete. It may also include users U whose status with respect to check-in procedures is completed, but whose status with respect to other procedures is incomplete.

[0359] Furthermore, for example, when airport A is not very crowded, when the CPU 102 receives a target face image from the signage terminal 60, it can extract a registered face image of a user U whose status regarding at least passing through or being in front of the signage terminal 60 is incomplete. The users U whose status regarding at least passing through or being in front of the signage terminal 60 is incomplete include the following users U. That is, users U whose status regarding check-in procedures, baggage drop-off procedures, security inspection procedures, and immigration procedures is complete, but whose status regarding other procedures is incomplete. Users U whose status regarding check-in procedures, baggage drop-off procedures, and security inspection procedures is complete, but whose status regarding other procedures is incomplete, may also be included. Users U whose status regarding check-in procedures and baggage drop-off procedures is complete, but whose status regarding other procedures is incomplete may also be included. Users U whose status regarding check-in procedures and baggage drop-off procedures is complete, but whose status regarding other procedures is incomplete may also be included. Users U whose status regarding check-in procedures is complete, but whose status regarding other procedures is incomplete may also be included.

[0360] Furthermore, for example, when airport A is not very congested, when the CPU 102 receives a target face image from the boarding gate device 70, it can extract a registered face image of at least a user U whose status regarding boarding the aircraft is incomplete. A user U whose status regarding boarding the aircraft is incomplete and whose status regarding other procedures is complete may be included. A user U whose status regarding check-in procedures, baggage drop-off procedures, security inspection procedures, and immigration procedures is complete, and whose status regarding other procedures is incomplete may be included. A user U whose status regarding check-in procedures, baggage drop-off procedures, and security inspection procedures is complete, and whose status regarding other procedures is incomplete may be included. A user U whose status regarding check-in procedures and baggage drop-off procedures is complete, and whose status regarding other procedures is incomplete may be included. A user U whose status regarding check-in procedures and baggage drop-off procedures is complete, and whose status regarding other procedures is incomplete may be included. A user U whose status regarding check-in procedures and baggage drop-off procedures is complete, and whose status regarding other procedures is incomplete may be included.

[0361] [Third embodiment] An information processing system, an information processing device, and an information processing method according to a third embodiment of the present invention will be described with reference to Fig. 26. Note that components similar to those of the information processing systems, information processing devices, and information processing methods according to the first and second embodiments will be given the same reference numerals, and descriptions thereof will be omitted or simplified.

[0362] In this embodiment, the alert operation of the management server 10 that can send an alert specifying the location of the user U in airport A will be described with reference to Fig. 26. Fig. 26 is a flowchart showing the alert operation of the management server 10 according to this embodiment.

[0363] The management server 10 according to this embodiment executes the process shown in Fig. 26 as the process of generating and transmitting alerts in steps S716 and S726 shown in Fig. 23 and steps S734, S742, and S750 shown in Fig. 24. Note that the process shown in Fig. 26 may be executed for all or some of steps S716, S726, S734, S742, and step S750.

[0364] Furthermore, to identify the location of user U, management server 10 uses images captured by multiple surveillance cameras 90 installed within airport A. Each of the multiple surveillance cameras 90 captures an image of a specific location within airport A and functions as an image acquisition unit that transmits the captured image to management server 10 via network NW.

[0365] The CPU 102 of the management server 10 functions as a location identification unit that identifies the location of the user U. The CPU 102 as the location identification unit identifies the user U from a facial image in the video captured by the multiple surveillance cameras 90. The CPU 102 as the location identification unit identifies the installation location of the surveillance camera 90 from which the user U was identified in the video as the location of the user U.

[0366] 26, when the CPU 102 of the management server 10 determines that the deadline for a specific procedure has passed, it acquires a registered face image of the user U from the user information DB 106a (step S802). The specific procedure is a baggage check-in procedure, a security inspection procedure, an immigration inspection procedure, a location in front of or passing through a signage terminal 60, or boarding an aircraft.

[0367] Furthermore, CPU 102 acquires the images transmitted by the multiple monitoring cameras 90 (step S804).

[0368] Next, CPU 102 detects faces from the images captured by the multiple surveillance cameras 90, and compares a detected face image, which is an image of the detected face, with a registered face image (step S806). When comparing the detected face image with the registered face image, CPU 102 can compare both face images by comparing a facial feature amount extracted from the detected face image with a facial feature amount extracted from the registered face image.

[0369] In particular, CPU 102 can obtain detected face images by detecting face images from video transmitted from surveillance cameras 90 installed between the location where the procedure whose deadline has passed is being performed and the location where the most recently completed procedure was performed. This makes it possible to narrow down the face images to be detected, thereby improving matching accuracy.

[0370] If the result of the comparison is that a detected face image that matches the registered face image is found (step S808, YES), CPU 102 identifies the location of user U and generates an alert indicating that the deadline has passed, and transmits it via network NW (step S810). In the alert, CPU 102 identifies the installation location of the surveillance camera 90 that captured the matching detected face image as the location of user U. The alert is sent to the business terminals 80 of one or more staff members S. Because the location of user U is identified in the alert, staff member S who receives the alert at their business terminal 80 can easily find user U for whom the deadline for a specific procedure has passed.

[0371] Furthermore, the destination of the alert can be the business terminal 80 of the staff member S that is closest to the location of the user U among multiple staff members S. The business terminal 80 carried by the staff member S transmits to the management server 10 location information of the business terminal 80 based on, for example, a position sensor that uses the GNSS (Global Navigation Satellite System) or a magnetic sensor that detects geomagnetism. The GNSS is not particularly limited, but examples include the GPS (Global Positioning System), GLONASS (Global Navigation Satellite System), Galileo, and Compass. The CPU 102 of the management server 10 can identify the business terminal 80 of the staff member S that is closest to the location of the user U based on the location information transmitted from the business terminal 80.

[0372] On the other hand, if the result of the comparison is that no detected face image matching the registered face image is found (step S808, NO), CPU 102 generates an alert indicating that the deadline has passed but the location of user U is unspecified, and transmits it via network NW (step S812).

[0373] As in this embodiment, by using footage captured by multiple surveillance cameras 90, the management server 10 can also generate and send an alert identifying the location of user U when the deadline for a specific procedure has passed.

[0374] [Other embodiments] According to still another embodiment, the information processing device described in the above embodiment can also be configured as shown in Figures 27 and 28. Figure 27 is a block diagram showing the configuration of an information processing device according to another embodiment. Figure 28 is a block diagram showing the configuration of an information processing device according to still another embodiment.

[0375] 27, an information processing device 1000 according to another embodiment includes an information management unit 1002 that registers boarding information related to a user's boarding, which is acquired through the user's check-in procedure, and the user's biometric information in association with each other. The information processing device 1000 also includes a matching unit 1004 that matches target biometric information, which is biometric information acquired for a single user during the procedures leading up to boarding, with registered biometric information, which is biometric information registered by the information management unit 1002. The matching unit 1004 selects the registered biometric information to be matched with the target biometric information based on the status of the user's procedures leading up to boarding, which corresponds to the registered biometric information.

[0376] According to another embodiment, the registered biometric information to be matched with the target biometric information is selected based on the status of the user corresponding to the registered biometric information, so that the number of registered biometric information that constitutes the population to be matched with the target biometric information can be reduced, thereby improving the matching accuracy of the biometric information.

[0377] 28, an information processing device 2000 according to another embodiment includes an information management unit 2002 that registers boarding information and biometric information related to a user's boarding, which are acquired through the user's check-in procedure. The information processing device 2000 also includes a transmission unit 2004 that transmits to the device verification information obtained by comparing the biometric information received from a device that performs the procedures up to the user's boarding with biometric information whose status related to the procedure is incomplete. The information processing device 2000 also includes a status management unit that updates the status related to the procedure when it receives status information indicating that the procedure has been completed from the device.

[0378] According to another embodiment, the biometric information received from the device that performs the procedures for the user before boarding is compared with the biometric information whose status regarding the procedures is incomplete, so that the number of registered biometric information pieces that are the population to be compared with the target biometric information can be reduced, and therefore, according to another embodiment, the accuracy of matching the biometric information can be improved.

[0379] [Modified embodiment] The present invention is not limited to the above-described embodiment, and various modifications are possible.

[0380] For example, in the above embodiment, an example has been described in which the status of each procedure after check-in, such as baggage drop-off procedure, security inspection procedure, immigration procedure, location or passage in front of the signage terminal 60, and boarding the aircraft, is managed, but this is not limited to this. For example, when user U boards a domestic flight, there is no need to manage the status of the immigration procedure. Furthermore, it is also possible to install signage terminals 60 in multiple locations within airport A and manage the status of each of the multiple signage terminals 60 regarding their location or passage. In addition to the status of the procedures exemplified above, various other statuses can be managed.

[0381] That is, in the above embodiment, an example has been described in which the automated baggage drop machine 30, security inspection device 40, automated gate device 50, signage terminal 60, and boarding gate device 70 are installed as devices subsequent to the check-in terminal 20, but this is not limited to this. It is not necessary to install all of the automated baggage drop machine 30, security inspection device 40, automated gate device 50, signage terminal 60, and boarding gate device 70, as long as at least one of these devices is installed. For example, only the signage terminal 60 may be installed as a device subsequent to the check-in terminal 20.

[0382] In the above embodiment, the case where identity verification is performed by matching a target facial image at each of the procedures for baggage check-in, security inspection, immigration, being in front of or passing through the signage terminal 60, and boarding an aircraft has been described as an example, but the present invention is not limited to this. For example, identity verification can also be performed using a code symbol such as a barcode or QR code. In this case, for example, when user U performs check-in procedures at the check-in terminal 20, the check-in terminal 20 issues user U a ticket such as a boarding pass printed with a code symbol containing information identifying user U. User U can verify his or her identity at each procedure by having a code reader read the code symbol.

[0383] In the above embodiment, the biometric information acquisition devices 214, 312, 412, 512, 610, and 712 capture and acquire a facial image as biometric information of the user U, but the present invention is not limited to this. The biometric information acquisition device 214 of the check-in terminal 20 may acquire, in addition to a facial image, a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein image, and the like as biometric information to be registered as registered biometric information in the user information DB 106a, etc. Furthermore, the other biometric information acquisition devices 312, 412, 512, 610, and 712 may acquire, in addition to a facial image, a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein image, and the like as target biometric information in accordance with the registered biometric information.

[0384] Furthermore, the management server 10 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the check-in terminal 20 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the automated baggage check machine 30 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the security inspection device 40 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the automated gate device 50 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the signage terminal 60 according to the above embodiment can be configured as a system consisting of one or more devices. Furthermore, the boarding gate device 70 according to the above embodiment can be configured as a system consisting of one or more devices.

[0385] Furthermore, the scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described computer program is recorded, but also the computer program itself.

[0386] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment is not limited to programs that execute processing by themselves recorded on the recording medium, but also includes programs that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0387] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0388] (Appendix 1) an information management unit that registers boarding information regarding the user's boarding, which is acquired through the user's check-in procedure, and biometric information of the user in association with each other; a matching unit that matches target biometric information, which is biometric information acquired for one of the users during the procedures before boarding, with registered biometric information, which is the biometric information registered by the information management unit; and The matching unit is an information processing device that selects the registered biometric information to be matched with the target biometric information based on a status of the user corresponding to the registered biometric information regarding the procedures up to boarding.

[0389] (Appendix 2) 2. The information processing device according to claim 1, wherein the matching unit matches the target biometric information with the registered face image of the user whose status regarding the procedure is incomplete.

[0390] (Appendix 3) An information processing device as described in Appendix 1 or 2, having a status management unit that updates the status corresponding to the procedure based on status information indicating that the procedure has been completed, received from an external device.

[0391] (Appendix 4) The information processing device of claim 3, wherein the status management unit updates the status corresponding to a procedure when it receives status information indicating that the procedures have been completed in the order in which the procedures are completed for the user before boarding.

[0392] (Appendix 5) The procedures include one procedure and another procedure subsequent to the one procedure, An information processing device according to any one of appendices 1 to 4, wherein the matching unit matches the target biometric information acquired during the other procedure with the registered facial image of the user whose status regarding the one procedure is completed and whose status regarding the other procedure is incomplete.

[0393] (Appendix 6) the information management unit registers the registered biometric information in a plurality of databases according to the status of the user corresponding to the registered biometric information; 6. The information processing device according to claim 1, wherein the matching unit matches the target biometric information with the registered biometric information registered in a database selected from the plurality of databases.

[0394] (Appendix 7) The procedures include one procedure and another procedure subsequent to the one procedure, An information processing device as described in Appendix 6, wherein the information management unit, when the status for one of the procedures becomes complete, moves and registers the registered facial image of the user from one of the databases corresponding to the one procedure to another of the databases corresponding to the other procedure.

[0395] (Appendix 8) 6. The information processing device according to claim 1, wherein the matching unit matches the target biometric information with the registered face image extracted from a plurality of registered face images based on the status of the user.

[0396] (Appendix 9) The procedures include one procedure and another procedure subsequent to the one procedure, The information processing device according to claim 8, wherein the matching unit extracts the registered face image from the plurality of registered face images based on the status related to the other procedure when the status related to the one procedure becomes complete.

[0397] (Appendix 10) An information processing device according to any one of appendices 1 to 9, wherein the matching unit changes the number of registered facial images to be selected based on the status of the user corresponding to the registered biometric information depending on the number of users who have completed the check-in procedure.

[0398] (Appendix 11) The information processing device according to claim 10, wherein the matching unit changes the number of registered facial images selected based on the status of the user corresponding to the registered biometric information so that the number of registered facial images selected decreases as the number of users who have completed the check-in procedure increases.

[0399] (Appendix 12) 5. The information processing device according to claim 3, wherein the status management unit manages the status based on a result of matching the target biometric information with the registered biometric information.

[0400] (Appendix 13) 13. The information processing device according to claim 12, wherein the status management unit updates the status when the verification results in a match.

[0401] (Appendix 14) 14. The information processing device according to any one of appendices 1 to 13, wherein the procedure is at least one of a baggage check-in procedure, a security inspection procedure, an immigration inspection procedure, and being in front of or passing through a signage terminal.

[0402] (Appendix 15) an information management unit that registers boarding information and biometric information regarding the user's boarding, which are acquired through the user's check-in procedure; a transmitting unit that transmits to the device verification information obtained by comparing biometric information received from the device that performs the procedures up to boarding of the user with biometric information whose status regarding the procedures is incomplete; a status management unit that updates the status of the procedure when status information indicating that the procedure has been completed is received from the device; An information processing device having the above.

[0403] (Appendix 16) registering boarding information regarding the user's boarding, which is acquired through the user's check-in procedure, and biometric information of the user in association with each other; Matching target biometric information, which is biometric information acquired for one of the users during the procedures up to boarding, with registered biometric information, which is the biometric information registered by the information management unit; An information processing method for selecting the registered biometric information to be compared with the target biometric information based on the status of the user corresponding to the registered biometric information regarding the procedures leading up to boarding.

[0404] (Appendix 17) On the computer, registering boarding information regarding the user's boarding, which is acquired through the user's check-in procedure, and biometric information of the user in association with each other; Matching target biometric information, which is biometric information acquired for one of the users during the procedures up to boarding, with registered biometric information, which is the biometric information registered by the information management unit; The registered biometric information to be compared with the target biometric information is selected based on a status of the user corresponding to the registered biometric information regarding the procedures up to boarding. A recording medium on which a program for executing the above is recorded. [Explanation of symbols]

[0405] 1. Information processing system 10...Administration server 20...Check-in terminal 30...Automatic baggage check-in machine 40...Security inspection equipment 50...Automated gate device 60...Signage terminal 70...Boarding gate equipment 80...Business terminal NW...Network

Claims

1. an acquisition unit that acquires biometric information of a user from a predetermined procedure included in a series of procedures performed at different locations; an update unit that updates status information of the user's predetermined procedure from incomplete to completed based on a result of matching the biometric information with registered biometric information; an output unit that outputs information on a plurality of users who have completed the predetermined procedure and have not yet completed the next procedure based on the status information; An information processing device comprising:

2. The procedures are performed in a predetermined order.

2. The information processing apparatus according to claim 1, wherein:

3. The plurality of procedures includes a first procedure and a second procedure subsequent to the first procedure.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The registered biometric information is registered in the first procedure.

4. The information processing apparatus according to claim 3,

5. an identification unit that identifies a user who has completed the first procedure but has not completed the second procedure; The output unit outputs a list of the users who have completed the first procedure but have not completed the second procedure.

5. The information processing device according to claim 3 or 4.

6. The update unit updates the user's status regarding the plurality of procedures based on status information received from an external device indicating that each of the plurality of procedures has been completed. The information processing device according to claim 1 .

7. The update unit, upon receiving status information indicating that a specific procedure is to be completed in the order of the plurality of procedures, updates the status corresponding to the specific procedure among the plurality of procedures. The information processing device according to claim 1 .

8. registering biometric information in a plurality of lists according to the user's status with respect to the plurality of procedures; The information processing device according to claim 1 .

9. A matching unit is provided to match the acquired biometric information with the registered biometric information. The information processing device according to claim 8 .

10. a moving unit that registers biometric information in a plurality of lists according to the user's status regarding the plurality of procedures, and moves the registered biometric information of the user from a list associated with the first procedure to a list associated with the second procedure when the status regarding the first procedure is completed; The information processing device according to claim 3 , comprising:

11. a matching unit that matches the acquired biometric information with registered biometric information; The enrolled biometric information is extracted from the plurality of enrolled biometric information based on the user's status with respect to the plurality of procedures. The information processing device according to claim 8 .

12. an extraction unit that extracts the registered biometric information from the plurality of registered biometric information based on the status regarding the second procedure when the status regarding the first procedure is in a completed state; The information processing device according to claim 3 , comprising:

13. Manage the status of the user regarding the plurality of procedures based on the result of the comparison between the acquired biometric information and the registered biometric information. The information processing device according to any one of claims 8 to 12.

14. The update unit updates the status when the verification is successful. The information processing device according to claim 13.

15. an information processing device acquires biometric information of a user from a predetermined procedure included in a series of a plurality of procedures performed at different locations; the information processing device updates status information of the user's predetermined procedure from incomplete to completed based on a result of matching the biometric information with registered biometric information; The information processing device outputs information on a plurality of users who have completed the predetermined procedure but have not yet completed the next procedure, based on the status information. Information processing methods.

16. On the computer, In a series of multiple procedures each performed at a different location, biometric information of a user is acquired from a predetermined procedure included in the multiple procedures; updating the status information of the user's predetermined procedure from incomplete to completed based on the result of matching the biometric information with registered biometric information; Based on the status information, information on a plurality of users who have completed the predetermined procedure but have not yet completed the next procedure is output. A program that makes it happen.

Images