Information processing device, information processing method, and recording medium

Abstract

To provide an information processing device, an information processing method, and a recording medium capable of realizing a display according to the situation for a user in front of a signage terminal without causing much trouble to a user who is planning to board. [Solution] The information processing device has an information management unit that registers boarding information regarding a user's boarding, obtained through the user's check-in procedure, and the user's biometric information, obtained during the check-in procedure, in association with each other, and a display management unit that displays display information on the display terminal according to the time remaining until the boarding time based on the user's boarding information, identified by comparing target biometric information, which is biometric information obtained by a display terminal for a single user, with registered biometric information, which is biometric information registered by the information management unit.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] Patent Document 1 describes an information display system including an information display device used to present service information such as flight information, etc. In the information display system described in Patent Document 1, the information display device transmits facial images of surrounding users to a server linked to a user terminal, performs user authentication by facial recognition, acquires user information acquired from the user terminal, and generates and displays a related individual guidance screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-017924 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 requires the user to operate the user terminal and register a facial image of the user that has been captured in advance in a server for user authentication, which means that the user has to go through a lot of trouble to use the system.

[0005] In consideration of the above-mentioned problems, the object of the present invention is to provide an information processing device, an information processing method, and a recording medium that can realize a display according to the situation for a user in front of a display terminal without causing significant inconvenience to users who are planning to board. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing device having an information management unit that registers boarding information regarding a user acquired through the user's check-in procedure and biometric information of the user acquired during the check-in procedure in association with each other, and a display management unit that displays display information on the display terminal according to the remaining time until the boarding time based on the boarding information of the user identified by comparing target biometric information, which is biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit.

[0007] According to another aspect of the present invention, there is provided an information processing device having an information management unit that registers boarding information regarding a user acquired through the user's check-in procedure and the user's biometric information acquired during the check-in procedure in association with each other, and a display management unit that causes the display terminal to display a deadline for the procedures until boarding of the user in accordance with the remaining time until the boarding time based on the boarding information of the user identified by comparing target biometric information, which is biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit.

[0008] According to another aspect of the present invention, there is provided an information processing method which registers boarding information regarding a user acquired through the user's check-in procedure and biometric information of the user acquired during the check-in procedure in association with each other, and displays display information on the display terminal according to the remaining time until the boarding time based on the boarding information of the user identified by comparing target biometric information, which is the biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit.

[0009] According to yet another aspect of the present invention, a recording medium having recorded thereon a program is provided that causes a computer to register boarding information regarding a user's boarding, obtained through the user's check-in procedure, and biometric information of the user obtained during the check-in procedure in association with each other, and to display display information on the display terminal according to the remaining time until the boarding time based on the boarding information of the user identified by comparing target biometric information, which is the biometric information obtained by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit. Effect of the Invention

[0010] According to the present invention, it is possible to realize a display according to the situation for a user in front of a display terminal, without causing much trouble to the user who is planning to board. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of an information processing system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the check-in terminal according to the first embodiment of the present invention. [Diagram 3] FIG. 3 is a block diagram showing an example of a hardware configuration of the automated baggage check-in machine according to the first embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing an example of a hardware configuration of the security inspection device according to the first embodiment of the present invention. [Diagram 5] FIG. 5 is a block diagram showing an example of a hardware configuration of the automated gate apparatus according to the first embodiment of the present invention. [Figure 6] FIG. 6 is a block diagram showing an example of a hardware configuration of the signage terminal according to the first embodiment of the present invention. [Figure 7] FIG. 7 is a block diagram showing an example of a hardware configuration of the boarding gate apparatus according to the first embodiment of the present invention. [Figure 8]FIG. 8 is a block diagram showing an example of a hardware configuration of the management server according to the first embodiment of the present invention. [Figure 9] FIG. 9 is a block diagram showing an example of the hardware configuration of the business terminal according to the first embodiment of the present invention. [Figure 10] FIG. 10 is a sequence diagram showing the operations of the check-in terminal and the management server in the information processing system according to the first embodiment of the present invention. [Figure 11] FIG. 11 is a sequence diagram showing the operation of the automated baggage drop machine and the management server in the information processing system according to the first embodiment of the present invention. [Figure 12] FIG. 12 is a sequence diagram showing the operations of the security inspection device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 13] FIG. 13 is a sequence diagram showing the operation of the automated gate device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 14] FIG. 14 is a sequence diagram showing the operations of the signage terminal and the management server in the information processing system according to the first embodiment of the present invention. [Figure 15] FIG. 15 is a sequence diagram showing the operation of the boarding gate device and the management server in the information processing system according to the first embodiment of the present invention. [Figure 16] FIG. 16 is a schematic diagram showing an example of the user information database of the management server according to the first embodiment of the present invention. [Figure 17] FIG. 17 is a schematic diagram showing an example of deadline times for each procedure set by the management server according to the first embodiment of the present invention. [Figure 18] FIG. 18 is a flowchart (part 1) showing operations including a status management operation and an alert operation of the management server in the information processing system according to the first embodiment of the present invention. [Figure 19] FIG. 19 is a flowchart (part 2) showing operations including a status management operation and an alert operation of the management server in the information processing system according to the first embodiment of the present invention. [Figure 20A] FIG. 20A is a schematic diagram showing an example of an alert displayed on the business terminal according to the first embodiment of the present invention. [Figure 20B] FIG. 20B is a schematic diagram showing an example of a status confirmation screen displayed on the business terminal according to the first embodiment of the present invention. [Figure 20C] FIG. 20C is a schematic diagram showing an example of a status confirmation screen displayed on the business terminal according to the first embodiment of the present invention. [Figure 21] FIG. 21 is a flowchart showing the display management operation of the management server in the information processing system according to the first embodiment of the present invention. [Figure 22] FIG. 22 is a schematic diagram showing an example of a display screen of the first display information in the signage terminal according to the first embodiment of the present invention. [Figure 23] FIG. 23 is a schematic diagram showing an example of a display screen of the first display information in the signage terminal according to the first embodiment of the present invention. [Figure 24] FIG. 24 is a schematic diagram showing an example of a display screen of the first display information in the signage terminal according to the first embodiment of the present invention. [Diagram 25] FIG. 25 is a schematic diagram showing an example of a display screen of the second display information in the signage terminal according to the first embodiment of the present invention. [Figure 26] FIG. 26 is a flowchart showing an alert operation of the management server according to the second embodiment of the present invention. [Figure 27] FIG. 27 is a block diagram showing a configuration of an information processing device according to another embodiment of the present invention. [Figure 28] FIG. 28 is a block diagram showing a configuration of an information processing device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [First embodiment] An information processing system, an information processing device, and an information processing method according to a first embodiment of the present invention will be described with reference to FIGS.

[0013] First, the configuration of an information processing system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing the overall configuration of an information processing system according to this embodiment.

[0014] 1, an information processing system 1 according to this embodiment includes a management server 10, a check-in terminal 20, an automated baggage drop machine 30, a security inspection device 40, an automated gate device 50, a signage terminal 60, a boarding gate device 70, and a business terminal 80. The information processing system 1 according to this embodiment is, for example, a tracking system that grasps and manages the situation of a user U who is scheduled to board an aircraft at airport A, and tracks the user U. The information processing system 1 according to this embodiment is also, for example, a display management system that manages information displayed on a signage terminal 60, which is a display terminal, for a user U who is scheduled to board an aircraft at airport A.

[0015] The information processing system 1 may be one that grasps and manages the situation within a facility for users who plan to board a transportation means at a facility for boarding the transportation means, in addition to the situation of user U who plans to board an aircraft at airport A. For example, the information processing system 1 may be one that grasps and manages the situation within a seaport of a user who plans to board a ship at a seaport. Also, for example, the information processing system 1 may be one that grasps and manages the situation within a station of a user who plans to board a train at a station.

[0016] The management server 10 is installed in the facilities of, for example, an airport company or an airline company that operates the airport A. The check-in terminal 20 is installed in the check-in lobby P1 in the airport A. The automated baggage drop machine 30 is installed in the baggage counter P2 in the airport A. The security inspection device 40 is installed in the security inspection area P3 in the airport A. The automated gate device 50 is installed in the departure inspection area P4 in the airport A. The signage terminal 60 is installed in various places in the airport A. For example, the signage terminal 60 is installed in the check-in lobby P1, the baggage counter P2, the security inspection area P3, etc. Also, for example, the signage terminal 60 is installed in the passage P5 in the airport A. The passage P5 is a passage connecting the departure inspection area P4 and the boarding gate P6. The boarding gate device 70 is installed in the boarding gate P6 in the airport A. The user U can board the aircraft from the boarding gate P6. The business terminal 80 is carried by a staff member S, such as an airline employee or an airport company employee. The business terminal 80 may be installed in a business location, such as a counter where the staff member works.

[0017] After arriving at airport A, a user U who is scheduled to board an international flight passes through the check-in lobby P1, the baggage counter P2, the security checkpoint P3, the immigration checkpoint P4, and the passageway P5, which are the points where various procedures are carried out or the points through which the user passes, and then boards the aircraft at the boarding gate P6. The user U performs the check-in procedure (boarding procedure) at the check-in terminal 20 at the check-in lobby P1. Furthermore, the user U performs the baggage check procedure at the automated baggage check machine 30 at the baggage counter P2, as necessary. After the check-in procedure and the baggage check procedure as necessary, the user U undergoes the security inspection procedure at the security inspection device 40 at the security inspection point P3. After the security inspection, the user U undergoes the immigration inspection procedure at the automated gate device 50 at the immigration checkpoint P4. After leaving the immigration checkpoint P4, the user U passes through the passageway P5 where the signage terminal 60 is installed and arrives at the boarding gate P6. The user U passes through the boarding gate device 70 at the boarding gate P6 to board the aircraft. Furthermore, at various locations within airport A, user U is in front of signage terminal 60 or passes in front of signage terminal 60 and can view various pieces of information displayed on signage terminal 60, which is a display terminal.

[0018] In addition, the user U may be not only a person who plans to board an international flight, but also a person who plans to board a domestic flight. In the case of a user U who plans to board a domestic flight, immigration inspection is not carried out at immigration inspection site P4.

[0019] A plurality of surveillance cameras 90 are installed at various locations within airport A. The surveillance cameras 90 are installed, for example, at check-in lobby P1, baggage counter P2, security checkpoint P3, immigration checkpoint P4, passageway P5, and boarding gate P6. Identifying the location of user U using the surveillance cameras 90 will be described in the second embodiment.

[0020] The management server 10, check-in terminal 20, automated baggage drop machine 30, security inspection device 40, automated gate device 50, signage terminal 60, boarding gate device 70, and surveillance camera 90 are connected to a network NW. The network NW is composed of a LAN (Local Area Network) including an in-house communication network of airport A, a WAN (Wide Area Network), a mobile communication network, etc. The business terminal 80 can be connected to the network NW wirelessly or by wire.

[0021] The management server 10 is capable of communicating with the check-in terminal 20, the automated baggage drop machine 30, the security inspection equipment 40, the automated gate equipment 50, the signage terminal 60, the boarding gate equipment 70, the business terminal 80 and the surveillance camera 90 via a network NW.

[0022] Next, each component of the information processing system 1 according to this embodiment will be further described with reference to FIGS.

[0023] First, the configuration of check-in terminal 20 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the hardware configuration of check-in terminal 20.

[0024] The check-in terminal 20 is an automated check-in terminal that is operated by the user U to carry out the check-in procedure (boarding procedure). The check-in terminal 20 may also be a check-in terminal installed at a manned counter operated by an airline employee. The check-in procedure (boarding procedure) is a procedure in which at least information for identifying the user U who is scheduled to board an aircraft is input to register the information. Specifically, for example, as described below, it is a procedure in which user information including the user U's identity information, face information, and boarding information is input to register the information.

[0025] 2, the check-in terminal 20 has a CPU (Central Processing Unit) 202, a RAM (Random Access Memory) 204, a storage device 206, an input device 208, and a display 210. The check-in terminal 20 further has a medium reading device 212, a biometric information acquiring device 214, and a communication unit 216. The CPU 202, the RAM 204, the storage device 206, the input device 208, the display 210, the medium reading device 212, the biometric information acquiring device 214, and the communication unit 216 are connected to a bus line 218.

[0026] CPU 202 operates by executing programs stored in storage device 206, and functions as a control unit that controls the overall operation of check-in terminal 20. CPU 202 also executes application programs stored in storage device 206 to perform various processes as check-in terminal 20. RAM 204 provides a memory area necessary for the operation of CPU 202.

[0027] More specifically, the CPU 202 functions as a matching unit that matches a facial image of a user U who performs a check-in procedure using the check-in terminal 20. The CPU 202 as a matching unit matches a passport facial image, which is a facial image acquired from the passport of the user U by the medium reading device 212, with a captured facial image, which is a facial image captured by the biometric information acquisition device 214 during the check-in procedure. When matching the passport facial image with the captured facial image, the CPU 202 can match both facial images by matching facial feature amounts extracted from the passport facial image with facial feature amounts extracted from the captured facial image.

[0028] Instead of functioning as a matching unit, the CPU 202 can be configured to request an external server such as the management server 10 to match the face image of the user U and obtain the matching result from the external server. In this case, the CPU 202 can transmit the passport face image and the captured face image of the user U to the external server and request matching of the face images.

[0029] Furthermore, the CPU 202 functions as a user information transmission unit that transmits user information of the user U to the management server 10. The CPU 202 as a user information transmission unit transmits the user information of the user U to the management server 10 when a match is found between the passport face image of the user U and the captured face image, and the identity verification of the user U is successful.

[0030] The user information of user U includes user U's identification information, face information, and boarding information, which are associated with each other.

[0031] The identity information is information about the user U, such as the name, nationality, sex, date of birth, etc. The identity information is obtained from the passport or airline ticket medium of the user U by the medium reading device 212. The identity information may also include passport information, such as the passport number and passport issuing country, obtained from the user U's passport by the medium reading device 212.

[0032] The face information is a captured face image or a passport face image of the user U that has been verified by the CPU 202. The face information may be either the captured face image or the passport face image, or may be both images. The face information does not have to be the captured face image or the passport face image itself, and may be facial feature amounts extracted from the captured face image or the passport face image.

[0033] The boarding information is information about the flight that user U plans to use, such as the airline, flight number, departure point, arrival point, departure date and time, and arrival date and time. The boarding information may also include the boarding time when boarding the aircraft for user U is closed. The boarding information is obtained from user U's airline ticket medium by the medium reading device 212.

[0034] The user information of the user U transmitted to the management server 10 is registered in a user information database (DB) 106a in the management server 10, as will be described later.

[0035] Furthermore, CPU 202 functions as a status information transmission unit that transmits status information, which is information regarding the status of user U. When CPU 202 as a status information transmission unit transmits user information of user U and completes the check-in procedure, it transmits status information indicating that check-in procedure of user U has been completed to management server 10. The status information is associated in management server 10 with at least one of user information of user U or face information, passport information, and boarding information included in the user information.

[0036] The CPU 202 only needs to transmit at least information for identifying the user U who is scheduled to board the aircraft and status information regarding the check-in procedure. In this case, the boarding information of the user U only needs to be registered in advance in a DB of a server such as the management server 10.

[0037] Furthermore, the CPU 202 functions as a display control unit that causes screens for guidance, notifications, etc., for the user U to be displayed on the display 210. For example, the CPU 202 as a display control unit causes the display 210 to display a guidance screen that provides guidance on how to use the check-in terminal 20. Furthermore, when the passport face image of the user U does not match the captured face image and identity verification of the user U fails, the CPU 202 causes the display 210 to display a notification screen that notifies the user U that identity verification has failed.

[0038] The storage device 206 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 206 stores programs executed by the CPU 202, data referenced by the CPU 202 when executing the programs, etc.

[0039] The input device 208 is, for example, a touch panel built into the display 210. The input device 208 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the check-in terminal 20 via the input device 208.

[0040] The display 210 functions as a display unit that displays various screens to the user U who uses the check-in terminal 20. For example, the display 210 displays a guidance screen that provides guidance on how to use the check-in terminal 20 and a notification screen for the user U.

[0041] The medium reading device 212 functions as an information acquiring unit that reads the passport or airline ticket medium of the user U to acquire information recorded on the passport or airline ticket. An airline ticket medium is, for example, a paper airline ticket or a mobile terminal that displays an e-ticket receipt. The medium reading device 212 is composed of, for example, a code reader, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, etc., and acquires information from various media held up to the reading unit.

[0042] For example, the medium reading device 212 reads and acquires the identity information and passport information of user U displayed on the face of the passport using an OCR device. Also, for example, the medium reading device 212 reads and acquires the passport face image of user U displayed on the face of the passport using an image scanner. Also, in the case of an e-passport, the medium reading device 212 reads and acquires the identity information, passport information, passport face image, etc. of user U recorded in the IC chip of the e-passport using a non-contact IC reader. Also, for example, the medium reading device 212 reads the barcode and QR code (registered trademark) displayed on the airline ticket medium using a code reader, and acquires the identity information and boarding information of user U from the airline ticket medium.

[0043] The check-in terminal 20 can obtain the identity information and boarding information not only from the airline ticket medium, but also by other methods. For example, the CPU 202 can inquire about airline ticket reservation and purchase information based on the user U's credit card number, reservation number, confirmation number, etc., of the airline server, and obtain the identity information and boarding information of the user U from the airline server.

[0044] The biometric information acquisition device 214 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U performing the check-in procedure. The biometric information acquisition device 214 is, for example, a digital camera that captures an image of the face of the user U standing in front of the check-in terminal 20, and captures the image of the face of the user U.

[0045] The communication unit 216 is connected to the network NW and transmits and receives data via the network NW. The communication unit 216 performs communication with the management server 10 and the like under the control of the CPU 202.

[0046] In this manner, check-in terminal 20 is configured.

[0047] Next, the configuration of the automated baggage check-in machine 30 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the hardware configuration of the automated baggage check-in machine 30. The automated baggage check-in machine 30 is a device that a user U operates himself / herself to check in baggage that is not to be carried on board an aircraft. The user U can carry out the procedure to check in baggage at the automated baggage check-in machine 30 as necessary.

[0048] 3, the automated baggage drop machine 30 has a CPU 302, a RAM 304, a storage device 306, an input device 308, and a display 310. The automated baggage drop machine 30 further has a biometric information acquisition device 312, a baggage transport device 314, an output device 316, and a communication unit 318. The CPU 302, RAM 304, storage device 306, input device 308, display 310, biometric information acquisition device 312, baggage transport device 314, output device 316, and communication unit 318 are connected to a bus line 320.

[0049] CPU 302 operates by executing programs stored in storage device 306, and functions as a control unit that controls the overall operation of automated baggage drop machine 30. CPU 302 also executes application programs stored in storage device 306 to perform various processes as automated baggage drop machine 30. RAM 304 provides a memory area necessary for the operation of CPU 302.

[0050] More specifically, the CPU 302 functions as a matching request unit that requests matching of a facial image of a user U who performs baggage check-in procedures using the automated baggage drop machine 30. The CPU 302 as the matching request unit requests the management server 10 to perform 1:N matching of a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 312, with a plurality of registered facial images registered in the user information DB 106a of the management server 10. For this reason, the CPU 302 transmits the target facial image captured by the biometric information acquisition device 312 as the target biometric information to the management server 10 together with a matching request. Note that instead of transmitting the target facial image as the target biometric information, the CPU 302 may transmit facial feature amounts, which are feature amounts extracted from the target facial image, to request matching.

[0051] Instead of requesting the above 1:N matching, the CPU 302 can also request the management server 10 to match the target face image of the user U with a registered face image associated with the information of the user U's passport, boarding pass, or QR code. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 as a registered face image in the user information DB 106a, it registers it in association with the information of the user U's passport, boarding pass, or QR code. The CPU 302 reads the information of the user U's passport, boarding pass, or QR code by a medium reading device (not shown), and transmits the read information together with the target face image to the management server 10. The management server 10 acquires from the user information DB 106a a registered face image associated with the information of the passport, boarding pass, or QR code that matches the information of the passport, boarding pass, or QR code transmitted from the automated baggage check-in machine 30. The management server 10 performs a one-to-one comparison between the target face image transmitted from the automated baggage drop machine 30 and the registered information face image acquired from the user information DB 106a.

[0052] The CPU 302 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image has been found and identity verification of the user U performing the baggage check-in procedure has been successful, or that a matching registered face image has not been found and identity verification of the user U has failed. In the case of 1:1 matching, the matching result information indicates that, as a result of matching, the target face image matches the registered face image and identity verification of the user U performing the baggage check-in procedure has been successful, or that there is no match and identity verification of the user U has failed.

[0053] Instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 302 can be configured to function as a matching unit that matches the target face image with the registered face images in the user information DB 106a on a 1:N or 1:1 basis and outputs matching result information as described above. In this case, the CPU 302 can perform face image matching by referring to the user information DB 106a of the management server 10, or by referring to a user information DB stored in the storage device 306 in synchronization with the user information DB 106a.

[0054] Furthermore, if the matching result information indicates that the identity verification of user U has been successful, CPU 302 controls baggage transport device 314 to receive and transport user U's baggage.

[0055] Furthermore, CPU 302 functions as a status information transmission unit that transmits status information, which is information regarding the status of user U. When baggage conveying device 314 has completed receipt and transportation of baggage and baggage check-in procedures have been completed, CPU 302 as a status information transmission unit transmits status information indicating that user U's baggage check-in procedures have been completed to management server 10. The status information is associated in management server 10 with at least one of user information of user U or face information, passport information, and boarding information included in the user information.

[0056] Furthermore, the CPU 302 functions as a display control unit that causes screens for guidance, notifications, etc., for the user U to be displayed on the display 310. For example, the CPU 302 as a display control unit causes the display 310 to display a guidance screen that provides guidance on how to use the automated baggage check machine 30. Furthermore, when the matching result information indicates that identity verification of the user U has failed, the CPU 302 causes the display 310 to display a notification screen that notifies the user U that identity verification has failed.

[0057] The storage device 306 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 306 stores programs executed by the CPU 302, data referenced by the CPU 302 when executing the programs, etc.

[0058] The input device 308 is, for example, a touch panel built into the display 310. The input device 308 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the automated baggage drop machine 30 via the input device 308.

[0059] The display 310 functions as a display unit that displays various screens to a user U who uses the automated baggage drop machine 30. For example, the display 310 displays a guidance screen that provides guidance on how to use the automated baggage drop machine 30 and a notification screen for the user U.

[0060] The biometric information acquisition device 312 functions as a biometric information acquisition unit that acquires a facial image of the user U as the biometric information of the user U performing the baggage check-in procedure. The biometric information acquisition device 312 is, for example, a digital camera that takes an image in front of the automated baggage drop machine 30, and when it detects the face of the user U standing in front of the automated baggage drop machine 30 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0061] If the identity verification of the user U is successful, the baggage transporting device 314 transports the baggage to be loaded onto the aircraft that the user U is boarding. The baggage transporting device 314 transports the baggage that the user U has placed in the claim area and to which a baggage tag has been attached, toward the baggage sorting area.

[0062] The output device 316 outputs a baggage tag to be attached to the checked baggage, and also outputs a baggage claim ticket required to collect the baggage after arrival. The user U attaches the baggage tag output from the output device 316 to the checked baggage. The user U also receives the baggage claim ticket output from the output device 316 in order to collect the baggage after arrival. The baggage tag is associated in the management server 10 with at least one of the user information of the user U or the face information, passport information, and boarding information included in the user information.

[0063] The communication unit 318 is connected to the network NW and transmits and receives data via the network NW. The communication unit 318 performs communication with the management server 10 and the like under the control of the CPU 302.

[0064] In this manner, the automated baggage drop machine 30 is configured.

[0065] Next, the configuration of the security inspection device 40 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the hardware configuration of the security inspection device 40. The security inspection device 40 is a device that checks whether or not the user U is carrying any metal objects that may be dangerous, using a metal detector such as the metal detector gate 414. Note that the security inspection device 40 may be a device that checks for the presence or absence of dangerous objects in carry-on baggage, etc., using an X-ray inspection device or the like, in addition to a metal detector such as the metal detector gate 414.

[0066] 4, the security inspection device 40 has a CPU 402, a RAM 404, a storage device 406, an input device 408, a display 410, a biometric information acquisition device 412, a metal detection gate 414, and a communication unit 416. The CPU 402, the RAM 404, the storage device 406, the input device 408, the display 410, the biometric information acquisition device 412, the metal detection gate 414, and the communication unit 416 are connected to a bus line 418.

[0067] The CPU 402 operates by executing a program stored in the storage device 406, and functions as a control unit that controls the overall operation of the security inspection device 40. The CPU 402 also executes application programs stored in the storage device 406 to perform various processes as the security inspection device 40. The RAM 404 provides a memory area necessary for the operation of the CPU 402.

[0068] More specifically, the CPU 402 functions as a matching request unit that requests matching of a facial image of a user U undergoing a security inspection procedure by the security inspection device 40. The CPU 402 as the matching request unit requests the management server 10 to perform 1:N matching of a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 412, with a plurality of registered facial images registered in the user information DB 106a of the management server 10. For this reason, the CPU 402 transmits the target facial image captured by the biometric information acquisition device 412 as the target biometric information, together with a matching request, to the management server 10. Note that instead of transmitting the target facial image as the target biometric information, the CPU 402 may transmit facial feature amounts, which are feature amounts extracted from the target facial image, to request matching.

[0069] Instead of requesting the above 1:N matching, the CPU 402 may request the management server 10 to match the target face image of the user U with a registered face image associated with information on the user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 as a registered face image in the user information DB 106a, it registers the image in association with information on the user U's passport, boarding pass, or code symbol. The CPU 402 reads information on the user U's passport, boarding pass, or code symbol using a medium reading device (not shown), and transmits the read information together with the target face image to the management server 10. The management server 10 acquires from the user information DB 106a a registered face image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the security inspection device 40. The management server 10 performs a one-to-one comparison between the target face image transmitted from the security inspection device 40 and the registered information face image acquired from the user information DB 106a.

[0070] The CPU 402 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image has been found and identity verification of user U undergoing security inspection procedures has been successful, or that a matching registered face image has not been found and identity verification of user U has failed. In the case of 1:1 matching, the matching result information indicates that, as a result of matching, the target face image matches the registered face image and identity verification of user U undergoing security inspection procedures has been successful, or that there is no match and identity verification of user U has failed.

[0071] Instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 402 can be configured to function as a matching unit that matches the target face image with the registered face images in the user information DB 106a on a 1:N or 1:1 basis and outputs matching result information as described above. In this case, the CPU 402 can perform face image matching by referring to the user information DB 106a of the management server 10, or by referring to a user information DB stored in the storage device 406 in synchronization with the user information DB 106a.

[0072] Furthermore, if the matching result information indicates that the identity verification of user U has been successful, CPU 402 continues the inspection using metal detection gate 414 .

[0073] Furthermore, the CPU 402 functions as a status information transmission unit that transmits status information, which is information regarding the situation of the user U. When the inspection through the metal detection gate 414 is completed without any abnormalities, the CPU 402 as the status information transmission unit transmits to the management server 10 status information indicating that the security inspection procedure for the user U has been completed. The status information is associated in the management server 10 with at least one of the user information of the user U or the face information, passport information, and boarding information included in the user information.

[0074] Furthermore, the CPU 402 functions as a display control unit that causes screens such as guidance and notifications for the user U to be displayed on the display 410. For example, the CPU 402 as a display control unit causes the display 410 to display a screen that urges the user U to pass through the metal detection gate 414. Furthermore, when the matching result information indicates that identity verification of the user U has failed, the CPU 402 causes the display 410 to display a notification screen that notifies the user U that identity verification has failed. Furthermore, when metal objects are detected in the inspection by the metal detection gate 414, the CPU 402 causes the display 410 to display a notification screen that instructs the user U to check whether there are any metal objects in his / her belongings and to pass through the metal detection gate 414 again.

[0075] The storage device 406 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 406 stores programs executed by the CPU 402, data referenced by the CPU 402 when executing the programs, etc.

[0076] The input device 408 is, for example, a touch panel built into the display 410. The input device 408 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the security inspection device 40 via the input device 408.

[0077] The display 410 functions as a display unit that displays various screens to the user U undergoing the security inspection procedure by the security inspection device 40. For example, the display 410 displays a screen that prompts the user U to pass through the metal detection gate 414, and a notification screen for the user U.

[0078] The biometric information acquisition device 412 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U undergoing a security inspection procedure. The biometric information acquisition device 412 is, for example, a digital camera that captures an image in front of the metal detection gate 414, and when it detects the face of the user U standing in front of the metal detection gate 414 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0079] The metal detection gate 414 is a gate-type metal detector that detects metal objects carried by a user U who passes through the metal detection gate 414 .

[0080] The communication unit 416 is connected to the network NW and transmits and receives data via the network NW. The communication unit 416 performs communication with the management server 10 and the like under the control of the CPU 402.

[0081] In this manner, the security inspection device 40 is configured.

[0082] Next, the configuration of the automated gate device 50 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the hardware configuration of the automated gate device 50. The automated gate device 50 is a device that automatically performs the departure inspection procedure for a user U. A user U who can use the departure inspection procedure by the automated gate device 50 is, for example, a person who has been registered as a user of the automated gate device 50 after undergoing an examination based on a prior application, a person who has been granted permission to use the device based on a travel history such as the number of trips made, a person who has been registered as a user based on an agreement between countries, etc.

[0083] 5, the automated gate device 50 has a CPU 502, a RAM 504, a storage device 506, an input device 508, a display 510, a biometric information acquisition device 512, a gate 514, and a communication unit 516. The CPU 502, the RAM 504, the storage device 506, the input device 508, the display 510, the biometric information acquisition device 512, the gate 514, and the communication unit 516 are connected to a bus line 518.

[0084] The CPU 502 operates by executing programs stored in the storage device 506, and functions as a control unit that controls the overall operation of the automated gate device 50. The CPU 502 also executes application programs stored in the storage device 506 to perform various processes as the automated gate device 50. The RAM 504 provides a memory area necessary for the operation of the CPU 502.

[0085] More specifically, the CPU 502 functions as a matching request unit that requests matching of a facial image of a user U who undergoes immigration inspection procedures using the automated gate device 50. The CPU 502 as the matching request unit requests the management server 10 to match a target facial image, which is a facial image of the user U captured by the biometric information acquisition device 512, with a plurality of registered facial images registered in the user information DB 106a of the management server 10 in a 1:N ratio. For this reason, the CPU 502 transmits the target facial image captured by the biometric information acquisition device 512 as the target biometric information to the management server 10 together with a matching request. Note that instead of transmitting the target facial image as the target biometric information, the CPU 502 may transmit facial feature amounts, which are feature amounts extracted from the target facial image, to request matching.

[0086] Instead of requesting the above 1:N matching, the CPU 502 may request the management server 10 to match the target face image of the user U with a registered face image associated with information on the user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 as a registered face image in the user information DB 106a, the management server 10 registers the image in association with information on the user U's passport, boarding pass, or code symbol. The CPU 502 reads information on the user U's passport, boarding pass, or code symbol using a medium reading device (not shown), and transmits the read information together with the target face image to the management server 10. The management server 10 acquires from the user information DB 106a a registered face image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the automated gate device 50. The management server 10 performs a one-to-one comparison between the target face image transmitted from the automated gate device 50 and the registered information face image acquired from the user information DB 106a.

[0087] The CPU 502 also functions as a matching result acquisition unit that acquires, from the management server 10, matching result information indicating the result of matching requested to the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image has been found and identity verification of the user U undergoing the departure inspection procedure has been successful, or that a matching registered face image has not been found and identity verification of the user U has failed. In the case of 1:1 matching, the matching result information indicates that, as a result of matching, the target face image matches the registered face image and identity verification of the user U undergoing the departure inspection procedure has been successful, or that there is no match and identity verification of the user U has failed.

[0088] Instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 502 can be configured to function as a matching unit that matches the target face image with the registered face images in the user information DB 106a on a 1:N or 1:1 basis and outputs matching result information as described above. In this case, the CPU 502 can perform face image matching by referring to the user information DB 106a of the management server 10, or by referring to a user information DB stored in the storage device 506 in synchronization with the user information DB 106a.

[0089] Furthermore, if the matching result information indicates that the identity of user U has been successfully verified, CPU 502 controls gate 514 to permit user U to pass through gate 514 .

[0090] Furthermore, the CPU 502 functions as a status information transmission unit that transmits status information, which is information regarding the situation of the user U. When the CPU 502 as a status information transmission unit permits the user U to pass through the gate 514 and completes the immigration procedure, the CPU 502 transmits status information indicating that the immigration procedure for the user U has been completed to the management server 10. The status information is associated in the management server 10 with at least one of the user information of the user U or the face information, passport information, and boarding information included in the user information.

[0091] Furthermore, the CPU 502 functions as a display control unit that causes the display 510 to display screens for guidance, notifications, etc. for the user U. For example, the CPU 502 as a display control unit causes the display 510 to display a guidance screen that provides guidance on how to use the automated gate device 50. Furthermore, when the matching result information indicates that identity verification of the user U has failed, the CPU 502 causes the display 510 to display a notification screen that notifies the user U that identity verification has failed.

[0092] The storage device 506 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 506 stores programs executed by the CPU 502, data referenced by the CPU 502 when executing the programs, etc.

[0093] The input device 508 is, for example, a touch panel built into the display 510. The input device 508 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the automated gate device 50 via the input device 508.

[0094] The display 510 functions as a display unit that displays various screens to the user U who undergoes the immigration procedure using the automated gate device 50. For example, the display 510 displays a guidance screen that provides guidance on how to use the automated gate device 50, a notification screen for the user U, and the like.

[0095] The biometric information acquisition device 512 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U undergoing the immigration inspection procedure. The biometric information acquisition device 512 is, for example, a digital camera that takes an image in front of the automated gate device 50, and when it detects the face of the user U standing in front of the automated gate device 50 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0096] When the automated gate device 50 successfully verifies the identity of the user U and the user U passes through immigration, the gate 514, under the control of the CPU 502, transitions from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The type of gate 514 is not particularly limited, and may be, for example, a flapper gate in which a flapper provided on one or both sides of the passage opens and closes, or a turnstile gate in which three bars rotate.

[0097] The communication unit 516 is connected to the network NW and transmits and receives data via the network NW. The communication unit 516 performs communication with the management server 10 and the like under the control of the CPU 502.

[0098] In this manner, the automated gate device 50 is constructed.

[0099] Next, the configuration of the signage terminal 60 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing an example of a hardware configuration of the signage terminal 60. The signage terminal 60 is a terminal that displays route guidance to the boarding gate P6, advertisements, and the like.

[0100] 6, the signage terminal 60 has a CPU 602, a RAM 604, a storage device 606, a display 608, a biometric information acquisition device 610, and a communication unit 612. The CPU 602, the RAM 604, the storage device 606, the display 608, the biometric information acquisition device 610, and the communication unit 612 are connected to a bus line 614.

[0101] CPU 602 operates by executing programs stored in storage device 606, and functions as a control unit that controls the overall operation of signage terminal 60. CPU 602 also executes application programs stored in storage device 606 to perform various processes as signage terminal 60. RAM 604 provides a memory area necessary for the operation of CPU 602.

[0102] More specifically, the CPU 602 functions as a face information transmitting unit that transmits a face image of the user U in front of the signage terminal 60 to the management server 10. The user U in front of the signage terminal 60 is, for example, a user who is in front of the signage terminal 60 and checks the guide displayed on the signage terminal 60, a user U who passes in front of the signage terminal 60, etc. The CPU 602 as a face information transmitting unit transmits a target face image, which is a face image of the user U captured by the biometric information acquiring device 610, to the management server 10 as the target biometric information. Note that, instead of transmitting the target face image, the CPU 602 may transmit a face feature amount, which is a feature amount extracted from the target face image, as the target biometric information. The management server 10 that receives the target face image from the signage terminal 60 compares the received target face image with a plurality of registered face images registered in the user information DB 106a in a 1:N ratio.

[0103] The CPU 602 also functions as a display control unit that causes the display 608 to display screens such as route guidance to the boarding gate P6 and advertisements.

[0104] Like the CPU 302 of the automated baggage drop machine 30, the CPU 602 of the signage terminal 60 can also function as a matching request unit, a matching result acquisition unit, and a status information transmission unit, as described below.

[0105] More specifically, the CPU 602 can function as a matching request unit that requests matching of a face image of a user U who is in front of the signage terminal 60 or who passes in front of the signage terminal 60. The CPU 602 as the matching request unit requests the management server 10 to match a target face image, which is a face image of the user U captured by the biometric information acquisition device 610, with a plurality of registered face images registered in the user information DB 106a of the management server 10 in a 1:N ratio. For this reason, the CPU 602 transmits the target face image captured by the biometric information acquisition device 610 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target face image as the target biometric information, the CPU 602 may transmit face feature amounts, which are feature amounts extracted from the target face image, to request matching.

[0106] Instead of requesting the above 1:N matching, the CPU 602 can also request the management server 10 to match the target face image of the user U with a registered face image associated with information on the user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 as a registered face image in the user information DB 106a, it registers the image in association with the passport, boarding pass, or code symbol information of the user U. The CPU 602 reads the passport, boarding pass, or code symbol information of the user U using a medium reading device (not shown), and transmits the read information together with the target face image to the management server 10. The management server 10 acquires from the user information DB 106a a registered face image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the signage terminal 60. The management server 10 performs a one-to-one comparison between the target face image transmitted from the signage terminal 60 and the registered information face image acquired from the user information DB 106a.

[0107] Furthermore, CPU 602 can function as a matching result acquisition unit that acquires matching result information indicating the result of matching requested to management server 10 from management server 10. In the case of 1:N matching, the matching result information indicates that as a result of matching, a registered face image matching the target face image has been found and identity verification of user U in front of signage terminal 60 has been successful, or that a matching registered face image has not been found and identity verification of user U has failed. In the case of 1:1 matching, the matching result information indicates that as a result of matching, the target face image matches a registered face image and identity verification of user U in front of signage terminal 60 has been successful, or that there is no match and identity verification of user U has failed.

[0108] Instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 602 can be configured to function as a matching unit that matches the target face image with the registered face images in the user information DB 106a on a 1:N or 1:1 basis and outputs matching result information as described above. In this case, the CPU 602 can perform face image matching by referring to the user information DB 106a of the management server 10, or by referring to a user information DB stored in the storage device 606 in synchronization with the user information DB 106a.

[0109] Furthermore, CPU 602 functions as a status information transmission unit that transmits status information that is information regarding the situation of user U. When CPU 602 as a status information transmission unit has successfully verified the identity of user U in front of signage terminal 60, it transmits to management server 10 status information indicating that user U has completed his / her presence or passage in front of signage terminal 60. The status information is associated in management server 10 with at least one of user information of user U or face information, passport information, and boarding information included in the user information.

[0110] Furthermore, the CPU 602 functions as a display control unit that controls the display of the display 608 based on display information transmitted from the management server 10 as described below. The CPU 602 as the display control unit causes the display 608 to display different display information according to the remaining time until the boarding time for the user U in front of the signage terminal 60 who has been identified through successful identity verification by matching the target face image.

[0111] The storage device 606 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 606 stores programs executed by the CPU 602, data referenced by the CPU 602 when executing the programs, etc.

[0112] The display 608 functions as a display unit that displays various screens. For example, the display 608 displays a screen of a route guide to the boarding gate P6, advertisements, etc. The route guide, advertisements, etc. displayed by the display 608 correspond to an individual identified as the user U in front of the signage terminal 60, for example.

[0113] The biometric information acquisition device 610 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U in front of the signage terminal 60. The biometric information acquisition device 610 is, for example, a digital camera that captures an image in front of the signage terminal 60, and when it detects the face of the user U in front of the signage terminal 60 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0114] The communication unit 612 is connected to the network NW and transmits and receives data via the network NW. The communication unit 612 performs communication with the management server 10 and the like under the control of the CPU 602.

[0115] In this manner, signage terminal 60 is configured.

[0116] Next, the configuration of the boarding gate device 70 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing an example of the hardware configuration of the boarding gate device 70. The boarding gate device 70 is a device that confirms that the user U is a passenger of an aircraft that can board through the boarding gate P6 at which the boarding gate device 70 is installed.

[0117] 7, the boarding gate device 70 has a CPU 702, a RAM 704, a storage device 706, an input device 708, a display 710, a biometric information acquisition device 712, a gate 714, and a communication unit 716. The CPU 702, the RAM 704, the storage device 706, the input device 708, the display 710, the biometric information acquisition device 712, the gate 714, and the communication unit 716 are connected to a bus line 718.

[0118] The CPU 702 operates by executing programs stored in the storage device 706, and functions as a control unit that controls the overall operation of the boarding gate device 70. The CPU 702 also executes application programs stored in the storage device 706 to perform various processes as the boarding gate device 70. The RAM 704 provides a memory area necessary for the operation of the CPU 702.

[0119] More specifically, the CPU 702 functions as a verification request unit that requests verification of the face image and confirmation of the boarding information of the user U who boards the aircraft through the boarding gate P6.

[0120] The CPU 702 as a matching request unit requests the management server 10 to perform 1:N matching of a target face image, which is a face image of user U captured by the biometric information acquisition device 712, with a plurality of registered face images registered in the user information DB 106a of the management server 10. For this reason, the CPU 702 transmits the target face image captured by the biometric information acquisition device 712 together with a matching request as the target biometric information to the management server 10. Note that instead of transmitting the target face image as the target biometric information, the CPU 702 may transmit facial feature amounts, which are feature amounts extracted from the target face image, to request matching.

[0121] Instead of requesting the above 1:N matching, the CPU 702 may request the management server 10 to match the target face image of the user U with a registered face image associated with information on the user U's passport, boarding pass, or code symbol such as a QR code. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 as a registered face image in the user information DB 106a, it registers the image in association with the passport, boarding pass, or code symbol information of the user U. The CPU 702 reads the passport, boarding pass, or code symbol information of the user U using a medium reading device (not shown), and transmits the read information together with the target face image to the management server 10. The management server 10 acquires from the user information DB 106a a registered face image associated with information on the passport, boarding pass, or code symbol that matches the information on the passport, boarding pass, or code symbol transmitted from the boarding gate device 70. The management server 10 performs a one-to-one comparison between the target face image transmitted from the boarding gate device 70 and the registered information face image acquired from the user information DB 106a.

[0122] Furthermore, the CPU 702 as a matching request unit requests the management server 10 to confirm that the boarding information associated with the registered face image that matches the target face image is related to an aircraft that can be boarded from the boarding gate P6.

[0123] The CPU 702 also functions as a matching result acquisition unit that acquires matching result information indicating the result of the matching requested to the management server 10 from the management server 10. In the case of 1:N matching, the matching result information indicates that, as a result of matching, a registered face image matching the target face image is found and the identity of the user U who boards the aircraft is successful, or that a matching registered face image is not found and the identity of the user U is unsuccessful. The matching result information also indicates that it is confirmed that the boarding information is related to the aircraft and the confirmation of the boarding information is successful, or that it is not confirmed that the boarding information is related and the confirmation of the boarding information is unsuccessful. In the case of 1:1 matching, the matching result information indicates that, as a result of matching, the target face image matches the registered face image and the identity of the user U who boards the aircraft is successful, or that they do not match and the identity of the user U is unsuccessful.

[0124] Instead of functioning as a matching request unit and a matching result acquisition unit, the CPU 702 can be configured to function as a matching unit that matches the target face image with registered face images in the user information DB 106a on a 1:N or 1:1 basis as described above and outputs matching result information. The CPU 702 can also be configured to confirm that boarding information associated with the registered face image that matches the target face image is related to an aircraft that can be boarded from the boarding gate P6. In these cases, the CPU 702 can match the face image and confirm the boarding information by referring to the user information DB 106a of the management server 10, or by referring to a user information DB synchronized with the user information DB 106a and stored in the storage device 706.

[0125] Furthermore, if the matching result information indicates that the identity verification of user U has been successful and that the boarding information has been successfully verified, CPU 702 controls gate 714 to permit user U to pass through gate 714 .

[0126] The CPU 702 also functions as a status information transmission unit that transmits status information, which is information regarding the situation of the user U. When the CPU 702 as a status information transmission unit permits the user U to pass through the gate 714 and the user U completes boarding the aircraft, the CPU 702 transmits status information indicating that the user U has completed boarding the aircraft to the management server 10. The status information is associated in the management server 10 with at least one of the user information of the user U or the face information, passport information, and boarding information included in the user information.

[0127] The CPU 702 also functions as a display control unit that causes the display 710 to display a screen for guidance, notification, etc. for the user U. For example, the CPU 702 as a display control unit causes the display 710 to display a guidance screen that provides guidance on how to use the boarding gate device 70. When the matching result information indicates a failure in identity verification of the user U, the CPU 702 also causes the display 710 to display a notification screen that notifies the user U that identity verification has failed. When the matching result information indicates a failure in boarding information verification, the CPU 702 also causes the display 710 to display a notification screen that notifies the user U that boarding information verification has failed.

[0128] The storage device 706 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 706 stores the programs executed by the CPU 702, data referenced by the CPU 702 when executing the programs, etc.

[0129] The input device 708 is, for example, a touch panel built into the display 710. The input device 708 functions as an input unit that accepts input of instructions from the user U. The user U can input various information and instructions to execute processing to the boarding gate device 70 via the input device 708.

[0130] The display 710 functions as a display unit that displays various screens to the user U who boards the aircraft through the boarding gate P6. For example, the display 710 displays a guidance screen that provides guidance on how to use the boarding gate device 70, a notification screen for the user U, and the like.

[0131] The biometric information acquisition device 712 functions as a biometric information acquisition unit that acquires a facial image of the user U as biometric information of the user U who boards the aircraft through the boarding gate P6. The biometric information acquisition device 712 is, for example, a digital camera that captures an image in front of the boarding gate device 70, and when it detects the face of the user U standing in front of the boarding gate device 70 in an image that is constantly or periodically captured, it captures the face of the user U and acquires the facial image.

[0132] When the boarding gate device 70 has successfully verified the identity and boarding information of the user U, the gate 714, under the control of the CPU 702, transitions from a closed standby state that blocks the passage of the user U to an open state that permits the passage of the user U. The type of the gate 714 is not particularly limited, and may be, for example, a flapper gate in which a flapper provided on one or both sides of the passage opens and closes, or a turnstile gate in which three bars rotate.

[0133] The communication unit 716 is connected to the network NW and transmits and receives data via the network NW. The communication unit 716 performs communication with the management server 10 and the like under the control of the CPU 702.

[0134] In this manner, the boarding gate device 70 is configured.

[0135] Next, the configuration of the management server 10 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing an example of the hardware configuration of the management server 10. The management server 10 is an information processing device that manages the user information and status of the user U, and also matches a target face image with a plurality of registered face images in the user information DB 106a in response to a face image matching request. The functions of the management server 10 may be realized by a single server, or may be realized by a plurality of server devices.

[0136] 8, the management server 10 includes a CPU 102, a RAM 104, a storage device 106, and a communication unit 108. The CPU 102, the RAM 104, the storage device 106, and the communication unit 108 are connected to a bus line 110.

[0137] The CPU 102 operates by executing programs stored in the storage device 106, and functions as a control unit that controls the overall operation of the management server 10. The CPU 102 also executes application programs stored in the storage device 106 to perform various processes as the management server 10. The RAM 104 provides a memory area necessary for the operation of the CPU 102.

[0138] More specifically, the CPU 102 functions as an information management unit that records and manages the user information of the user U received from the check-in terminal 20 in the storage device 106. The CPU 102 as an information management unit registers and manages the user information received from the check-in terminal 20 in the user information DB 106a stored in the storage device 106. Every time the CPU 102 receives user information from the check-in terminal 20, it registers the received user information in the user information DB 106a. As described above, the user information of the user U includes the user U's identification information, face information, and boarding information, which are associated with each other. The face information is a photographed face image or a passport face image acquired by the check-in terminal 20. The registered face image, which is the photographed face image or the passport face image registered in the user information DB 106a, is used for matching face images for identity verification of the user U at the automated baggage check-in machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70.

[0139] The CPU 102 also functions as a status management unit that records and manages the status of the user U with respect to multiple procedures up to the user U's boarding of the aircraft in the storage device 106. The CPU 102 as a status management unit records and manages the status of the user U in the user information DB 106a in association with the user information of the user U. The CPU 102 manages the status of each procedure of the user U based on status information received from the external devices, that is, the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70. The CPU 102 also manages the status of the user U with respect to the location or passage of the user U in front of the signage terminal 60, which is a procedure of the user U, based on the result of matching the target face image received from the signage terminal 60. Furthermore, the CPU 102 manages the status of each procedure of the user U together with the deadline time, which is a deadline set for the multiple procedures up to the user U's boarding of the aircraft as described later.

[0140] Specifically, CPU 102 manages the status related to the check-in procedure of user U. That is, when CPU 102 receives status information indicating that the check-in procedure of user U has been completed from check-in terminal 20, CPU 102 updates the status related to the check-in procedure of user U in user information DB 106a from "uncompleted" to "completed."

[0141] CPU 102 also manages the status of user U's baggage check-in procedure. That is, when CPU 102 receives status information from automated baggage check-in machine 30 indicating that user U's baggage check-in procedure has been completed, it updates the status of user U's baggage check-in procedure in user information DB 106a from "incomplete" to "completed." Note that user U's baggage check-in procedure is an optional procedure that is performed when baggage needs to be checked in. For this reason, the status of user U's baggage check-in procedure may remain incomplete. This is intended for cases where some users U have little baggage and do not check in any baggage.

[0142] Furthermore, the CPU 102 manages the status related to the security inspection procedure of the user U. That is, when the CPU 102 receives status information indicating that the security inspection procedure of the user U has been completed from the security inspection device 40, the CPU 102 updates the status related to the security inspection procedure of the user U in the user information DB 106a from "uncompleted" to "completed."

[0143] Furthermore, the CPU 102 manages the status of the immigration procedure for the user U. That is, when the CPU 102 receives status information indicating that the immigration procedure for the user U has been completed from the automated gate device 50, the CPU 102 updates the status of the immigration procedure for the user U in the user information DB 106a from "uncompleted" to "completed."

[0144] Furthermore, the CPU 102 manages the status regarding the boarding of the user U to the aircraft. That is, when the CPU 102 receives status information indicating that the boarding of the user U to the aircraft has been completed from the boarding gate device 70, the CPU 102 updates the status regarding the boarding of the user U to the aircraft in the user information DB 106a from incomplete to completed.

[0145] Furthermore, CPU 102 also manages the status regarding user U's location in front of or passage through signage terminal 60. In this case, when CPU 102 receives a target face image from signage terminal 60, it compares the received target face image with a plurality of registered face images in user information DB 106a. If a matching registered face image is found as a result of the comparison, CPU 102 updates the status regarding user U's location in front of or passage through signage terminal 60 in user information DB 106a from incomplete to completed.

[0146] In this way, the CPU 102 as a status management unit manages the status of the user U's procedures before boarding, which are the check-in procedure, baggage check-in procedure, security inspection procedure, immigration procedure, the location in front of or passing through the signage terminal 60, and boarding the aircraft. The CPU 102 manages the status of each procedure of the user U based on the result of matching the target face image acquired at each procedure with the registered face image. That is, when the target face image acquired at each procedure matches the registered face image, the CPU 102 updates the status of each procedure of the user U from incomplete to completed. A procedure included in the procedures at the airport A and another procedure following the one procedure refer to, for example, two adjacent procedures in the order of the procedures from the check-in procedure to boarding the aircraft, and another procedure following the one procedure refers to the procedure following the one procedure. For example, specifically, if the security inspection procedure is one procedure, the immigration procedure is another procedure following the one procedure.

[0147] Note that CPU 102 does not necessarily need to manage the status of user U with respect to all of these multiple procedures, but can manage the status of user U with respect to any one or more of these procedures.

[0148] CPU 102 also functions as a deadline setting unit that sets deadline times, which are predetermined times by which user U must complete multiple procedures, including each procedure at airport A, based on user U's boarding information. The procedures for which deadline times are set are baggage drop-off procedures after check-in procedures, security inspection procedures, immigration procedures, and boarding the aircraft. CPU 102 also treats user U's location in front of or passing through signage terminal 60 as a procedure for which a deadline time is set. CPU 102 sets deadline times for these multiple procedures up until user U's boarding the aircraft.

[0149] The deadline by which each procedure should be completed may be an ideal deadline or a strict deadline. The ideal deadline is a time by which the procedure should be completed, that is, a time by which the procedure should be completed from the viewpoint of smooth progress of the procedure, but the procedure can be performed after the time has passed. The strict deadline is a time later than the ideal deadline and a time by which the procedure must be completed, that is, a time by which the procedure is closed when the time has passed. The CPU 102 as a deadline setting unit can set either the ideal deadline or the strict deadline, or can set the deadline in stages, setting the ideal deadline as the first deadline and setting the strict deadline as the second deadline. The CPU 102 can also set multiple times in stages as the ideal deadline.

[0150] CPU 102 as a time limit setting unit calculates the boarding time when boarding of user U to the aircraft is closed from the departure time of the departure date and time included in the boarding information of user U. For example, CPU 102 can calculate the boarding time to be 10 minutes before the departure time of the aircraft. CPU 102 can also obtain the boarding time included in the boarding information of user U itself from the boarding information.

[0151] CPU 102 as a deadline setting unit calculates, from the calculated or acquired boarding time, the deadline by which user U must complete each of the procedures of baggage check-in procedure, security inspection procedure, immigration procedure, being in front of or passing through signage terminal 60, and boarding the aircraft. CPU 102 can set deadlines for each of the multiple procedures based on the order of the multiple procedures up to user U's boarding the aircraft and the boarding information. In other words, CPU 102 can set a later deadline for a procedure the closer the order of the multiple procedures up to user U's boarding the aircraft is to the procedure for boarding the aircraft.

[0152] Note that user U will not usually be in front of or necessarily pass in front of all of the signage terminals 60 installed at various locations within airport A. For this reason, CPU 102 does not need to set a deadline time for the location in front of or passage in front of each of the signage terminals 60 installed at various locations within airport A. CPU 102 can set a deadline time for the location in front of or passage in front of a signage terminal 60 installed at a specific location, such as passage P5, where user U will definitely pass or is likely to pass.

[0153] For example, the CPU 102 can calculate the time 60 minutes before the boarding time as the deadline for the baggage check-in procedure. Also, for example, the CPU 102 can calculate the time 30 minutes before the boarding time as the deadline for the security inspection procedure. Also, for example, the CPU 102 can calculate the time 20 minutes before the boarding time as the deadline for the immigration procedure. Also, for example, the CPU 102 can calculate the time 15 minutes before the boarding time as the deadline for being in front of or passing through the signage terminal 60 in the passage P5. Also, for example, the CPU 102 can calculate the time 10 minutes before the boarding time as the deadline for boarding the aircraft. Note that the CPU 102 can also calculate the deadline for each procedure from the departure time itself included in the boarding information. Also, the CPU 102 can calculate the deadline for each procedure by referring to a database related to flight schedules, etc., from the flight name of the aircraft included in the boarding information to obtain the boarding time or departure time.

[0154] Note that the CPU 102 as a deadline setting unit can set the deadline time depending on the number of users U who have completed the check-in procedure. In other words, the CPU 102 can set the time between the deadline time and the boarding time to be shorter as the number of users U who have completed the check-in procedure is greater.

[0155] Furthermore, CPU 102 as a deadline setting unit can appropriately change and set the deadline time for each of the above-mentioned procedures according to the congestion state of airport A, which is the facility where user U boards the aircraft, in other words, according to the number of users U at airport A. CPU 102 can determine the congestion state of airport A, for example, based on the number of pieces of user information registered in user information DB 106a per unit time. That is, it can be determined that the more the number of pieces of user information registered in user information DB 106a per unit time, the more congested the airport A is. CPU 102 can set the deadline time to an earlier time the more congested the airport A is.

[0156] Furthermore, CPU 102 as a deadline setting unit can record and manage the deadline time of each procedure that has been set, for example, in user information DB 106a in association with the user information and status of user U in user information DB 106a. That is, CPU 102 as a status management unit can manage the status of each procedure of user U together with the deadline time, which is the set deadline.

[0157] As described above, CPU 102 as a deadline setting unit sets deadline times as deadlines for the multiple procedures before boarding of user U, namely, check-in procedure, security inspection procedure, immigration procedure, location in front of or passing through signage terminal 60, and boarding the aircraft. Note that CPU 102 does not necessarily need to set deadline times for all of these multiple procedures, and can set deadline times for any one or more of these procedures.

[0158] Furthermore, the CPU 102 functions as a determination unit that determines whether or not the deadline has passed with the status of each procedure up to boarding of the user U, for which a deadline has been set as described above. The CPU 102 as a determination unit can determine whether or not the deadline has passed regularly or improperly for an incomplete procedure, for example.

[0159] Furthermore, the CPU 102 functions as an alert unit, and generates and transmits an alert indicating that a procedure of a user U whose status has been determined to be incomplete after the deadline has passed, is incomplete after the deadline has passed. The CPU 102 as an alert unit can transmit the alert to the business terminal 80 carried by the staff S. For example, when the location of the user U is specified as described in the second embodiment, the CPU 102 can transmit an alert to the business terminal 80 carried by the staff S who is near the location. Furthermore, the CPU 102 can notify or display the staff S who is near the specified location of the user U on the business terminal 80 carried by the staff S and other staff S. This allows the CPU 102 to instruct the staff S which of the staff S is appropriate to respond to the alert.

[0160] The alert may include, for example, a part or all of the user information of the user U for whom the procedure has not been completed, a part or all of the boarding information, and a status regarding each procedure. The alert may include a registered face image of the user U, preferably a registered face image that is a photographed face image of the user U taken by the check-in terminal 20. The staff member S who has received the alert at the business terminal 80 can use the registered face image included in the alert as a clue to search for the user U for whom the procedure has not been completed. Note that the registered face image included in the alert may be a passport face image of the user U, but is preferably a face image taken by the check-in terminal 20 that shows the face of the user U most recently, i.e., at the time of the check-in procedure.

[0161] Furthermore, the CPU 102 functions as a matching unit that matches the facial image of the user U when it receives a target facial image and a matching request or a target facial image from the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70. The CPU 102 as a matching unit matches the target facial image, which is the target biometric information, with a plurality of registered facial images, which are registered biometric information registered in the user information DB 106a, in a 1:N ratio. Note that the user information of a plurality of users U who have completed the check-in procedure at the check-in terminal 20 is registered in the user information DB 106a. When matching the target facial image with the registered facial image, the CPU 102 can match both facial images by matching a facial feature amount extracted from the target facial image, which is the target biometric information, with a facial feature amount extracted from the registered facial image, which is the registered biometric information.

[0162] The CPU 102 as a matching unit tries to find a registered face image that matches the target face image from among the multiple registered face images by matching the target face image with the multiple registered face images. The CPU 102 also functions as a transmission unit, and transmits matching result information indicating the result of the matching to each of the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70 that sent the matching request. The matching result information indicates a match or a mismatch. That is, the matching result information indicates that, as a result of the matching, a registered face image that matches the target face image has been found and the identity verification of the user U who is going through the baggage check-in procedure has been successful, or that a matching registered face image has not been found and the identity verification of the user U has failed. The CPU 102 may match the target face image with one registered face image.

[0163] Furthermore, the CPU 102, instead of the CPU 202 of the check-in terminal 20, can also perform one-to-one matching between a captured face image captured by the biometric information acquisition device 214 and a passport face image acquired by the medium reading device 212. In this case, the CPU 102 receives the captured face image and passport face image or facial feature amounts thereof to be matched from the check-in terminal 20. The CPU 102 also transmits matching result information indicating the result of matching between the captured face image and the passport face image to the check-in terminal 20.

[0164] In addition, the CPU 102 functions as a display management unit that causes the signage terminal 60 to display different display information depending on the remaining time until the boarding time of the previous user U of the signage terminal 60 who has been identified and successfully identified by matching the target facial image, as described below.

[0165] First, CPU 102 functions as a time calculation unit that calculates the remaining time until the boarding time for user U in front of signage terminal 60 who has been identified after successful identity verification by matching the target face image transmitted from signage terminal 60. To calculate the remaining time, CPU 102 refers to user information DB 106a and acquires boarding information for identified user U. CPU 102 calculates the boarding time from the departure time included in the boarding information or acquires the boarding time included in the boarding information as described above. Furthermore, CPU 102 calculates the remaining time until the boarding time based on the boarding information calculated from or acquired from the boarding information.

[0166] Furthermore, CPU 102 functions as a display information generating unit that generates display information to be displayed on signage terminal 60 according to the calculated remaining time until the boarding time. CPU 102 as a display information generating unit generates different display information according to the remaining time, that is, whether the boarding time is approaching or there is still time until the boarding time.

[0167] To generate the display information, the CPU 102 compares the remaining time until the boarding time based on the passenger information with a predetermined threshold value, and determines whether the remaining time is short, i.e., whether the boarding time is approaching or there is plenty of time until the boarding time. When the remaining time is equal to or less than the predetermined threshold value, the CPU 102 determines that the remaining time is short, i.e., the boarding time is approaching. On the other hand, when the remaining time exceeds the predetermined threshold value, the CPU 102 determines that the remaining time is long, i.e., there is plenty of time until the boarding time. The CPU 102 can appropriately change and set the threshold value that is the basis for the determination according to the congestion state of the airport A, in other words, according to the number of users U of the airport A. The CPU 102 can set the threshold value that is the basis for the determination to be longer the more congested the airport A is. The determination of the congestion state of the airport A is as described above.

[0168] When the CPU 102 determines that the boarding time is approaching, it generates first display information as display information to be displayed on the signage terminal 60 for the specified user U in front of the signage terminal 60. The first display information includes, for example, boarding information of the user U, the remaining time until the boarding time, the deadline time of each procedure, the status of each procedure, and the like. The boarding information includes, for example, boarding information such as the departure time, flight name, departure point, and arrival point of the flight on which the user U will board. The deadline time is, for example, the deadline time for baggage check-in procedure, security inspection procedure, immigration procedure, and boarding the aircraft. The deadline information included in the first display information may be ideal deadline information or may be a deadline time that must be strictly observed. In addition, the progress information indicates, for example, the progress status of whether each procedure has been completed or not.

[0169] CPU 102 can also exclude the deadline times of procedures that have already been completed from the first display information by referring to the status registered in user information DB 106a. That is, CPU 102 can include only the deadline times of procedures that have not yet been completed in the first display information. In this case, CPU 102 can also exclude the progress information of procedures that have already been completed from the first display information.

[0170] The first display information may include congestion information, which is information indicating the congestion status of the security checkpoint P3, the immigration checkpoint P4, and the like, which are processing locations. The congestion information may include, for example, availability information that identifies a relatively empty processing location or the least empty processing location among a plurality of processing locations where the same procedure is performed. The congestion information may also include, for example, the waiting time required to complete a procedure at a processing location such as the security checkpoint P3 or the immigration checkpoint P4, and the number of people waiting for a procedure such as a queue at a processing location. The waiting time is, for example, a predicted waiting time that is automatically calculated based on the number of people counted by a human sensor, a camera, or the like installed at the security checkpoint P3, the immigration checkpoint P4, and the like. Note that the congestion information, such as availability information, waiting time, and the number of people waiting in a queue, may be calculated using the number of people counted by a human sensor, as well as the number of faces detected by a camera installed in a security check device or immigration booth, a security camera installed in each room, and the like. The congestion information is transmitted, for example, from information terminals installed at the security checkpoint P3, the immigration checkpoint P4, etc. to the management server 10 via the network NW on a regular or irregular basis, and can be referenced by the CPU 102.

[0171] In addition, the first display information does not necessarily need to include all of the above-mentioned boarding information of user U, the remaining time until boarding time, the deadline time for each procedure, the status of each procedure, and congestion information, but may include any one or more of these pieces of information.

[0172] On the other hand, when the CPU 102 determines that there is sufficient time until the boarding time, the CPU 102 generates second display information as display information to be displayed on the signage terminal 60 for the identified user U in front of the signage terminal 60. The second display information includes, for example, advertising information. The advertising information may be a general advertisement whose content does not differ depending on the user U, or may be a targeted advertisement according to the user U whose content differs depending on the user U.

[0173] The CPU 102 can acquire advertisement information by referring to the advertisement information DB 106b stored in the storage device 106, an advertisement DB of an external server, etc., and generate second display information including the acquired advertisement information.

[0174] In the case of targeted advertising, the CPU 102 acquires attribute information of the user U, such as age and gender, from the user information of the user U registered in the user information DB 106a. The CPU 102 can also acquire attribute information of the user U, such as age and gender, by performing age estimation, gender estimation, etc., using image processing on a target face image of the user U transmitted from the signage terminal 60. The CPU 102 can generate advertisement information according to the acquired attribute information of the user U. The CPU 102 can select and acquire advertisement information according to the attribute information of the user U from the advertisement information DB 106b, an advertisement DB of an external server, etc.

[0175] Furthermore, when the CPU 102 can acquire purchase history information of the user U recorded in an external server based on, for example, credit card information used by the user U when purchasing an airline ticket, the CPU 102 can also acquire advertisement information according to the purchase history information acquired from the external server. In this case, the user U can give permission in advance for the management server 10 to acquire the purchase history information. The CPU 102 can select and acquire advertisement information according to the purchase history information of the user U from the advertisement information DB 106b, the advertisement DB of the external server, etc.

[0176] CPU 102 transmits the first display information or the second display information generated as described above to signage terminal 60 in front of identified user U via network NW. Signage terminal 60 displays the received first display information or second display information on display 608.

[0177] The advertising information displayed on signage terminal 60 may be network-distributed advertising information transmitted from management server 10 as described above, or may be stored in advance in storage device 606 of signage terminal 60. In this case, CPU 102 transmits, as second display information, advertising designation information that is information designating the advertising information to be displayed to signage terminal 60. Signage terminal 60 can obtain the advertising information designated by the received advertising designation information from storage device 606 and display it on display 608.

[0178] As described above, the CPU 102 causes the signage terminal 60 to display different display information depending on the remaining time until the boarding time based on the boarding information of user U identified by matching the target biometric information transmitted from the signage terminal 60 with the registered biometric information.

[0179] The storage device 106 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 106 stores programs executed by the CPU 102, data referenced by the CPU 102 when executing the programs, etc.

[0180] The storage device 106 also stores a user information DB 106a. The user information DB 106a registers user information of a plurality of users U who have performed a check-in procedure at the check-in terminal 20. The user information DB 106a also registers the status of the users U in association with the user information.

[0181] Furthermore, the storage device 106 stores an advertisement information DB 106b. Various types of advertisement information to be displayed on the signage terminal 60 are registered in the advertisement information DB 106b. The CPU 102 can select and acquire advertisement information according to the user U from the advertisement information DB 106b.

[0182] The communication unit 108 is connected to the network NW and transmits and receives data via the network NW. The communication unit 108 communicates with the check-in terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the like under the control of the CPU 102.

[0183] In this manner, the management server 10 is configured.

[0184] Next, the configuration of the business terminal 80 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing an example of the hardware configuration of the business terminal 80. The business terminal 80 is a terminal carried by staff S, such as an airline staff member or an airport company staff member, to be used for the business, and is, for example, a tablet terminal, a smartphone, a mobile phone, etc. Note that the business terminal 80 may be, for example, a stationary information processing terminal installed at a business location, such as a counter where the staff member is engaged in business.

[0185] 9, the business terminal 80 has a CPU 802, a RAM 804, a storage device 806, an input device 808, a display 810, a mobile wireless communication unit 812, and a short-range wireless communication unit 814. The CPU 802, RAM 804, storage device 806, input device 808, display 810, mobile wireless communication unit 812, and short-range wireless communication unit 814 are connected to a bus line 816.

[0186] The CPU 802 operates by executing programs stored in the storage device 806, and functions as a control unit that controls the overall operation of the business terminal 80. The CPU 802 also executes application programs stored in the storage device 806 to perform various processes as the business terminal 80. The RAM 804 provides a memory area necessary for the operation of the CPU 802.

[0187] More specifically, the CPU 802 functions as an information acquisition unit, and can access the user information DB 106a of the management server 10 to acquire the user information and status of the user U recorded in the user information DB 106a. The CPU 802 as an information acquisition unit can display the acquired user information and status on the display 810.

[0188] Furthermore, the CPU 802 functions as an alert receiving unit, and can receive an alert transmitted from the management server 10. The CPU 802 as an alert receiving unit can cause the display 810 to display the received alert.

[0189] The storage device 806 is configured with a storage medium such as a non-volatile memory, a hard disk drive, etc., and functions as a storage unit. The storage device 806 stores programs executed by the CPU 802, data referenced by the CPU 802 when executing the programs, etc.

[0190] The input device 808 is, for example, a touch panel built into the display 810. The input device 808 functions as an input unit that accepts input of instructions from the staff member S. The staff member S can input various information and instructions to execute processing to the business terminal 80 via the input device 808.

[0191] The display 810 functions as a display unit that displays various screens to the staff S. For example, the display 810 displays a screen showing the user information and status of the user U recorded in the user information DB 106a, a screen showing the contents of an alert received from the management server 10, and the like.

[0192] The mobile wireless communication unit 812 connects to the network NW via a mobile communication network under the control of the CPU 802. The communication method of the mobile wireless communication unit 812 is not particularly limited, but examples thereof include a third generation mobile communication method, an LTE (Long Term Evolution) method, and a fourth generation mobile communication method.

[0193] The short-range wireless communication unit 814 performs wireless communication with access points, external devices, etc., under the control of the CPU 802, and connects to the network NW, for example, via an access point within the premises of airport A. The communication method of the short-range wireless communication unit 814 is not particularly limited, and examples thereof include a wireless LAN method such as Wi-Fi (registered trademark), a Bluetooth (registered trademark) communication method, an NFC (Near Field Communication) method, and an infrared communication method.

[0194] In this manner, the business terminal 80 is configured.

[0195] The information processing system 1 according to this embodiment sets, in the management server 10, a deadline for each procedure up to boarding for a user U who is scheduled to board an aircraft based on the boarding information acquired by the check-in terminal 20, and manages the status of each procedure for the user U. Therefore, the information processing system 1 according to this embodiment makes it possible to grasp and manage the status of the user U who is scheduled to board an aircraft in more detail.

[0196] Furthermore, in the information processing system 1 according to this embodiment, if the deadline has passed with the procedure status remaining incomplete, the management server 10 generates an alert indicating this and transmits it to the business terminal 80. The alert also includes the registered face image of the user U. Therefore, according to the information processing system 1 according to this embodiment, the staff member S can easily find the user U whose procedure has not been completed by using the registered face image of the user U as a clue.

[0197] Hereinafter, the operation of each component in the information processing system 1 according to this embodiment will be further described with reference to FIGS. 10 to 20C.

[0198] First, the operation of check-in terminal 20 will be described together with the operation of management server 10 with reference to Fig. 10. Fig. 10 is a sequence diagram showing the operation of check-in terminal 20 and management server 10.

[0199] A user U who has arrived at airport A proceeds to the check-in lobby P1 and performs a check-in procedure at the check-in terminal 20. The check-in terminal 20 and the management server 10 execute the process shown in FIG. 10 each time each of the multiple users U performs a check-in procedure.

[0200] As shown in FIG. 10, the medium reading device 212 of the check-in terminal 20 determines whether or not the passport of the user U is held over its reading portion (step S102), and waits until the passport is held over (step S102, NO).

[0201] When the medium reading device 212 determines that a passport has been held over the passport (step S102, YES), it acquires the passport information of the user U from the held passport (step S104). The acquired passport information includes a passport face image of the user U. At this time, the medium reading device 212 can also acquire the identity information of the user U from the passport.

[0202] Next, the medium reading device 212 determines whether or not the airline ticket medium of the user U is held over its reading portion (step S106), and waits until the airline ticket medium is held over (step S106, NO).

[0203] When the medium reading device 212 determines that the airline ticket medium has been held up (step S106, YES), it acquires the boarding information of the user U from the held-up passport (step S108). At this time, the medium reading device 212 can also acquire the identity information of the user U from the airline ticket medium.

[0204] The order of step S104 of acquiring passport information, step S108 of acquiring boarding information, and step S110 of acquiring a face image is not limited to the above case. Any of steps S104, S108, and S110 may be executed in the order mentioned above, and all or some of the sets of steps S104, S108, and S110 may be executed simultaneously.

[0205] Next, the biometric information acquisition device 214 of the check-in terminal 20 captures an image of the face of the user U standing in front of the check-in terminal 20, and acquires a captured face image that is a facial image of the user U (step S110).

[0206] Next, the CPU 202 of the check-in terminal 20 performs a one-to-one comparison between the captured face image captured by the biometric information acquisition device 214 and the passport face image acquired by the medium reading device 212 (step S112).

[0207] As a result of the comparison, if the CPU 202 determines that the captured face image matches the passport face image and identity verification is successful (step S114, YES), it transmits the user information of the user U to the management server 10 via the network NW (step S116). The user information includes the user U's identity information, face information, and boarding information, which are associated with each other.

[0208] When the CPU 102 of the management server 10 receives the user information from the check-in terminal 20, it registers the received user information in the user information DB 106a (step S118). The CPU 102 registers the photographed face image or the passport face image included in the user information in the user information DB 106a as a registered face image. In this way, the check-in terminal 20 completes the check-in procedure for user U. After completing the check-in procedure, user U heads to the baggage counter P2 if he or she needs to check in baggage, or heads to the security checkpoint P3 if he or she does not need to check in baggage.

[0209] Furthermore, after or together with transmitting the user information, the CPU 202 of the check-in terminal 20 transmits status information indicating that the check-in procedure for user U has been completed after facial image matching to the management server 10 via the network NW (step S120).

[0210] When the CPU 102 of the management server 10 receives the status information from the check-in terminal 20, which is an external device, it updates the status of the check-in procedure of the user U in the user information DB 106a from "incomplete" to "completed" (step S122). In this way, the CPU 102 manages the status of the check-in procedure of the user U based on the result of matching between the captured face image acquired during the check-in procedure and the passport face image. That is, when the match between the captured face image acquired during the check-in procedure and the passport face image is found, the CPU 102 updates the status of the check-in procedure of the user U from "incomplete" to "completed".

[0211] On the other hand, if the CPU 202 determines that the captured face image does not match the passport face image as a result of the comparison and identity verification has failed (step S114, NO), it notifies the user U that identity verification has failed (step S124). At this time, the CPU 202 causes a notification screen notifying the user U that identity verification has failed to be displayed on the display 210. Note that the CPU 202 can notify the user U that identity verification has failed, for example, by voice, together with or instead of displaying the notification screen.

[0212] In this manner, the check-in procedure for user U is carried out at check-in terminal 20.

[0213] Note that instead of the check-in procedure using the check-in terminal 20, the user U can also carry out the check-in procedure at a manned check-in counter. In this case, a terminal operated by a staff member at the check-in counter can execute the same process as the check-in terminal 20 described above. Also, instead of the check-in procedure using the check-in terminal 20, the user U can use online check-in via the airline's website. In this case, for example, the user U can separately register a facial image as a registered facial image in the user information DB 106a of the management server 10 using a dedicated terminal installed at the airport A.

[0214] Next, the operation of the automated baggage drop machine 30 will be described together with the operation of the management server 10 with reference to Fig. 11. Fig. 11 is a sequence diagram showing the operation of the automated baggage drop machine 30 and the management server 10.

[0215] After completing the check-in procedure, the user U proceeds to the baggage counter P2 as necessary and performs the baggage check-in procedure at the automated baggage check-in machine 30. The automated baggage check-in machine 30 and the management server 10 execute the process shown in Fig. 11 each time each of the multiple users U performs the baggage check-in procedure.

[0216] 11, the biometric information acquisition device 312 of the automated baggage drop machine 30 constantly or periodically captures an image in front of the automated baggage drop machine 30, and determines whether the face of a user U standing in front of the automated baggage drop machine 30 is detected in the captured image (step S202). The biometric information acquisition device 312 waits until the face of the user U is detected in the image (step S202, NO).

[0217] When the biometric information acquisition device 312 determines that the face of the user U has been detected (step S202, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S204).

[0218] Next, the CPU 302 of the automated baggage drop machine 30 transmits the target face image of user U captured by the biometric information acquisition device 312 together with a matching request to the management server 10 via the network NW (step S206). As a result, the CPU 302 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 312 and multiple registered face images registered in the user information DB 106a of the management server 10.

[0219] When the CPU 102 of the management server 10 receives the target face image and the matching request from the automated baggage drop machine 30, it matches the face image of the user U (step S208). The CPU 102 matches the target face image received from the automated baggage drop machine 30 with multiple registered face images registered in the user information DB 106a in a 1:N ratio.

[0220] Next, the CPU 102 transmits collation result information indicating the result of the collation to the automated baggage drop machine 30 via the network NW (step S210).

[0221] The CPU 302 of the automated baggage drop machine 30 receives the matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and the identity of the user U who is going to carry out the baggage check procedure has been successfully verified (step S212, YES), the CPU 302 executes the baggage check process for the user U (step S214). In the check process, the CPU 302 acquires the boarding information or passport information associated with the registered face image matching the target face image and uses it for the check process. The CPU 302 controls each part of the automated baggage drop machine 30. As a result, the output device 316 outputs the baggage tag and the baggage claim ticket in association with the boarding information or passport information associated with the registered face image. In addition, the baggage transport device 314 transports the baggage that the user U has placed in the claim section and to which the baggage tag has been attached, toward the baggage sorting area. After the user U has checked in the baggage, the user U heads to the security checkpoint P3.

[0222] Next, CPU 302 transmits status information indicating that the baggage check-in procedure for user U has been completed through face image matching to management server 10 via network NW (step S216).

[0223] When the CPU 102 of the management server 10 receives the status information from the automated baggage drop machine 30, which is an external device, it updates the status of the user U's baggage check-in procedure in the user information DB 106a from "incomplete" to "completed" (step S218). In this way, the CPU 102 manages the status of the user U's baggage check-in procedure based on the result of matching the target face image acquired during the baggage check-in procedure with the registered face image. That is, when the target face image acquired during the baggage check-in procedure matches the registered face image, the CPU 102 updates the status of the user U's baggage check-in procedure from "incomplete" to "completed."

[0224] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S212, NO), CPU 302 of automated baggage check-in machine 30 notifies user U that identity verification has failed (step S220). At this time, CPU 302 causes display 310 to display a notification screen notifying user U that identity verification has failed. Note that CPU 302 can notify user U that identity verification has failed, for example, by voice, in addition to or instead of displaying the notification screen. When identity verification has failed in this way, baggage check-in processing can be performed in the normal process by having a media reading device (not shown) read the boarding pass or passport.

[0225] Thus, the baggage check-in procedure is completed at the automated baggage check-in machine 30.

[0226] Next, the operation of the security inspection device 40 will be described together with the operation of the management server 10 with reference to Fig. 12. Fig. 12 is a sequence diagram showing the operation of the security inspection device 40 and the management server 10.

[0227] After completing the check-in procedure and, if necessary, the baggage drop-off procedure, the user U proceeds to the security inspection area P3 and undergoes the security inspection procedure at the security inspection device 40. The security inspection device 40 and the management server 10 execute the process shown in FIG. 12 each time each of the multiple users U undergoes the security inspection procedure.

[0228] 12, the biometric information acquisition device 412 of the security inspection device 40 constantly or periodically captures an image in front of the metal detection gate 414, and determines whether the face of a user U standing in front of the metal detection gate 414 is detected in the captured image (step S302). The biometric information acquisition device 412 waits until the face of the user U is detected in the image (step S302, NO).

[0229] When the biometric information acquisition device 412 determines that the face of the user U has been detected (step S302, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S304).

[0230] Next, the CPU 402 of the security inspection device 40 transmits the target face image of user U captured by the biometric information acquisition device 412 together with a matching request to the management server 10 via the network NW (step S306). As a result, the CPU 402 requests the management server 10 to perform a 1:N matching of the target face image of user U captured by the biometric information acquisition device 412 with multiple registered face images registered in the user information DB 106a of the management server 10.

[0231] When the CPU 102 of the management server 10 receives the target face image and the matching request from the security inspection device 40, it matches the face image of the user U (step S308). The CPU 102 matches the target face image received from the security inspection device 40 with a plurality of registered face images registered in the user information DB 106a in a 1:N ratio.

[0232] Next, CPU 102 transmits matching result information indicating the result of the matching to security inspection device 40 via network NW (step S310).

[0233] The CPU 402 of the security inspection device 40 receives the matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and identity verification of the user U undergoing the security inspection procedure has been successful (step S312, YES), the CPU 402 executes security inspection processing for the user U (step S314). In the security inspection processing, the CPU 402 controls each part of the security inspection device 40. As a result, the metal detection gate 414 detects metal objects carried by the user U who passes through the metal detection gate 414. After passing through the metal detection gate 414, the user U heads to the immigration inspection area P4.

[0234] Next, the CPU 402 transmits status information indicating that the security inspection procedure for the user U has been completed through face image matching to the management server 10 via the network NW (step S316).

[0235] When the CPU 102 of the management server 10 receives the status information from the security inspection device 40, which is an external device, it updates the status of the security inspection procedure of the user U in the user information DB 106a from "incomplete" to "completed" (step S318). In this way, the CPU 102 manages the status of the security inspection procedure of the user U based on the result of matching the target face image acquired during the security inspection procedure with the registered face image. That is, when the target face image acquired during the security inspection procedure matches the registered face image, the CPU 102 updates the status of the security inspection procedure of the user U from "incomplete" to "completed."

[0236] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S312, NO), the CPU 402 of the security inspection device 40 notifies user U that identity verification has failed (step S320). At this time, the CPU 402 causes a notification screen notifying user U that identity verification has failed to be displayed on the display 410. Note that, together with or instead of displaying the notification screen, the CPU 402 can also notify user U that identity verification has failed by, for example, audio.

[0237] Thus, the security inspection procedure is carried out at the security inspection device 40.

[0238] Next, the operation of the automated gate device 50 will be described together with the operation of the management server 10 with reference to Fig. 13. Fig. 13 is a sequence diagram showing the operation of the automated gate device 50 and the management server 10.

[0239] After completing the security inspection procedure, the user U proceeds to the immigration checkpoint P4 and undergoes the immigration procedure at the automated gate device 50. The automated gate device 50 and the management server 10 execute the process shown in FIG. 13 each time each of the multiple users U undergoes the immigration procedure.

[0240] 13, the biometric information acquisition device 512 of the automated gate device 50 constantly or periodically captures an image in front of the automated gate device 50, and determines whether the face of a user U standing in front of the automated gate device 50 is detected in the captured image (step S402). The biometric information acquisition device 512 waits until the face of the user U is detected in the image (step S402, NO).

[0241] When the biometric information acquisition device 512 determines that the face of the user U has been detected (step S402, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S404).

[0242] Next, the CPU 502 of the automated gate device 50 transmits the target face image of the user U captured by the biometric information acquisition device 512 to the management server 10 via the network NW together with a matching request (step S406). As a result, the CPU 502 requests the management server 10 to perform a 1:N matching between the target face image of the user U captured by the biometric information acquisition device 512 and a plurality of registered face images registered in the user information DB 106a of the management server 10.

[0243] When the CPU 102 of the management server 10 receives the target face image and the matching request from the automated gate device 50, it matches the face image of the user U (step S408). The CPU 102 matches the target face image received from the automated gate device 50 with a plurality of registered face images registered in the user information DB 106a in a 1:N ratio.

[0244] Next, the CPU 102 transmits collation result information indicating the result of the collation to the automated gate device 50 via the network NW (step S410).

[0245] The CPU 502 of the automated gate device 50 receives the matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and identity verification of the user U undergoing immigration inspection procedures has been successful (step S412, YES), the CPU 502 executes processing to open the gate 514 (step S414). As a result, the CPU 502 transitions the gate 514 from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The user U passes through the opened gate 514 toward the boarding gate P6.

[0246] Next, the CPU 502 transmits status information indicating that the immigration procedure for the user U has been completed after the facial image matching to the management server 10 via the network NW (step S416).

[0247] When the CPU 102 of the management server 10 receives the status information from the automated gate device 50, which is an external device, it updates the status of the immigration procedure for the user U in the user information DB 106a from "incomplete" to "completed" (step S418). In this way, the CPU 102 manages the status of the immigration procedure for the user U based on the result of matching the target face image acquired during the immigration procedure with the registered face image. That is, when the target face image acquired during the immigration procedure matches the registered face image, the CPU 102 updates the status of the immigration procedure for the user U from "incomplete" to "completed."

[0248] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed (step S412, NO), the CPU 502 of the automated gate device 50 notifies the user U that identity verification has failed (step S420). At this time, the CPU 502 causes a notification screen notifying the user that identity verification has failed to be displayed on the display 510. Note that, in addition to or instead of displaying the notification screen, the CPU 502 can also notify the user U that identity verification has failed, for example, by voice.

[0249] In this manner, the immigration procedure is carried out at the automated gate device 50.

[0250] Next, the operation of signage terminal 60 will be described together with the operation of management server 10 with reference to Fig. 14. Fig. 14 is a sequence diagram showing the operation of signage terminal 60 and management server 10.

[0251] After completing the immigration procedure, the user U passes through passage P5 where the signage terminal 60 is installed and heads to the boarding gate P6. At this time, the user U passes in front of the signage terminal 60 installed in the passage P5 or stops in front of the signage terminal 60 for a moment and checks the route guidance to the boarding gate P6 displayed on the signage terminal 60. The signage terminal 60 in the passage P5 and the management server 10 execute the process shown in FIG. 14 every time each of the multiple users U passes in front of the signage terminal 60 or is in front of the signage terminal 60. Note that the signage terminals 60 installed in other places in the airport A other than the passage P5 can also execute the process shown in FIG. 14 in the same way as the signage terminal 60 installed in the passage P5.

[0252] 14, the biometric information acquiring device 610 of the signage terminal 60 installed in the passage P5 constantly or periodically captures an image in front of the signage terminal 60, and determines whether or not the face of a user U in front of the signage terminal 60 is detected in the captured image (step S502). The user U in front of the signage terminal 60 is a user U who passes in front of the signage terminal 60 or is located in front of the signage terminal 60. The biometric information acquiring device 610 waits until the face of the user U is detected in the image (step S502, NO).

[0253] When the biometric information acquisition device 610 determines that the face of the user U has been detected (step S502, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S504).

[0254] Next, CPU 602 of signage terminal 60 transmits the target face image of user U captured by biometric information acquisition device 610 to management server 10 via network NW (step S506).

[0255] When the CPU 102 of the management server 10 receives the target face image from the signage terminal 60, which is an external device, it compares it with the face image of the user U (step S508). The CPU 102 compares the target face image received from the signage terminal 60 with a plurality of registered face images registered in the user information DB 106a in a 1:N ratio.

[0256] Note that CPU 602 of signage terminal 60 can be configured to stream video in front of signage terminal 60 to management server 10. In this case, CPU 102 of management server 10 can detect and acquire the target face image of user U from the video streamed from signage terminal 60, instead of receiving the target face image from signage terminal 60.

[0257] As a result of the comparison, if a registered face image matching the target face image is found and the user U in front of the signage terminal 60 is identified (step S510, YES), the CPU 102 updates the status of the user U (step S512). That is, the CPU 102 updates the status of the user U in the user information DB 106a regarding the location or passage of the user U in front of the signage terminal 60 from incomplete to complete. In this way, the CPU 102 manages the status of the user U regarding the location or passage of the user U in front of the signage terminal 60 based on the comparison result between the target face image acquired when the user U was in front of or passing through the signage terminal 60 and the registered face image. That is, when the comparison between the target face image acquired when the user U was in front of or passing through the signage terminal 60 and the registered face image matches, the CPU 102 updates the status of the user U regarding the location or passage of the user U in front of the signage terminal 60 from incomplete to complete.

[0258] Next, CPU 102 generates display information according to the length of the remaining time until the boarding time of the previously identified user U on signage terminal 60 (step S514). Next, CPU 102 transmits the generated display information to signage terminal 60 via network NW (step S516). In this way, CPU 102 manages to have the signage terminal 60 display display information according to the length of the remaining time until the boarding time of the previously identified user U. Note that the timing of steps S514 and S516 is not limited to this. CPU 102 can, for example, execute steps S514 and S516 before step S512, or execute steps S514 and S516 simultaneously with step S512.

[0259] CPU 602 of signage terminal 60 causes display information received from management server 10 to be displayed on display 608 for identified user U (step S518).

[0260] On the other hand, if the comparison result does not find a registered face image that matches the target face image and the user U in front of the signage terminal 60 is not identified (step S510, NO), the CPU 102 terminates processing related to the target face image transmitted from the signage terminal 60.

[0261] 14 for a signage terminal 60 that does not need to manage status related to the previous location or passage of user U. In this way, management server 10 can manage the display information to be displayed on signage terminal 60 without managing the status. Management server 10 can appropriately set signage terminals 60 that manage both status and display information, and signage terminals 60 that manage either status or display information, depending on the installation location of signage terminal 60, etc.

[0262] Next, the operation of the boarding gate device 70 will be described together with the operation of the management server 10 with reference to Fig. 15. Fig. 15 is a sequence diagram showing the operation of the boarding gate device 70 and the management server 10.

[0263] A user U who has passed through passage P5 where the signage terminal 60 is installed heads toward boarding gate P6 and passes through boarding gate device 70 to board the aircraft. The boarding gate device 70 and management server 10 execute the process shown in FIG. 15 every time each of the multiple users U boards the aircraft.

[0264] 15, the biometric information acquiring device 712 of the boarding gate device 70 constantly or periodically captures an image in front of the boarding gate device 70, and determines whether the face of a user U standing in front of the boarding gate device 70 is detected in the captured image (step S602). The biometric information acquiring device 712 waits until the face of the user U is detected in the image (step S602, NO).

[0265] When the biometric information acquisition device 712 determines that the face of the user U has been detected (step S602, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S604).

[0266] Next, the CPU 702 of the boarding gate device 70 transmits the target face image of user U captured by the biometric information acquisition device 712 together with a matching request to the management server 10 via the network NW (step S606). As a result, the CPU 702 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 712 and a plurality of registered face images registered in the user information DB 106a of the management server 10.

[0267] When the CPU 102 of the management server 10 receives the target facial image and the matching request from the boarding gate device 70, it matches the facial image of the user U (step S608). The CPU 102 matches the target facial image received from the boarding gate device 70 with a plurality of registered facial images registered in the user information DB 106a in a 1:N ratio. Furthermore, when the CPU 102 finds a registered facial image that matches the target facial image, it confirms that the boarding information associated with the registered facial image is related to an aircraft that can be boarded from the boarding gate P6.

[0268] Next, the CPU 102 transmits collation result information indicating the result of the collation to the boarding gate device 70 via the network NW (step S610).

[0269] The CPU 702 of the boarding gate device 70 receives the matching result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and that the identity of the user U who will board has been successfully verified, and that the boarding information has been successfully verified (step S612, YES), the CPU 702 executes an opening process for the gate 714 (step S614). As a result, the CPU 702 transitions the gate 714 from a closed standby state that blocks the passage of the user U to an open state that allows the passage of the user U. The user U passes through the opened gate 714 to board the aircraft.

[0270] Next, the CPU 702 transmits status information indicating that the user U has completed boarding the aircraft after checking the face image to the management server 10 via the network NW (step S616).

[0271] When the CPU 102 of the management server 10 receives the status information from the boarding gate device 70, which is an external device, it updates the status of the user U in the user information DB 106a regarding boarding the aircraft from incomplete to completed (step S618). In this way, the CPU 102 manages the status of the user U regarding boarding the aircraft based on the result of matching the target face image acquired when boarding the aircraft with the registered face image. That is, when the target face image acquired when boarding the aircraft matches the registered face image, the CPU 102 updates the status of the user U regarding boarding the aircraft from incomplete to completed.

[0272] On the other hand, if the matching result information indicates that a matching registered face image was not found and identity verification of user U has failed or that confirmation of boarding information has failed (step S612, NO), the CPU 702 of the boarding gate device 70 notifies user U (step S620). That is, the CPU 702 notifies that identity verification has failed or that confirmation of boarding information has failed. At this time, the CPU 702 causes the display 710 to display a notification screen notifying that identity verification has failed or that confirmation of boarding information has failed. Note that, together with or instead of displaying the notification screen, the CPU 702 can also notify user U that identity verification has failed or that confirmation of boarding information has failed, for example, by voice.

[0273] In this manner, the user U who has passed through the boarding gate device 70 boards the aircraft.

[0274] As described above, the management server 10 grasps and manages the status up to boarding the aircraft for each of the multiple users U who have completed the check-in procedure at the check-in terminal 20 in the user information DB 106a.

[0275] 16 is a schematic diagram showing an example of the user information DB 106a of the management server 10. As shown in the figure, in the user information DB 106a, user information and a status regarding each user U are registered for each user ID (Identification) that is an identifier for identifying a plurality of users U.

[0276] The user information registered in the user information DB 106a includes the mutually associated identity information of the user U, such as the name and nationality, a face image which is face information, and boarding information, such as the flight number, departure point, destination, departure time, boarding gate, etc. of the aircraft on which the user U is boarding. Note that the identity information and boarding information may each include information other than that shown in FIG.

[0277] The status of user U registered in user information DB 106a is recorded as completed or incomplete for each procedure of check-in procedure, baggage drop-off procedure, security inspection procedure, immigration procedure, and boarding the aircraft. The status of user U registered in user information DB 106a is recorded as completed or incomplete for the location or passage in front of a signage terminal 60 installed in passage P5, for example. Note that the signage terminal 60 in which the status regarding the previous location or passage is recorded is not limited to the one installed in passage P5, but may be installed in another location within airport A. The status of user U is updated as needed in accordance with the processes shown in Figs. 10 to 15 described above.

[0278] Furthermore, the CPU 102 of the management server 10 further calculates and sets a deadline by which the user U should complete each procedure, and generates an alert if the deadline has passed without the procedure being completed. FIG. 17 is a schematic diagram showing an example of the deadline for each procedure set by the CPU 102 of the management server 10. As shown in the figure, a deadline is set for each procedure of the user U, including the baggage check procedure, the security inspection procedure, the immigration procedure, the location in front of or passing through the signage terminal 60, and boarding an aircraft, for each user ID. The CPU 102 of the management server 10 can record and manage the deadline shown in FIG. 17 in the user information DB 106a in association with the user information and status of the user U in the user information DB 106a shown in FIG. 16.

[0279] Staff S can access the management server 10 using the business terminal 80 to check the user information and status of user U recorded in the user information DB 106a, as well as the deadline time of each procedure. In this case, the CPU 802 of the business terminal 80 can obtain the user information and status of user U recorded in the user information DB 106a, as well as the deadline time of each procedure, from the user information DB 106a and display them on the display 810. The CPU 802 can display a part or all of the identity information included in the user information, and can display a part or all of the boarding information included in the user information. In addition, the CPU 802 can display the status of user U using, for example, a bar-shaped or circular progress bar whose length varies depending on the progress of which of the procedures has been completed.

[0280] Hereinafter, operations including the status management operation and alert operation of the management server 10 will be described with reference to Figs. 18 to 20C. Figs. 18 and 19 are flowcharts showing operations including the status management operation and alert operation of the management server 10. Fig. 20A is a schematic diagram showing an example of an alert displayed on the business terminal 80. Figs. 20B and 20C are schematic diagrams showing an example of a status confirmation screen displayed on the business terminal 80. The management server 10 executes the processes shown in Figs. 18 and 19 for each of the multiple users U.

[0281] As shown in FIG. 18, CPU 102 of management server 10 determines whether or not user information has been received from check-in terminal 20 (step S702), and waits until user information has been received from check-in terminal 20 (step S702, NO).

[0282] When CPU 102 determines that it has received the user information from check-in terminal 20 (step S702, YES), CPU 102 registers the received user information in user information DB 106a (step S704). Step S704 corresponds to step S118 shown in FIG.

[0283] Next, CPU 102 calculates and sets deadline times for each procedure, including baggage check-in procedure, security inspection procedure, immigration procedure, location in front of or passing through signage terminal 60, and boarding the aircraft, from the boarding time based on the boarding information included in the user information (step S706). CPU 102 can appropriately change and set the deadline time for each procedure depending on the congestion situation at airport A, the facility where user U boards the aircraft. CPU 102 can also record and manage the set deadline times for each procedure in user information DB 106a, for example, in association with the user information and status of user U in user information DB 106a.

[0284] Next, CPU 102 determines whether or not status information has been received from check-in terminal 20 (step S708), and waits until status information has been received from check-in terminal 20 (step S708, NO).

[0285] When CPU 102 determines that it has received status information from check-in terminal 20 (step S708, YES), it updates the status of the check-in procedure of user U in user information DB 106a from “uncompleted” to “completed” (step S710). Step S710 corresponds to step S122 shown in FIG.

[0286] Next, the CPU 102 determines whether or not status information has been received from the automated baggage drop machine 30 (step S712).

[0287] If the CPU 102 determines that it has not received status information from the automated baggage drop machine 30 (step S712, NO), it determines whether the deadline for the baggage drop procedure has passed (step S714).

[0288] When the CPU 102 determines that the deadline for baggage check-in procedures has passed (step S714, YES), it generates an alert indicating that the deadline for baggage check-in procedures for the user U has passed and transmits the alert via the network NW (step S716). The destination of the alert is the business terminal 80 of one or more staff members S.

[0289] If the CPU 102 determines that the deadline for baggage check-in procedures has not passed (step S714, NO), it determines whether or not it has received status information from the security inspection device 40 (step S718). Note that this step S718 is performed on the assumption that there is a user U who has little baggage and will not check in any baggage. If the CPU 102 determines that it has received status information from the security inspection device 40 (step S718, YES), it proceeds to step S728, which will be described later. If the CPU 102 determines that it has not received status information from the security inspection device 40 (step S718, NO), it waits to receive status information from the automated baggage check machine 30 (step S712).

[0290] On the other hand, when the CPU 102 determines that it has received status information from the automated baggage drop machine 30 (step S712, YES), it updates the status of the baggage drop procedure for the user U in the user information DB 106a from "uncompleted" to "completed" (step S720). Step S720 corresponds to step S218 shown in FIG.

[0291] Next, the CPU 102 determines whether or not status information has been received from the security inspection device 40 (step S722).

[0292] When CPU 102 determines that it has not received status information from security inspection device 40 (step S722, NO), CPU 102 determines whether the deadline for the security inspection procedure has passed (step S724).

[0293] When the CPU 102 determines that the deadline for the security inspection procedure has passed (step S724, YES), it generates an alert indicating that the deadline for the security inspection procedure for the user U has passed and transmits the alert via the network NW (step S726). The destination of the alert is the business terminal 80 of one or more staff members S.

[0294] When CPU 102 determines that the deadline for the security inspection procedure has not passed (step S724, NO), CPU 102 waits to receive status information from security inspection device 40 (step S722).

[0295] On the other hand, when the CPU 102 determines that it has received the status information from the security inspection device 40 (step S722, YES), it updates the status of the security inspection procedure for the user U in the user information DB 106a from "uncompleted" to "completed" (step S728). Step S728 corresponds to step S318 shown in FIG. 12.

[0296] Next, as shown in FIG. 19, the CPU 102 determines whether or not status information has been received from the automated gate device 50 (step S730).

[0297] When the CPU 102 determines that it has not received status information from the automated gate device 50 (step S730, NO), it determines whether the deadline for the immigration procedure has passed (step S732).

[0298] When the CPU 102 determines that the deadline for the immigration procedure has passed (step S732, YES), it generates an alert notifying the user that the deadline for the immigration procedure has passed and transmits the alert via the network NW (step S734). The destination of the alert is the business terminal 80 of one or more staff members S.

[0299] When the CPU 102 determines that the deadline for the immigration procedure has not passed (step S732, NO), the CPU 102 waits to receive status information from the automated gate device 50 (step S730).

[0300] On the other hand, when the CPU 102 determines that it has received status information from the automated gate device 50 (step S730, YES), it updates the status of the immigration procedure for the user U in the user information DB 106a from "uncompleted" to "completed" (step S736). Step S736 corresponds to step S418 shown in FIG.

[0301] Next, CPU 102 compares the target face image received from signage terminal 60 with multiple registered face images in user information DB 106a in a 1:N ratio to determine whether or not user U has been in front of or passed by signage terminal 60 (step S738). If a registered face image matching the target face image is found as a result of the comparison, it is determined that user U has been in front of or passed by signage terminal 60.

[0302] If CPU 102 determines that there has been no presence or passage of signage terminal 60 (step S738, NO), CPU 102 determines whether the time limit for the presence or passage of signage terminal 60 has elapsed (step S740).

[0303] When CPU 102 determines that the time limit for the location or passage of signage terminal 60 has passed (step S740, YES), it generates an alert and transmits it via network NW (step S742). That is, CPU 102 generates an alert indicating that the time limit for the location or passage of signage terminal 60 for the user has passed and transmits it via network NW. The destination of the alert is the business terminal 80 of one or more staff members S.

[0304] When CPU 102 determines that the time limit for the presence or passage in front of signage terminal 60 has not passed (step S740, NO), the process proceeds to step S738.

[0305] On the other hand, when CPU 102 determines that user U has been in front of or passed by signage terminal 60 (step S738, YES), it updates the status of that user U (step S744). That is, CPU 102 updates the status of that user U in user information DB 106a regarding the location of or passage of user U in front of signage terminal 60 from incomplete to completed. Step S744 corresponds to step S512 shown in FIG.

[0306] Furthermore, CPU 102 generates display information according to the remaining time until the boarding time of the previously identified user U of signage terminal 60, and transmits the generated display information to signage terminal 60 via network NW (step S745). Step S745 corresponds to steps S514 and S516 shown in FIG.

[0307] Next, the CPU 102 determines whether or not status information has been received from the boarding gate device 70 (step S746).

[0308] When the CPU 102 determines that it has not received status information from the boarding gate device 70 (step S746, NO), it determines whether the deadline for boarding the aircraft has passed (step S748).

[0309] When the CPU 102 determines that the deadline for boarding the aircraft has passed (step S748, YES), it generates an alert indicating that the deadline for boarding the aircraft for the user has passed and transmits the alert via the network NW (step S750). The destination of the alert is the business terminal 80 of one or more staff members S.

[0310] When the CPU 102 determines that the deadline for boarding the aircraft has not passed (step S748, NO), it waits to receive status information from the boarding gate device 70 (step S746).

[0311] On the other hand, when the CPU 102 determines that it has received the status information from the boarding gate device 70 (step S746, YES), it updates the status of the user U's boarding of the aircraft in the user information DB 106a from "uncompleted" to "completed" (step S752). Step S752 corresponds to step S618 shown in FIG. 15.

[0312] 18 and 19, CPU 102 determines whether the deadline for each procedure has passed in sequence in steps S714, S724, S732, S740, and S748, but this does not necessarily have to be done in sequence. CPU 102 can also determine whether the deadline for each procedure has passed independently of each other.

[0313] In this way, the management server 10 keeps track of and manages the status of each procedure for user U along with the deadline until user U boards the aircraft, and if any procedure has passed its deadline, it generates an alert and sends it to the business terminal 80.

[0314] When staff member S selects to display an alert on the business terminal 80, the CPU 802 of the business terminal 80 acquires the user information and status of user U for whom the deadline for the procedure specified by the alert has passed from the management server 10 via the network NW. The CPU 802 acquires the user information and status of the user U from the user information DB 106a of the management server 10.

[0315] The CPU 802 displays an alert on the display 810 based on the acquired user information and status. Fig. 20A is a schematic diagram showing an example of an alert displayed on the business terminal 80. Note that Fig. 20A illustrates a case where, unlike the case shown in Fig. 16, a user U with a user ID of 10105 has not completed the security inspection procedure even though the deadline for the security inspection procedure has passed.

[0316] As shown in FIG. 20A, the alert AL includes a user information display field AL10 that displays user information of user U, a status display field AL12 that displays the status of user U, and a facial image display field AL14 that displays a registered facial image of user U.

[0317] The user information display field AL10 displays user U's identity information such as the name and nationality, and boarding information such as the flight number of the aircraft that user U is scheduled to board. The user information display field AL10 can display part or all of the identity information, and can display part or all of the boarding information.

[0318] The status display field AL12 displays the status of each procedure of the user U, whether incomplete or complete. The status display field AL12 also displays the procedure whose deadline has passed. Note that when an alert is sent to inform the user that the deadline has passed for a certain procedure, the deadlines for subsequent procedures have also passed.

[0319] The face image display field AL14 displays the photographed face image or passport face image of the user U that was acquired by the check-in terminal 20 and registered in the user information DB 106a. The staff member S can easily find the user U who has not completed the procedures, including the procedures at the airport A, by using the registered face image of the user U displayed in the alert AL as a clue.

[0320] Furthermore, the CPU 802 of the business terminal 80 can display a status confirmation screen for confirming the status of the user U on the display 810 regardless of whether an alert has been received from the management server 10. In this case, the CPU 802 acquires the user information and status of the user U whose status should be confirmed from the user information DB 106a of the management server 10 via the network NW. FIG. 20B and FIG. 20C are schematic diagrams showing examples of the status confirmation screen displayed on the business terminal 80. In FIG. 20B and FIG. 20C, the format of the progress bar displaying the status of the user U is different from each other. Note that, unlike the case shown in FIG. 16, FIG. 20B and FIG. 20C show a case where the user U with the user ID 10105 has not completed the security inspection procedure even though the deadline for the security inspection procedure has passed.

[0321] As shown in Figures 20B and 20C, the status confirmation screen ST includes a user information display field ST10 that displays user information of user U, a status display field ST12 that displays the status of user U, and a facial image display field ST14 that displays the registered facial image of user U.

[0322] The user information display field ST10 displays the same information as the user information display field AL10 of the alert AL. The face image display field ST14 displays a registered face image similar to the face image display field AL14 of the alert AL.

[0323] The status display field ST12 uses a progress bar whose length varies depending on the progress of the procedures that the user U has completed. Fig. 20B shows the status of the user U displayed using a bar-shaped progress bar. Fig. 20C shows the status of the user U displayed using a circular progress bar.

[0324] In the alert AL shown in FIG. 20A, the status of the user U can also be displayed using a progress bar, similar to FIGS. 20B and 20C.

[0325] The CPU 802 of the business terminal 80 can store the user information to be displayed on the alert AL shown in Fig. 20A and the status check screen ST shown in Fig. 20B and Fig. 20C in the local storage device 806 and display each screen using a local application. The CPU 802 can also communicate with the management server 10 via a web browser to obtain the user information to be displayed on the alert AL shown in Fig. 20A and the status check screen ST shown in Fig. 20B and Fig. 20C and display each screen on the web browser.

[0326] Furthermore, for a user U in front of the signage terminal 60 identified by matching the target face image transmitted from the signage terminal 60, the management server 10 generates different display information according to the remaining time until the boarding time, and causes the signage terminal 60 to display the generated display information. In this way, the management server 10 manages the display of the signage terminal 60.

[0327] The display management operation of management server 10 that manages the display of signage terminals 60 will be described below with reference to Fig. 21. Fig. 21 is a flowchart showing the display management operation of management server 10. Management server 10 executes the process shown in Fig. 21 for each signage terminal 60 for which the previous user has been identified by matching the target face image.

[0328] The CPU 102 of the management server 10 identifies the user U in front of the signage terminal 60 by matching the face image in step S508 shown in Fig. 14. The CPU 102 acquires boarding information of the identified user U by referring to the user information DB 106a.

[0329] Next, as shown in FIG. 21, CPU 102 calculates the boarding time from the departure time included in the acquired boarding information or acquires the boarding time included in the boarding information, and calculates the remaining time until the boarding time calculated from the boarding information or based on the acquired boarding information (step S802).

[0330] Next, CPU 102 compares the calculated remaining time until the boarding time with a predetermined threshold value (step S804). In this way, CPU 102 determines whether the remaining time until the boarding time is short or long, i.e., whether the boarding time is approaching or there is still time until the boarding time. CPU 102 can appropriately change and set the threshold value that is the basis for the determination, depending on the congestion situation at airport A.

[0331] If the remaining time is equal to or less than a predetermined threshold (step S804, YES), CPU 102 determines that the remaining time is short, i.e., the boarding time is approaching. Furthermore, CPU 102 generates first display information as display information to be displayed on signage terminal 60 for identified user U in front of signage terminal 60 (step S806). As described above, the first display information includes, for example, boarding information of user U, the time remaining until boarding time, the deadline time of each procedure, progress information of each procedure, etc. Furthermore, as described above, the first display information may include congestion information indicating the congestion status of security checkpoint P3, immigration checkpoint P4, etc., which are processing locations where the procedures are performed.

[0332] On the other hand, if the remaining time exceeds the predetermined threshold (step S804, NO), CPU 102 determines that the remaining time is long, i.e., there is plenty of time until the boarding time. Furthermore, CPU 102 generates second display information as display information to be displayed on signage terminal 60 for identified user U in front of signage terminal 60 (step S808). As described above, the second display information includes, for example, advertising information such as general advertisements and targeted advertisements.

[0333] In this way, CPU 102 generates first display information or second display information that differ from each other as display information to be displayed on signage terminal 60 according to the remaining time until the boarding time of identified user U. CPU 102 transmits the generated first display information or second display information to the signage terminal 60 in front of which user U is identified, via network NW (step S810).

[0334] The CPU 602 of the signage terminal 60 in front of which the user U has been identified displays the first display information or the second display information received from the management server 10 on the display 608. Figures 22 to 24 are schematic diagrams showing examples of a display screen of the first display information on the signage terminal 60. Figure 25 is a schematic diagram showing an example of a display screen of the second display information on the signage terminal 60.

[0335] Fig. 22 and Fig. 23 show a display screen SNT of the display 608 of the signage terminal 60, which displays the boarding information included in the first display information, the time remaining until the boarding time, the deadline for each procedure, and the status of each procedure. Fig. 22 shows a case where the baggage check-in procedure, security check procedure, immigration procedure, and boarding the aircraft are all incomplete. Fig. 23 shows a case where, of these procedures, the baggage check-in procedure and security check procedure have been completed, but the immigration procedure and boarding the aircraft are incomplete.

[0336] 22 and 23, the display screen SNT includes a boarding information display field SNT10 that displays boarding information for the user U, and a remaining time display field SNT12 that displays the remaining time until the boarding time for the user U. The display screen SNT also includes a deadline time display field SNT14 that displays the deadline time for each procedure, and a status display field SNT16 that displays the status of each procedure.

[0337] The boarding information display field SNT10 displays boarding information such as the departure time, flight name, departure point, and arrival point of the flight on which user U is boarding. The boarding information display field SNT10 can also display user identification information, which is information for identifying user U, such as an identification number notified in advance to user U or a nickname set in advance by user U, in order to identify user U. In this case, CPU102 of the management server can include the user identification information in the first display information. Furthermore, CPU102 can include user information such as the name of user U as user identification information in the first display information, but can also be set not to display the user information from the perspective of privacy, etc.

[0338] The remaining time display field SNT12 displays the time remaining until the boarding time of the user U, for example, in comparison with the boarding time. The display format for displaying the remaining time is not particularly limited, and may be, for example, the display format of hours, minutes, and seconds as shown in the figure, or the seconds may be omitted from the hours, minutes, and seconds, or the display format may be in minutes. The remaining time display field SNT12 can display the remaining time until the deadline for each procedure, such as baggage check-in procedure, security inspection procedure, immigration procedure, and boarding the aircraft, in addition to or instead of the remaining time until the boarding time. In this case, the remaining time display field SNT12 can display the remaining time to be displayed out of the remaining time until the boarding time and the remaining time until the deadline for each procedure, by switching between regular or irregular display, or by displaying it in a list.

[0339] The deadline display field SNT14 displays the deadline for each procedure, including baggage check-in, security inspection, immigration, and boarding the aircraft, alongside the procedure name. As shown in FIG. 23, the deadline display field SNT14 can display the procedure name and deadline for an already completed procedure, distinguished from the procedure name and deadline for an incomplete procedure, for example, by graying out the procedure. If the deadline for an already completed procedure is excluded from the first display information, the procedure name and deadline for that procedure are not displayed in the deadline display field SNT14. That is, only the deadline for an incomplete procedure is displayed in the deadline display field SNT14.

[0340] The status display field SNT16 displays progress information indicating the incomplete or completed status of each procedure, for example, baggage check-in procedure, security inspection procedure, immigration procedure, and boarding an aircraft, alongside the procedure name. The status display field SNT16 does not need to display all of the deadline times for each procedure, and can also display the deadline times for some of the procedures, such as the security inspection procedure and immigration procedure. If the deadline times for procedures that have already been completed are excluded from the first display information, i.e., if only the deadline times for incomplete procedures are displayed in the deadline time display field SNT14, the status display field SNT16 can be omitted.

[0341] In this way, when the boarding time is approaching, the remaining time until the boarding time, the deadline for each procedure, and the remaining time until the deadline are displayed on the display screen SNT of the signage terminal 60, thereby encouraging the user U to take appropriate action toward boarding. In addition, by displaying progress information on the display screen SNT, the user U can properly grasp his / her own situation.

[0342] Fig. 24 shows a display screen SNC of display 608 of signage terminal 60 displaying congestion information included in the first display information. Display screen SNC shown in Fig. 24 shows the congestion status of a security checkpoint as an example of congestion information. CPU 602 of signage terminal 60 can switch between display screen SNT and display screen SNC at regular intervals, for example, and display the display contents of display screen SNT and display screen SNC on display 608 in a single screen.

[0343] 24, the display screen SNC includes an availability information display field SNC10 that identifies and displays a relatively empty security check point among a plurality of security check points, and a waiting time display field SNC12 that displays the waiting time required to complete the procedure at each security check point. The display screen SNC also includes a location display field SNC14 that shows the location of a relatively empty security check point.

[0344] The vacancy information display field SNC10 identifies and displays the security check point with the shortest waiting time among multiple security check points. In Fig. 24, the vacancy information display field SNC10 displays security check point J, which has the shortest waiting time, as the vacant security check point among security check points J and K.

[0345] The waiting time display field SNC12 displays the waiting time at each of the multiple available security checkpoints. In Fig. 24, the waiting time display field SNC12 displays the waiting time at each of security checkpoints J and K as a time range from the upper limit to the lower limit of the predicted waiting time. Note that the display format of the waiting time in the waiting time display field SNC12 may be a display with a time range, or a format that displays the predicted waiting time with or without words such as "about", "approximately", or "approximate".

[0346] The location display field SNC14 highlights the location of a relatively vacant security check point among multiple security check points, for example, on a floor map. In Fig. 24, the location display field SNC14 highlights the location of security check point J, which is relatively vacant among security check points J and K, on ​​the floor map of the departure lobby.

[0347] Incidentally, congestion information showing the congestion status of other processing locations, such as the passport control area, other than the security checkpoint, can also be displayed on the signage terminal 60 in the same manner as in the case of the security checkpoint.

[0348] In this way, when the boarding time is approaching, by displaying congestion information at the processing location on the display screen SNC of the signage terminal 60, the user U can be encouraged to take appropriate action in preparation for boarding.

[0349] Fig. 25 shows a display screen SNA of the display 608 of the signage terminal 60 displaying the advertising information included in the second display information. The display screen SNA shown in Fig. 25 shows an advertisement for a duty-free shop in airport A as an example of the advertising information.

[0350] 25, the display screen SNA includes an advertisement information display field SNA10 that displays advertisement information for the user U. The advertisement information display field SNA10 can display general advertisements that are not specific to the user U, and can also display targeted advertisements according to the user U based on the attribute information, purchase history, etc. of the user U.

[0351] In this way, when there is sufficient time until the boarding time, advertising information is displayed on the signage terminal 60 instead of information related to the boarding of the user U, such as the time remaining until the boarding time and the deadlines for each procedure. Therefore, advertising information can be effectively provided to the user U without excessively encouraging the user U to take action toward boarding.

[0352] Thus, according to this embodiment, the management server 10 sets the deadline for each procedure at airport A for user U who is scheduled to board an aircraft based on the boarding information acquired by the check-in terminal 20, and manages the status of each procedure for user U. Therefore, according to this embodiment, it is possible to grasp and manage the status of user U who is scheduled to board an aircraft in more detail.

[0353] Furthermore, according to this embodiment, the management server 10 causes the signage terminal 60 to display different display information according to the remaining time until the boarding time of the user U in front of the signage terminal 60, who is identified by matching the target face image transmitted from the signage terminal 60. The management server 10 matches the target face image transmitted from the signage terminal 60 with a registered face image, which is a photographed face image or a passport face image acquired by the check-in terminal 20 during the check-in procedure. For this reason, the user U does not need to register the face image in advance in the server from the user terminal such as the mobile terminal. Therefore, according to this embodiment, it is possible to realize a display according to the situation of the user U in front of the signage terminal 60, without causing much trouble to the user U who is scheduled to board.

[0354] In the above, a case has been described in which the signage terminal 60 displays first display information or second display information that are different from each other depending on the remaining time until the boarding time of the specified user U, but the present invention is not limited to this. The signage terminal 60 can display both the first display information, such as the remaining time until the boarding time, and the second display information, such as advertisement information. In this case, the CPU 102 of the management server 10 can display the first display information and the second display information on the signage terminal 60 by assigning superiority or inferiority to the size, area, font, etc. of the information to be displayed depending on the remaining time until the boarding time. For example, when the boarding time is approaching, the CPU 102 can display the first display information larger than the second display information on the signage terminal 60. On the other hand, when there is time until the boarding time, the CPU 102 can display the second display information larger than the first display information on the signage terminal 60.

[0355] In the above, the case where different display information is displayed on the signage terminal 60 depending on the remaining time until the boarding time of the user U in front of the signage terminal 60 has been described, but the present invention is not limited to this. For example, the CPU 102 of the management server 10 can also display different display information on a mobile information terminal such as a smartphone or tablet terminal of the user U depending on the remaining time until the boarding time, similar to the signage terminal 60. In this case, the CPU 102 transmits the remaining time until the boarding time, the deadline time of each procedure, the remaining time until the deadline time, congestion information, or advertisement information as display information to the mobile information terminal of a specific user U depending on the remaining time until the boarding time. The specific user U to whom the display information is to be transmitted is not particularly limited, but may be, for example, the user U in front of the signage terminal 60 identified in the same manner as in the above case, the user U whose location is identified by the video of the surveillance camera 90, etc. The CPU 102 can identify the mobile information terminal of the user U to which the information to be displayed is to be transmitted based on the terminal identification information of the mobile information terminal registered in advance in association with the user information, and the ID of the application program installed in the mobile information terminal. Furthermore, the CPU 102 can identify the mobile information terminal of the user U to which the information to be displayed should be sent, based on the result of matching between the face image captured by the mobile information terminal and the registered face image. The mobile information terminal of the user U can display the information sent from the management server 10, for example, by an installed application program. The application program can display information, for example, on a main screen during execution, a lock screen of the mobile information terminal, or by a pop-up notification. On the screen of the mobile information terminal, the user U can check the time remaining until the boarding time, the deadline for each procedure, the time remaining until the deadline, congestion information, or advertisement information displayed by the application program.

[0356] [Second embodiment] An information processing system, an information processing device, and an information processing method according to a second embodiment of the present invention will be described with reference to Fig. 26. Note that components similar to those of the information processing system, the information processing device, and the information processing method according to the first embodiment will be given the same reference numerals, and descriptions thereof will be omitted or simplified.

[0357] In this embodiment, an alert operation of the management server 10 that can transmit an alert specifying the location of the user U in the airport A will be described with reference to Fig. 26. Fig. 26 is a flowchart showing the alert operation of the management server 10 according to this embodiment.

[0358] The management server 10 according to this embodiment executes the process shown in Fig. 26 as the process of generating and transmitting the alerts in steps S716, S726 shown in Fig. 18 and steps S734, S742, and step S750 shown in Fig. 19. Note that the process shown in Fig. 26 may be executed for all or some of steps S716, S726, S734, S742, and step S750.

[0359] Furthermore, the management server 10 uses images captured by multiple surveillance cameras 90 installed in the airport A to identify the location of the user U. Each of the multiple surveillance cameras 90 captures an image of a specific location in the airport A and functions as an image acquisition unit that transmits the captured image to the management server 10 via the network NW.

[0360] The CPU 102 of the management server 10 functions as a location identification unit that identifies the location of the user U. The CPU 102 as a location identification unit identifies the user U from a facial image in the video captured by the multiple surveillance cameras 90. The CPU 102 as a location identification unit identifies the installation location of the surveillance camera 90 in which the user U was identified in the video, among the multiple surveillance cameras 90, as the location of the user U.

[0361] 26, when the CPU 102 of the management server 10 determines that the deadline for a specific procedure has passed, it acquires a registered face image of the user U from the user information DB 106a (step S902). The specific procedure is a baggage check-in procedure, a security inspection procedure, a passport control procedure, a location in front of or passing through a signage terminal 60, or boarding an aircraft.

[0362] Furthermore, the CPU 102 acquires the images transmitted by the multiple surveillance cameras 90 (step S904).

[0363] Next, CPU 102 detects faces from the images captured by the multiple surveillance cameras 90, and compares a detected face image, which is an image of the detected face, with a registered face image (step S906). When comparing the detected face image with the registered face image, CPU 102 can compare both face images by comparing a facial feature amount extracted from the detected face image with a facial feature amount extracted from the registered face image.

[0364] In particular, CPU 102 can detect face images from video transmitted from security cameras 90 installed between the location where the procedure whose deadline has passed is performed and the location where the most recently completed procedure is performed, and acquire the detected face image. This makes it possible to narrow down the face images to be detected, and improves the matching accuracy.

[0365] As a result of the comparison, if a detected face image matching the registered face image is found (step S908, YES), the CPU 102 identifies the location of the user U and generates an alert indicating that the deadline has passed, and transmits it via the network NW (step S910). In the alert, the CPU 102 identifies the location of the surveillance camera 90 that captured the matching detected face image as the location of the user U. The destination of the alert is the business terminal 80 of one or more staff members S. Since the location of the user U is identified in the alert, staff member S who receives the alert at the business terminal 80 can easily find user U for whom the deadline for a specific procedure has passed.

[0366] The destination of the alert may be the business terminal 80 of the staff S that is closest to the location of the user U among the multiple staff S. The business terminal 80 carried by the staff S transmits to the management server 10 the location information of the business terminal 80 based on, for example, a position sensor that uses the GNSS (Global Navigation Satellite System) or a magnetic sensor that detects geomagnetism. The GNSS is not particularly limited, but may be, for example, the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), Galileo, a compass, etc. The CPU 102 of the management server 10 can identify the business terminal 80 of the staff S that is closest to the location of the user U based on the location information transmitted from the business terminal 80.

[0367] On the other hand, if the comparison results in no detected face image matching the registered face image (step S908, NO), the CPU 102 generates an alert indicating that the deadline has passed but the location of user U is unspecified, and transmits it via the network NW (step S912).

[0368] As in this embodiment, by using footage captured by multiple surveillance cameras 90, the management server 10 can also generate and send an alert identifying the location of user U when the deadline for a particular procedure has passed.

[0369] [Other embodiments] According to still another embodiment, the information processing device described in the above embodiment can also be configured as shown in Figures 27 and 28. Figures 27 and 28 are block diagrams each showing a configuration of an information processing device according to another embodiment.

[0370] As shown in Fig. 27, an information processing device 1000 according to another embodiment has an information management unit 1002 and a display management unit 1004. The information management unit 1002 registers boarding information related to a user acquired by the user's check-in procedure and biometric information of the user acquired at the time of the check-in procedure in association with each other. The display management unit 1004 causes the display terminal to display display information according to the remaining time until the boarding time based on the user's boarding information. The user is a user identified by matching target biometric information, which is biometric information acquired by the display terminal for one user, with registered biometric information, which is biometric information registered by the information management unit.

[0371] 28, an information processing device 2000 according to another embodiment has an information management unit 2002 and a display management unit 2004. The information management unit 2002 is similar to the above-mentioned information management unit 1002. The display management unit 2004 causes a display terminal to display a time limit for procedures to be completed until the user's boarding, in accordance with the time remaining until the boarding time based on the user's boarding information. The user is the same as in the case of the above-mentioned information processing device 1000.

[0372] According to another embodiment, the user is identified by comparing the target biometric information acquired by the display terminal with the registered biometric information acquired during the check-in procedure. Therefore, the user does not need to register the biometric information in advance from the user terminal such as a mobile terminal. Therefore, according to another embodiment, it is possible to realize a display according to the situation of the user in front of the signage terminal without causing much trouble to the user who is scheduled to board.

[0373] [Modified embodiment] The present invention is not limited to the above-described embodiment, and various modifications are possible.

[0374] For example, in the above embodiment, an example has been described in which the status of each procedure after the check-in procedure, such as baggage drop-off procedure, security inspection procedure, immigration procedure, the location or passage in front of the signage terminal 60, and boarding the aircraft is managed, but the present invention is not limited to this. For example, when user U boards a domestic flight, there is no need to manage the status of the immigration procedure. Also, it is possible to install signage terminals 60 in multiple locations within airport A and manage the status of the location or passage in front of each of the multiple signage terminals 60. In addition to the status of the procedures exemplified above, various other statuses can be managed.

[0375] That is, in the above embodiment, the case where the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70 are installed as devices subsequent to the check-in terminal 20 has been described as an example, but the present invention is not limited to this. It is not necessary to install all of the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70, and it is sufficient that at least one of these devices is installed. For example, only the signage terminal 60 may be installed as a device subsequent to the check-in terminal 20.

[0376] In the above embodiment, the case where identity verification is performed by matching a target face image at each procedure of baggage check-in, security inspection, immigration, being in front of or passing through the signage terminal 60, and boarding an aircraft has been described as an example, but the present invention is not limited to this. For example, identity verification can also be performed using a code symbol such as a barcode or QR code. In this case, for example, when the user U performs a check-in procedure at the check-in terminal 20, the check-in terminal 20 issues to the user U a ticket such as a boarding pass on which a code symbol including information identifying the user U is printed. The user U can perform identity verification at each procedure by having a code reader read the code symbol.

[0377] In the above embodiment, the biometric information acquisition devices 214, 312, 412, 512, 610, and 712 capture and acquire a face image as biometric information of the user U, but the present invention is not limited to this. The biometric information acquisition device 214 of the check-in terminal 20 may acquire a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein image, and the like, in addition to a face image, as biometric information to be registered as registered biometric information in the user information DB 106a. The other biometric information acquisition devices 312, 412, 512, 610, and 712 may acquire a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein image, and the like, in addition to a face image, as target biometric information, depending on the registered biometric information.

[0378] Moreover, the management server 10 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the check-in terminal 20 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the automated baggage check machine 30 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the security inspection device 40 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the automated gate device 50 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the signage terminal 60 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the boarding gate device 70 according to the above embodiment can be configured as a system consisting of one or more devices.

[0379] Also included in the scope of each embodiment is a processing method for recording a program that operates the configuration of each embodiment to realize the functions of the above-mentioned embodiments on a recording medium, reading the program recorded on the recording medium as code, and executing the program on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Also included in each embodiment is not only a recording medium on which the above-mentioned computer program is recorded, but also the computer program itself.

[0380] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment includes not only those that execute processing by a single program recorded on the recording medium, but also those that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an extension board.

[0381] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0382] (Appendix 1) an information management unit that registers boarding information regarding the boarding of the user acquired through a check-in procedure of the user and biometric information of the user acquired during the check-in procedure in association with each other; a display management unit that causes the display terminal to display display information according to the remaining time until the boarding time based on the boarding information of the user identified by matching target biometric information, which is biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit; An information processing device having the above configuration.

[0383] (Appendix 2) The information processing device described in Appendix 1, wherein the display management unit causes the display terminal to display first display information when the remaining time is equal to or less than a predetermined threshold, and causes the display terminal to display second display information different from the first display information when the remaining time exceeds the predetermined threshold.

[0384] (Appendix 3) The information processing device described in Appendix 1, wherein the display management unit, when the remaining time is equal to or less than a predetermined threshold, causes the display terminal to display first display information larger than second display information different from the first display information, and when the remaining time exceeds a predetermined threshold, causes the display terminal to display the second display information larger than the first display information.

[0385] (Appendix 4) 4. The information processing device according to claim 2, wherein the display management unit causes the display terminal to display the first display information including the remaining time.

[0386] (Appendix 5) a deadline setting unit that sets a deadline for the procedures up to the boarding of the user based on the boarding information; 5. The information processing device according to claim 2, wherein the display management unit causes the display terminal to display the first display information including the deadline.

[0387] (Appendix 6) a status management unit for managing a status relating to the procedure; An information processing device as described in Appendix 5, wherein the display management unit causes the display terminal to display the first display information including the deadline of the procedure whose status is incomplete.

[0388] (Appendix 7) The information processing device according to any one of appendices 2 to 6, wherein the display management unit causes the display terminal to display the first display information including congestion information indicating the congestion status of the location where the user's procedures until boarding are carried out.

[0389] (Appendix 8) 8. The information processing device according to claim 2, wherein the display management unit causes the display terminal to display the second display information including advertising information.

[0390] (Appendix 9) 9. The information processing device according to claim 8, wherein the display management unit selects the advertising information included in the second display information in accordance with the user.

[0391] (Appendix 10) an information management unit that registers boarding information regarding the boarding of the user acquired through a check-in procedure of the user and biometric information of the user acquired during the check-in procedure in association with each other; a display management unit that causes the display terminal to display a time limit for procedures until boarding of the user in accordance with the remaining time until the boarding time based on the boarding information of the user identified by matching target biometric information, which is biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit; An information processing device having the above configuration.

[0392] (Appendix 11) registering boarding information regarding the boarding of the user acquired through a check-in procedure of the user and biometric information of the user acquired during the check-in procedure in association with each other; An information processing method that displays display information on the display terminal according to the remaining time until the boarding time based on the boarding information of a user identified by comparing target biometric information, which is biometric information acquired by a display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit.

[0393] (Appendix 12) On the computer, registering boarding information regarding the boarding of the user acquired through a check-in procedure of the user and biometric information of the user acquired during the check-in procedure in association with each other; Display information on the display terminal in accordance with the remaining time until the boarding time based on the boarding information of the user identified by matching target biometric information, which is biometric information acquired by the display terminal for one of the users, with registered biometric information, which is the biometric information registered by the information management unit. A recording medium on which a program for performing the above-mentioned operations is recorded. [Explanation of symbols]

[0394] 1. Information processing system 10…Administration server 20…Check-in terminal 30…Automatic baggage drop machine 40...Security inspection device 50...Automated gate device 60…Signage terminal 70...Boarding gate equipment 80: Business terminal NW…Network

Claims

1. an imaging unit that captures a first face image of a user present in front of a display terminal; a transmission unit that transmits the first face image; an acquisition unit that receives and acquires, via a network, first display information including related information associated with the first face image and the second face image corresponding to the first face image based on a comparison result between the first face image and a registered second face image; An information processing device comprising: a display unit that displays the first display information separately from other display information, that is, second display information, while displaying the first display information and the second display information on a single display.

2. An imaging unit that captures a first face image of a user who is in front of a display terminal; a transmission unit that transmits the first face image; an acquisition unit that receives and acquires, via a network, first display information including related information associated with the first face image and the second face image corresponding to the first face image based on a comparison result between the first face image and a registered second face image; An information processing device comprising: a display unit that displays the first display information separately from second display information, which is other display information, and simultaneously displays the first display information and the second display information.

3. The information processing apparatus according to claim 1 , wherein the acquisition unit acquires the first display information specified based on a comparison result between the first face image and the second face image.

4. The information processing apparatus according to claim 1 , wherein the display unit displays the first display information including the related information larger than the second display information.

5. The information processing apparatus according to claim 1 , wherein the display unit displays the first display information including the related information in an area different from that of the second display information, the second display information being different from the first display information.

6. The information processing apparatus according to claim 1 , wherein the display unit displays the first display information including the related information in a font different from that of the second display information, the font being different from that of the first display information.

7. The information processing apparatus according to claim 1 , wherein the second display information is different from the related information associated with the user.

8. The information processing device according to claim 1 , wherein the display unit displays the first display information including a remaining time until boarding indicated in the related information and calculated by an external device.

9. A display management system including a signage terminal having an imaging unit, an acquisition unit, and a display unit, and a management server having a setting unit, The imaging unit captures a first face image of a user who is in front of a display terminal; the acquisition unit acquires first display information including boarding information associated with the first facial image and the second facial image corresponding to the first facial image based on a comparison result between the first facial image and a second facial image registered in a check-in procedure; The setting unit sets a deadline for at least one procedure between the check-in procedure and the boarding procedure among a plurality of procedures based on the boarding information, The display unit is a display management system that displays the first display information, which includes the deadline and indicates the remaining time until boarding, when the remaining time calculated by an external device is below a predetermined threshold, separately from the second display information, which is other display information.

10. a receiving unit for receiving a status regarding the plurality of procedures prior to the boarding procedure, The display management system according to claim 9 , wherein the display unit displays the first display information including the expired deadline of a specific procedure among the plurality of procedures for the user.

11. the receiving unit receives a status corresponding to a specific procedure based on status information indicating completion of the specific procedure received from an external device associated with each of the plurality of procedures prior to the boarding procedure; The display management system according to claim 10 , wherein the display unit displays the first display information including the deadline of the procedure having the status of incomplete.

12. The display management system according to claim 9 , wherein the display unit displays the first display information including congestion information based on a number of people determined based on a sensor installed at each procedure.

13. The display management system according to claim 12 , wherein the congestion information indicates a degree of congestion at a location where the user completes procedures before the boarding procedure.

14. The display management system according to claim 12 , wherein the congestion information indicates availability, waiting time, or the number of people waiting in line.

15. The information processing device according to claim 1 , wherein the display unit displays the second display information including advertisement information.

16. The information processing device according to claim 15 , further comprising a selection unit that selects the advertising information included in the second display information in response to the user.

17. an information processing device captures a first face image of a user who is in front of a display terminal; the information processing device transmits the first face image; the information processing device receives and acquires, via a network, first display information including related information associated with the first face image and the second face image corresponding thereto, based on a comparison result between the first face image and a registered second face image; An information processing method in which the information processing device displays the first display information and the second display information on a single display while displaying the first display information separately from the second display information, which is other display information.

18. An information processing device captures a first face image of a user present in front of a display terminal, the information processing device transmits the first face image; the information processing device receives and acquires, via a network, first display information including related information associated with the first face image and the second face image corresponding thereto, based on a comparison result between the first face image and a registered second face image; An information processing method in which the information processing device displays the first display information separately from second display information, which is other display information, and simultaneously displays the first display information and the second display information.

19. On the computer, Taking a first face image of a user present in front of a display terminal; Sending the first facial image; receiving and acquiring, via a network, first display information including related information associated with the first face image and the second face image corresponding to the first face image based on a comparison result between the first face image and a registered second face image; A program that executes the process of displaying the first display information and the second display information on a single display while displaying the first display information separately from the second display information, which is other display information.

20. A computer comprising: Taking a first face image of a user present in front of a display terminal; Sending the first facial image; receiving and acquiring, via a network, first display information including related information associated with the first face image and the second face image corresponding to the first face image based on a comparison result between the first face image and a registered second face image; A program that causes the first display information and the second display information to be displayed simultaneously while displaying the first display information separately from second display information, which is other display information.

21. an imaging unit that captures a first face image of a user present in front of a display terminal; a transmission unit that transmits the first face image; an acquisition unit that receives and acquires, via a network, first display information including related information associated with the first facial image and the second facial image corresponding to the first facial image based on a comparison result between the first facial image and a second facial image registered in advance; An information processing device comprising: a display unit that displays the first display information separately from other display information, that is, second display information, while displaying the first display information and the second display information on a single display.

22. An imaging unit that captures a first face image of a user who is in front of a display terminal; a transmission unit that transmits the first face image; an acquisition unit that receives and acquires, via a network, first display information including related information associated with the first facial image and the second facial image corresponding to the first facial image based on a comparison result between the first facial image and a second facial image registered in advance; An information processing device comprising: a display unit that displays the first display information separately from second display information, which is other display information, and simultaneously displays the first display information and the second display information.

23. an information processing device captures a first face image of a user who is in front of a display terminal; the information processing device transmits the first face image; the information processing device receives and acquires, via a network, first display information including related information associated with the first facial image and the second facial image corresponding thereto, based on a comparison result between the first facial image and a second facial image registered in advance; An information processing method in which the information processing device displays the first display information and the second display information on a single display while displaying the first display information separately from the second display information, which is other display information.

24. An information processing device captures a first face image of a user present in front of a display terminal, the information processing device transmits the first face image; the information processing device receives and acquires, via a network, first display information including related information associated with the first facial image and the second facial image corresponding thereto, based on a comparison result between the first facial image and a second facial image registered in advance; An information processing method in which the information processing device displays the first display information separately from second display information, which is other display information, and simultaneously displays the first display information and the second display information.

25. On the computer, Taking a first face image of a user present in front of a display terminal; Sending the first facial image; receiving and acquiring, via a network, first display information including related information associated with the first facial image and the second facial image corresponding to the first facial image based on a comparison result between the first facial image and a second facial image registered in advance; A program that executes the process of displaying the first display information and the second display information on a single display while displaying the first display information separately from the second display information, which is other display information.

26. A computer comprising: Taking a first face image of a user present in front of a display terminal; Sending the first facial image; receiving and acquiring, via a network, first display information including related information associated with the first facial image and the second facial image corresponding to the first facial image based on a comparison result between the first facial image and a second facial image registered in advance; A program that causes the first display information and the second display information to be displayed simultaneously while displaying the first display information separately from second display information, which is other display information.

Images