Information processing device, information processing method, and program

Abstract

To improve a throughput in a procedure area in which a procedure system using biometric authentication or a procedure system using an authentication method other than the biometric authentication can be selected.SOLUTION: An information processing device according to the present invention includes: an acquisition unit that acquires first biometric information of a user; and a generation unit that, when the user is determined as a registrant on the basis of a first comparison result between the first biometric information and registration biometric information of the registrant, generates first guide information guiding a user to a first procedure place where personal identification is performed according to an automated procedure, the information superimposed and displayed in an area for a first person determined as the registrant in a captured image including a plurality of persons, and when the user is determined as not a registrant, generates second guide information guiding the user to a second procedure place different from the first procedure place, the information superimposed and displayed in an area for a second person determined as not a registrant in the captured image.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses a ticketless boarding system that performs procedures for passengers using biometric authentication at a plurality of checkpoints (check-in lobby, security inspection area, boarding gate, etc.). Patent Document 2 also discloses a cardless payment system that executes payment processing for customers using biometric authentication at the store cash register.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] As exemplified in Patent Document 1 and Patent Document 2, in various fields, the automation of procedures using biometric authentication has been promoted. In the current procedure area, users often select either an automated lane that executes procedures using biometric authentication or a manned lane staffed by employees to perform the procedures. However, in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected, if the user makes a mistake in selecting the procedure method, the throughput in the procedure area will decrease.

[0005] Therefore, in view of the above-mentioned problems, the present invention aims to provide an information processing device, an information processing method, and a program that can improve throughput in a procedure area where a procedure using biometric authentication or a procedure using an authentication method other than biometric authentication can be selected. [Means for solving the problem]

[0006] According to one aspect of the present invention, an acquisition unit acquires first biometric information of a user, and if it is determined that the user is the registered person based on a first comparison result between the first biometric information and the registered biometric information of the registrant, At the first location Information indicating that identity verification can be performed through automated procedures. Includes multiple In the captured image that includes the aforementioned user, the area of ​​the first person determined to be the registered user is superimposed. , guide the user to the first procedure location The system generates the first guidance information, and if it is determined that the user is not the registered user, At the first procedure location Information indicating that identity verification cannot be performed through the aforementioned automated procedure. Includes, In the aforementioned captured image, the area of ​​the second person, which is determined not to be the registered person, is superimposed. , guide the user to the second procedure location. An information processing device is provided, comprising a generation unit that generates second guidance information.

[0007] According to another aspect of the present invention, the computer obtains first biometric information of a user, and if the computer determines that the user is the registered person based on a first matching result between the first biometric information and the registered biometric information of the registered person, At the first location Information indicating that identity verification can be performed through automated procedures. Includes multiple In the captured image that includes the aforementioned user, the area of ​​the first person determined to be the registered user is superimposed. , guide the user to the first procedure location The system generates the first guidance information, and if it is determined that the user is not the registered user, At the first procedure location The aforementioned automated procedure The aforementioned Information indicating that identity verification cannot be performed. Includes, In the aforementioned captured image, the area of ​​the second person, which is determined not to be the registered person, is superimposed. , guide the user to the second procedure location.An information processing method is provided, comprising the step of generating a second guidance information.

[0008] According to yet another aspect of the present invention, the computer comprises the steps of acquiring first biometric information of a user, and if it is determined that the user is the registered person based on a first matching result between the first biometric information and the registered biometric information of the registered person, At the first location Information indicating that identity verification can be performed through automated procedures. Includes multiple In the captured image containing the user, first guidance information is generated to be superimposed on the area of ​​the first person determined to be the registered person, and if the user is determined not to be the registered person, At the first procedure location The aforementioned automated procedure The aforementioned Information indicating that identity verification cannot be performed. Includes, In the aforementioned captured image, the area of ​​the second person, which is determined not to be the registered person, is superimposed. , guide the user to the second procedure location. A program is provided to perform the steps of generating second guidance information. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that can improve throughput in a procedure area where a procedure using biometric authentication or a procedure using an authentication method other than biometric authentication can be selected. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram showing an example of the overall configuration of the information processing system according to the first embodiment. [Figure 2] This figure shows an example of the information stored in the boarding reservation information database according to the first embodiment. [Figure 3] This figure shows an example of the information stored in the user information database according to the first embodiment. [Figure 4] This figure shows an example of the information stored in the passage history information DB according to the first embodiment. [Figure 5] It is a block diagram showing an example of the hardware configuration of the management server according to the first embodiment. [Figure 6] It is a block diagram showing an example of the hardware configuration of the signage terminal according to the first embodiment. [Figure 7] It is a layout diagram showing an example of the installation location of the signage terminal in the security inspection area according to the first embodiment. [Figure 8] It is a sequence chart showing an example of the processing between the management server and the signage terminal in the information processing system according to the first embodiment. [Figure 9] It is a diagram showing an example of the screen displayed by the signage terminal according to the first embodiment. [Figure 10] It is a diagram showing an example of the screen displayed by the signage terminal according to the first embodiment. [Figure 11] It is a diagram showing an example of the screen displayed by the signage terminal according to the first embodiment. [Figure 12] It is a sequence chart showing an example of the processing between the management server and the business terminal in the information processing system according to the first embodiment. [Figure 13] It is a diagram showing an example of the screen displayed by the business terminal according to the first embodiment. [Figure 14] It is a diagram showing an example of the screen displayed by the business terminal according to the first embodiment. [Figure 15] It is a functional block diagram of the information processing apparatus according to the second embodiment.

Modes for Carrying Out the Invention

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements or corresponding elements are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0012] <First Embodiment> Figure 1 is a schematic diagram showing an example of the overall configuration of the information processing system 1 according to this embodiment. The information processing system 1 according to this embodiment is a computer system that supports a series of procedures carried out in both the first and second countries for a user (traveler) U who plans to depart from airport DA in the first country by aircraft and travel to the second country. The information processing system 1 is operated by a public institution such as an immigration bureau or a contractor entrusted with the work by such an institution. For the sake of explanation, only the equipment in the first country is shown, but it can also be applied to procedures in the second country.

[0013] As shown in Figure 1, the information processing system 1 comprises a management server 10, a check-in terminal 20, an automated baggage drop-off machine 30, a security screening device 40, an automated gate device 50, a boarding gate device 60, business terminals 42 and 52, a signage terminal 70, and a camera 80. The management server 10 and the other devices are connected via a network NW. The network NW consists of a LAN (Local Area Network), a WAN (Wide Area Network), a mobile communication network, etc. The connection method is not limited to wired; wireless connections are also possible.

[0014] The management server 10 is an information processing device that manages various screening procedures for user U during entry and exit from the country. The management server 10 is installed, for example, within the facilities of an airport company or airline operating airport DA. The management server 10 does not need to be a single server, but may be configured as a group of servers including multiple servers. For example, a server that handles some of the functions of the management server 10 may be installed in the first country, and other servers that handle the remaining functions of the management server 10 may be installed in the second country.

[0015] As shown in Figure 1, the management server 10 includes a storage unit 11, an information acquisition unit 12, a database management unit 13, a matching unit 14, a guidance unit 15, and an aggregation unit 16.

[0016] The storage unit 11 stores information used by each part of the management server 10. The storage unit 11 includes, for example, a boarding reservation information DB 11a, a user information DB 11b, and a transit history information DB 11c.

[0017] The boarding reservation information DB11a is a database that aggregates and stores boarding reservation information transmitted from each airline's reservation system (not shown).

[0018] Figure 2 shows an example of the information stored in the boarding reservation information DB11a. The boarding reservation information DB11a includes the following data items: reservation number, flight number, airline code, passenger name, departure city, destination, date of operation, seat number, nationality, passport number, last name, first name, date of birth, and gender. Note that these data items are just examples, and other data items may also be included. The reservation number is an identifier that uniquely identifies the boarding reservation information. The airline code is an identifier that uniquely identifies the airline.

[0019] User information DB11b is a database that stores information about user U who has completed the check-in procedure.

[0020] Figure 3 shows an example of the information stored in User Information DB11b. User Information DB11b includes the following data items: User ID, registered facial image, feature quantity, passenger name, reservation number, departure city, destination, date of operation, airline code, flight number, seat number, nationality, passport number, last name, first name, date of birth, gender, and procedure status (P1) to procedure status (P5). Note that these data items are just examples, and other data items may also be included.

[0021] The User ID is an identifier that uniquely identifies User U. In this embodiment, the User ID is issued on the condition that the matching result between the facial image of User U, who is holding a passport during the check-in procedure, and the passport facial image read from the passport, is a match. In this embodiment, the phrase "match" means that the matching score, which indicates the similarity between User U's biometric information and the registrant's registered biometric information, is above a predetermined threshold. The phrase "mismatch" means that the matching score is below a predetermined threshold.

[0022] The registered facial image is a facial image registered for user U. In this embodiment, the registered facial image is registered during the check-in procedure. The registered facial image may also be registered in the first procedure among a series of procedures performed upon departure. Preferably, the registered facial image is registered based on the consent of user U and deleted at a predetermined time. The feature quantities are values ​​extracted from biometric information (registered facial image).

[0023] In this embodiment, the registered facial image is registered, similar to the user ID, on the condition that the facial image taken of user U, who is holding a passport, during the initial procedure (check-in procedure) matches the passport facial image read from the passport.

[0024] Furthermore, the facial image used for registration shall be the facial image taken during the initial procedure at the location. This is because the facial image taken during the initial procedure is more recent than the passport facial image, and its quality (appearance) is closer to that of images taken during subsequent authentication processes than that of the passport facial image. However, instead of the target facial image (photographed facial image), the passport facial image may be set as the registered facial image (registered biometric information).

[0025] The management server 10 verifies whether user U is the person holding the appropriate boarding pass by comparing the facial image (biometric information) captured by the automated baggage drop-off machine 30, security screening device 40, automated gate device 50, boarding gate device 60, and signage terminal 70 with the registered facial image stored in the user information DB 11b. Further details will be described later.

[0026] In this embodiment, the term "biometric information" refers to a facial image and features extracted from the facial image; however, biometric information is not limited to facial images and facial features. That is, biometric authentication may be performed using iris images, fingerprint images, palm print images, and auricle images as the biometric information of user U.

[0027] The user information shown in Figure 3 includes the boarding reservation information shown in Figure 2. User U's boarding reservation information is obtained from recording media such as passports and boarding passes during the check-in process and registered in the user information DB11b for each user ID. The user information DB11b and the boarding reservation information DB11a are linked by airline code and reservation number.

[0028] The transit history information DB11c is a database that stores the transit history of user U at the locations (checkpoints) of a series of procedures performed when leaving the country.

[0029] Figure 4 shows an example of the information stored in the passage history information DB11c. The passage history information DB11c has the following data items: user ID, passage time, device name, business system type, passage touchpoint, and procedure method. The passage time is the timestamp when user U passed through the touchpoint. The device name is the name of the business terminal used for the procedure at the touchpoint. The business system type is the type of business system to which the business terminal belongs.

[0030] The procedure method is the method of procedure selected by user U at each touchpoint. Examples of procedure methods include facial recognition, face-to-face interaction, self-service, and web-based methods, but the available procedure methods vary depending on the touchpoint. User information DB11b and passage history information DB11c are linked by the user ID.

[0031] The information acquisition unit 12 acquires information from the devices at each touch point P1 to P5. The database management unit 13 performs registration, update, and search processing on the database in the storage unit 11.

[0032] The matching unit 14 performs a matching process between the biometric information of user U acquired by the signage terminal 70 and the registered biometric information registered in the user information DB 11b, and outputs the matching result.

[0033] If the verification unit 14 determines that user U is a registered user, the guidance unit 15 guides user U to a procedure location corresponding to the first method (biometric authentication method). If it determines that user U is not a registered user, the guidance unit 15 generates information guiding user U to a procedure location corresponding to the second method (authentication method other than biometric authentication). Hereinafter, in this embodiment, a procedure location where procedures are automatically executed using facial recognition (biometric authentication) is referred to as the facial recognition lane, and a location where procedures are executed in a face-to-face format with an attendant S is referred to as the manned lane.

[0034] In the first method, the procedure is performed automatically based on the result of a comparison process between the user's new biometric information acquired at the procedure location and their registered biometric information. In the second method, the procedure is performed face-to-face between user U and staff member S, based on a medium carried by user U. This medium may include a passport, boarding pass, etc.

[0035] The aggregation unit 16 aggregates and outputs the number of users who completed the procedure using the first method and the number of users who completed the procedure using the second method in the procedure area.

[0036] Check-in terminal 20 is located in the check-in lobby or check-in counter within the airport DA of the first country (departure country). Hereafter, the procedure area where check-in terminal 20 is located will be referred to as "touchpoint P1". Check-in terminal 20 is a self-service terminal that allows passenger U to perform check-in procedures (boarding procedures) by operating it themselves. After completing the check-in procedure at touchpoint P1, passenger U proceeds to the baggage drop-off area or security checkpoint.

[0037] The automated baggage drop-off machine 30 is installed in an area adjacent to the baggage counter or near the check-in terminal 20 within the airport's DA (Department Area). Hereinafter, the procedure area where the automated baggage drop-off machine 30 is installed will be referred to as "Touch Point P2". The automated baggage drop-off machine 30 is a self-service terminal that allows passengers U to check in baggage that they will not or cannot bring into the cabin. After completing the baggage check-in procedure, passengers U proceed to the security checkpoint. If passengers U have no baggage to check in, the procedure at Touch Point P2 is omitted.

[0038] The security screening device 40 is installed at the security checkpoint within the airport DA (hereinafter referred to as "touchpoint P3"). In this embodiment, the term "security screening device" includes all of the following: a metal detector that checks whether user U is wearing any metal objects that could be dangerous, an X-ray inspection device that checks for dangerous objects in carry-on baggage using X-rays, and a passage control device that determines whether user U is allowed to pass through the entrance and exit of the security checkpoint. After user U completes the security screening procedure using the security screening device 40 at touchpoint P3, they proceed to the immigration area. The service terminal 42 is installed at the manned counter in the security checkpoint. Staff member S uses the service terminal 42 to perform the security screening procedure for user U.

[0039] Furthermore, the procedure area (inspection area) at the security checkpoint is set up in multiple lanes. User U selects a lane from among the multiple lanes and undergoes inspection. At the entrance of each lane, user U undergoes identity verification procedures before the body search and baggage inspection.

[0040] The automated gate device 50 is installed in the departure immigration area (hereinafter referred to as "touchpoint P4") within Airport DA. The automated gate device 50 is a device that automatically performs the departure immigration procedures for user U. After user U completes the departure immigration procedures at touchpoint P4, they move to the departure area where duty-free shops and boarding gates are located. The service terminal 52 is installed at the manned counter in the departure immigration area. Staff member S uses the service terminal 52 to perform the departure immigration procedures for user U.

[0041] The boarding gate device 60 is installed at each boarding gate in the departure area (hereinafter referred to as "touch point P5"). The boarding gate device 60 is a passage control device that confirms that user U is a passenger of an aircraft that can be boarded from the boarding gate. Once user U completes the identity verification procedure at touch point P5, they board the aircraft and depart for the second country.

[0042] Business terminals 42 and 52 are terminals used by airline and airport facility staff S for their respective tasks at each touchpoint. Business terminals 42 and 52 are, for example, personal computers, tablet terminals, smartphones, etc. In this embodiment, for the sake of explanation, only business terminals 42 and 52 at touchpoints P3 and P4 are shown in the diagram, but business terminals can be similarly installed at other touchpoints as well.

[0043] The signage terminal 70 is installed at the security checkpoint (touch point P3) and the immigration checkpoint (touch point P4). The signage terminal 70 is a display terminal that displays information on its screen to guide users U to the procedure location, according to display control from the management server 10. The signage terminal 70 sequentially transmits facial images of users U standing in front of the terminal to the management server 10, thereby requesting the management server 10 to perform a one-to-many match between the facial images of users U and registered facial images stored in the user information DB 11b.

[0044] Camera 80 is, for example, a digital camera and is installed at each touch point P1 to P5. Camera 80 is mounted on, for example, the ceiling, wall, or support column so that it can capture the face and entire body of user U. Camera 80 can be either fixed or movable. Camera 80 sequentially transmits the captured images to the management server 10. The management server 10 can use the captured images for purposes such as facial recognition of user U and surveillance within the airport DA.

[0045] Figure 5 is a block diagram showing an example of the hardware configuration of the management server 10. As shown in Figure 5, the management server 10 is a computer that performs calculations, control, and storage, and includes a CPU (Central Processing Unit) 101, RAM (Random Access Memory) 102, ROM (Read Only Memory) 103, storage 104, a communication I / F (Interface) 105, a display device 106, and an input device 107. Each device is interconnected via buses, wiring, drive devices, etc.

[0046] The CPU 101 is a processor that performs predetermined operations according to programs stored in the ROM 103 or storage 104, and also has the function of controlling various parts of the management server 10. The RAM 102 is composed of a volatile storage medium and provides a temporary memory area necessary for the operation of the CPU 101.

[0047] ROM 103 consists of a non-volatile storage medium and stores necessary information such as programs used for the operation of the management server 10. Storage 104 consists of a non-volatile storage medium and stores programs and data for the operation of the management server 10. Storage 104 is composed of, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0048] The communication interface 105 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with other devices.

[0049] The display device 106 is a liquid crystal display, OLED (Organic Light Emitting Diode) display, etc., which displays videos, still images, text, etc., and is used to present information to the user.

[0050] The input device 107 is a keyboard, pointing device, button, etc., that accepts user operation. The display device 106 and the input device 107 may be integrally formed as a touch panel.

[0051] Figure 6 is a block diagram showing an example of the hardware configuration of a signage terminal 70. The signage terminal 70 includes a CPU 701, RAM 702, ROM 703, storage 704, communication I / F 705, display device 706, input device 707, and biometric information acquisition device 708.

[0052] The biometric information acquisition device 708 is a device that acquires a facial image of user U as biometric information of user U. For example, the biometric information acquisition device 708 is a digital camera that photographs the face of user U standing in front of the signage terminal 70, and acquires the facial image of user U by photographing the face of user U.

[0053] The hardware configuration shown in Figures 5 and 6 is merely an example; additional devices may be included, and some devices may be omitted. Furthermore, some devices may be replaced with other devices having similar functions. Additionally, some functions of this embodiment may be provided by other devices via a network (NW), and the functions of this embodiment may be distributed and implemented across multiple devices. Thus, the hardware configuration shown in Figures 5 and 6 can be modified as appropriate.

[0054] Figure 7 is a layout diagram showing an example of the installation location of a signage terminal 70 in a security checkpoint. Here, the signage terminal 70 is shown installed in the passageway of the security checkpoint (touchpoint P3) between the facial recognition lane L1 and the face-to-face lane L2 where a manned counter is located. The facial recognition lane L1 is a procedure area corresponding to the facial recognition method (first method). The facial recognition lane L1 includes an automated lane using facial recognition. The face-to-face lane L2 is a procedure area corresponding to an authentication method other than facial recognition (second method).

[0055] User U chooses either facial recognition lane L1 or face-to-face lane L2 to undergo security screening. At the entrance to both facial recognition lane L1 and face-to-face lane L2, user U undergoes identity verification procedures. In the case of facial recognition lane L1, identity verification is performed by facial recognition, and in the case of face-to-face lane L2, user U presents a passport or other document to officer S. Once identity verification is complete, user U undergoes a body search and baggage inspection.

[0056] If user U is identified by biometric verification on the management server 10, the signage terminal 70 displays a screen guiding user U to the facial recognition lane L1. Conversely, if user U is not identified by biometric verification on the management server 10, the terminal displays a screen guiding user U to the face-to-face lane L2.

[0057] Next, the operation of the information processing system 1 in this embodiment will be described with reference to the drawings.

[0058] [Information for users on where to complete procedures] Figure 8 is a sequence chart showing an example of processing between the management server 10 and the signage terminal 70 in the information processing system 1. This processing is executed when user U enters the procedure area. Figure 8 illustrates the case where user U enters the security checkpoint as an example.

[0059] First, the signage terminal 70 continuously or periodically photographs the area in front of the device using the biometric information acquisition device 708 and determines whether or not the face of user U is detected in the captured image (step S101). The signage terminal 70 waits until the face of user U is detected in the image by the biometric information acquisition device 708 (step S101, NO).

[0060] When the signage terminal 70 determines that the face of user U has been detected by the biometric information acquisition device 708 (step S101, YES), it takes a photograph of user U's face and acquires user U's face image as the target face image (step S102).

[0061] Next, the signage terminal 70 transmits the target face image of user U, captured by the biometric information acquisition device 708, to the management server 10 via the network NW along with a matching request (step S103). This prompts the signage terminal 70 to request the management server 10 to perform a 1:N matching of the target face image of user U captured by the biometric information acquisition device 708 with multiple registered face images registered in the user information DB 11b of the management server 10.

[0062] Next, when the management server 10 receives the target face image and matching request from the signage terminal 70, it matches the target face image with multiple registered face images registered in the user information DB 11b in a 1:N ratio (step S104).

[0063] Next, the management server 10 determines whether the comparison result between the target face image and the registered face image is a match (step S105). That is, the management server 10 determines whether there is a registered face image of a registered person that is authenticated as the same person as the user.

[0064] If the management server 10 determines that the comparison result between the target face image and the registered face image is a match (step S105, YES), the process proceeds to step S106.

[0065] In contrast, if the comparison result between the target face image and the registered face image is determined to be a mismatch (step S105, NO), the process proceeds to step S107.

[0066] In step S106, the management server 10 sends information to the signage terminal 70 guiding the user to the facial recognition lane.

[0067] Meanwhile, in step S107, the management server 10 transmits guidance information to the signage terminal 70 for the face-to-face lane.

[0068] In step S108, when the signage terminal 70 receives guidance information from the management server 10, it displays this information on the screen of the display device 706 and then terminates the process.

[0069] Figures 9 to 11 show examples of screens displayed by the signage terminal 70. In Figure 9, the face image of user U1, a message guiding user U1 to the face recognition lane ("Your face image has been registered in the authentication system. Please proceed to the face recognition lane and complete the security screening procedure."), and an arrow A1 indicating the direction of the face recognition lane are displayed.

[0070] The message in Figure 9 is displayed when the face image of user U1 captured by the signage terminal 70 matches the registered face image of the registered user registered in the user information DB 11b (i.e., when the management server 10 determines that user U1 is a registered user).

[0071] Figure 10 shows the facial image of user U2, a message guiding user U2 to a face-to-face lane where staff member S is present ("Your facial image is not registered in the facial recognition system. Please proceed to the face-to-face lane and complete the security screening procedure."), and an arrow A2 indicating the direction to the face-to-face lane.

[0072] The message in Figure 10 is displayed when the face image of user U2 captured by the signage terminal 70 does not match the registered face image of the registered user registered in the user information DB 11b (i.e., when the management server 10 determines that user U2 is not a registered user).

[0073] Furthermore, the management server 10 (guidance unit 15) may generate a screen that overlays guidance information onto the face image detection area in the captured image when a face image is detected in the captured image of the procedure area.

[0074] In Figure 11, the screen contains multiple users U3 to U6, and arrows A3 to A6, indicating the procedure location for each person, are superimposed on the detection area of ​​each user's face image. In Figures 10 and 11, guidance information was output for each user U. In contrast, Figure 11 has the advantage of being able to provide guidance information to multiple people simultaneously.

[0075] [Inquiry processing of procedural status] Figure 12 is a sequence chart showing an example of processing between the management server 10 and the business terminal 42 in the information processing system 1. This processing is executed when an employee S inquires about the status of each user U within the airport. Figure 12 explains the process using the business terminal 42 as an example, but the same applies to business terminal 52 and other business terminals (not shown).

[0076] First, the business terminal 42 determines whether or not an inquiry about the status of user U's procedure has been requested by staff member S (step S201). If the business terminal 42 determines that an inquiry about the status of the procedure has been requested (step S201, YES), the process proceeds to step S202.

[0077] In response, if the business terminal 42 determines that no inquiry regarding the procedure status has been requested (step S201, NO), it maintains a standby state.

[0078] In step S202, the business terminal 42 obtains the inquiry conditions based on the input operation of employee S. Next, the business terminal 42 sends an inquiry request to the management server 10 (step S203).

[0079] Next, when the management server 10 receives an inquiry request from the business terminal 42, it determines whether the inquiry request is in list format (step S204). If the management server 10 determines that the inquiry request is in list format (step S204, YES), the process proceeds to step S205.

[0080] In contrast, if it is determined that the inquiry request is not a list-format inquiry (step S204, NO), the process proceeds to step S207.

[0081] In step S205, the management server 10 searches the user information DB 11b and the passage history information DB 11c. Based on the search, the management server 10 combines the user information and passage history information for each user ID and generates screen data for the procedure status list screen, which displays the procedure status of each user U in a list format (step S206). After that, the process moves on to step S210.

[0082] In step S207, the boarding reservation information DB11a is searched. Through this search, the management server 10 can obtain the number of boarding reservations for the current day.

[0083] Next, the management server 10 searches the user information DB 11b and the passage history information DB 11c and aggregates the total number of users U who performed procedures at each touchpoint and the number of users U for each procedure type (step S208).

[0084] Next, the management server 10 generates screen data for the touchpoint-specific inquiry screen (step S209). After that, the process proceeds to step S210.

[0085] In step S210, the management server 10 transmits the screen data generated in step S206 or step S209 to the business terminal 42.

[0086] Then, when the business terminal 42 receives screen data from the management server 10, it displays the inquiry screen based on the screen data (step S211) and terminates the process.

[0087] Figures 13 and 14 show examples of screens displayed on the business terminal 42. Figure 13 shows a procedure status list screen that displays user information obtained from the user information DB 11b and passage history information and procedure methods for each touchpoint obtained from the passage history information DB 11c in a list format. For example, user U, whose user ID is 10101, is a person whose facial image has been registered, and has performed check-in procedures (P1), baggage drop-off procedures (P2), security screening procedures (P3), immigration procedures (P4), and boarding the aircraft (P5) using automatic and facial recognition.

[0088] Furthermore, user U, whose user ID is 10102, is a person whose facial image is not registered. The check-in procedure (P1) is performed automatically using the check-in terminal 20, while the baggage drop-off procedure (P2) and security screening procedure (P3) are performed in person at a counter where staff member S is present.

[0089] Furthermore, user U, whose user ID is 10103, is a person whose facial image has been registered, and has completed the check-in procedure (P1) and baggage drop-off procedure (P2) using automated and facial recognition. However, this user U (user ID: 10103) is also completing the security screening procedure (P3) in person. Thus, as shown in Figure 13, the progress of user U's procedures and the procedure method at each touchpoint can be easily understood.

[0090] Figure 14 shows a touchpoint-specific inquiry screen that displays the total number of people who have not yet completed the procedure, the number of people who have completed the procedure, and the number of people who used each procedure method for each touchpoint. For example, in the security screening procedure, 30 people who have completed the check-in procedure have not yet undergone security screening. Furthermore, of the 100 people who have completed security screening, 60 used the facial recognition method, and the remaining 40 used the face-to-face method.

[0091] As described above, the information processing system 1 (management server 10) of this embodiment compares the facial image (biometric information) acquired from user U with a plurality of registered facial images (registered biometric information) registered in user information DB 11b, and guides user U to a procedure location corresponding to the first method (biometric authentication method) or the second method (face-to-face method) based on the comparison result. This makes it possible to suppress a decrease in throughput in procedure areas where users can select a procedure method other than facial authentication.

[0092] <Second Embodiment> Figure 15 is a functional block diagram of the information processing device 100 in this embodiment. The information processing device 100 comprises an acquisition unit 100A, a verification unit 100B, and a guidance unit 100C. The acquisition unit 100A acquires the user's biometric information in a procedure area where the user can select either a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure. The verification unit 100B compares the biometric information with the registered biometric information of a registered user who can use the first method and determines whether the user is a registered user or not. If the verification unit 100B determines that the user is a registered user, the guidance unit 100C guides the user to a procedure location corresponding to the first method, and if it determines that the user is not a registered user, it generates guidance information to a procedure location corresponding to the second method.

[0093] According to this embodiment, an information processing device 100 is provided that can improve throughput in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected.

[0094] [Modified Embodiment] The present invention is not limited to the embodiments described above and can be modified as appropriate without departing from the spirit of the invention. For example, an example in which a part of the configuration of one embodiment is added to another embodiment, or in which a part of the configuration of another embodiment is replaced, is also an embodiment of the present invention.

[0095] Furthermore, the configuration of the present invention can be applied not only to international flights but also to domestic flights. In the case of domestic flights, in addition to the departure immigration procedures, the one-to-one matching process between the passport facial image and the photographed facial image can be omitted. In this case, the registered biometric image can be, for example, the facial image taken when purchasing the boarding pass.

[0096] In the embodiments described above, security screening procedures at the time of departure were explained as an example, but the procedure areas to which the present invention can be applied are not limited to security checkpoints. For example, in the case of airport facilities, it can also be applied to procedure areas such as departure immigration checkpoints, arrival immigration checkpoints, and customs checkpoints.

[0097] Furthermore, the configuration of the present invention can be applied to procedures other than those at airports. Specific examples of such procedures include payment procedures performed for a user U purchasing goods or receiving services in a store. The same effect can be achieved in cases where a store has both a facial recognition register and a manned register staffed by an employee S, and the user U can choose which register to use. In other words, the configuration of the present invention can be applied to any procedure area where the user U can choose between a first method that utilizes biometric authentication or a second method that does not utilize biometric authentication.

[0098] The management server 10 (guidance unit 15) may guide the user to a procedure location corresponding to the attribute information of user U associated with the registered biometric information. For example, this is effective when a priority lane is provided for user U whose attribute information meets certain conditions to be given priority in the screening procedure. Specifically, if the user information DB 11b includes attribute information such as the airline membership category (regular member / VIP member, etc.) and whether or not user U has a companion who requires assistance, user U can be guided to the priority lane based on the attribute information of user U obtained by facial recognition.

[0099] Furthermore, in the above-described embodiment, the management server 10 was configured to guide user U to the appropriate procedure lane when user U is standing in front of the signage terminal 70. However, the management server 10 may also be configured to provide guidance at terminals other than the signage terminal 70 that are connected to it.

[0100] For example, when user U operates a KIOSK terminal installed in the airport, the KIOSK terminal may capture a facial image (biometric information) of user U and send it to the management server 10, where the management server 10 can determine whether or not the facial image is registered. If the management server 10 determines that user U's facial image is registered in the user information DB 11b, the KIOSK terminal will guide user U to the procedure location at each touchpoint. If the management server 10 determines that user U's facial image is not registered in the user information DB 11b, the KIOSK terminal will prompt user U to register with the facial recognition system. Once user U's facial image is registered in the user information DB 11b of the management server 10, the KIOSK terminal will guide user U to the procedure location based on the control from the management server 10.

[0101] Furthermore, the camera 80 shown in Figure 1 may also be installed in the devices at each touch point P1 to P5 (check-in terminal 20, automated baggage drop-off machine 30, security screening device 40, automated gate device 50, boarding gate device 60).

[0102] Furthermore, the data items displayed on the touchpoint-specific inquiry screen shown in Figure 14 are just examples and are not limited to these. For example, the number of users (passengers) U who registered their facial image during the check-in procedure but then proceeded with the subsequent procedure using the face-to-face method instead of the facial recognition method could also be displayed. This would allow the system to track the number of users U who registered their facial image and the number of users U who actually selected the facial recognition method for each touchpoint.

[0103] Furthermore, for each procedure, the average time taken by user U to pass through each stage may be calculated and displayed. Additionally, the system may be configured to record the time taken to pass through all touchpoints for each user U and display this information for each user U.

[0104] The processing method of recording a program that operates the configuration of the embodiment to realize the functions of the embodiment described above on a storage medium, reading the program recorded on the storage medium as code, and executing it on a computer is also included in the scope of each embodiment. In other words, a computer-readable storage medium is also included in the scope of each embodiment. Furthermore, not only the storage medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment. In addition, one or more components included in the above-described embodiment may be circuits such as ASICs (Application Specific Integrated Circuits) or FPGAs (Field Programmable Gate Arrays) configured to realize the functions of each component.

[0105] Examples of storage media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD (Compact Disk)-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that perform processing on the storage medium alone, but also includes programs that operate on an OS (Operating System) in cooperation with other software and the functions of expansion boards to perform processing.

[0106] The services realized by the functions of each of the above embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0107] It should be noted that the embodiments described above are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various ways without departing from its technical concept or its main features.

[0108] Some or all of the embodiments described above may also be described as follows, but are not limited to the following.

[0109] (Note 1) An acquisition unit that acquires the user's biometric information in a procedure area where the user can select either a first method that uses biometric authentication in the procedure or a second method that does not use biometric authentication in the procedure, A matching unit that compares the biometric information with the registered biometric information of a registered user who can use the first method, and determines whether the user is the registered user or not. If the verification unit determines that the user is the registered person, the guidance unit guides the user to a procedure location corresponding to the first method, and if the verification unit determines that the user is not the registered person, the guidance unit generates guidance information to a procedure location corresponding to the second method. An information processing device equipped with the following features.

[0110] (Note 2) The aforementioned biometric information is a facial image. The information processing device described in Appendix 1.

[0111] (Note 3) In the first method, the procedure is automatically executed based on the result of a matching process between the new biometric information of the user acquired at the procedure location and the registered biometric information. The information processing device described in Appendix 1 or 2.

[0112] (Note 4) In the second method described above, the procedure is performed with the user and the staff member in face-to-face, based on a medium carried by the user. An information processing device as described in any of the appendices 1 to 3.

[0113] (Note 5) The guidance unit causes the guidance information to be displayed on the display terminal. An information processing device as described in any of the appendices 1 to 4.

[0114] (Note 6) The guidance unit generates a screen that superimposes the guidance information onto the detection area of ​​the face image in the captured image when the face image is detected in the captured image of the procedure area. The information processing device described in Appendix 2.

[0115] (Note 7) A summarization unit that aggregates and outputs the number of users who completed the procedure using the first method and the number of users who completed the procedure using the second method in the procedure area. An information processing device according to any one of the appendices 1 to 6, further comprising:

[0116] (Note 8) The guidance unit guides the user to the procedure location corresponding to the user's attribute information associated with the registered biometric information. An information processing device as described in any of the appendices 1 to 7.

[0117] (Note 9) The aforementioned procedures include screening procedures conducted at the airport for the aforementioned passenger upon arrival. An information processing device as described in any of the appendices 1 to 8.

[0118] (Note 10) The aforementioned inspection procedure includes at least one of the following: security inspection procedure, departure inspection procedure, arrival inspection procedure, and customs inspection procedure. The information processing device described in Appendix 9.

[0119] (Note 11) The aforementioned procedure includes a payment procedure performed for the user who purchases goods at the store or the user who receives the service. An information processing device as described in any of the appendices 1 to 10.

[0120] (Note 12) A step of acquiring the user's biometric information in a procedure area where the user can select either a first method that uses biometric authentication in the procedure or a second method that does not use biometric authentication in the procedure, A step of comparing the biometric information with the registered biometric information of a registered person who can use the first method, and determining whether the user is the registered person or not. If the user is determined to be the registered person, the user is guided to a procedure location corresponding to the first method; if the user is determined not to be the registered person, the user is guided to a procedure location corresponding to the second method. An information processing method comprising the following:

[0121] (Note 13) On the computer, A step of acquiring the user's biometric information in a procedure area where the user can select either a first method that uses biometric authentication in the procedure or a second method that does not use biometric authentication in the procedure, A step of comparing the biometric information with the registered biometric information of a registered person who can use the first method, and determining whether the user is the registered person or not. If the user is determined to be the registered person, the user is guided to a procedure location corresponding to the first method; if the user is determined not to be the registered person, the user is guided to a procedure location corresponding to the second method. A recording medium on which a program to execute a program is stored. [Explanation of Symbols]

[0122] NW... Network U, U1~U6...User S... Staff 1. Information Processing System 10. Management Server 11...Storage section 11a...Boarding reservation information database 11b...User information DB 11c...Passage History Information Database 12...Information acquisition section 13. Database Management Department 14.. Verification section 15...Information Department 16. Tallying Department 20. Check-in terminal 30...Automated baggage drop-off machine 40. Security Inspection Device 42, 52... Business terminals 50. Automated gate device 60...Boarding gate device 70... Digital signage terminals 80... Camera

Claims

1. An acquisition unit that acquires the user's first biometric information, A generation unit generates first guidance information that, if the user is determined to be the registrant based on the first matching result between the first biometric information and the registrant's registered biometric information, includes information indicating that identity verification can be performed by an automated procedure at the first procedure location, which is superimposed on the area of ​​the first person determined to be the registrant in a captured image containing multiple users, and guides the user to the first procedure location; and if the user is determined not to be the registrant, includes information indicating that identity verification cannot be performed by the automated procedure at the first procedure location, which is superimposed on the area of ​​the second person determined not to be the registrant in the captured image, and guides the user to the second procedure location; An information processing device equipped with the following features.

2. The generation unit generates a screen in which, when a face image is detected from the captured image, the first guidance information or the second guidance information is superimposed on the face image detection area in the captured image. The information processing apparatus according to claim 1.

3. A aggregation unit that aggregates and outputs the number of users who have completed the identity verification process through the automated procedure described above. The information processing apparatus according to claim 2, further comprising:

4. The computer obtains the user's first biometric information, The steps include generating first guidance information that, if the computer determines, based on a first matching result between the first biometric information and the registered biometric information of the registrant, the user is a registrant, and the computer generates first guidance information that includes information indicating that identity verification can be performed by an automated procedure at a first procedure location, which is superimposed on the area of ​​the first person determined to be a registrant in a captured image containing multiple users, and guides the user to the first procedure location; and generating second guidance information that, if the user is determined not to be a registrant, the computer generates second guidance information that includes information indicating that identity verification cannot be performed by the automated procedure at the first procedure location, which is superimposed on the area of ​​the second person determined not to be a registrant in the captured image, and guides the user to the second procedure location. An information processing method comprising the following:

5. In the generation step, the computer generates a screen in which, when a face image is detected from the captured image, the first guidance information or the second guidance information is superimposed on the face image detection area in the captured image. The information processing method according to claim 4.

6. A step of aggregating and outputting the number of users who have completed the identity verification through the automated procedure described above, The information processing method according to claim 5, further comprising:

7. On the computer, Steps include obtaining the user's first biometric information, Based on the first matching result between the first biometric information and the registered biometric information of the registrant, if the user is determined to be the registrant, first guidance information is generated that includes information indicating that identity verification can be performed by an automated procedure at the first procedure location, which is superimposed on the area of ​​the first person determined to be the registrant in a captured image containing multiple users, and guides the user to the first procedure location; and if the user is determined not to be the registrant, second guidance information is generated that includes information indicating that identity verification cannot be performed by the automated procedure at the first procedure location, which is superimposed on the area of ​​the second person determined not to be the registrant in the captured image, and guides the user to the second procedure location. A program to execute.

8. In the generation step, when a face image is detected from the captured image, a screen is generated that superimposes the first guidance information or the second guidance information onto the face image detection area in the captured image. The program according to claim 7.

9. A step of aggregating and outputting the number of users who have completed the identity verification through the automated procedure described above, The program according to claim 8, further comprising:

Images