Information processing device, information processing method, and program

Abstract

To provide an information processor, an information processing method, and a program that can improve throughput in procedural areas where procedural methods using biometric authentication or authentication methods other than biometric authentication can be selected.SOLUTION: An information processor according to the present invention includes: an acquisition unit for acquiring first biometric information of a user; and a display unit for displaying second guide information to encourage the user to register first biometric information or second biometric information by reading a medium equipped with the second biometric information when the user is determined not to be a registered person based on a result of matching the first biometric information with the registered biometric information of the registered person.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a ticketless boarding system that uses biometric authentication to process passengers at multiple checkpoints (check-in lobbies, security checkpoints, boarding gates, etc.). Patent Document 2 discloses a cardless payment system that uses biometric authentication to process payment for products at store cash registers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-79656 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-126749 Summary of the Invention [Problem to be solved by the invention]

[0004] As exemplified by Patent Documents 1 and 2, automation of procedures using biometric authentication is progressing in various fields. In current processing areas, users often select either an automated lane where procedures are performed using biometric authentication or a manned lane where an attendant is stationed. However, in processing areas where users can select a processing method using biometric authentication or a processing method using an authentication method other than biometric authentication, if a user makes a mistake in selecting the processing method, throughput in the processing area will decrease.

[0005] Therefore, in consideration of the above-mentioned problems, the present invention aims to provide an information processing device, information processing method, and program that can improve throughput in a processing area where a processing method using biometric authentication or a processing method using an authentication method other than biometric authentication can be selected. [Means for solving the problem]

[0006] According to one aspect of the present invention, an acquisition unit acquires first biometric information of a user, and when the user is determined to be the registrant based on a first comparison result between the first biometric information and the registered biometric information of a registrant, the acquisition unit outputs first guidance information that guides the user to a first procedure location where identity verification will be performed by an automated procedure. In a photographed image including a plurality of users, the image is superimposed on the area of ​​the first person who is determined to be the registered user. and if it is determined that the user is not a registered person, displaying second guidance information that guides the user to a second procedure location that is different from the first procedure location. The image is superimposed on the area of ​​the second person who is determined not to be the registered person in the captured image. and a display unit for displaying the information.

[0007] According to another aspect of the present invention, a method for identifying a registered person by an automated procedure includes: a step of acquiring first biometric information of a user by a computer; and when the computer determines that the user is the registered person based on a first comparison result between the first biometric information and registered biometric information of a registered person, outputting first guidance information to the user that guides the user to a first procedure location where the user's identity is verified by an automated procedure. In a photographed image including a plurality of users, the image is superimposed on the area of ​​the first person who is determined to be the registered user. and if it is determined that the user is not a registered person, displaying second guidance information that guides the user to a second procedure location that is different from the first procedure location. The image is superimposed on the area of ​​the second person who is determined not to be the registered person in the captured image. and displaying the information.

[0008] According to yet another aspect of the present invention, a computer includes a step of acquiring first biometric information of a user, and when it is determined that the user is the enrolled person based on a first comparison result between the first biometric information and enrolled biometric information of an enrolled person, a first guidance information is output to the computer, the first guidance information instructing the user to a first procedure location where identity verification will be performed by an automated procedure. In a photographed image including a plurality of users, the image is superimposed on the area of ​​the first person who is determined to be the registered user. and if it is determined that the user is not a registered person, displaying second guidance information that guides the user to a second procedure location that is different from the first procedure location. The image is superimposed on the area of ​​the second person who is determined not to be the registered person in the captured image. A program for executing the steps of displaying is provided. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing device, information processing method, and program that can improve throughput in a processing area where a processing method using biometric authentication or a processing method using an authentication method other than biometric authentication can be selected. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram illustrating an example of the overall configuration of an information processing system according to a first embodiment. [Figure 2] FIG. 3 is a diagram showing an example of information stored in a boarding reservation information DB according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of information stored in a user information DB according to the first embodiment. [Figure 4] 3 is a diagram showing an example of information stored in a passage history information DB according to the first embodiment. FIG. [Figure 5] FIG. 2 is a block diagram showing an example of a hardware configuration of a management server according to the first embodiment. [Figure 6] 2 is a block diagram showing an example of a hardware configuration of the signage terminal according to the first embodiment. FIG. [Figure 7] FIG. 2 is a layout diagram showing an example of installation locations of signage terminals at a security checkpoint according to the first embodiment. [Figure 8] 4 is a sequence chart showing an example of processing between a management server and a signage terminal in the information processing system according to the first embodiment. [Figure 9] FIG. 3 is a diagram showing an example of a screen displayed by a signage terminal according to the first embodiment. [Figure 10] FIG. 3 is a diagram showing an example of a screen displayed by a signage terminal according to the first embodiment. [Figure 11] FIG. 3 is a diagram showing an example of a screen displayed by a signage terminal according to the first embodiment. [Figure 12] 4 is a sequence chart showing an example of processing between a management server and a business terminal in the information processing system according to the first embodiment. [Figure 13] FIG. 4 is a diagram showing an example of a screen displayed on a business terminal according to the first embodiment. [Figure 14] FIG. 4 is a diagram showing an example of a screen displayed on a business terminal according to the first embodiment. [Figure 15] FIG. 10 is a functional block diagram of an information processing device according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, similar or corresponding elements are designated by the same reference numerals, and descriptions thereof may be omitted or simplified.

[0012] First Embodiment FIG. 1 is a schematic diagram showing an example of the overall configuration of an information processing system 1 according to this embodiment. The information processing system 1 according to this embodiment is a computer system that supports a series of procedures to be carried out in a first country and a second country for a user (traveler) U who plans to depart a first country by airplane from an airport DA in the first country and travel to a second country. The information processing system 1 is operated, for example, by a public institution such as an immigration control bureau or a contractor entrusted with the work by such an institution. For ease of explanation, only the device in the first country is shown, but the system can also be applied to procedures in the second country.

[0013] As shown in Fig. 1, the information processing system 1 includes a management server 10, a check-in terminal 20, an automated baggage drop machine 30, a security inspection device 40, an automated gate device 50, a boarding gate device 60, business terminals 42 and 52, a signage terminal 70, and a camera 80. The management server 10 and the other devices are connected to each other via a network NW. The network NW is configured by a LAN (Local Area Network), a WAN (Wide Area Network), a mobile communication network, etc. The connection method is not limited to a wired method, and may be a wireless method.

[0014] The management server 10 is an information processing device that manages various screening procedures when a user U enters or leaves the country. The management server 10 is installed, for example, within the facilities of an airport company or an airline that operates an airport DA. The management server 10 does not have to be a single server, but may be configured as a server group including multiple servers. For example, a server that performs some of the functions of the management server 10 may be installed in a first country, and another server that performs the remaining functions of the management server 10 may be installed in a second country.

[0015] As shown in FIG. 1, the management server 10 includes a storage unit 11, an information acquisition unit 12, a database management unit 13, a collating unit 14, a guidance unit 15, and a counting unit 16.

[0016] The storage unit 11 stores information used by each unit of the management server 10. The storage unit 11 includes, for example, a boarding reservation information DB 11a, a user information DB 11b, and a passage history information DB 11c.

[0017] The boarding reservation information DB 11a is a database that collects and stores boarding reservation information transmitted from the reservation systems (not shown) of airline companies.

[0018] Fig. 2 is a diagram showing an example of information stored in the boarding reservation information DB11a. The boarding reservation information DB11a has the following data items: reservation number, flight number, airline code, passenger name, departure point, destination, operation date, seat number, nationality, passport number, surname, given name, date of birth, and gender. Note that these data items are examples, and other data items may also be included. The reservation number is an identifier that uniquely identifies the boarding reservation information. The airline code is an identifier that uniquely identifies the airline.

[0019] The user information DB 11b is a database that stores information about a user U who has completed check-in procedures.

[0020] 3 is a diagram showing an example of information stored in the user information DB 11b. The user information DB 11b has the following data items: user ID, registered face image, feature amount, passenger name, reservation number, departure point, destination, operation date, airline code, flight number, seat number, nationality, passport number, surname, given name, date of birth, gender, and processing status (P1) to processing status (P5). Note that these data items are merely examples, and the user information DB 11b may further include other data items.

[0021] The user ID is an identifier that uniquely identifies a user U. In this embodiment, the user ID is issued on the condition that the match between the facial image of the user U holding the passport taken during the check-in procedure and the passport facial image read from the passport is a match. In this embodiment, the phrase "match" means that the match score, which indicates the degree of similarity between the biometric information of the user U and the registered biometric information of the registrant, is equal to or greater than a predetermined threshold. In addition, the phrase "mismatch" means that the match score is less than a predetermined threshold.

[0022] The registered face image is a face image registered for user U. In this embodiment, the registered face image is registered during check-in procedures. The registered face image may be registered in the first procedure among a series of procedures performed when departing the country. The registered face image is preferably registered based on the consent of user U and deleted at a predetermined timing. The feature amount is a value extracted from biometric information (registered face image).

[0023] In this embodiment, the registered facial image, like the user ID, is registered on the condition that the comparison result between the facial image of user U holding a passport taken during the initial procedure (check-in procedure) and the passport facial image read from the passport is a match.

[0024] Furthermore, the face image taken during the initial local procedure is used as the registration face image. This is because the face image taken during the initial procedure is newer than the passport face image and is closer in quality (appearance) to the image taken during the subsequent authentication process than the passport face image. However, the passport face image may be set as the registration face image (registered biometric information) instead of the target face image (taken face image).

[0025] The management server 10 verifies the identity of the user U by comparing the facial images (biometric information) taken at the automated baggage drop machine 30, security inspection device 40, automated gate device 50, boarding gate device 60, and signage terminal 70 with the registered facial images stored in the user information DB 11b. Details will be described later.

[0026] In this embodiment, the term "biometric information" refers to a facial image and features extracted from the facial image, but the biometric information is not limited to a facial image and facial features. In other words, biometric authentication may be performed using an iris image, a fingerprint image, a palm print image, an ear image, or the like as biometric information of the user U.

[0027] The user information shown in Fig. 3 includes the boarding reservation information shown in Fig. 2. The boarding reservation information of user U is acquired from a recording medium such as a passport or boarding pass during the check-in procedure, and is registered in the user information DB11b for each user ID. The user information DB11b and the boarding reservation information DB11a are associated with each other by the airline code and the reservation number.

[0028] The passage history information DB11c is a database that stores the passage history of the user U at locations (checkpoints) where a series of procedures are carried out at the time of departure.

[0029] 4 is a diagram showing an example of information stored in the passage history information DB11c. The passage history information DB11c has the following data items: user ID, passage time, device name, business system type, passed touch point, and procedure method. The passage time is the timestamp when user U passed through the touch point. The device name is the name of the business terminal used for the procedure at the touch point. The business system type is the type of business system to which the business terminal belongs.

[0030] The procedure method is the procedure method selected by the user U at each touch point. Examples of procedure methods include facial recognition, face-to-face, self-checkout, and online checkout, but the selectable procedure methods vary depending on the touch point. The user information DB11b and the passage history information DB11c are associated with each other by the user ID.

[0031] The information acquisition unit 12 acquires information from the devices at the touch points P1 to P5. The database management unit 13 performs registration processing, update processing, and search processing for the database in the storage unit 11.

[0032] The matching unit 14 executes a process of matching the biometric information of the user U acquired by the signage terminal 70 with the registered biometric information registered in the user information DB 11b, and outputs the matching result.

[0033] The guidance unit 15 guides the user U to a processing location corresponding to the first method (biometric authentication method) when the matching unit 14 determines that the user U is a registered person, and generates guidance information to a processing location corresponding to the second method (authentication method other than biometric authentication) when the matching unit 14 determines that the user U is not a registered person. Hereinafter, in this embodiment, a processing location where a procedure is automatically performed using facial recognition (biometric authentication) is referred to as a facial recognition lane, and a location where a procedure is performed in a face-to-face format with an attendant S is referred to as a manned lane.

[0034] In the first method, the procedure is automatically executed based on the results of a process of matching the user's new biometric information acquired at the processing location with the registered biometric information. In the second method, the procedure is executed based on a medium carried by the user U, with the user U and the staff member S meeting face to face. The medium used may be a passport, boarding pass, or the like.

[0035] The counting unit 16 counts and outputs the number of users who have completed the procedure using the first method and the number of users who have completed the procedure using the second method in the procedure area.

[0036] The check-in terminal 20 is installed in a check-in lobby or check-in counter in an airport DA of a first country (country of departure). Hereinafter, the processing area where the check-in terminal 20 is installed will be referred to as a "touch point P1." The check-in terminal 20 is a self-service terminal that a user U operates to carry out check-in procedures (boarding procedures). After completing the check-in procedures at touch point P1, the user U moves to the baggage drop-off area or security checkpoint.

[0037] The automated baggage drop machine 30 is installed in an area adjacent to the baggage counter in the airport DA or in an area near the check-in terminal 20. Hereinafter, the processing area where the automated baggage drop machine 30 is installed will be referred to as "touch point P2." The automated baggage drop machine 30 is a self-service terminal that a user U operates to carry on the procedure for checking in baggage that will not or cannot be carried into the cabin. After completing the baggage check-in procedure, the user U proceeds to the security checkpoint. If the user U does not have any baggage to check in, the procedure at touch point P2 is omitted.

[0038] The security inspection device 40 is installed at a security inspection point (hereinafter referred to as "touch point P3") within the airport DA. In this embodiment, the term "security inspection device" is used to include all of the following: a metal detector that uses a metal detector to check whether or not a user U is carrying any potentially dangerous metal objects; an X-ray inspection device that uses X-rays to check whether or not dangerous objects are present in carry-on baggage, etc.; and a traffic control device that determines whether or not the user U can pass through at the entrance / exit to the security inspection point. After the user U completes the security inspection procedure using the security inspection device 40 at touch point P3, the user U moves to the departure inspection area. The business terminal 42 is installed at a manned counter at the security inspection point. An officer S uses the business terminal 42 to carry out the security inspection procedure for the user U.

[0039] Furthermore, processing locations (inspection locations) are provided for each of the multiple lanes at the security checkpoint. User U selects a lane from the multiple lanes and undergoes inspection. At the entrance to each lane, user U undergoes identity verification procedures before undergoing a physical inspection and baggage inspection.

[0040] The automated gate device 50 is installed at the departure inspection area (hereinafter referred to as "touch point P4") within the airport DA. The automated gate device 50 is a device that automatically carries out the departure inspection procedures for user U. After user U completes the departure inspection procedures at touch point P4, he or she moves to the departure area where duty-free shops and boarding gates are located. The business terminal 52 is installed at a manned counter at the departure inspection area. Staff member S uses the business terminal 52 to carry out the departure inspection procedures for user U.

[0041] A boarding gate device 60 is installed at each boarding gate (hereinafter referred to as "touch point P5") in the departure area. The boarding gate device 60 is a traffic control device that verifies that the user U is a passenger on an aircraft that can board through the boarding gate. After the user U completes the identity verification procedure at touch point P5, the user U boards the aircraft and departs for a second country.

[0042] The business terminals 42, 52 are terminals used by airline or airport facility staff S for their work at each touch point. The business terminals 42, 52 are, for example, personal computers, tablet terminals, smartphones, etc. Note that in this embodiment, for convenience of explanation, only the business terminals 42, 52 at touch points P3 and P4 are illustrated, but business terminals may also be installed at other touch points in the same way.

[0043] The signage terminal 70 is installed at the security checkpoint (touch point P3) and the immigration checkpoint (touch point P4). The signage terminal 70 is a display terminal that displays information on a screen guiding the user U to the processing location in accordance with display control from the management server 10. The signage terminal 70 sequentially transmits facial images of the user U standing in front of the terminal to the management server 10, thereby requesting the management server 10 to perform a one-to-many comparison between the facial image of the user U and the registered facial images stored in the user information DB 11b.

[0044] The cameras 80 are, for example, digital cameras, and are installed at each of the touch points P1 to P5. The cameras 80 are attached to, for example, the ceiling, a wall, or a support so as to capture images of the face and entire body of the user U. The camera 80 may be either a fixed type or a movable type. The camera 80 sequentially transmits the captured images to the management server 10. The management server 10 can use the captured images for purposes such as facial authentication of the user U and monitoring within the airport DA.

[0045] Fig. 5 is a block diagram showing an example of the hardware configuration of the management server 10. As shown in Fig. 5, the management server 10 is a computer that performs calculations, control, and storage, and includes a CPU (Central Processing Unit) 101, RAM (Random Access Memory) 102, ROM (Read Only Memory) 103, storage 104, a communication I / F (Interface) 105, a display device 106, and an input device 107. The devices are connected to each other via buses, wiring, drives, etc.

[0046] The CPU 101 is a processor that performs predetermined operations in accordance with programs stored in the ROM 103 or storage 104, and has the function of controlling each part of the management server 10. The RAM 102 is made up of a volatile storage medium, and provides a temporary memory area necessary for the operation of the CPU 101.

[0047] The ROM 103 is made up of a nonvolatile storage medium and stores necessary information such as programs used for the operation of the management server 10. The storage 104 is made up of a nonvolatile storage medium and stores programs and data for the operation of the management server 10. The storage 104 is made up of, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0048] The communication I / F 105 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with other devices.

[0049] The display device 106 is a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or the like that displays moving images, still images, characters, etc., and is used to present information to the user.

[0050] The input device 107 is a keyboard, a pointing device, a button, etc., and receives operations by the user. The display device 106 and the input device 107 may be integrally formed as a touch panel.

[0051] 6 is a block diagram showing an example of the hardware configuration of signage terminal 70. Signage terminal 70 has a CPU 701, a RAM 702, a ROM 703, a storage 704, a communication I / F 705, a display device 706, an input device 707, and a biometric information acquisition device 708.

[0052] The biometric information acquisition device 708 is a device that acquires a facial image of the user U as biometric information of the user U. The biometric information acquisition device 708 is, for example, a digital camera that captures an image of the face of the user U standing in front of the signage terminal 70, and captures the image of the face of the user U.

[0053] Note that the hardware configurations shown in Figures 5 and 6 are merely examples, and other devices may be added, or some devices may not be provided. Furthermore, some devices may be replaced with other devices having similar functions. Furthermore, some functions of this embodiment may be provided by other devices via a network NW, or the functions of this embodiment may be distributed and realized among multiple devices. In this way, the hardware configurations shown in Figures 5 and 6 can be modified as appropriate.

[0054] FIG. 7 is a layout diagram showing an example of the installation location of a signage terminal 70 at a security checkpoint. Here, the signage terminal 70 is installed in a passageway at the security checkpoint (touch point P3) between a facial recognition lane L1 and a face-to-face lane L2 where a manned counter is installed. The facial recognition lane L1 is a processing location that supports a facial recognition method (first method). The facial recognition lane L1 includes an automated lane that uses facial recognition. The face-to-face lane L2 is a processing location that supports an authentication method other than facial recognition (second method).

[0055] User U selects either facial recognition lane L1 or face-to-face lane L2 to undergo security inspection. At the entrances to facial recognition lane L1 and face-to-face lane L2, identity verification procedures are carried out for user U. Identity verification is carried out by facial recognition in the case of facial recognition lane L1, and by user U presenting a medium such as a passport to staff member S in the case of face-to-face lane L2. Once identity verification is complete, user U undergoes a physical and baggage inspection.

[0056] If the user U is identified by biometric matching in the management server 10, the signage terminal 70 displays a screen guiding the user U to the face recognition lane L1. Conversely, if the user U is not identified by biometric matching in the management server 10, the signage terminal 70 displays a screen guiding the user U to the face-to-face lane L2.

[0057] Next, the operation of the information processing system 1 in this embodiment will be described with reference to the drawings.

[0058] [Guidance to users on where to go for procedures] 8 is a sequence chart showing an example of processing between the management server 10 and the signage terminal 70 in the information processing system 1. This processing is executed when the user U enters the processing area. In FIG. 8, the case where the user U enters the security checkpoint will be described as an example.

[0059] First, the signage terminal 70 constantly or periodically captures an image of the area in front of the device using the biometric information acquisition device 708, and determines whether the face of the user U is detected in the captured image (step S101). The signage terminal 70 waits until the face of the user U is detected in the image by the biometric information acquisition device 708 (step S101, NO).

[0060] When the signage terminal 70 determines that the face of the user U has been detected by the biometric information acquisition device 708 (step S101, YES), it photographs the face of the user U and acquires the facial image of the user U as a target facial image (step S102).

[0061] Next, the signage terminal 70 transmits the target face image of user U captured by the biometric information acquisition device 708 together with a matching request to the management server 10 via the network NW (step S103). As a result, the signage terminal 70 requests the management server 10 to perform a 1:N matching between the target face image of user U captured by the biometric information acquisition device 708 and multiple registered face images registered in the user information DB 11b of the management server 10.

[0062] Next, upon receiving the target face image and the matching request from the signage terminal 70, management server 10 matches the target face image with a plurality of registered face images registered in user information DB 11b on a 1:N basis (step S104).

[0063] Next, the management server 10 determines whether the matching result between the target face image and the registered face image is a match (step S105). That is, the management server 10 determines whether there is a registered face image of a registrant who is authenticated as the same person as the user.

[0064] Here, if the management server 10 determines that the comparison result between the target face image and the registered face image is a match (step S105, YES), the process proceeds to step S106.

[0065] On the other hand, if it is determined that the matching result between the target face image and the registered face image is a mismatch (step S105, NO), the process proceeds to step S107.

[0066] In step S106, the management server 10 transmits guidance information to the signage terminal 70 for guiding to the face recognition lane.

[0067] On the other hand, in step S107, the management server 10 transmits guidance information to the signage terminal 70 for guiding to the on-coming lane.

[0068] In step S108, upon receiving the guidance information from management server 10, signage terminal 70 displays it on the screen of display device 706, and the process ends.

[0069] 9 to 11 are diagrams showing examples of screens displayed by the signage terminal 70. In Fig. 9, a facial image of user U1, a message guiding user U1 to the facial recognition lane ("Your facial image has been registered in the authentication system. Please proceed to the facial recognition lane and go through the security inspection procedure."), and an arrow A1 indicating the direction of the facial recognition lane are displayed.

[0070] The message in Figure 9 is displayed when the comparison result between the facial image of user U1 captured on the signage terminal 70 and the registered facial image of a registrant registered in the user information DB11b is a match (i.e., when the management server 10 determines that user U1 is a registrant).

[0071] Figure 10 displays a facial image of user U2, a message guiding user U2 to the face-to-face lane where attendant S is located ("Your facial image is not registered in the facial recognition system. Please proceed to the face-to-face lane and undergo security inspection procedures."), and an arrow A2 indicating the direction of the face-to-face lane.

[0072] The message in Figure 10 is displayed when the comparison result between the facial image of user U2 captured on the signage terminal 70 and the registered facial image of a registrant registered in the user information DB11b is a mismatch (i.e., when the management server 10 determines that user U2 is not a registrant).

[0073] Furthermore, when a face image is detected from a photographed image of the procedure area, the management server 10 (the guidance unit 15) may generate a screen that displays guidance information superimposed on the detection area of ​​the face image in the photographed image.

[0074] In Fig. 11, multiple users U3 to U6 are included on the screen, and arrows A3 to A6 indicating the procedure location for each person are superimposed on the detection area of ​​the face image of each of users U3 to U6. In the cases of Figs. 10 and 11, guidance information was output for each user U. In contrast, the case of Fig. 11 has the advantage that guidance information can be provided to multiple people simultaneously.

[0075] [Procedure status inquiry processing] 12 is a sequence chart showing an example of processing between the management server 10 and the business terminal 42 in the information processing system 1. This processing is executed when an attendant S inquires about the procedural status of each user U in the airport. While FIG. 12 explains the case where the business terminal 42 is used as an example, the same applies to the case of the business terminal 52 and other business terminals (not shown).

[0076] First, the business terminal 42 determines whether or not an inquiry about the procedure status of the user U has been requested by the clerk S (step S201). Here, if the business terminal 42 determines that an inquiry about the procedure status has been requested (step S201, YES), the process proceeds to step S202.

[0077] On the other hand, if the business terminal 42 determines that an inquiry about the procedure status has not been requested (step S201, NO), the business terminal 42 remains in a standby state.

[0078] In step S202, the business terminal 42 acquires the inquiry conditions based on the input operation of the clerk S. Next, the business terminal 42 transmits an inquiry request to the management server 10 (step S203).

[0079] Next, when the management server 10 receives a query request from the business terminal 42, it determines whether the query request is a list-format query (step S204). If the management server 10 determines that the query request is a list-format query (step S204, YES), the process proceeds to step S205.

[0080] On the other hand, if it is determined that the inquiry request is not a list-format inquiry (step S204, NO), the process proceeds to step S207.

[0081] In step S205, the management server 10 searches the user information DB 11b and the passage history information DB 11c. Through the search, the management server 10 combines the user information and passage history information for each user ID and generates screen data for a procedure status list screen that displays the procedure status of each user U in a list format (step S206). Thereafter, the process proceeds to step S210.

[0082] In step S207, the boarding reservation information DB 11a is searched. Through the search, the management server 10 can obtain the number of boarding reservation information items for the day.

[0083] Next, the management server 10 searches the user information DB 11b and the passage history information DB 11c, and tallies the total number of users U who performed the procedure at each touch point and the number of users U for each procedure method (step S208).

[0084] Next, the management server 10 generates screen data for the touch point-specific inquiry screen (step S209), after which the process proceeds to step S210.

[0085] In step S210, the management server 10 transmits the screen data generated in step S206 or step S209 to the business terminal .

[0086] Then, when the business terminal 42 receives the screen data from the management server 10, it displays the inquiry screen based on the screen data (step S211), and ends the process.

[0087] 13 and 14 are diagrams showing examples of screens displayed on the business terminal 42. Fig. 13 shows a procedure status list screen that displays, in a list format, user information acquired from the user information DB 11b and passage history information and procedure methods for each touch point acquired from the passage history information DB 11c. For example, user U with user ID 10101 is a person whose face image is registered, and has completed check-in procedures (P1), baggage drop-off procedures (P2), security inspection procedures (P3), immigration procedures (P4), and boarding the aircraft (P5) automatically and using facial recognition.

[0088] Furthermore, user U, whose user ID is 10102, is a person whose facial image is not registered, and the check-in procedure (P1) is carried out automatically by the check-in terminal 20, and the baggage check-in procedure (P2) and security inspection procedure (P3) are carried out face-to-face at a counter or the like where staff member S is present.

[0089] User U, whose user ID is 10103, has a registered facial image and has completed the check-in procedure (P1) and baggage drop-off procedure (P2) automatically and using facial recognition. However, this user U (user ID: 10103) has completed the security inspection procedure (P3) face-to-face. In this way, the screen shown in Figure 13 makes it easy to understand the progress of user U's procedures and the procedure method at each touchpoint.

[0090] Figure 14 shows an inquiry screen by touchpoint that tally and displays the number of people who have not yet completed the procedure, the number of people who have completed the procedure, and the number of people who have used each procedure method for each touchpoint. For example, in the security inspection procedure, of the people who have completed the check-in procedure, 30 people have not yet undergone security inspection. It also shows that of the 100 people who have completed security inspection, 60 used the facial recognition method and the remaining 40 used the face-to-face method.

[0091] As described above, the information processing system 1 (management server 10) of this embodiment compares a face image (biometric information) acquired from the user U with a plurality of registered face images (registered biometric information) registered in the user information DB 11b, and guides the user U to a processing location corresponding to the first method (biometric authentication method) or the second method (face-to-face method) based on the comparison result. This makes it possible to suppress a decrease in throughput in processing areas where a processing method using face authentication or a method other than face authentication can be selected.

[0092] Second Embodiment FIG. 15 is a functional block diagram of an information processing device 100 according to this embodiment. The information processing device 100 includes an acquisition unit 100A, a matching unit 100B, and a guidance unit 100C. The acquisition unit 100A acquires biometric information of a user in a procedure area where the user can select either a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure. The matching unit 100B compares the biometric information with the registered biometric information of a registered person who can use the first method, and determines whether the user is a registered person. If the matching unit 100B determines that the user is a registered person, the guidance unit 100C guides the user to a procedure location corresponding to the first method. If the matching unit 100B determines that the user is not a registered person, the guidance unit 100C generates guidance information to a procedure location corresponding to the second method.

[0093] According to this embodiment, an information processing device 100 is provided that can improve throughput in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected.

[0094] [Modified embodiment] The present invention is not limited to the above-described embodiments and can be modified as appropriate within the scope of the present invention. For example, an example in which part of the configuration of one embodiment is added to another embodiment, or an example in which part of the configuration of another embodiment is replaced with another embodiment, is also an embodiment of the present invention.

[0095] Furthermore, the configuration of the present invention can be applied not only to international flights but also to domestic flights. For domestic flights, the immigration inspection procedure and the one-to-one matching process between the passport face image and the photographed face image can be omitted. In this case, the registered biometric image can be, for example, the photographed face image taken when purchasing the boarding pass.

[0096] In the above-described embodiment, the security inspection procedure at the time of departure has been described as an example, but the procedure area to which the present invention can be applied is not limited to the security inspection area. For example, in the case of an airport facility, the present invention can also be applied to the procedure areas such as the departure inspection area, immigration inspection area, and customs inspection area.

[0097] The configuration of the present invention can also be applied to procedures other than those at airports. Specific examples of procedures include payment procedures performed for a user U who purchases a product or receives a service at a store. A similar effect can be achieved when a store has a facial recognition cash register that supports facial recognition and a manned cash register staffed by an attendant S, and the user U can choose which cash register to use. In other words, the configuration of the present invention can be applied to any processing area where the user U can select either a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure.

[0098] The management server 10 (the guidance unit 15) may guide the user to a procedure location corresponding to the attribute information of the user U associated with the registered biometric information. For example, this is effective when a priority lane is provided to give priority to the screening procedure to the user U whose attribute information meets certain conditions. Specifically, when the user information DB 11b includes attribute information such as the airline membership type (normal member / VIP member, etc.) and whether the user U is accompanied by someone who requires assistance, the user U can be guided to the priority lane based on the attribute information of the user U acquired by facial recognition.

[0099] Furthermore, in the above-described embodiment, the management server 10 is configured to guide the user U to the lane for the appropriate processing location when the user U is standing in front of the signage terminal 70, but the management server 10 may also be configured to provide guidance on a terminal other than the signage terminal 70 connected to the management server 10.

[0100] For example, when user U operates a KIOSK terminal installed in an airport, the KIOSK terminal may capture a facial image (biometric information) of user U and transmit it to management server 10, and management server 10 may determine whether the facial image is registered. If management server 10 determines that user U's facial image is registered in user information DB 11b, the KIOSK terminal may guide user U to the procedure location at each touch point. If management server 10 determines that user U's facial image is not registered in user information DB 11b, the KIOSK terminal may prompt user U to register with the face authentication system. Then, once user U's facial image is registered in user information DB 11b of management server 10, the KIOSK terminal guides user U to the procedure location under control of management server 10.

[0101] Furthermore, the camera 80 shown in FIG. 1 may be provided in the devices at each of the touch points P1 to P5 (check-in terminal 20, automated baggage drop machine 30, security inspection device 40, automated gate device 50, and boarding gate device 60).

[0102] Furthermore, the data items displayed on the touchpoint-specific inquiry screen shown in Fig. 14 are merely examples and are not limited to these. For example, the number of users (passengers) U who registered their facial images during the check-in procedure but then performed the subsequent procedure face-to-face rather than using facial recognition may also be displayed. This allows the number of users U who registered their facial images and the number of users U who actually selected facial recognition to be ascertained for each touchpoint.

[0103] Also, for each procedure, the average time at which the user U passed through may be calculated and displayed for both the face authentication method and the face-to-face method. Furthermore, the touch point passing times of all users U may be recorded and displayed for each user U.

[0104] The scope of each embodiment also includes a processing method in which a program that operates the configuration of the embodiment to realize the functions of the above-described embodiments is recorded on a storage medium, the program recorded on the storage medium is read as code, and the program is executed on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. Furthermore, not only the storage medium on which the above-described program is recorded, but also the program itself is included in each embodiment. Furthermore, one or more components included in the above-described embodiments may be circuits such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) configured to realize the functions of each component.

[0105] Examples of the storage medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disk)-ROM, a magnetic tape, a non-volatile memory card, and a ROM. Furthermore, the scope of each embodiment is not limited to programs that execute processing by themselves recorded on the storage medium, but also includes programs that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0106] The services realized by the functions of the above-described embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0107] It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from its technical concept or main features.

[0108] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0109] (Appendix 1) an acquisition unit that acquires biometric information of a user in a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure; a matching unit that matches the biometric information with registered biometric information of a registered person who can use the first method and determines whether the user is the registered person; a guidance unit that guides the user to a procedure location corresponding to the first method when the verification unit determines that the user is a registered person, and that generates guidance information to a procedure location corresponding to the second method when the verification unit determines that the user is not a registered person; An information processing device comprising:

[0110] (Appendix 2) The biometric information is a facial image. 10. The information processing device according to claim 1.

[0111] (Appendix 3) In the first method, the procedure is automatically executed based on the result of a process of matching the new biometric information of the user acquired at the procedure location with the registered biometric information. 3. The information processing device according to claim 1 or 2.

[0112] (Appendix 4) In the second method, the procedure is carried out based on a medium carried by the user in a face-to-face situation between the user and an attendant. 4. An information processing device according to any one of claims 1 to 3.

[0113] (Appendix 5) The guidance unit displays the guidance information on a display terminal. 5. An information processing device according to any one of appendices 1 to 4.

[0114] (Appendix 6) when the face image is detected from a photographed image of the procedure area, the guidance unit generates a screen that displays the guidance information superimposed on a detection area of ​​the face image in the photographed image. 3. The information processing device according to claim 2.

[0115] (Appendix 7) a counting unit that counts and outputs the number of users who have completed the procedure using the first method in the procedure area and the number of users who have completed the procedure using the second method; 7. The information processing device according to any one of Supplementary Notes 1 to 6, further comprising:

[0116] (Appendix 8) the guiding unit guides the user to the procedure location corresponding to the attribute information of the user associated with the registered biometric information. 8. An information processing device according to any one of appendices 1 to 7.

[0117] (Appendix 9) The procedures include screening procedures conducted for the user at the airport upon travel, An information processing device according to any one of appendices 1 to 8.

[0118] (Appendix 10) The screening procedures include at least one of security screening procedures, immigration screening procedures, immigration screening procedures, and customs screening procedures; 10. The information processing device according to claim 9.

[0119] (Appendix 11) The procedure includes a payment procedure carried out for the user who purchases a product or receives a service at a store. An information processing device according to any one of Supplementary Notes 1 to 10.

[0120] (Appendix 12) acquiring biometric information of a user in a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure; a step of comparing the biometric information with registered biometric information of a registered person who can use the first method and determining whether the user is the registered person; a step of guiding the user to a procedure location corresponding to the first method when it is determined that the user is a registered person, and guiding the user to a procedure location corresponding to the second method when it is determined that the user is not a registered person; An information processing method comprising:

[0121] (Appendix 13) On the computer, acquiring biometric information of a user in a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure; a step of comparing the biometric information with registered biometric information of a registered person who can use the first method and determining whether the user is the registered person; a step of guiding the user to a procedure location corresponding to the first method when it is determined that the user is a registered person, and guiding the user to a procedure location corresponding to the second method when it is determined that the user is not a registered person; A recording medium on which a program for executing the above is recorded. [Explanation of symbols]

[0122] NW...Network U, U1~U6...User S. Staff 1. Information Processing System 10. Management Server 11...Storage section 11a···Boarding reservation information DB 11b...User information DB 11c Passing history information DB 12...Information acquisition section 13. Database Management Department 14. Matching section 15...Information Department 16. Aggregation section 20. Check-in terminal 30. Self-service baggage check-in machine 40. Security inspection device 42, 52 Business terminal 50. Automated gate device 60 Boarding gate equipment 70 Signage terminal 80···Camera

Claims

1. an acquisition unit that acquires first biometric information of a user; a display unit that, when it is determined that the user is the enrolled person based on a first comparison result between the first biometric information and the enrolled biometric information of a registrant, superimposes a first guidance message in a captured image including a plurality of the users, the first guidance message directing the user to a first procedure location where the user's identity will be verified by an automated procedure, on an area of ​​the first person determined to be the enrolled person; and, when it is determined that the user is not the enrolled person, superimposes a second guidance message in the captured image, the second guidance message directing the user to a second procedure location different from the first procedure location, on an area of ​​the second person determined to not be the enrolled person. An information processing device comprising:

2. the procedure at the first procedure location is automatically executed based on the result of a process of matching the new biometric information of the user acquired at the first procedure location with the registered biometric information; The information processing device according to claim 1 .

3. when a facial image is detected from the captured image of a procedure area including the first procedure location and the second procedure location, the display unit displays a screen that superimposes the first guide information or the second guide information on a detection area of ​​the facial image in the captured image.

3. The information processing device according to claim 1.

4. The procedure in the processing area is an examination procedure conducted for the user at the airport when traveling. The information processing device according to claim 3 .

5. The inspection procedure is at least one of a security inspection procedure, an immigration inspection procedure, an immigration inspection procedure, and a customs inspection procedure; The information processing device according to claim 4 .

6. The procedure in the procedure area is a payment procedure carried out for the user who purchases a product or receives a service in the store. The information processing device according to claim 3 .

7. a step of acquiring first biometric information of a user by a computer; When the computer determines that the user is the enrolled person based on a first comparison result between the first biometric information and the enrolled biometric information of the enrolled person, the computer superimposes a first guidance message instructing the user to a first procedure location where identity verification will be performed through an automated procedure on an area of ​​the first person determined to be the enrolled person in the captured image including multiple users, and when the computer determines that the user is not the enrolled person, the computer superimposes a second guidance message instructing the user to a second procedure location different from the first procedure location on an area of ​​the second person determined to not be the enrolled person in the captured image; An information processing method comprising:

8. the procedure at the first procedure location is automatically executed based on the result of a process of matching the new biometric information of the user acquired at the first procedure location with the registered biometric information; The information processing method according to claim 7.

9. In the superimposed display step, when a face image is detected from the photographed image of a procedure area including the first procedure location and the second procedure location, the computer displays a screen in which the first guide information or the second guide information is superimposed on an area in the photographed image where the face image is detected.

9. The information processing method according to claim 7 or 8.

10. The procedure in the processing area is an examination procedure conducted for the user at the airport when traveling. The information processing method according to claim 9.

11. The inspection procedure is at least one of a security inspection procedure, an immigration inspection procedure, an immigration inspection procedure, and a customs inspection procedure; The information processing method according to claim 10.

12. The procedure in the procedure area is a payment procedure carried out for the user who purchases a product or receives a service in the store. The information processing method according to claim 9.

13. On the computer, acquiring first biometric information of a user; When it is determined that the user is the registrant based on a first comparison result between the first biometric information and the registered biometric information of the registrant, a first guidance message is displayed in a captured image including a plurality of the users, superimposed on an area of ​​the first person determined to be the registrant, instructing the user to a first procedure location where identity verification will be performed through an automated procedure; when it is determined that the user is not the registrant, a second guidance message is displayed in a captured image in a superimposed on an area of ​​the second person determined to be not the registrant, instructing the user to a second procedure location different from the first procedure location; A program to execute.

14. the procedure at the first procedure location is automatically executed based on the result of a process of matching the new biometric information of the user acquired at the first procedure location with the registered biometric information; The program according to claim 13.

15. and in the superimposed display step, when a face image is detected from the photographed image of a procedure area including the first procedure location and the second procedure location, a screen is displayed in which the first guide information or the second guide information is superimposed on an area in the photographed image where the face image is detected.

15. The program according to claim 13 or 14.

16. The procedure in the processing area is an examination procedure conducted for the user at the airport when traveling. The program according to claim 15.

17. The inspection procedure is at least one of a security inspection procedure, an immigration inspection procedure, an immigration inspection procedure, and a customs inspection procedure; The program according to claim 16.

18. The procedure in the procedure area is a payment procedure carried out for the user who purchases a product or receives a service in the store. The program according to claim 15.

Images