Information processing device, information processing method and program

Abstract

To improve a throughput in a procedure area in which a procedure system using biometric authentication or a procedure system using an authentication method other than the biometric authentication can be selected.SOLUTION: An information processing device according to the present invention includes: an acquisition unit that acquires first biometric information of a user; and a generation unit that, when the user is determined as a registrant on the basis of a first comparison result between the first biometric information and registration biometric information of the registrant, generates first guide information guiding a user to a first procedure place where personal identification is performed according to an automated procedure, the information superimposed and displayed in an area for a first person determined as the registrant in a captured image including a plurality of persons, and when the user is determined as not a registrant, generates second guide information guiding the user to a second procedure place different from the first procedure place, the information superimposed and displayed in an area for a second person determined as not a registrant in the captured image.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses a ticketless boarding system that performs procedures for passengers using biometric authentication at a plurality of checkpoints (check-in lobby, security inspection area, boarding gate, etc.). Patent Document 2 discloses a cardless payment system that executes payment processing for customers using biometric authentication at the cash register of a store.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] As exemplified in Patent Document 1 and Patent Document 2, in various fields, the automation of procedures using biometric authentication has been promoted. In the current procedure area, users often select one of the automated lanes that execute procedures using biometric authentication and the manned lanes staffed with employees to perform the procedures. However, in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected, if the user makes a mistake in selecting the procedure method, the throughput in the procedure area will decrease.

[0005] Therefore, in view of the above problems, an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that can improve the throughput in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected.

Means for Solving the Problems

[0006] According to one aspect of the present invention, an acquisition unit that acquires first biometric information of a user, and based on a first collation result between the first biometric information and registered biometric information of a registrant, when it is determined that the user is the registrant, a display unit that superimposes and displays first guidance information for guiding the user to a first procedure location for identity confirmation by an automated procedure on a region of a person determined to be the registrant in a captured image including a plurality of users, and when it is determined that the user is not the registrant, displays second guidance information for guiding the user to a second procedure location different from the first procedure location on a region of a person determined not to be the registrant in the captured image, and an information processing apparatus is provided.

[0007] According to another aspect of the present invention, an information processing method is provided, in which a computer acquires first biometric information of a user, and based on a first collation result between the first biometric information and registered biometric information of a registrant, when it is determined that the user is the registrant, the computer superimposes and displays first guidance information for guiding the user to a first procedure location for identity confirmation by an automated procedure on a region of a person determined to be the registrant in a captured image including a plurality of users, and when it is determined that the user is not the registrant, the computer displays second guidance information for guiding the user to a second procedure location different from the first procedure location on a region of a person determined not to be the registrant in the captured image.

[0008] According to still another aspect of the present invention, a computer is caused to execute steps of: obtaining first biometric information of a user; and based on a first collation result between the first biometric information and registered biometric information of a registrant, when it is determined that the user is the registrant, superimposing and displaying first guidance information for guiding the user to a first procedure location for performing identity verification by an automated procedure on a region of a person determined to be the registrant in a captured image including a plurality of users, and when it is determined that the user is not the registrant, displaying second guidance information for guiding the user to a second procedure location different from the first procedure location on a region of a person determined not to be the registrant in the captured image. A program for causing the computer to execute the above steps is provided.

Advantages of the Invention

[0009] According to the present invention, it is possible to provide an information processing apparatus, an information processing method, and a program capable of improving throughput in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Embodiments for Carrying Out the Invention

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements or corresponding elements are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0012] <First Embodiment> FIG. 1 is a schematic diagram showing an example of the overall configuration of the information processing system 1 according to the present embodiment. The information processing system 1 according to the present embodiment is, for example, a computer system that supports a series of procedures performed in the first country and the second country for a user (traveler) U who plans to leave the first country from the airport DA in the first country by airplane and fly to the second country. The information processing system 1 is operated, for example, by a public agency such as an immigration control authority or a contractor who has received a business commission from such an agency. For the sake of convenience of explanation, only the devices in the first country are shown, but it can also be applied to the procedures in the second country.

[0013] As shown in FIG. 1, the information processing system 1 includes a management server 10, a check-in terminal 20, an automatic baggage storage device 30, a security inspection device 40, an automated gate device 50, a boarding gate device 60, business terminals 42 and 52, a signage terminal 70, and a camera 80. The management server 10 and the other devices are respectively connected via a network NW. The network NW is composed of a LAN (Local Area Network), a WAN (Wide Area Network), a mobile communication network, etc. The connection method is not limited to a wired method and may also be a wireless method.

[0014] The management server 10 is an information processing device that manages various review procedures when the user U enters or exits the country. The management server 10 is installed, for example, in a facility of an airport company or an airline company that operates the airport DA. Note that the management server 10 does not necessarily have to be a single server and may be configured as a server group including a plurality of servers. For example, a server that undertakes some functions of the management server 10 may be installed in the first country, and another server that undertakes the remaining functions of the management server 10 may be installed in the second country.

[0015] As shown in FIG. 1, the management server 10 includes a storage unit 11, an information acquisition unit 12, a database management unit 13, a collation unit 14, a guidance unit 15, and a totaling unit 16.

[0016] The storage unit 11 stores information used in each part of the management server 10. The storage unit 11 includes, for example, a boarding reservation information DB 11a, a user information DB 11b, and a passing history information DB 11c.

[0017] The boarding reservation information DB 11a is a database that aggregates and stores the boarding reservation information respectively transmitted from the reservation systems (not shown) of the airline companies.

[0018] FIG. 2 is a diagram showing an example of information stored in the boarding reservation information DB 11a. The boarding reservation information DB 11a has data items such as a reservation number, a flight number, an airline code, a passenger name, a departure location, a destination, an operation date, a seat number, a nationality, a passport number, a surname, a first name, a date of birth, and a gender. Note that these data items are just examples, and it may further include other data items. The reservation number is an identifier that uniquely identifies the boarding reservation information. The airline code is an identifier that uniquely identifies the airline company.

[0019] The user information DB 11b is a database that stores information about the user U who has completed the check-in procedure.

[0020] FIG. 3 is a diagram showing an example of information stored in the user information DB 11b. The user information DB 11b has data items such as a user ID, a registered face image, feature amounts, a passenger name, a reservation number, a departure location, a destination, an operation date, an airline code, a flight number, a seat number, a nationality, a passport number, a surname, a first name, a date of birth, a gender, and procedure statuses (P1) to (P5). Note that these data items are just examples, and it may further include other data items.

[0021] The user ID is an identifier that uniquely identifies the user U. In this embodiment, it is assumed that the user ID is issued on the condition that the collation result between the face image of the user U holding the passport in the check-in procedure and the passport face image read from the passport is a collation match. In this embodiment, the phrase "collation match" means that the collation score indicating the similarity between the biometric information of the user U and the registered biometric information of the registrant is equal to or higher than a predetermined threshold value. Also, the phrase "collation mismatch" means that the collation score is less than the predetermined threshold value.

[0022] The registered face image is a face image registered for the user U. In the present embodiment, the registered face image is registered during the check-in procedure. The registered face image may be registered in the first procedure among a series of procedures performed when leaving the country. It is preferable that the registered face image is registered based on the consent of the user U and deleted at a predetermined timing. The feature amount is a value extracted from biometric information (registered face image).

[0023] In the present embodiment, the registered face image is registered on the condition that the collation result of the face image of the user U holding the passport taken in the first procedure (check-in procedure) and the passport face image read from the passport is a collation match, similar to the user ID.

[0024] Also, as the registered face image, the face image taken in the first procedure at the destination is used. The reason is that the face image taken in the first procedure is newer than the passport face image, and the quality (appearance) is closer to the passport face image than the image taken in the subsequent authentication process. However, instead of the target face image (captured face image), the passport face image may be set as the registered face image (registered biometric information).

[0025] The management server 10 performs identity verification on whether the user U is a person holding a proper boarding pass by collating the face image (biometric information) captured by the automatic baggage deposit machine 30, the security inspection device 40, the automated gate device 50, the boarding gate device 60, and the signage terminal 70 with the registered face image stored in the user information DB 11b, respectively. Details will be described later.

[0026] Note that the term biometric information in the present embodiment means a face image and a feature amount extracted from the face image, but the biometric information is not limited to the face image and the face feature amount. That is, biometric authentication may be performed using an iris image, a fingerprint image, a palmprint image, an auricle image, etc. as the biometric information of the user U.

[0027] The user information shown in FIG. 3 includes the boarding reservation information shown in FIG. 2. The boarding reservation information of user U is obtained from recording media such as a passport and a boarding pass during the check-in procedure, and is registered in the user information DB11b for each user ID. The user information DB11b and the boarding reservation information DB11a are associated by an airline code and a reservation number.

[0028] The passage history information DB11c is a database that stores the passage history of user U at the location (checkpoint) of a series of procedures performed at the time of departure.

[0029] FIG. 4 is a diagram showing an example of the information stored in the passage history information DB11c. The passage history information DB11c has user ID, passage time, device name, business system type, passage touch point, and procedure method as data items. The passage time is a timestamp when user U passes through the touch point. The device name is the name of the business terminal used for the procedure at the touch point. The business system type is the type of the business system to which the business terminal belongs.

[0030] The procedure method is the method of the procedure selected by user U at each touch point. Examples of the procedure method include a face recognition method, an in-person method, a self-service form, WEB, etc., but the selectable procedure method varies depending on the touch point. The user information DB11b and the passage history information DB11c are associated by a user ID.

[0031] The information acquisition unit 12 acquires information from the devices at each touch point P1 to P5. The database management unit 13 performs registration processing, update processing, and search processing on the databases in the storage unit 11.

[0032] The verification unit 14 executes verification processing of the biometric information of user U acquired at the signage terminal 70 and the registered biometric information registered in the user information DB11b, and outputs the verification result.

[0033] When the user U is determined to be a registered user in the verification unit 14, the case internal unit 15 guides the user U to the procedure location corresponding to the first method (biometric authentication method). When the user U is determined not to be a registered user, the case internal unit 15 generates guidance information to the procedure location corresponding to the second method (authentication method other than biometric authentication). Hereinafter, in the present embodiment, a procedure location that automatically executes a procedure using face authentication (biometric authentication) is called a face authentication lane, and a location where a procedure is executed in a face-to-face format with the staff member S is called a manned lane.

[0034] In the first method, the procedure is automatically executed based on the result of the collation process between the new biometric information of the user acquired at the procedure location and the registered biometric information. In the second method, the procedure is executed based on the medium carried by the user U in a state where the user U and the staff member S face each other. As the medium, a passport, a boarding pass, etc. are used.

[0035] The aggregation unit 16 aggregates and outputs the number of users who have completed the procedure using the first method and the number of users who have completed the procedure using the second method in the procedure area, respectively.

[0036] The check-in terminal 20 is installed in the check-in lobby or check-in counter in the airport DA of the first country (departure country). Hereinafter, the procedure area where the check-in terminal 20 is installed is referred to as "touch point P1". The check-in terminal 20 is a self-service terminal for the user U to perform the check-in procedure (boarding procedure) by operating it himself / herself. After the user U completes the check-in procedure at the touch point P1, the user U moves to the place for checking in luggage or the security inspection area.

[0037] The automatic baggage deposit machine 30 is installed in the adjacent area of the baggage counter in the airport DA or in the vicinity of the check-in terminal 20. Hereinafter, the procedure area where the automatic baggage deposit machine 30 is installed is referred to as the "touch point P2". The automatic baggage deposit machine 30 is a self-service terminal for performing the procedure of depositing baggage that cannot or should not be carried into the passenger cabin by the user U operating it himself / herself. When the user U completes the baggage deposit procedure, he / she moves to the security inspection area. In the case of a user U who has no baggage to deposit, the procedure at the touch point P2 is omitted.

[0038] The security inspection device 40 is installed in the security inspection area (hereinafter referred to as the "touch point P3") in the airport DA. In this embodiment, the term "security inspection device" is used in the sense that it includes all of a metal detector for checking whether the user U is carrying metals that can be dangerous goods by a metal detector, an X-ray inspection device for checking the presence or absence of dangerous goods in checked baggage, etc. using X-rays, a passage control device for determining whether the user U can pass through at the entrance and exit of the security inspection area, etc. When the user U completes the security inspection procedure by the security inspection device 40 at the touch point P3, he / she moves to the departure inspection area. The service terminal 42 is installed at the manned counter in the security inspection area. The attendant S uses the service terminal 42 to perform the security inspection procedure for the user U.

[0039] Also, the procedure locations (inspection locations) in the security inspection area are provided in a plurality of lanes respectively. The user U selects a lane from among the plurality of lanes and undergoes an inspection. At the entrance of each lane, a procedure for verifying the identity of the user U is performed before the body inspection and baggage inspection.

[0040] The automated gate device 50 is installed at the departure inspection area (hereinafter referred to as "touchpoint P4") within the airport DA. The automated gate device 50 is a device that automatically performs the departure inspection procedures for the user U. When the user U completes the departure inspection procedures at the touchpoint P4, the user U moves to the departure area where duty-free shops and boarding gates are provided. The operation terminal 52 is installed at the manned counter in the departure inspection area. The staff member S uses the operation terminal 52 to perform the departure inspection procedures for the user U.

[0041] The boarding gate device 60 is installed for each boarding gate (hereinafter referred to as "touchpoint P5") in the departure area. The boarding gate device 60 is an access control device that confirms that the user U is a passenger of the aircraft that can board from the boarding gate. When the user U completes the identity verification procedures at the touchpoint P5, the user U boards the aircraft and departs for the second country.

[0042] The operation terminals 42 and 52 are terminals used by the staff members S of the airline company and the airport facilities respectively for the operations at each touchpoint. The operation terminals 42 and 52 are, for example, personal computers, tablet terminals, smartphones, etc. In this embodiment, for the sake of convenience of explanation, only the operation terminals 42 and 52 at the touchpoints P3 and P4 are shown in the figure, but operation terminals can be similarly installed at other touchpoints.

[0043] The signage terminal 70 is installed at the security inspection area (touchpoint P3) and the departure inspection area (touchpoint P4). The signage terminal 70 is a display terminal that displays on the screen information for guiding the user U to the procedure location according to the display control from the management server 10. The signage terminal 70 requests the management server 10 to perform a one-to-N comparison between the face image of the user U captured by taking a picture of the user U standing in front of the terminal and the registered face image stored in the user information DB 11b by sequentially transmitting the face image to the management server 10.

[0044] The camera 80 is, for example, a digital camera and is installed at each touch point P1 to P5. The camera 80 is attached to, for example, the ceiling, wall, pillar, etc. so that it can photograph the face or the whole body of the user U. The type of the camera 80 may be either a fixed type or a movable type. The camera 80 sequentially transmits the photographed images to the management server 10. The management server 10 can use the photographed images for purposes such as face authentication of the user U and monitoring within the airport DA.

[0045] FIG. 5 is a block diagram showing an example of the hardware configuration of the management server 10. As shown in FIG. 5, the management server 10 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, a storage 104, a communication I / F (Interface) 105, a display device 106, and an input device 107 as a computer that performs calculation, control, and storage. Each device is interconnected via a bus, wiring, a driving device, etc.

[0046] The CPU 101 is a processor that performs a predetermined operation according to a program stored in the ROM 103 or the storage 104 and has a function of controlling each part of the management server 10. The RAM 102 is composed of a volatile memory medium and provides a temporary memory area necessary for the operation of the CPU 101.

[0047] The ROM 103 is composed of a non-volatile memory medium and stores necessary information such as a program used for the operation of the management server 10. The storage 104 is composed of a non-volatile memory medium and stores the operation program and data of the management server 10. The storage 104 is composed of, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0048] The communication I / F 105 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), 4G, etc., and is a module for communicating with other devices.

[0049] The display device 106 is a liquid crystal display, an OLED (Organic Light Emitting Diode) display, etc. that display videos, still images, characters, etc., and is used to present information to the user.

[0050] The input device 107 is a keyboard, a pointing device, buttons, etc., and accepts operations by the user. The display device 106 and the input device 107 may be integrally formed as a touch panel.

[0051] FIG. 6 is a block diagram showing an example of the hardware configuration of the signage terminal 70. The signage terminal 70 includes a CPU 701, a RAM 702, a ROM 703, a storage 704, a communication I / F 705, a display device 706, an input device 707, and a biometric information acquisition device 708.

[0052] The biometric information acquisition device 708 is a device that acquires a face image of the user U as the biometric information of the user U. The biometric information acquisition device 708 is, for example, a digital camera that photographs the face of the user U standing in front of the signage terminal 70, and photographs the face of the user U to acquire the face image.

[0053] Note that the hardware configurations shown in FIGS. 5 and 6 are examples, and devices other than these may be added, or some devices may not be provided. Also, some devices may be replaced with other devices having similar functions. Further, some functions of the present embodiment may be provided by other devices via the network NW, and the functions of the present embodiment may be realized by being distributed among a plurality of devices. Thus, the hardware configurations shown in FIGS. 5 and 6 can be appropriately changed.

[0054] FIG. 7 is a layout diagram showing an example of the installation location of the signage terminal 70 in the security inspection area. Here, the case where the signage terminal 70 is installed between the face recognition lane L1 and the face-to-face lane L2 where a manned counter is provided in the passage of the security inspection area (touch point P3) is shown. The face recognition lane L1 is a procedure location corresponding to the face recognition method (first method). The face recognition lane L1 includes an automated lane using face recognition. The face-to-face lane L2 is a procedure location corresponding to an authentication method other than face recognition (second method).

[0055] The user U selects one of the face recognition lane L1 and the face-to-face lane L2 to undergo security inspection. At the entrances of the face recognition lane L1 and the face-to-face lane L2, the procedure for verifying the identity of the user U is performed. The identity verification is performed by face recognition in the case of the face recognition lane L1, and in the case of the face-to-face lane L2, it is performed by the user U presenting a medium such as a passport to the staff member S. When the identity verification is completed, a physical examination and a baggage inspection are performed on the user U.

[0056] When the user U is identified by biometric verification in the management server 10, the signage terminal 70 displays a screen guiding the user U to the face recognition lane L1. Conversely, when the user U is not identified by biometric verification in the management server 10, the signage terminal 70 displays a screen guiding the user U to the face-to-face lane L2.

[0057] Subsequently, with reference to the drawings, the operation of the information processing system 1 in the present embodiment will be described.

[0058] [Guidance on Procedure Location for User] FIG. 8 is a sequence chart showing an example of the processing between the management server 10 and the signage terminal 70 in the information processing system 1. This processing is executed when the user U enters the procedure area. In FIG. 8, the case where the user U enters the security inspection area is described as an example.

[0059] First, the signage terminal 70 uses the biometric information acquisition device 708 to constantly or periodically photograph in front of the device, and determines whether the face of the user U is detected in the photographed image (step S101). The signage terminal 70 waits until the face of the user U is detected in the image by the biometric information acquisition device 708 (step S101, NO).

[0060] When the signage terminal 70 determines that the face of the user U is detected by the biometric information acquisition device 708 (step S101, YES), it photographs the face of the user U and acquires the face image of the user U as the target face image (step S102).

[0061] Next, the signage terminal 70 transmits the target face image of the user U captured by the biometric information acquisition device 708 to the management server 10 via the network NW together with the collation request (step S103). Thereby, the signage terminal 70 requests the management server 10 to collate the target face image of the user U captured by the biometric information acquisition device 708 with a plurality of registered face images registered in the user information DB11b of the management server 10 in a 1:N manner.

[0062] Next, when the management server 10 receives the target face image and the collation request from the signage terminal 70, it collates the target face image with a plurality of registered face images registered in the user information DB11b in a 1:N manner (step S104).

[0063] Next, the management server 10 determines whether the collation result between the target face image and the registered face image is a collation match (step S105). That is, the management server 10 determines whether there is a registered face image of a registrant who is authenticated as the same person as the user.

[0064] Here, when the management server 10 determines that the collation result between the target face image and the registered face image is a collation match (step S105, YES), the process proceeds to step S106.

[0065] On the other hand, when it is determined that the matching result between the target face image and the registered face image does not match (step S105, NO), the process proceeds to step S107.

[0066] In step S106, the management server 10 transmits guidance information to the signage terminal 70 to the face authentication lane.

[0067] On the other hand, in step S107, the management server 10 transmits guidance information to the signage terminal 70 to the face-to-face lane.

[0068] In step S108, when the signage terminal 70 receives the guidance information from the management server 10, it displays this on the screen on the display device 706 and ends the process.

[0069] FIGS. 9 to 11 are diagrams showing an example of the screen displayed by the signage terminal 70. In FIG. 9, the face image of the user U1, a message guiding the user U1 to the face authentication lane ("The face image of the customer is registered in the authentication system. Please proceed to the face authentication lane and undergo the security inspection procedure."), and an arrow A1 indicating the direction of the face authentication lane are displayed.

[0070] The message in FIG. 9 is displayed when the matching result between the face image of the user U1 captured by the signage terminal 70 and the registered face image of the registered person registered in the user information DB11b matches (that is, when the management server 10 determines that the user U1 is a registered person).

[0071] In FIG. 10, the face image of the user U2, a message guiding the user U2 to the face-to-face lane where the staff member S is located ("The face image of the customer is not registered in the face authentication system. Please proceed to the face-to-face lane and undergo the security inspection procedure."), and an arrow A2 indicating the direction of the face-to-face lane are displayed.

[0072] The message in Fig. 10 is displayed when the collation result between the face image of user U2 taken by the signage terminal 70 and the registered face image of the registrant registered in the user information DB11b is a collation mismatch (that is, when the management server 10 determines that user U2 is not the registrant).

[0073] Further, when a face image is detected from the captured image of the procedure area, the management server 10 (guide unit 15) may generate a screen for superimposing and displaying guide information on the detection area of the face image in the captured image.

[0074] In Fig. 11, a plurality of users U3 to U6 are included in the screen, and arrows A3 to A6 indicating the procedure location for each person are superimposed and displayed on the detection areas of the face images of users U3 to U6 respectively. In the cases of Fig. 10 and Fig. 11, guide information was output for each user U. In contrast, in the case of Fig. 11, there is an advantage that guide information can be provided to a plurality of people simultaneously.

[0075] [Inquiry processing of procedure status] Fig. 12 is a sequence chart showing an example of the processing between the management server 10 and the business terminal 42 in the information processing system 1. This processing is executed when the staff member S inquires about the procedure status of each user U in the airport. In Fig. 12, the case of using the business terminal 42 is described as an example, but the same applies to the case of the business terminal 52 and other business terminals (not shown).

[0076] First, the business terminal 42 determines whether a request for inquiring about the procedure status of user U has been made from the staff member S (step S201). Here, when the business terminal 42 determines that a request for inquiring about the procedure status has been made (step S201, YES), the processing proceeds to step S202.

[0077] On the contrary, when the business terminal 42 determines that a request for inquiring about the procedure status has not been made (step S201, NO), the standby state is maintained.

[0078] In step S202, the business terminal 42 obtains query conditions based on the input operation of the staff member S. Next, the business terminal 42 sends a query request to the management server 10 (step S203).

[0079] Next, when the management server 10 receives a query request from the business terminal 42, it determines whether the query request is a query in list form (step S204). Here, when the management server 10 determines that the query request is a query in list form (step S204, YES), the process proceeds to step S205.

[0080] On the contrary, when it is determined that the query request is not a query in list form (step S204, NO), the process proceeds to step S207.

[0081] In step S205, the management server 10 searches the user information DB11b and the passage history information DB11c. Through the search, the management server 10 combines the user information and the passage history information for each user ID, and generates screen data of a procedure status list screen that represents the procedure status of each user U in list form (step S206). Then, the process proceeds to step S210.

[0082] In step S207, the boarding reservation information DB11a is searched. Through the search, the management server 10 can obtain the number of boarding reservation information for the current day.

[0083] Next, the management server 10 searches the user information DB11b and the passage history information DB11c, and aggregates the total number of users U who have performed procedures at each touch point and the number of users U for each procedure method (step S208).

[0084] Next, the management server 10 generates screen data of a touch point-specific query screen (step S209). Then, the process proceeds to step S210.

[0085] In step S210, the management server 10 transmits the screen data generated in step S206 or step S209 to the business terminal 42.

[0086] Then, when the business terminal 42 receives the screen data from the management server 10, it displays an inquiry screen based on the screen data (step S211) and ends the process.

[0087] FIG. 13 and FIG. 14 are diagrams showing an example of the screen displayed on the business terminal 42. In FIG. 13, a procedure status list screen is shown that displays, in a list format, the user information acquired from the user information DB 11b, the passage history information for each touch point and the procedure method acquired from the passage history information DB 11c. For example, user U with user ID 10101 is a person with a registered face image and has performed check-in procedure (P1), checked baggage deposit procedure (P2), security inspection procedure (P3), departure inspection procedure (P4), and boarding an aircraft (P5) using automatic and face authentication.

[0088] Also, user U with user ID 10102 is a person without a registered face image. The check-in procedure (P1) is automatically performed by the check-in terminal 20, and the checked baggage deposit procedure (P2) and the security inspection procedure (P3) are performed in a face-to-face manner at a counter where staff member S is present.

[0089] And user U with user ID 10103 is a person with a registered face image and has performed the check-in procedure (P1) and the checked baggage deposit procedure (P2) using automatic and face authentication. However, this user U (user ID: 10103) is performing the security inspection procedure (P3) in a face-to-face manner. Thus, according to the screen shown in FIG. 13, it is possible to easily grasp the progress status of the procedures of user U and the procedure methods at each touch point.

[0090] In FIG. 14, a touch point-specific inquiry screen is shown that totals and displays, for each touch point, the number of people who have not completed the procedure, the number of people who have completed the procedure, and the number of people who have used each procedure method in the procedure. For example, in the security inspection procedure, out of the people who have completed the check-in procedure, 30 people have not yet undergone the security inspection procedure. Also, out of the 100 people who have completed the security inspection procedure, it is shown that 60 people used the face authentication method and the remaining 40 people used the in-person method.

[0091] As described above, the information processing system 1 (management server 10) of the present embodiment collates the face image (biometric information) acquired from the user U with a plurality of registered face images (registered biometric information) registered in the user information DB 11b, and guides the user U to a procedure location corresponding to the first method (biometric authentication method) or the second method (in-person method) based on the collation result. Thereby, it is possible to suppress a decrease in throughput in a procedure area where a procedure method such as face authentication or a procedure method other than face authentication can be selected.

[0092] <Second Embodiment> FIG. 15 is a functional block diagram of the information processing apparatus 100 in the present embodiment. The information processing apparatus 100 includes an acquisition unit 100A, a collation unit 100B, and a guidance unit 100C. The acquisition unit 100A acquires the biometric information of the user in a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure. The collation unit 100B collates the biometric information with the registered biometric information of the registrants who can use the first method, and determines whether the user is a registrant. When it is determined in the collation unit 100B that the user is a registrant, the guidance unit 100C guides the user to a procedure location corresponding to the first method, and when it is determined that the user is not a registrant, generates guidance information to a procedure location corresponding to the second method.

[0093] According to the present embodiment, there is provided an information processing apparatus 100 that can improve the throughput in a procedure area where a procedure method using biometric authentication or a procedure method using an authentication method other than biometric authentication can be selected.

[0094] [Modification Embodiment] The present invention is not limited to the above-described embodiments and can be appropriately modified without departing from the gist of the present invention. For example, an example in which a part of the configuration of any one of the embodiments is added to another embodiment, or an example in which a part of the configuration of another embodiment is replaced, is also an embodiment of the present invention.

[0095] In addition, the configuration of the present invention can be applied not only to international lines but also to domestic lines. In the case of domestic lines, in addition to the departure inspection procedure, the one-to-one matching process between the travel document face image and the photographed face image may be omitted. In this case, as the registered biometric image, for example, the photographed face image at the time of purchasing a boarding pass may be registered.

[0096] In the above-described embodiments, the security inspection procedure at the time of departure has been described as an example, but the procedure area to which the present invention can be applied is not limited to the security inspection area. For example, in the case of an airport facility, it can also be applied to procedure areas such as the departure inspection area, the arrival inspection area, and the customs inspection area.

[0097] In addition, the configuration of the present invention can be applied to procedures other than those at airports. Specific examples of the procedure include a settlement procedure performed on a user U who purchases a product or receives a service at a store. When there is a face recognition cash register corresponding to face recognition and a manned cash register staffed by an employee S in the store, and the user U can select which cash register to use, the same effect can be obtained. That is, the configuration of the present invention can be applied to any procedure area where the user U can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure.

[0098] The management server 10 (guide unit 15) may guide the user to the procedure location corresponding to the attribute information of the user U associated with the registered biometric information. For example, this is effective when a priority lane is provided for preferentially performing a review procedure for a user U whose attribute information satisfies a specific condition. Specifically, in the user information DB 11b, when attribute information such as the membership classification of an airline company (ordinary member / VIP member, etc.) or the presence or absence of a companion who requires assistance for the user U is included, the user U can be guided to the priority lane based on the attribute information of the user U obtained by face authentication.

[0099] Also, in the above-described embodiment, the management server 10 has been described as being configured to guide the user U to an appropriate procedure location lane when the user U stands in front of the signage terminal 70. However, it may be configured to be able to guide at a terminal other than the signage terminal 70 connected to the management server 10.

[0100] For example, when the user U operates a KIOSK terminal installed in the airport, the KIOSK terminal may capture a face image (biometric information) of the user U and transmit it to the management server 10, and the management server 10 may determine whether the face image is registered. When the management server 10 determines that the face image of the user U is registered in the user information DB 11b, the KIOSK terminal guides the procedure location at each touch point. Also, when the management server 10 determines that the face image of the user U is not registered in the user information DB 11b, the KIOSK terminal prompts registration to the face authentication system. Then, when the face image of the user U is registered in the user information DB 11b of the management server 10, the KIOSK terminal guides the procedure location to the user U based on the control from the management server 10.

[0101] Also, the camera 80 shown in FIG. 1 may be provided in the devices (check-in terminal 20, automatic baggage deposit machine 30, security inspection device 40, automated gate device 50, boarding gate device 60) at each touch point P1 to P5.

[0102] In addition, the data items displayed on the touch point-by-touch point inquiry screen shown in FIG. 14 are just an example and are not limited thereto. For example, even though a face image has been registered in the check-in procedure, the number of users (passengers) U who have carried out the procedure in a face-to-face manner instead of the face authentication method in subsequent procedures may be further displayed. Thereby, the number of users U who have registered a face image and the number of users U who have actually selected the face authentication method can be grasped for each touch point.

[0103] Also, for each procedure, the average value of the times when the user U has passed through may be calculated and displayed for each of the face authentication method and the face-to-face method. Furthermore, the touch point passing times of all users U may be recorded and configured so as to be displayable for each user U.

[0104] A program for operating the configuration of the above-described embodiment so as to realize the functions of the above-described embodiment is recorded on a storage medium, the program recorded on the storage medium is read out as code, and a processing method for executing the program on a computer is also included in the scope of each embodiment. That is, a computer-readable storage medium is also included in the scope of each embodiment. In addition, not only the storage medium on which the above-described program is recorded but also the program itself are included in each embodiment. Further, one or two or more constituent elements included in the above-described embodiment may be circuits such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) configured to realize the functions of each constituent element.

[0105] As the storage medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disk)-ROM, a magnetic tape, a non-volatile memory card, or a ROM can be used. Also, not only those that execute processing with the program recorded on the storage medium alone, but also those that operate on an OS (Operating System) and execute processing in cooperation with the functions of other software and expansion boards are included in the scope of each embodiment.

[0106] The services realized by the functions of the above-described embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0107] It should be noted that the above-mentioned embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0108] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0109] (Appendix 1) an acquisition unit that acquires biometric information of a user in a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use biometric authentication for the procedure; a matching unit that matches the biometric information with registered biometric information of a registered person who can use the first method and determines whether the user is the registered person; a guidance unit that guides the user to a procedure location corresponding to the first method when the verification unit determines that the user is a registered person, and generates guidance information to a procedure location corresponding to the second method when the verification unit determines that the user is not a registered person; An information processing device comprising:

[0110] (Appendix 2) The biometric information is a face image. 2. An information processing device according to claim 1.

[0111] (Appendix 3) In the first method, the procedure is automatically executed based on a result of a matching process between the new biometric information of the user acquired at the procedure location and the registered biometric information. 3. The information processing device according to claim 1 or 2.

[0112] (Appendix 4) In the second method, the procedure is executed based on a medium carried by the user in a state where the user and the staff member are face to face. The information processing apparatus according to any one of Appendices 1 to 3.

[0113] (Appendix 5) The guiding unit causes the guiding information to be displayed on a display terminal. The information processing apparatus according to any one of Appendices 1 to 4.

[0114] (Appendix 6) When the face image is detected from a captured image of the procedure area, the guiding unit generates a screen for superimposing and displaying the guiding information on the detection area of the face image in the captured image. The information processing apparatus according to Appendix 2.

[0115] (Appendix 7) A totaling unit that totals and outputs the number of users who have completed the procedure using the first method and the number of users who have completed the procedure using the second method in the procedure area. The information processing apparatus according to any one of Appendices 1 to 6, further comprising the same.

[0116] (Appendix 8) The guiding unit guides the user to the procedure location corresponding to the attribute information of the user associated with the registered biometric information. The information processing apparatus according to any one of Appendices 1 to 7.

[0117] (Appendix 9) The procedure includes a screening procedure performed on the user at the airport during departure. The information processing apparatus according to any one of Appendices 1 to 8.

[0118] (Appendix 10) The screening procedure includes at least one of a security screening procedure, a departure screening procedure, an immigration screening procedure, and a customs inspection procedure. The information processing apparatus according to Appendix 9.

[0119] (Appendix 11) The procedure includes a settlement procedure performed on the user who purchases a product or receives a service at a store. The information processing apparatus according to any one of Appendices 1 to 10.

[0120] (Appendix 12) In a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use the biometric authentication for the procedure, obtaining the user's biometric information; Comparing the biometric information with the registered biometric information of a registrant who can use the first method, and determining whether the user is the registrant; When it is determined that the user is the registrant, guiding the user to a procedure location corresponding to the first method, and when it is determined that the user is not the registrant, guiding the user to a procedure location corresponding to the second method; An information processing method comprising:

[0121] (Appendix 13) Causing a computer to In a procedure area where the user can select a first method that uses biometric authentication for the procedure or a second method that does not use the biometric authentication for the procedure, obtaining the user's biometric information; Comparing the biometric information with the registered biometric information of a registrant who can use the first method, and determining whether the user is the registrant; When it is determined that the user is the registrant, guiding the user to a procedure location corresponding to the first method, and when it is determined that the user is not the registrant, guiding the user to a procedure location corresponding to the second method; A recording medium having recorded thereon a program for causing the above to be executed.

Explanation of Reference Numerals

[0122] NW ··· Network U, U1 to U6 ··· Users S... Staff member 1... Information processing system 10... Management server 11... Memory unit 11a... Boarding reservation information DB 11b... User information DB 11c... Passage history information DB 12... Information acquisition unit 13... Database management unit 14... Verification unit 15... Guidance unit 16... Aggregation unit 20... Check-in terminal 30... Automatic baggage deposit machine 40... Security inspection device 42, 52... Business terminals 50... Automated gate device 60... Boarding gate device 70... Signage terminal 80... Camera

Claims

1. An acquisition unit that acquires first biometric information of a user; Based on a first verification result between the first biometric information and the registered biometric information of a registrant, when it is determined that the user is the registrant, information that guides the user to a first procedure location for identity verification by an automated procedure, and the first guidance information is superimposed on the area of the first person determined to be the registrant in a captured image including a plurality of the users, and when it is determined that the user is not the registrant, information that guides the user to a second procedure location different from the first procedure location, and the second guidance information is superimposed on the area of the second person determined not to be the registrant in the captured image, a generation unit that generates; An information processing apparatus comprising:

2. When a face image is detected from the captured image that captures a procedure area including the first procedure location and the second procedure location, the generation unit generates a screen that superimposes the first guidance information or the second guidance information on the detected area of the face image in the captured image. The information processing apparatus according to Claim 1.

3. A counting unit that counts and outputs the number of users who have completed the identity verification by the automated procedure in the procedure area; The information processing apparatus according to Claim 2, further comprising:

4. A step in which a computer acquires first biometric information of a user; Based on a first verification result between the first biometric information and the registered biometric information of a registrant, when it is determined that the user is the registrant, information that guides the user to a first procedure location for identity verification by an automated procedure, and the first guidance information is superimposed on the area of the first person determined to be the registrant in a captured image including a plurality of the users, and when it is determined that the user is not the registrant, information that guides the user to a second procedure location different from the first procedure location, and the second guidance information is superimposed on the area of the second person determined not to be the registrant in the captured image, a step of generating; An information processing method comprising:

5. In the step of generating, when a face image is detected from the captured image that captures a procedure area including the first procedure location and the second procedure location, the computer generates a screen that superimposes the first guidance information or the second guidance information on the detected area of the face image in the captured image. The information processing method according to claim 4.

6. The step of totaling and outputting the number of users who have completed the identity verification by the automated procedure in the procedure area. The information processing method according to claim 5, further comprising the above.

7. In a computer, The step of acquiring the first biometric information of the user; Based on the first verification result between the first biometric information and the registered biometric information of the registrant, when it is determined that the user is the registrant, the first procedure location for performing identity verification by an automated procedure is provided to the user. Generating first guidance information that is superimposed on the area of the first person determined to be the registrant in a captured image including a plurality of the users, and when it is determined that the user is not the registrant, a second procedure location different from the first procedure location is provided to the user. Generating second guidance information that is superimposed on the area of the second person determined not to be the registrant in the captured image; A program for causing the above to be executed.

8. In the generating step, when a face image is detected from the captured image that has captured the procedure area including the first procedure location and the second procedure location, a screen is generated in which the first guidance information or the second guidance information is superimposed on the detected area of the face image in the captured image. The program according to claim 7.

9. The step of totaling and outputting the number of users who have completed the identity verification by the automated procedure in the procedure area. The program according to claim 8, further comprising the above.

Images