Information processing device, information processing method, and recording medium

Abstract

The present invention provides an information processing device, an information processing method, and a recording medium. [Solution] The information processing device includes an image acquisition means for acquiring a first image that includes a predetermined area through which multiple persons to be authenticated pass; an information acquisition means for acquiring the location of a terminal device held by a user; and a determination means for determining the priority of notifying multiple authentication results of face authentication performed using the first image, based on the location of the terminal device and the locations of multiple persons to be authenticated detected based on the first image.

Description

Technical Field

[0001] This disclosure relates to the technical fields of information processing apparatuses, information processing methods, and recording media.

Background Art

[0002] For example, based on the result of comparing a face image acquired from a user with a plurality of registered face images registered in a database, a device that guides the user to a face authentication lane for performing personal identification by face authentication or a face-to-face lane for performing personal identification by face-to-face has been proposed (see Patent Document 1). In addition, Patent Documents 2 to 4 are cited as prior art documents related to this disclosure.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Summary of the Invention

Problems to be Solved by the Invention

[0004] This disclosure aims to provide an information processing apparatus, an information processing method, and a recording medium for improving the technologies described in the prior art documents.

Means for Solving the Problems

[0005] One embodiment of the information processing device includes: an image acquisition means for acquiring a first image that includes a predetermined area through which multiple persons to be authenticated pass; an information acquisition means for acquiring the location of a terminal device held by a user; and a determination means for determining the priority of notifying multiple authentication results of face authentication performed using the first image, based on the location of the terminal device and the locations of the multiple persons to be authenticated detected based on the first image.

[0006] One aspect of the information processing method involves acquiring a first image that includes a predetermined area through which multiple persons to be authenticated pass, acquiring the location of a terminal device held by a user, and determining the priority for notifying multiple authentication results of facial authentication performed using the first image, based on the location of the terminal device and the locations of the multiple persons to be authenticated detected based on the first image.

[0007] One embodiment of a recording medium contains a computer program that causes a computer to execute an information processing method that causes the computer to acquire a first image including a predetermined area through which multiple persons to be authenticated pass, acquire the location of a terminal device held by a user, and determine the priority for notifying multiple authentication results of facial authentication performed using the first image, based on the location of the terminal device and the locations of the multiple persons to be authenticated detected based on the first image. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an example of the configuration of an information processing device. [Figure 2] This is a block diagram showing an example of an airport system configuration. [Figure 3] This is a floor plan showing an example of a floor where airport boarding gates are located. [Figure 4] This is a plan view showing an example of a virtual authentication area. [Figure 5] This is a block diagram showing another example of the configuration of an information processing device. [Figure 6] This figure shows an example of a face database included in an information processing device. [Figure 7] This is a diagram illustrating the passenger tracking process. [Figure 8] It is a diagram showing an example of an ID correspondence table. [Figure 9] It is a diagram showing an example of an image. [Figure 10] It is a flowchart showing the tracking and authentication operations according to the second embodiment. [Figure 11] It is a flowchart showing the determination operation according to the second embodiment. [Figure 12] It is a diagram showing an example of a screen displayed on the terminal device. [Figure 13] It is a block diagram showing an example of the configuration of the authentication device. [Figure 14] It is a diagram showing another example of a screen displayed on the terminal device. [Figure 15] It is a diagram showing another example of a screen displayed on the terminal device. [Figure 16] It is a diagram showing another example of a screen displayed on the terminal device. [Figure 17] It is a diagram showing another example of a screen displayed on the terminal device. [Figure 18] It is a diagram showing another example of a screen displayed on the terminal device. [Figure 19] It is a block diagram showing an example of the configuration of the terminal device.

Embodiments for Carrying Out the Invention

[0009] Embodiments related to an information processing apparatus, an information processing method, and a recording medium will be described.

[0010] <First Embodiment> The first embodiment of an information processing apparatus, an information processing method, and a recording medium will be described with reference to FIG. 1. Hereinafter, the first embodiment of an information processing apparatus, an information processing method, and a recording medium will be described using the information processing apparatus 1. In FIG. 1, the information processing apparatus 1 includes an image acquisition unit 11, an information acquisition unit 12, and a determination unit 13.

[0011] The image acquisition unit 11 acquires an image that includes a predetermined region. Here, the predetermined region is an area through which multiple authenticated individuals pass. Therefore, the image acquired by the image acquisition unit 11 may include one or more authenticated individuals passing through the predetermined region.

[0012] The information acquisition unit 12 acquires the location of the terminal device held by the user. The terminal device is configured to notify the user of at least a portion of the authentication result of facial recognition performed using the image acquired by the image acquisition unit 11. The user may be a different person from the multiple people being authenticated. The user may be at least one of the traffic controller and / or security guard.

[0013] The determination unit 13 determines the priority for notifying multiple authentication results corresponding to each of the multiple authenticated persons, based on the location of the terminal device and the locations of the multiple authenticated persons. Here, the multiple authentication results are the authentication results of face recognition performed using images acquired by the image acquisition unit 11. For example, if the distance between one authenticated person and the terminal device is shorter than the distance between another authenticated person and the terminal device, the determination unit 13 may set the priority of the authentication result for one authenticated person higher than the priority of the authentication results for the other authenticated persons.

[0014] The terminal device can notify the user (e.g., at least one of the traffic controller and security guard) of at least a portion of the facial recognition authentication results. The terminal device may display at least a portion of the facial recognition authentication results based on priority. For example, the terminal device may display higher-priority authentication results at the top of the screen than lower-priority authentication results. In other words, the terminal device may determine (or change) the display order of the authentication results based on priority. In other words, the terminal device may change the displayed content based on priority.

[0015] Users are often located near terminal devices. Therefore, the location of the terminal device can be interpreted as the user's location. However, it is difficult for a user to handle all of multiple authenticated individuals. By determining the priority of authentication results based on the terminal device location and the location of the authenticated individuals, and changing the display content of the terminal device based on the priority, the number of authenticated individuals that a user must handle can be reduced.

[0016] When a user interacts with an authenticated person, the time required to interact with an authenticated person located far from the user is likely to be longer than the time required to interact with an authenticated person located near the user. According to the information processing device 1, the priority of the authentication result is determined based on the location of the terminal device and the locations of multiple authenticated persons (for example, authenticated persons closer to the terminal device will have a higher priority than authenticated persons further away from the terminal device), so it is expected that the user will be able to interact with authenticated persons efficiently.

[0017] For example, a facial recognition gate device may allow passage for people whose facial recognition is successful, but not for those whose facial recognition fails. The facial recognition gate device may determine that facial recognition is successful if the face of the person attempting to pass through the gate device matches the face shown in a pre-registered facial image. In other words, the facial recognition gate device may determine that facial recognition is successful if there is a person among those whose facial images are pre-registered who matches the person attempting to pass through the gate device.

[0018] Therefore, if a person's facial image is not registered when attempting to pass through a facial recognition gate, the gate will not allow that person to pass (for example, if the facial recognition gate is a flap-type gate, the flap will close). As a result, if a person whose facial image is not registered enters the facial recognition gate, they will not be allowed to pass, which disrupts the flow of people passing through the gate. In other words, the throughput of the facial recognition gate decreases.

[0019] For example, the authentication result of facial recognition performed using the image acquired by the image acquisition unit 11 may indicate whether or not the person to be authenticated can pass through the facial recognition gate device. In this case, the determination unit 13 may determine the priority of the authentication results based on the location of the terminal device and the locations of multiple people to be authenticated, so that authentication results indicating that the person cannot pass through the facial recognition gate device are notified to the user first.

[0020] With this configuration, users (for example, at least one of the guides and security guards) can prioritize assisting individuals who cannot pass through the facial recognition gate device. As a result, it is possible to prevent individuals who cannot pass through the facial recognition gate device from entering the device. Therefore, the information processing device 1 can suppress a decrease in the throughput of the facial recognition gate device.

[0021] In the information processing device 1, the image acquisition unit 11 may acquire an image that includes a predetermined area through which multiple persons to be authenticated pass. The information acquisition unit 12 may acquire the location of a terminal device held by the user. The determination unit 13 may determine the priority of multiple authentication results of face authentication performed using the image, based on the location of the terminal device and the locations of multiple persons to be authenticated detected based on the image.

[0022] Such an information processing device 1 may be implemented, for example, by a computer reading a computer program recorded on a recording medium. In this case, the recording medium contains a computer program that causes the computer to execute an information processing method that acquires an image including a predetermined area through which multiple persons to be authenticated pass, acquires the location of a terminal device held by the user, and determines the priority for notifying multiple authentication results of facial recognition performed using an image, based on the location of the terminal device and the locations of multiple persons to be authenticated detected based on the image.

[0023] <Second Embodiment> A second embodiment of the display control device, display control method, and recording medium will be described with reference to Figures 2 to 12. In the following description, the second embodiment of the information processing device, information processing method, and recording medium will be described using an information processing device 3 used at an airport.

[0024] First, the airport system 2 of the airport will be explained with reference to Figure 2. In Figure 2, the airport system 2 comprises a management server 21, check-in terminals 22, and multiple gate devices installed at boarding gates. The management server 21, check-in terminals 22, and multiple gate devices are connected to each other via a network NW.

[0025] Furthermore, the airport system 2 may have other check-in terminals in addition to check-in terminal 22. In other words, the airport system 2 may have multiple check-in terminals. Furthermore, the network NW may be a wide area network (WAN) such as the internet, or a local area network (LAN).

[0026] Multiple gate devices include a facial recognition function that performs facial recognition processing, a facial recognition gate device 23 that determines whether a passenger is allowed to pass based on the result of the facial recognition processing, and a gate device 24 that determines whether a passenger is allowed to pass based on the ticket held by the passenger. Gate device 24 will henceforth be referred to as "normal gate device 24" as appropriate. As shown in Figure 3, the airport is assumed to have boarding gates G1, G2, and G3. The facial recognition gate device 23 and the normal gate device 24 are assumed to be installed at boarding gate G1.

[0027] Furthermore, "airline ticket" may mean at least one of a paper airline ticket and / or an electronic airline ticket. In addition to or instead of at least one of a paper airline ticket and / or an electronic airline ticket, "airline ticket" may also be a concept that includes information indicating personal information associated with the electronic airline ticket (e.g., passport, credit card used to purchase the ticket, etc.).

[0028] The management server 21 has a face database 211 (hereinafter referred to as "face DB211"), a flight operation database 212 (hereinafter referred to as "flight DB212"), and a gate database 213 (hereinafter referred to as "gate DB213").

[0029] Face DB211 contains facial images used for facial recognition processing. Face DB211 may also contain feature quantities related to facial images, either in place of or in addition to the facial images themselves. Flight DB212 contains aircraft flight information (so-called flight information). Flight information may include the aircraft's flight number, gate identification information (e.g., boarding gate number) to identify the boarding gate, and boarding start time. The aircraft's flight number, identification information, and boarding start time may be associated with each other.

[0030] Gate DB213 contains multiple boarding gate information entries, each corresponding to a different boarding gate. Note that the entity managing and operating Airport System 2 may be different from the airport company that manages and operates the airport, and the airline that operates the aircraft. In this case, the multiple boarding gate information entries in Gate DB213 may be obtained from the systems of at least one of the airport company and the airline. Gate DB213 may be shared between Airport System 2 and the systems of at least one of the airport company and the airline.

[0031] The boarding gate information may include gate identification information (e.g., boarding gate number) for identifying the boarding gate and device information relating to the installed gate equipment. The device information may include the number of gate equipment, and information indicating at least one of the following: type, operating state, and installation location of each gate equipment. Here, the type of gate equipment may include a first type capable of facial recognition and a second type that is not capable of facial recognition. The second type of gate equipment may include gate equipment capable of reading information indicating passenger identification (e.g., ID) (e.g., a two-dimensional barcode). The operating state of the gate equipment may include an operating state in which the gate equipment is operational and a dormant state in which the gate equipment is idle (i.e., not operational). The installation location of the gate equipment may be expressed as the relative positional relationship of two or more gate equipment when two or more gate equipment is installed at one boarding gate. Alternatively, the installation location of the gate equipment may be expressed as the coordinates of each gate equipment in a coordinate system relating to the floor where the airport boarding gates are located (the so-called departure floor). Furthermore, if only one gate device is installed at a single boarding gate, the device information does not need to include the installation location of the gate device. Furthermore, the idle state may include a state in which no power is supplied to the gate device (e.g., power OFF state) and a state in which power is supplied to a part of the gate device, but the gate device is unable to perform its function (so-called standby state). Furthermore, the multiple boarding gate information registered in Gate DB213 may be predetermined according to at least one of the airline and the aircraft flight. The multiple boarding gate information registered in Gate DB213 may be automatically updated according to the aircraft departure time, etc.

[0032] The check-in terminal 22 is a terminal used for boarding procedures (i.e., check-in). The check-in terminal 22 may be operated by airport staff or by passengers (i.e., the check-in terminal 22 may be a so-called self-check-in machine). Note that "airport staff" is a concept that includes not only people belonging to the airport company that manages and operates the airport, but also people belonging to airlines that operate aircraft, etc., who work at the airport.

[0033] The check-in terminal 22 processes passenger boarding procedures based on the passenger's ticket. The check-in terminal 22 may acquire a facial image of the passenger during the boarding process. The check-in terminal 22 may acquire a facial image of the passenger by taking a picture of the passenger with a camera, or by reading the facial photograph printed on the passenger's passport. The check-in terminal 22 is not required to acquire facial images of all passengers.

[0034] The check-in terminal 22 transmits passenger information (e.g., name and flight number) and a facial image of the passenger who has completed the boarding procedure to the management server 21. The check-in terminal 22 may also obtain the above passenger information from the information written on the ticket (in other words, the information associated with the ticket).

[0035] The management server 21 associates the passenger information and facial image transmitted from the check-in terminal 22 with each other and registers them in the facial database 211. At this time, the management server 21 may also attach passenger identification information to the passenger information and facial image to identify the passenger. As will be described later, the facial image is used for facial authentication processing. For this reason, the passenger identification information attached to the passenger information and facial image will be referred to as the "authentication ID" from now on. In addition to the check-in terminal 22, the passenger's facial image may also be obtained by an application installed on a terminal device (e.g., a smartphone) carried by the passenger (e.g., an application provided by the airline), or by a gate device installed in the airport's departure immigration area.

[0036] The management server 21 may, based on the current time, identify the flight number of an aircraft that departs a first predetermined time (for example, several minutes to 10 minutes) prior to the boarding start time from the flight information registered in the flight DB 212. Based on the gate identification information associated with the identified flight number, the management server 21 may extract gate information corresponding to the gate identification information from a plurality of gate information registered in the gate DB 213. Based on the extracted gate information, the management server 21 may determine whether or not a facial recognition gate device (for example, facial recognition gate device 23) is installed at the boarding gate corresponding to the extracted gate information.

[0037] If it is determined that a facial recognition gate device (for example, facial recognition gate device 23) is installed, the management server 21 may extract facial images from the face DB 211 that are associated with passenger information including the identified flight number (in other words, passengers scheduled to board the aircraft with the identified flight number). The management server 21 may transmit the extracted facial images to the facial recognition gate device (for example, facial recognition gate device 23) identified by the extracted gate information. If it is determined that no facial recognition gate device is installed, the management server 21 does not have to perform these processes. If it is determined that a facial recognition gate device is installed, the management server 21 may determine whether the installed facial recognition gate device is operational based on the extracted gate information. If feature quantities related to facial images are registered in the face DB 211, the management server 21 may transmit the feature quantities related to facial images to the facial recognition gate device in place of or in addition to the facial images.

[0038] The facial recognition gate device 23 includes a camera 231, a facial database 232 (hereinafter referred to as "Face DB232"), and a facial recognition device 233. Face DB232 stores facial images transmitted from the management server 21. The facial recognition gate device 23 may also have a display device 234. The display device 234 may display at least one of the images captured by the camera 231 and information indicating the results of the facial recognition process.

[0039] The facial recognition device 233 performs facial recognition processing using the image captured by the camera 231 (for example, an image showing the passenger's face) and the facial image registered in the facial database 232. If facial recognition is successful, the facial recognition gate device 23 allows the passenger to pass through. On the other hand, if facial recognition fails, the facial recognition gate device 23 does not allow the passenger to pass through. Various existing methods (for example, at least one of two-dimensional (2D) authentication methods and three-dimensional (3D) authentication methods) can be applied to the facial recognition processing.

[0040] A specific example of facial recognition processing in the facial recognition gate device 23 will be described. The facial recognition gate device 23 may be a flap-type gate device. The facial recognition device 233 may extract feature quantities from the image captured by the camera 231. The facial recognition device 233 may compare the extracted feature quantities with the feature quantities related to the facial image registered in the face DB 232. At this time, the facial recognition device 233 may calculate a matching score (or similarity score) based on the extracted feature quantities and the feature quantities related to the facial image registered in the face DB 232. If the matching score is above a threshold (i.e., facial recognition is successful), the facial recognition device 233 may allow the passenger to pass through. At this time, the facial recognition device 233 may identify the authentication ID related to the passenger. In this case, the facial recognition gate device 23 may open the flap. If the matching score is below a threshold (i.e., facial recognition fails), the facial recognition device 233 does not need to allow the passenger to pass through. In this case, the facial recognition gate device 23 may keep its flap closed. Furthermore, the face DB 232 may contain feature quantities related to the facial image, either in place of or in addition to the facial image itself.

[0041] Furthermore, another device (for example, a management server 21) different from the facial recognition gate device 23 may perform part of the facial recognition processing. In this case, the facial recognition device 233 of the facial recognition gate device 23 may extract feature quantities from the image captured by the camera 231. The facial recognition device 233 may transmit the extracted feature quantities to the other device. The other device may compare the feature quantities transmitted from the facial recognition device 233 with the feature quantities related to the facial image registered in the face database (for example, face DB 211). The other device may transmit information indicating the comparison result (for example, information indicating whether the comparison score is above a threshold) to the facial recognition gate device 23. Furthermore, if the comparison score is above a threshold, the other device may include the authentication ID related to the passenger in the information indicating the comparison result. If the information indicating the comparison result indicates that the comparison score is above a threshold, the facial recognition device 233 may allow the passenger to pass. If the information indicating the comparison result indicates that the comparison score is below a threshold, the facial recognition device 233 does not have to allow the passenger to pass.

[0042] The facial recognition gate device 23 is expected to allow passengers to pass through faster than the conventional gate device 24. In other words, the number of passengers passing through the facial recognition gate device 23 in a given period is expected to be greater than the number of passengers passing through the conventional gate device 24. In short, the facial recognition gate device 23 can improve throughput at boarding gates.

[0043] However, as mentioned above, only passengers who have successfully undergone facial recognition are allowed to pass through the facial recognition gate device 23. For a passenger to successfully undergo facial recognition at the facial recognition gate device 23, their facial image must be registered in the facial database 232 of the facial recognition gate device 23. If a passenger whose facial image is not registered in the facial database 232 attempts to enter the facial recognition gate device 23, their passage will not be permitted, resulting in a decrease in throughput at the boarding gate.

[0044] To address this problem, one possible approach is to identify (so-called screen) passengers who are unable to pass through the facial recognition gate device 23 before they enter the gate.

[0045] In view of the above problems, the information processing device 3 determines whether a passenger can pass through the facial recognition gate device 23 before the passenger enters the facial recognition gate device 23. In other words, the information processing device 3 determines whether a passenger can pass through the facial recognition gate device 23 independently of the facial recognition gate device 23.

[0046] As shown in Figure 4, a virtual authentication area RA is provided around boarding gate G1, where the facial recognition gate device 23 and the normal gate device 24 are installed. The authentication area RA is an area through which multiple passengers passing towards either the facial recognition gate device 23 or the normal gate device 24 pass. The authentication area RA corresponds to an example of the "predetermined area" in the first embodiment described above.

[0047] Furthermore, airport staff (for example, at least one of a traffic controller and a security guard) A1 and A2 are stationed around boarding gate G1. Staff A1 possesses terminal device 41. Staff A2 possesses terminal device 42. As shown in Figure 2, terminal devices 41 and 42 are connected to the information processing device 3 via a network NW. Note that "possession" is not limited to "wearing on one's person". For example, even if staff A1 has taken terminal device 41 away from them, if they substantially control terminal device 41, it may be interpreted that staff A1 possesses terminal device 41. Note that terminal devices 41 and 42 may consist of a tablet terminal, a smartphone, and AR (Augmented Reality) glasses. Note that staff A1 and A2 correspond to the "users" in the first embodiment described above. Note that at least one of terminal devices 41 and 42 may constitute part of the airport system 2. In other words, the airport system 2 may include at least one of terminal devices 41 and 42. In addition to terminal devices 41 and 42, there may be other terminal devices. In other words, there may be three or more terminal devices.

[0048] The camera CAM is positioned to capture images of the authentication area RA. The camera CAM may be connected to the information processing device 3 via a network NW. The camera CAM does not need to be positioned so that its field of view includes the entire authentication area RA. In other words, the camera CAM may be positioned to capture images of at least a portion of the authentication area RA. The camera CAM may be positioned in a location that does not obstruct the passage of passengers (for example, higher than the passengers' heads). As described later, the images captured by the camera CAM may be used for facial recognition processing. For this reason, the camera CAM may be a high-resolution camera, such as a 4K resolution camera. The camera CAM does not need to be connected to the information processing device 3 via a network NW. In this case, the camera CAM may be connected to the information processing device 3 via a cable (for example, a USB (Universal Serial Bus) cable).

[0049] The camera CAM may generate a first image, which includes the authentication area RA, by capturing an image of the authentication area RA. The first image may also correspond to a single frame of a video.

[0050] The information processing device 3 performs facial recognition processing using the first image generated when the camera CAM captures the authentication area RA, and determines whether the passenger included in the first image is eligible to pass through the facial recognition gate device 23 before entering the gate device 23. The information processing device 3 will be described in detail below.

[0051] As shown in Figure 5, the information processing device 3 comprises an arithmetic unit 31, a storage device 32, and a communication device 33. The information processing device 3 may also include an input device 34 and an output device 35. The information processing device 3 may also include a face database 36 (hereinafter referred to as "face DB36"). However, the information processing device 3 does not need to include at least one of the input device 34 and the output device 35. In the information processing device 3, the arithmetic unit 31, storage device 32, communication device 33, input device 34, output device 35, and face DB36 may be connected via a data bus 37. The information processing device 3 is connected to the management server 21 via the communication device 33 and a network NW. The information processing device 3 may also constitute a part of the airport system 2. In other words, the airport system 2 may include the information processing device 3.

[0052] The computing device 31 may include, for example, at least one of the following: a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0053] The storage device 32 may include, for example, at least one of RAM (Random Access Memory), ROM (Read Only Memory), a hard disk drive, a magneto-optical disk drive, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 32 may include a non-temporary recording medium. The storage device 32 is capable of storing desired data. For example, the storage device 32 may temporarily store a computer program executed by the arithmetic unit 31. The storage device 32 may temporarily store data that the arithmetic unit 31 temporarily uses when the arithmetic unit 31 is executing a computer program.

[0054] The communication device 33 can communicate with the management server 21 via the network NW. The communication device 33 may also communicate with devices outside the information processing device 3 other than the management server 21 via the network NW. The communication device 33 may use either wired or wireless communication.

[0055] The input device 34 is a device capable of receiving information input to the information processing device 3 from an external source. It may include an operating device (e.g., a keyboard, mouse, touch panel, etc.) that can be operated by the operator of the information processing device 3. The input device 34 may include a recording medium reader capable of reading information recorded on a recording medium that can be attached to or detached from the information processing device 3, such as a USB memory stick. When information is input to the information processing device 3 via the communication device 33 (in other words, when the airport system 2 acquires information via the communication device 33), the communication device 33 may function as an input device.

[0056] The output device 35 is a device capable of outputting information to the outside of the information processing device 3. The output device 35 may output visual information such as characters and images, auditory information such as sounds, or tactile information such as vibrations. The output device 35 may include, for example, at least one of a display, speaker, printer, and vibration motor. The output device 35 may also be capable of outputting information to a recording medium that can be attached to or detached from the information processing device 3, such as a USB memory stick. When the information processing device 3 outputs information via the communication device 33, the communication device 33 may function as an output device.

[0057] The arithmetic unit 31 may have an image acquisition unit 311, an information acquisition unit 312, a tracking unit 313, a face recognition unit 314, and a determination unit 315, either as logically implemented functional blocks or as physically implemented processing circuits. At least one of the image acquisition unit 311, information acquisition unit 312, tracking unit 313, tracking unit 313, face recognition unit 314, and determination unit 315 may be implemented in a form that combines a logical functional block and a physical processing circuit (i.e., hardware). If at least a part of the image acquisition unit 311, information acquisition unit 312, tracking unit 313, tracking unit 313, face recognition unit 314, and determination unit 315 is a functional block, at least a part of the image acquisition unit 311, information acquisition unit 312, tracking unit 313, tracking unit 313, face recognition unit 314, and determination unit 315 may be implemented by the arithmetic unit 31 executing a predetermined computer program.

[0058] The arithmetic unit 31 may obtain (in other words, read) the predetermined computer program from the storage device 32. The arithmetic unit 31 may also read the predetermined computer program stored on a computer-readable and non-temporary recording medium using a recording medium reader (not shown) provided by the information processing device 3. The arithmetic unit 31 may also obtain (in other words, download or read) the predetermined computer program from an external device (not shown) of the information processing device 3 via the communication device 33. At least one of the following may be used as the recording medium for recording the predetermined computer program executed by the arithmetic unit 31: an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program.

[0059] The management server 21 transmits at least a portion of the facial images registered in the facial DB 211, along with the authentication ID (i.e., passenger identification information) assigned to the facial images, to the information processing device 3. In this case, the management server 21 may also transmit gate identification information and boarding start time to the information processing device 3 in addition to the facial images. The management server 21 may identify the gate identification information and boarding start time based on the flight number of the aircraft included in the passenger information associated with the facial images registered in the facial DB 211 and the flight information registered in the flight DB 212. In other words, the management server 21 may identify the gate identification information and boarding start time related to the aircraft on which the passenger indicated by the facial image is boarding. Furthermore, if the facial DB 211 has feature quantities related to facial images registered in place of or in addition to the facial images, the management server 21 may transmit the feature quantities related to facial images to the information processing device 3 in place of or in addition to the facial images.

[0060] The information processing device 3 registers the face image transmitted from the management server 21 in the face database 36. In addition to the face image, the information processing device 3 may also register gate identification information and boarding start time in the face database 36. As shown in Figure 6, the face database 36 may include (i) multiple face images and (ii) a table that associates authentication ID, gate identification information (e.g., boarding gate number), boarding start time, and face image with each other. The management server 21 may transmit at least a portion of the face images registered in the face database 211 to the information processing device 3 at predetermined intervals. The information processing device 3 may update the face images registered in the face database 36 each time a face image is transmitted from the management server 21. If the management server 21 transmits feature quantities related to the face image to the information processing device 3 in place of or in addition to the face image, the face database 36 may also register feature quantities related to the face image in place of or in addition to the face image.

[0061] The image acquisition unit 311 of the arithmetic unit 31 may acquire one or more first images generated by the camera CAM via the communication device 33. The image acquisition unit 311 may store the acquired one or more first images in the storage device 32. The information acquisition unit 312 of the arithmetic unit 31 acquires boarding gate information related to boarding gate G1 from the gate DB 213 of the management server 21 via the communication device 33. The information acquisition unit 312 may store the acquired boarding gate information in the storage device 32.

[0062] The information acquisition unit 312 of the arithmetic unit 31 acquires terminal location information indicating the positions of terminal devices 41 and 42, respectively. The information acquisition unit 312 may acquire terminal location information from terminal devices 41 and 42, respectively. In this case, the position of terminal device 41 may be detected by the location information function of terminal device 41. Similarly, the position of terminal device 42 may be detected by the location information function of terminal device 42.

[0063] The tracking unit 313 of the computing unit 31 tracks one or more passengers passing through the authentication area RA using multiple first images acquired by the image acquisition unit 311 (i.e., multiple first images generated by the camera CAM). The facial recognition unit 314 of the computing unit 31 performs facial recognition processing on one or more passengers passing through the authentication area RA using multiple first images acquired by the image acquisition unit 311.

[0064] The case in which the tracking unit 313 performs tracking processing for passenger P1 passing through the authentication area RA shown in Figure 4, and the facial recognition unit 314 performs facial recognition processing for passenger P1, will be explained with reference to Figure 7. Note that since passenger P1 is also the subject of facial recognition processing, they may also be referred to as the authenticated person.

[0065] As shown in Figure 7, images IMG1, IMG2, and IMG3 are images that include passenger P1 (in other words, images in which passenger P1 is visible). Image IMG1 is an image generated at time t1 when camera CAM captures the authentication area RA. Image IMG2 is an image generated at time t2, which is later than time t1, when camera CAM captures the authentication area RA. Image IMG3 is an image generated at time t3, which is later than time t2, when camera CAM captures the authentication area RA.

[0066] Images IMG1, IMG2, and IMG3 may each correspond to a single frame of a video. In this case, image IMG2 does not have to correspond to the frame immediately following the frame corresponding to image IMG1. That is, image IMG2 may correspond to a frame two or more frames later than the frame corresponding to image IMG1. Similarly, image IMG3 does not have to correspond to the frame immediately following the frame corresponding to image IMG2. That is, image IMG3 may correspond to a frame two or more frames later than the frame corresponding to image IMG2.

[0067] The tracking unit 313 detects the head of passenger P1 contained in image IMG1. Note that the method for detecting a person's head from an image is based on existing technology, so a detailed explanation is omitted. Based on the detected head of passenger P1, the tracking unit 313 sets the region containing the head of passenger P1 as the tracking region TA1.

[0068] When a tracking area TA1 is set, the tracking unit 313 sets a tracking ID, which is identification information for identifying the passenger P1 related to the tracking area TA1, to the passenger P1. The tracking unit 313 calculates the position of passenger P1 based on the tracking area TA1. Note that existing technology can be applied to the method of calculating the position of an object contained in an image, so a detailed explanation of that will be omitted. The tracking unit 313 may associate the tracking ID with the position of passenger P1 and register it in the ID correspondence table 321 stored in the storage device 32.

[0069] If a tracking area TA1 is set, the tracking unit 313 may determine whether or not the passenger P1's face is captured in the tracking area TA1. In other words, the tracking unit 313 may perform face detection on the tracking area TA1. If it is determined that the passenger P1's face is captured in the tracking area TA1, the tracking unit 313 generates a face image that includes the passenger P1's face area. The tracking unit 313 associates the generated face image with the tracking ID related to passenger P1 and transmits it to the face authentication unit 314. If it is determined that the passenger P1's face is not captured in the tracking area TA1, the tracking unit 313 does not need to generate a face image.

[0070] The face recognition unit 314 performs face recognition processing using the face image transmitted from the tracking unit 313 and the face images registered in the face database 36. The face recognition unit 314 may extract feature quantities from the face image transmitted from the tracking unit 313. The face recognition unit 314 may compare the feature quantities from the face image transmitted from the tracking unit 313 with the feature quantities related to the face images registered in the face database 36. At this time, the face recognition unit 314 may calculate a matching score (or similarity score) based on the extracted feature quantities and the feature quantities related to the face images registered in the face database 36. The face recognition unit 314 may compare the matching score with a threshold. If the matching score is equal to or greater than the threshold, the face recognition unit 314 may determine that the face indicated by the face image transmitted from the tracking unit 313 corresponds to the face indicated by one of the face images registered in the face database 36. If the matching score is below the threshold, it may be determined that no face image corresponding to the face indicated by the face image transmitted from the tracking unit 313 is registered in the face database 36.

[0071] If the face indicated by the face image transmitted from the tracking unit 313 corresponds to the face indicated by one of the face images registered in the face DB 36 (in other words, if face authentication is successful), the face authentication unit 314 associates the authentication ID associated with the one face image with the tracking ID associated with the face image transmitted from the tracking unit 313 and registers it in the ID correspondence table 321. In addition to the authentication ID, the face authentication unit 314 may also register the authentication time, which is the time when the face authentication process was performed, in the ID correspondence table 321.

[0072] If no face image corresponding to the face shown by the face image transmitted from the tracking unit 313 is registered in the face DB 36 (in other words, if face authentication fails), the face authentication unit 314 may register information indicating that there is no matching person (for example, "N / A (Not Applicable)") in the ID correspondence table 321, associating it with the tracking ID associated with the face image transmitted from the tracking unit 313.

[0073] In this case, the face recognition unit 314 may register failure reason information indicating the reason why face recognition failed in the ID correspondence table 321. The reason for face recognition failure may include a first reason indicating that face recognition failed because the image (e.g., face image) is unsuitable for face recognition, and a second reason indicating that face recognition failed despite the image (e.g., face image) being suitable for face recognition. Images unsuitable for face recognition may include images in which the passenger's face region included in the face image is unsuitable for face recognition because the passenger's face (e.g., passenger P1) is facing downwards or to the side, or part of the face is hidden by an obstruction; passenger face images that are unusual (in other words, different from the face shown by the face images registered in the face DB 36) (e.g., face images that include at least one of a beard, glasses, and a mask); and images that are out of focus or blurry. The second reason for face recognition failure occurs when the face image showing the face of the passenger to be processed for face recognition (e.g., passenger P1) is not registered in the face DB 36.

[0074] The tracking unit 313 may use image IMG2 and image IMG1 to identify passenger P1 contained in image IMG2. Identifying passenger P1 contained in image IMG2 is equivalent to matching passenger P1 contained in image IMG1 with passenger P1 contained in image IMG2. For this reason, at least one of the matching method and the optical flow method related to matching between images can be applied to identify passenger P1 contained in image IMG2. Since various existing forms can be applied to the matching method and the optical flow method, a detailed explanation thereof will be omitted.

[0075] If passenger P1 included in image IMG2 is identified, the tracking unit 313 detects the head of passenger P1. Based on the detected head of passenger P1, the tracking unit 313 sets the area including the head of passenger P1 as tracking area TA2. Since passenger P1 included in image IMG1 and passenger P1 included in image IMG2 are the same passenger, the tracking ID of passenger P1 related to tracking area TA2 is the same as the tracking ID of passenger P1 related to tracking area TA1. Based on tracking area TA2, the tracking unit 313 calculates the position of passenger P1.

[0076] The tracking unit 313 registers the location of passenger P1 in the ID correspondence table 321, associating it with the tracking ID related to passenger P1. In this case, the ID correspondence table 321 already contains the location of passenger P1 calculated based on the tracking area TA1, so the location of passenger P1 is updated when the tracking unit 313 registers the location of passenger P1 calculated based on the tracking area TA2 in the ID correspondence table 321.

[0077] If a tracking area TA2 is set, the tracking unit 313 may determine whether or not the passenger P1's face is captured in the tracking area TA2. In other words, the tracking unit 313 may perform face detection on the tracking area TA2. If it is determined that the passenger P1's face is captured in the tracking area TA2, the tracking unit 313 generates a face image that includes the passenger P1's face area. The tracking unit 313 associates the generated face image with the tracking ID related to passenger P1 and transmits it to the face authentication unit 314. If it is determined that the passenger P1's face is not captured in the tracking area TA2, the tracking unit 313 does not need to generate a face image. Even if it is determined that the passenger P1's face is captured in the tracking area TA2, if the tracking ID related to passenger P1 and the authentication ID are associated in the ID correspondence table 321 (i.e., face authentication has already been successful), the tracking unit 313 does not need to generate a face image.

[0078] The facial recognition unit 314 performs facial recognition processing using the facial image transmitted from the tracking unit 313 and the facial images registered in the face database 36. If the face indicated by the facial image transmitted from the tracking unit 313 corresponds to the face indicated by one of the facial images registered in the face database 36 (in other words, if facial recognition is successful), the facial recognition unit 314 registers the authentication ID associated with the one facial image in the ID correspondence table 321, associating it with the tracking ID associated with the facial image transmitted from the tracking unit 313. In addition to the authentication ID, the facial recognition unit 314 may also register the authentication time, which is the time when the facial recognition processing was performed, in the ID correspondence table 321. If the authentication time is already registered in the ID correspondence table 321 (i.e., if facial recognition has been successful in the past), the facial recognition unit 314 may update the authentication time registered in the ID correspondence table 321.

[0079] If no face image corresponding to the face shown by the face image transmitted from the tracking unit 313 is registered in the face database 36 (in other words, if face authentication fails), the face authentication unit 314 may register information indicating that there is no matching person in the ID correspondence table 321, associating it with the tracking ID associated with the face image transmitted from the tracking unit 313. In this case, the face authentication unit 314 may also register failure reason information indicating the reason why face authentication failed in the ID correspondence table 321.

[0080] The tracking unit 313 may use image IMG3 and image IMG2 to identify passenger P1 included in image IMG3. If passenger P1 included in image IMG3 is identified, the tracking unit 313 detects the head of passenger P1. Based on the detected head of passenger P1, the tracking unit 313 sets the region including the head of passenger P1 as tracking region TA3. Since passenger P1 included in image IMG2 and passenger P1 included in image IMG3 are the same passenger, the tracking ID of passenger P1 related to tracking region TA3 is the same as the tracking ID of passenger P1 related to tracking region TA2. Based on tracking region TA3, the tracking unit 313 calculates the position of passenger P1.

[0081] The tracking unit 313 registers the location of passenger P1 in the ID correspondence table 321, associating it with the tracking ID related to passenger P1. In this case, the ID correspondence table 321 already contains the location of passenger P1 calculated based on the tracking area TA2, so the tracking unit 313 updates the location of passenger P1 by registering the location of passenger P1 calculated based on the tracking area TA3 in the ID correspondence table 321.

[0082] If a tracking area TA3 is set, the tracking unit 313 may determine whether or not the passenger P1's face is captured in the tracking area TA3. In other words, the tracking unit 313 may perform face detection on the tracking area TA3. If it is determined that the passenger P1's face is captured in the tracking area TA3, the tracking unit 313 generates a face image that includes the passenger P1's face area. The tracking unit 313 associates the generated face image with the tracking ID related to passenger P1 and transmits it to the face authentication unit 314. If it is determined that the passenger P1's face is not captured in the tracking area TA3, the tracking unit 313 does not need to generate a face image. Even if it is determined that the passenger P1's face is captured in the tracking area TA3, if the tracking ID related to passenger P1 and the authentication ID are associated in the ID correspondence table 321 (i.e., face authentication has already been successful), the tracking unit 313 does not need to generate a face image.

[0083] The facial recognition unit 314 performs facial recognition processing using the facial image transmitted from the tracking unit 313 and the facial images registered in the face database 36. If the face indicated by the facial image transmitted from the tracking unit 313 corresponds to the face indicated by one of the facial images registered in the face database 36 (in other words, if facial recognition is successful), the facial recognition unit 314 registers the authentication ID associated with the one facial image in the ID correspondence table 321, associating it with the tracking ID associated with the facial image transmitted from the tracking unit 313. In addition to the authentication ID, the facial recognition unit 314 may also register the authentication time, which is the time when the facial recognition processing was performed, in the ID correspondence table 321. If the authentication time is already registered in the ID correspondence table 321 (i.e., if facial recognition has been successful in the past), the facial recognition unit 314 may update the authentication time registered in the ID correspondence table 321.

[0084] If no face image corresponding to the face shown by the face image transmitted from the tracking unit 313 is registered in the face database 36 (in other words, if face authentication fails), the face authentication unit 314 may register information indicating that there is no matching person in the ID correspondence table 321, associating it with the tracking ID associated with the face image transmitted from the tracking unit 313. In this case, the face authentication unit 314 may also register failure reason information indicating the reason why face authentication failed in the ID correspondence table 321.

[0085] The tracking unit 313 and the facial recognition unit 314 may repeatedly perform the above-described process until passenger P1 passes through the authentication area RA. As described above, the tracking unit 313 calculates the position of passenger P1. In other words, it can be said that the tracking unit 313 detects the position of passenger P1. For this reason, the tracking unit 313 may also be called a position detection means.

[0086] Here, an example of the ID correspondence table 321 will be explained with reference to Figure 8. As shown in Figure 8, in the ID correspondence table 321, the tracking ID, tracking location (for example, the location of passenger P1), authentication ID, and authentication time may be associated with each other. In the ID correspondence table 321, if the tracking ID is associated with a specific authentication ID, it indicates that the facial image of the person corresponding to the passenger for whom the tracking ID is set is registered in the face DB 36. If the tracking ID is associated with the string "N / A", it indicates that the facial image of the person corresponding to the passenger for whom the tracking ID is set is not registered in the face DB 36. If the tracking ID is not associated with an authentication ID (i.e., the authentication ID field is blank), it indicates that facial authentication processing has never been performed.

[0087] Incidentally, there are times when it becomes difficult for the tracking unit 313 to continue tracking passenger P1, for example, if passenger P1's head is hidden behind someone else. If the tracking of passenger P1 is interrupted, the tracking unit 313 may perform the following processing. After the tracking of passenger P1 is interrupted, the tracking unit 313 may determine whether a new passenger has been detected from the first image acquired by the image acquisition unit 311 (i.e., the first image generated by the camera CAM). A "new passenger" means a passenger for whom a tracking ID has not been set.

[0088] If a new passenger is detected, the tracking unit 313 may determine whether passenger P1 and the new passenger are the same person by comparing the feature quantities of the tracking area related to passenger P1 (for example, at least one of the tracking areas TA1, TA2, and TA3) with the feature quantities of the tracking area related to the new passenger. If it is determined that passenger P1 and the new passenger are the same person, the tracking unit 313 may set a tracking ID for passenger P1 for the new passenger. As a result, the tracking unit 313 can track passenger P1 again. The feature quantities may be features related to the passenger's head, features related to the passenger's upper body, or features related to the passenger's whole body. Therefore, the tracking area may include the passenger's head, the passenger's upper body, or the passenger's whole body. The feature quantities may be obtained, for example, by Person Re-Identification technology.

[0089] The tracking unit 313 and the facial recognition unit 314 may perform the above-described tracking process and facial recognition process for each of the multiple passengers included in a single first image generated by the camera CAM. Here, the authentication area RA may be, for example, an area of ​​5 meters x 5 meters. A distance of 5 meters is a distance that allows 5 to 6 passengers to pass through in a single line. If the authentication area RA is an area of ​​5 meters x 5 meters, there may be 20 to 30 passengers within the authentication area RA. Therefore, as shown in Figure 9, the information processing device 3 can perform tracking and facial recognition processing for multiple passengers based on a single first image generated by the camera CAM. Note that the multiple dotted rectangles in Figure 9 represent the tracking area.

[0090] Furthermore, the tracking area (for example, at least one of tracking areas TA1, TA2, and TA3) may include not only the head of the passenger (for example, passenger P1) that the tracking unit 313 tracks, but also other parts of the passenger (for example, shoulders). Furthermore, the tracking area may be set to include the upper body of the passenger, or to include the entire body of the passenger.

[0091] The operation of the tracking unit 313 and the facial recognition unit 314 will be explained with reference to the flowchart in Figure 10. In Figure 10, the tracking unit 313 detects one or more passengers (i.e., people) from the first image acquired by the image acquisition unit 311 (i.e., the first image generated by the camera CAM) (step S101). In the process of step S101, the tracking unit 313 may detect the heads of the passengers. In the process of step S101, the tracking unit 313 may set a tracking area that includes the heads of the detected passengers based on the detected heads of the passengers. In the process of step S101, the tracking unit 313 may perform face detection on the detected one or more passengers.

[0092] The tracking unit 313 uses other first images acquired by the image acquisition unit 311 to perform tracking processing on at least one of the one or more passengers detected in the processing of step S101 (step S102). In the processing of step S102, the tracking unit 313 may perform face detection on the one or more detected passengers. If the face of at least one of the one or more passengers is detected in at least one of the processing of steps S101 and S102, the tracking unit 313 transmits a face image including the face region of at least one person to the face recognition unit 314.

[0093] The facial recognition unit 314 performs facial recognition processing using the facial image transmitted from the tracking unit 313 (step S103). The facial recognition unit 314 registers the result of the facial recognition processing in the ID correspondence table 321, or updates the ID correspondence table 321 based on the result of the facial recognition processing (step S104).

[0094] Next, the operation of the determination unit 315 of the arithmetic unit 31 will be explained. Here, passenger P2 will be used as an example. Based on the ID correspondence table 321, the determination unit 315 may determine whether or not passenger P2 can pass through the facial recognition gate device 23. If the tracking ID related to passenger P2 in the ID correspondence table 321 is associated with a specific authentication ID, the determination unit 315 may determine that "there is a matching person" for passenger P2. If the tracking ID related to passenger P2 in the ID correspondence table 321 is associated with the string "N / A", the determination unit 315 may determine that "there is no matching person" for passenger P2. If the tracking ID related to passenger P2 is not associated with an authentication ID (i.e., the authentication ID field is blank), the determination unit 315 may determine that passenger P2 is "unauthenticated".

[0095] Furthermore, if failure reason information is registered in the ID correspondence table 321, the determination unit 315 may make the following determinations: If the tracking ID for passenger P2 is associated with the string "N / A" and the failure reason information is the second reason (i.e., a reason indicating that facial recognition failed despite the image being suitable for facial recognition), the determination unit 315 may determine that there is "no matching passenger" for passenger P2. If the tracking ID for passenger P2 is associated with the string "N / A" and the failure reason information is the first reason (i.e., a reason indicating that facial recognition failed because the image was unsuitable for facial recognition), the determination unit 315 may determine that passenger P2 is "unauthenticated".

[0096] If it is determined that there is a passenger P2, the decision unit 315 may determine whether or not passenger P2 can pass through the facial recognition gate device 23 based on passenger P2's authentication ID and face DB 36. For example, the decision unit 315 may determine whether the boarding gate number (see Figure 6) associated with the authentication ID in face DB 36 matches the boarding gate number where the facial recognition gate device 23 is installed. If the boarding gate number associated with the authentication ID does not match the boarding gate number where the facial recognition gate device 23 is installed, the decision unit 315 may determine that the passenger cannot pass through the facial recognition gate device 23. If it is determined that the boarding gate number associated with the authentication ID matches the boarding gate number where the facial recognition gate device 23 is installed, the decision unit 315 may determine that the passenger can pass through the facial recognition gate device 23. Alternatively, if it is determined that the boarding gate number associated with the authentication ID matches the boarding gate number where the facial recognition gate device 23 is installed, the determination unit 315 may compare the boarding start time associated with the authentication ID in the face DB 36 with the current time to determine whether the passenger is eligible to pass through the facial recognition gate device 23.

[0097] As shown in Figure 3, the facial recognition gate device 23 is installed at boarding gate G1. If the boarding gate for the aircraft on which passenger P2 is boarding is not boarding gate G1, the decision unit 315 may determine that passenger P2 cannot pass through the facial recognition gate device 23. If the boarding gate for the aircraft on which passenger P2 is boarding is boarding gate G1, but the current time is more than a second predetermined time (for example, several minutes to several tens of minutes) before the boarding start time, the decision unit 315 may determine that passenger P2 cannot pass through the facial recognition gate device 23. If the boarding gate for the aircraft on which passenger P2 is boarding is boarding gate G1, and the current time is not more than a second predetermined time before the boarding start time, the decision unit 315 may determine that passenger P2 can pass through the facial recognition gate device 23.

[0098] The determination unit 315 may output any of the following determination results for passenger P2: (i) a first determination result indicating that there is a suitable person and that they can pass through the facial recognition gate device 23; (ii) a second determination result indicating that there is a suitable person but they cannot pass through the facial recognition gate device 23; (iii) a third determination result indicating that there is no suitable person; and (iv) a fourth determination result indicating that the person is not authenticated. In other words, the determination unit 315 may classify multiple passengers into one of the following categories: a first category corresponding to the first determination result, a second category corresponding to the second determination result, a third category corresponding to the third determination result, and a fourth category corresponding to the fourth determination result. It should be noted that the third and fourth categories indicate that facial recognition has failed. The determination result by the determination unit 315 is based on the result of the facial recognition processing performed by the facial recognition unit 314. For this reason, the determination result by the determination unit 315 may be rephrased as the result of the facial recognition processing or the authentication result. Furthermore, since the determination unit 315 classifies passengers by determining their passenger type, the determination unit 315 may also be referred to as a passenger type determination means.

[0099] The determination unit 315 determines the priority of the determination result for passenger P2 based on the type of passenger P2 based on the determination result and the respective locations of terminal devices 41 and 42 indicated by terminal location information. Based on the determined priority, the determination unit 315 may decide whether or not to transmit the determination result for passenger P2 to at least one of terminal devices 41 and 42. Alternatively, based on the determined priority, the determination unit 315 may decide whether or not to preferentially transmit the determination result for passenger P2 to at least one of terminal devices 41 and 42.

[0100] The method for determining priority by the determination unit 315 (in other words, the rules or criteria for prioritization) is arbitrary. An example of the method for determining priority by the determination unit 315 is described below. If the priority of the determination result is higher than the criterion, the determination result is transmitted to at least one of the terminal devices 41 and 42, and if the priority of the determination result is lower than the criterion, the determination result is not transmitted to either of the terminal devices 41 and 42. If the priority and the criterion are "equal", they may be treated as being included in either case. Priority may be expressed numerically or as a category (e.g., high, medium, low).

[0101] The decision unit 315 may set the priority of the determination result to be lower than the standard so that the determination result relating to the first type of passenger (i.e., a passenger who is identified and is determined to be able to pass through the facial recognition gate device 23) is not transmitted to the terminal devices 41 and 42.

[0102] The determination unit 315 may set the priority of the determination results higher than the standard so that the determination results for Category 2 passengers (i.e., passengers who are identified but determined not to be able to pass through the facial recognition gate device 23), Category 3 passengers (i.e., passengers determined not to be identified), and Category 4 passengers (i.e., passengers determined not to be authenticated) are transmitted to at least one of the terminal devices 41 and 42. In other words, the determination unit 315 may set the priority of the determination results for passengers who are unable to pass through the facial recognition gate device 23 higher than the standard so that the determination results are transmitted to at least one of the terminal devices 41 and 42.

[0103] The decision unit 315 may set the priority of the determination result for passengers of the second category lower than the priority of the determination result for passengers of the third category and the priority of the determination result for passengers of the fourth category among the determination results transmitted to the terminal device 41. In this case, the priority of the determination result for passengers of the second category is higher than the standard.

[0104] The decision unit 315 may set the priority of the determination result for passengers of the second category higher than the priority of the determination result for passengers of the third category and passengers of the fourth category among the determination results transmitted to the terminal device 42. The priority of the determination result for passengers of the third category and passengers of the fourth category is higher than the standard. In this case, the decision unit 315 may set the priority of the determination result for passengers of the third category higher than the priority of the determination result for passengers of the fourth category.

[0105] Furthermore, even if failure reason information is registered in the ID correspondence table 321, the determination unit 315 may determine that there is "no matching passenger" for passenger P2 if the tracking ID related to passenger P2 is associated with the string "N / A", regardless of the failure reason information (i.e., it may determine that passenger P2 is a third-class passenger). In this case, the determination unit 315 may determine the priority of the determination result for passenger P2 based on the failure reason information. The determination unit 315 may set the priority of the determination result for passenger P2 when the failure reason information indicates a first reason (i.e., a reason indicating that face recognition failed because the image was unsuitable for face recognition) lower than the priority of the determination result for passenger P2 when the failure reason information indicates a second reason (i.e., a reason indicating that face recognition failed despite the image being suitable for face recognition).

[0106] As shown in Figure 4, the distance between terminal device 41 and facial recognition gate device 23 is different from the distance between terminal device 42 and facial recognition gate device 23. Therefore, the determination unit 315 may determine (or change) the priority of the determination result for the passenger based on the type of passenger (e.g., passenger P2) based on the determination result and the positional relationship between the position of terminal device 41 or 42 and the facial recognition gate device 23.

[0107] For example, the distance from the facial recognition gate device 23 to the end of the authentication area RA on the side of the facial recognition gate device 23 is defined as the predetermined distance. In Figure 4, the distance between the terminal device 41 and the facial recognition gate device 23 is shorter than the predetermined distance. On the other hand, the distance between the terminal device 41 and the facial recognition gate device 23 is longer than the predetermined distance.

[0108] As described above, the determination unit 315 may set the priority of the determination result relating to passenger type 2 to be lower than the priority of the determination result relating to passenger type 3 and passenger type 4 among the determination results transmitted to the terminal device 41. In other words, the determination unit 315 may set the priority of the determination result relating to passengers higher than when the distance between the terminal device 41 and the facial recognition gate device 23 is shorter than a predetermined distance and the passenger type is type 3 or type 4, compared to when the distance between the terminal device 41 and the facial recognition gate device 23 is shorter than a predetermined distance and the passenger type is type 2.

[0109] As described above, the determination unit 315 may set the priority of the determination result relating to passenger type 2 higher than the priority of the determination result relating to passenger type 3 and passenger type 4 among the determination results transmitted to the terminal device 42. In other words, the determination unit 315 may set the priority of the determination result relating to passengers higher when the distance between the terminal device 42 and the facial recognition gate device 23 is longer than a predetermined distance and the passenger type is type 2, compared to when the distance between the terminal device 42 and the facial recognition gate device 23 is longer than a predetermined distance and the passenger type is type 3 or type 4.

[0110] The operation of the decision unit 315 will be explained with reference to the flowchart in Figure 11. In Figure 11, the decision unit 315 determines the priority of each of the multiple judgment results corresponding to each of the multiple passengers (step S201). Based on the determined priority and the multiple judgment results, the decision unit 315 generates information to be transmitted to at least one of the terminal devices 41 and 42 (step S202). The decision unit 315 transmits the information generated in step S202 to at least one of the terminal devices 41 and 42 via the communication device 33. As a result, the information transmitted to at least one of the terminal devices 41 and 42 is displayed on at least one of the terminal devices 41 and 42, thereby notifying at least one of the staff members A1 and A2 (step S203). In this case, the terminal devices 41 and 42 may determine the display order of the notification information based on the priority determined by the decision unit 315.

[0111] Information transmitted from the decision unit 315 to at least one of the terminal devices 41 and 42 via the communication device 33 is displayed on at least one of the terminal devices 41 and 42, thereby notifying at least one of the employees A1 and A2. For this reason, the information generated by the decision unit 315 in the processing of step S202 may be referred to as notification information. Hereafter, the information generated by the decision unit 315 in the processing of step S202 will be referred to as "notification information" as appropriate.

[0112] Furthermore, the notification information may include information indicating the judgment result and information indicating the priority of the judgment result. The notification information may include information indicating the judgment result, information indicating the priority of the judgment result, and an image of the passenger detected by the tracking unit 313 from the first image (i.e., the first image generated by the camera CAM). If the judgment result is for a passenger of the second type, the decision unit 315 may include in the notification information information information indicating the judgment result, information indicating the priority of the judgment result, and information relating to the passenger of the second type (for example, name, facial image, and at least one of the boarding gate number).

[0113] For example, Figure 12 shows an example of the screen of terminal device 42 when notification information transmitted from decision unit 315 is displayed on terminal device 42. In Figure 12, images 421, 422, and 423, which include a human figure, represent images including a passenger (i.e., the person to be authenticated). Images 421, 422, and 423 (i.e., images including the passenger) may be images actually taken of the entire body of the passenger. Such images may be extracted from the first image generated by the camera CAM. The images including the passenger may be face images used in face authentication processing by face authentication unit 314, or they may be symbols (e.g., icons) that represent a person. The fact that the border lines surrounding images 421 and 422 are dashed indicates that the passenger type is type 2 (i.e., a passenger who is identified but has been determined not to be able to pass through face authentication gate device 23). The solid border in Image 423 indicates that the passenger's category is either Category 3 (i.e., a passenger determined to be unqualified) or Category 4 (i.e., a passenger determined to be unauthenticated).

[0114] Furthermore, if the notification information generated by the decision unit 315 includes information relating to passengers of the second category, the terminal device 42 may display the passenger's name and specific destination on the screen based on the information relating to passengers of the second category (see dotted circle C1 in Figure 12). Furthermore, the terminal device 42 may set the specific destination for passengers of the third and fourth categories to a regular gate device.

[0115] As described above, the determination unit 315 may set the priority of the determination results relating to passengers of the second category higher than the priority of the determination results relating to passengers of the third category and passengers of the fourth category among the determination results transmitted to the terminal device 42. The terminal device 42 may determine or change the display order of the determination results based on the priority of the determination results. The terminal device 42 may generate display information to be displayed on the screen based on the determined or changed display order of the determination results. As a result, the terminal device 42 displays information relating to passengers of the second category with higher priority than information relating to passengers of the third or fourth category.

[0116] For example, employee A2 may identify passengers who should be given priority attention based on the information displayed on terminal device 42. Once the assistance to a passenger is complete (for example, after guiding the passenger to the appropriate gate device), employee A2 may tap the "Guidance Complete" button (see Figure 12) displayed on terminal device 42. As a result, terminal device 42 may update the screen so that the information relating to the passenger for whom the "Guidance Complete" button was tapped disappears from the screen (in other words, it may change the information displayed on the screen). Terminal device 42 may further transmit information indicating the passenger that employee A2 has assisted (for example, the passenger's tracking ID) to information processing device 3. Upon receiving the information indicating the passenger that employee A2 has assisted from terminal device 42, information processing device 3 may delete the information relating to the passenger indicated by the received information from ID correspondence table 321.

[0117] An example of the screen of terminal device 42 has been explained with reference to Figure 12, but the same applies to terminal device 41. However, the determination unit 315 may set the priority of the determination results relating to the third type of passenger and the determination results relating to the fourth type of passenger higher than the priority of the determination results relating to the second type of passenger among the determination results transmitted to terminal device 41. Terminal device 41 may determine or change the display order of the determination results based on the priority of the determination results. Terminal device 41 may generate the display information to be displayed on the screen based on the determined or changed display order of the determination results. As a result, terminal device 41 displays information relating to the third type or fourth type of passenger with higher priority than information relating to the second type of passenger.

[0118] Furthermore, the operation of the information processing device 3 described above may be achieved by the information processing device 3 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium contains a computer program that causes the information processing device 3 to perform the above-described operation.

[0119] (Technical effects) The information processing device 3 determines the priority of at least some of the multiple determination results corresponding to each of the multiple passengers, based on the types of multiple passengers and the location of the terminal devices (for example, at least one of terminal devices 41 and 42). As a result, the information processing device 3 notifies airport staff (for example, at least one of staff members A1 and A2) who possess the terminal devices of the higher-priority determination results. This allows airport staff to easily identify passengers who should be given priority attention. For example, airport staff can easily identify (or identify) passengers who cannot pass through the facial recognition gate device 23. If airport staff prioritize assisting those who cannot pass through the facial recognition gate device 23, it is possible to prevent passengers who cannot pass through the facial recognition gate device 23 from entering the device. Therefore, the information processing device 3 can suppress a decrease in the throughput of the facial recognition gate device.

[0120] Furthermore, the information processing device 3 may be applied not only to airport boarding gates, but also to, for example, airport security gates (i.e., gates installed at airport security checkpoints) and immigration gates. In addition to airports, the information processing device 3 may be applied to, for example, at least one of offices, train stations, theme parks, and event venues that use facial recognition gate devices for at least one of entry and exit.

[0121] (First variation) In the second embodiment described above, the information processing device 3 (specifically, the facial recognition unit 314) performs facial recognition processing. However, the information processing device 3 does not have to perform facial recognition processing. In this case, the information processing device 3 does not have to be equipped with the facial recognition unit 314 and the facial database 36. In this case, the facial recognition processing may be performed by an authentication device 5 different from the information processing device 3. In this case, as shown in Figure 13, the information processing device 3 and the authentication device 5 may be connected via a network NW. Furthermore, the information processing device 3 and the authentication device 5 may constitute a single system. This single system may be called an information processing system or an authentication system. Furthermore, at least one of the terminal devices 41 and 42 may constitute a part of the above system. In other words, the above system may include the information processing device 3, the authentication device 5, and the terminal devices 41 and 42.

[0122] The authentication device 5 comprises a face recognition unit 51 and a face database 52 (hereinafter referred to as "face DB 52"). The face recognition unit 51 is configured to perform face recognition processing. In other words, the authentication device 5 is an authentication device having a face recognition function. The management server 21 of the airport system 2 may transmit at least a portion of the face images registered in the face DB 211 to the authentication device 5, along with the authentication ID (i.e., passenger identification information) assigned to the face image. In this case, the management server 21 may transmit gate identification information and boarding start time to the authentication device 5 in addition to the face image. The authentication device 5 may register the face images transmitted from the management server 21 in the face DB 52. The authentication device 5 may also register gate identification information and boarding start time to the face DB 52 in addition to the face image.

[0123] The tracking unit 313 of the information processing device 3 may detect passengers (for example, passenger P1) included in the image acquired by the image acquisition unit 311. The tracking unit 313 may set a tracking area that includes the head of the detected passenger. The tracking unit 313 may perform face detection of the detected passenger. If the passenger's face is detected, the tracking unit 313 may transmit the face image including the passenger's face area to the authentication device 5 via the communication device 33.

[0124] The facial recognition unit 51 of the authentication device 5 may perform facial recognition processing using the facial image transmitted from the information processing device 3 (specifically, the tracking unit 313) and the facial database 52. The facial recognition unit 51 may transmit information indicating the result of the facial recognition processing to the information processing device 3. The information processing device 3 may register the result of the facial recognition processing indicated by the information transmitted from the authentication device 5 (specifically, the facial recognition unit 51) in the ID correspondence table 321.

[0125] (Second variation) The tracking unit 313 may determine the location of a passenger based on the tracking ID of the passenger determined by the determination unit 315 to be unauthenticated (i.e., a passenger of type 4). If the passenger's location is within a line formed by passengers waiting to pass through the facial recognition gate device 23 (i.e., the passenger is in line), the tracking unit 313 may perform face detection of the passenger using multiple first images (i.e., multiple first images generated by the camera CAM). In this case, the tracking unit 313 may set the frequency of face detection of the passenger higher than the frequency of face detection of other passengers. With this configuration, the facial recognition unit 314 can perform facial recognition processing for the passenger at a relatively high frequency.

[0126] Alternatively, if failure reason information is registered in the ID correspondence table 321, the tracking unit 313 may identify the passenger's location based on the tracking ID of the passenger whose failure reason information indicates a first reason (i.e., a reason indicating that face recognition failed because the image was unsuitable for face recognition). If the passenger's location is within a line formed by passengers waiting to pass through the face recognition gate device 23 (i.e., the passenger is in line), the tracking unit 313 may perform face detection of the passenger using multiple first images (i.e., multiple first images generated by the camera CAM). In this case, the tracking unit 313 may set the frequency of face detection for the passenger higher than the frequency of face detection for other passengers. With this configuration, the face recognition unit 314 can perform face recognition processing for the passenger at a relatively high frequency. In other words, the face recognition unit 314 may repeatedly perform face recognition processing using multiple first images for passengers whose failure reason information indicates a first reason.

[0127] (Third variation) The determination unit 315 may determine (change) the priority of the determination results transmitted to the terminal device 41 (for example, determination results of passengers determined to be unable to pass through the facial recognition gate device 23) such that determination results of passengers closer to the facial recognition gate device 23 have a higher priority.

[0128] (Fourth variation) The determination unit 315 may determine the priority of the determination result (specifically, the determination result relating to passengers of the second type, third type, and fourth type) transmitted to at least one of the terminal devices 41 and 42 to either "high" or "low". In other words, the determination unit 315 may classify the priority into two types. Furthermore, the determination unit 315 may classify the priority into three or more types. Furthermore, the determination unit 315 may calculate the priority as a numerical value.

[0129] The priority of the judgment results included in the notification information transmitted from the decision unit 315 shall be either "high" priority or "low" priority. In this case, as shown in Figure 14, the terminal device 42 may display the notification information transmitted from the decision unit 315 for each priority using a tab display function. As described above, the decision unit 315 may set the priority of the judgment results relating to Category 2 passengers higher than the priority of the judgment results relating to Category 3 passengers and Category 4 passengers among the judgment results (in other words, notification information) transmitted to the terminal device 42. That is, the decision unit 315 may set the priority of the judgment results relating to Category 2 passengers to "high" priority. The decision unit 315 may set the priority of the judgment results relating to Category 3 passengers and Category 4 passengers to "low" priority. For this reason, the terminal device 42 may display the information relating to Category 2 passengers on a tab labeled "Priority: High". Terminal device 42 may display information relating to passengers of category 3 and passengers of category 4 on a tab labeled "Priority: Low" (not shown).

[0130] As shown in Figure 15, the terminal device 41 may display the notification information transmitted from the decision unit 315 according to priority using a tab display function. As described above, the decision unit 315 may set the priority of the decision results (in other words, notification information) transmitted to the terminal device 41 that pertain to passengers of the third or fourth category higher than the priority of the decision results pertaining to passengers of the second category. That is, the decision unit 315 may set the priority of the decision results pertaining to passengers of the third category and passengers of the fourth category to "high priority". The decision unit 315 may set the priority of the decision results pertaining to passengers of the second category to "low priority". For this reason, the terminal device 41 may display information pertaining to passengers of the third or fourth category on a tab labeled "Priority: High". The terminal device 41 may display information pertaining to passengers of the second category on a tab labeled "Priority: Low" (not shown).

[0131] The notification information transmitted from the determination unit 315 may include failure reason information in the determination result for the third type of passenger (i.e., a determination result indicating that there are no applicable persons). When the terminal device 41 displays information for the third type of passenger, it may display on the screen the reason why facial recognition failed based on the failure reason information. If the determination result for the third type of passenger includes failure reason information indicating a first reason (a reason indicating that facial recognition failed because the image was unsuitable for facial recognition), the terminal device 41 may include the notation "Error: Unauthenticated person" in the information for the third type of passenger (see dotted circle C3 in Figure 15). If the determination result for the third type of passenger includes failure reason information indicating a second reason (a reason indicating that facial recognition failed despite the image being suitable for facial recognition), the terminal device 41 may include the notation "Error: Unregistered person" in the information for the third type of passenger (see dotted circle C2 in Figure 15). Furthermore, the terminal device 41 may include the phrase "Error: Unregistered person" in the information relating to the fourth type of passenger.

[0132] Terminal devices 41 and 42 may display information relating to passengers for whom one of staff members A1 or A2 has completed assistance on a tab labeled "Guidance Completed". Furthermore, if the "Guidance Completed" button is tapped by one of staff members A1 or A2, one of terminal devices 41 or 42 may transmit status information indicating the status of the passenger for whom the "Guidance Completed" button was tapped (i.e., guidance completed) to the information processing device 3. This status information may include the passenger's tracking ID and information indicating "Guidance Completed". Upon receiving status information from one of terminal devices 41 or 42, the information processing device 3 may transmit information corresponding to the received status information to the other terminal device 41 or 42. The other terminal device 41 or 42 may display information relating to the corresponding passenger on a tab labeled "Guidance Completed" based on the information received from the information processing device 3. As a result, staff members A1 and A2 can share information about passengers for whom guidance has been completed.

[0133] (Fifth variation) Two employees may be positioned near the facial recognition gate device 23 (for example, near employee A1 in Figure 4). In this case, each of the two employees may possess a terminal device 41a and 41b. In this case, the same information (i.e., notification information) may be transmitted to terminal devices 41a and 41b from the information processing device 3. Therefore, the information displayed on terminal devices 41a and 41b may be the same. For example, as shown in Figures 16 and 17, the terminal devices 41a and 41b display information about passengers P11 and P12.

[0134] In this case, there is a possibility that the staff member holding terminal device 41a and the staff member holding terminal device 41b may end up assisting the same passenger. Therefore, when the staff member holding terminal device 41a is assisting passenger P11, the information related to passenger P11 may be pinned, as shown in Figure 16. In Figure 16, "guide a" refers to the staff member holding terminal device 41a.

[0135] If an employee holding terminal device 41a performs a prescribed operation and pins information relating to passenger P11, terminal device 41a may determine that the employee is responding to passenger P11. In this case, terminal device 41a may change the status (e.g., status) relating to passenger P11 from "not responding" to "responding". Terminal device 41a may further transmit status information indicating the status relating to passenger P11 to the information processing device 3. The status information may include information to identify the employee holding terminal device 41a, a tracking ID relating to passenger P11, and information indicating the status relating to passenger P11 (e.g., "responding").

[0136] The information processing device 3, upon receiving status information from terminal device 41a, may transmit information corresponding to the received status information to terminal device 41b via communication device 33. The information corresponding to the status information may include information for identifying the employee possessing terminal device 41a, a tracking ID relating to passenger P11, and information indicating the status of passenger P11 (for example, "in progress").

[0137] Terminal device 41b may change the status of passenger P11 from "Not attending" to "Attending staff a" based on the information received from information processing device 3. As a result, the staff member holding terminal device 41b may be notified that the staff member holding terminal device 41a is attending to passenger P11. With this configuration, the staff member holding terminal device 41b can attend to passenger P12, who is currently not attending. In other words, it is possible to prevent the staff member holding terminal device 41a and the staff member holding terminal device 41b from attending to the same passenger.

[0138] The terminal device 41a may fix the display position of the information related to the pinned passenger P11. With this configuration, it is possible to prevent the display position of the information related to passenger P11 from changing while the employee holding the terminal device 41a is attending to the passenger.

[0139] (Sixth variation) The tracking unit 313 may detect changes in at least one of the face orientation and gaze direction of each of the multiple passengers based on the first image (i.e., the first image generated by the camera CAM). Existing technologies can be applied to the method for detecting face orientation and gaze direction. Existing technologies can also be applied to the method for detecting changes in at least one of the face orientation and gaze direction based on the detected face orientation and gaze direction. For this reason, a detailed explanation of these methods will be omitted. Note that since the tracking unit 313 may detect changes in at least one of the face orientation and gaze direction, it may also be referred to as a detection means.

[0140] The determination unit 315 may determine priority based on the passenger's position and the position of the terminal device (for example, at least one of terminal devices 41 and 42), as well as the detected change in at least one of the face orientation and gaze. In this case, the determination unit 315 may assign a higher priority the greater the detected change in at least one of the face orientation and gaze.

[0141] (Seventh variation) The decision unit 315 does not need to determine priority. In this case, the decision unit 315 may determine the determination result to transmit to terminal devices 41 and 42 (in other words, the determination result to notify at least one of staff members A1 and A2) based on the passenger's location and the locations of terminal devices 41 and 42. In addition to terminal devices 41 and 42, there may be other terminal devices. That is, there may be three or more terminal devices.

[0142] For example, if the distance between one passenger and the terminal device 41 is shorter than the distance between another passenger and the terminal device 41, the determination unit 315 may transmit the determination result for one passenger to the terminal device 41, prioritizing it over the determination result for the other passenger. The first passenger and the other passengers may be passengers of the second category (i.e., passengers who are identified but determined not to be able to pass through the facial recognition gate device 23), passengers of the third category (i.e., passengers determined not to be identified), or passengers of the fourth category (i.e., passengers determined not to be authenticated).

[0143] The image acquisition unit 311 may acquire a second image that includes at least one of employee A1 and A2. The second image may be generated by camera CAM capturing images of at least one of employee A1 and A2, or by a camera different from camera CAM capturing images of at least one of employee A1 and A2.

[0144] The tracking unit 313 may detect the face orientation of at least one of employees A1 and A2 based on the second image. Since existing technologies can be applied to the face orientation detection method, a detailed explanation will be omitted. Furthermore, the detection of the face orientation of at least one of employees A1 and A2 may be performed by a functional block different from the tracking unit 313. In this case, the computing unit 31 may have a functional block for detecting the face orientation of at least one of employees A1 and A2. Since the tracking unit 313 can detect face orientation, it may also be referred to as a face orientation detection means.

[0145] The determination unit 315 may determine a determination result to transmit to terminal devices 41 and 42 (in other words, a determination result to notify at least one of staff members A1 and A2) based on the passenger's position, the positions of terminal devices 41 and 42, and the orientation of at least one of staff members A1 and A2.

[0146] The determination unit 315 may determine, based on the orientation of employee A1's face, whether to transmit a determination result to the terminal device 41, from the determination results relating to one or more passengers located in the direction that employee A1's face is facing, based on the passenger's position and the position of the terminal device 41 (for example, based on the distance between the passenger and the terminal device 41). The determination unit 315 may decide, based on the orientation of employee A1's face, not to transmit a determination result to the terminal device 41 relating to one or more passengers located in a direction that employee A1's face is not facing.

[0147] The determination unit 315 may determine, based on the orientation of employee A2's face, to transmit a determination result to the terminal device 42 from the determination results for one or more passengers located in the direction that employee A2's face is facing, based on the passenger's position and the position of the terminal device 42 (for example, based on the distance between the passenger and the terminal device 42). The determination unit 315 may decide not to transmit a determination result to the terminal device 42 for one or more passengers located in a direction that employee A2's face is not facing, based on the orientation of employee A2's face.

[0148] In this case, the tracking unit 313 may estimate the visibility range, which is the range in which at least one of employees A1 and A2 can see, based on the face orientation of at least one of employees A1 and A2. The tracking unit 313 may estimate employee A1's visibility range F1 (see Figure 4) based on employee A1's face orientation. The tracking unit 313 may estimate employee A2's visibility range F2 (see Figure 4) based on employee A2's face orientation. Note that existing technologies can be applied to the method of estimating the visibility range, so a detailed explanation will be omitted. Note that if face orientation detection is performed by a functional block different from the tracking unit 313, the estimation of the visibility range may be performed by a functional block different from the tracking unit 313.

[0149] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F1 of employee A1, based on the passengers' positions. The determination unit 315 may then determine, based on the passengers' positions and the position of the terminal device 41 (for example, based on the distance between the passengers and the terminal device 41), to transmit a determination result to the terminal device 41. The determination unit 315 may decide not to transmit a determination result for one or more passengers that are not within the line of sight F1 of employee A1 to the terminal device 41.

[0150] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F2 of employee A2, based on the passenger's position. The determination unit 315 may then determine, based on the passenger's position and the terminal device 42's position (for example, based on the distance between the passenger and the terminal device 42), to transmit a determination result to the terminal device 42. The determination unit 315 may decide not to transmit a determination result for one or more passengers that are not within the line of sight F2 of employee A2 to the terminal device 42.

[0151] The determination unit 315 may consider the direction of movement of passengers in addition to the line of sight of staff members (e.g., at least one of line of sight F1 and F2). For example, the tracking unit 313 may estimate the direction of movement of each of several passengers based on a plurality of first images (i.e., a plurality of first images generated by the camera CAM). Since existing techniques can be applied to the method of estimating the direction of movement from a plurality of images, a detailed explanation of that method will be omitted.

[0152] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F1 of employee A1, based on the passengers' positions. The determination unit 315 may then determine a determination result to transmit to the terminal device 41 based on the position of the terminal device 41 and the passengers' directions of movement, using the determination results for one or more passengers that are within the line of sight F1 of employee A1. In this case, the determination unit 315 may decide to transmit to the terminal device 41 the determination result for passengers whose direction of movement is toward the terminal device 41. On the other hand, the determination unit 315 may decide not to transmit to the terminal device 41 the determination result for passengers whose direction of movement is toward the terminal device 41.

[0153] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F2 of employee A2, based on the passenger's position. The determination unit 315 may then determine a determination result to transmit to the terminal device 42, based on the position of the terminal device 42 and the passenger's direction of movement, from the determination results for one or more passengers that are within the line of sight F2 of employee A2. In this case, the determination unit 315 may decide to transmit to the terminal device 42 the determination result for passengers whose direction of movement is toward the terminal device 42. On the other hand, the determination unit 315 may decide not to transmit to the terminal device 42 the determination result for passengers whose direction of movement is toward the terminal device 42.

[0154] Alternatively, the determination unit 315 may determine a determination result to transmit to the terminal device based on the position of the terminal device (for example, at least one of terminal devices 41 and 42) and the direction of the passenger's movement (in this case, the determination unit 315 does not need to consider the line of sight of the staff).

[0155] The determination unit 315 may determine which determination result to transmit to the terminal device 41 based on the determination results for multiple passengers, taking into account the position of the terminal device 41 and the direction of movement of the passengers. In this case, the determination unit 315 may decide to transmit to the terminal device 41 the determination result for passengers whose direction of movement is toward the terminal device 41. On the other hand, the determination unit 315 may decide not to transmit to the terminal device 41 the determination result for passengers whose direction of movement is toward the terminal device 41.

[0156] The determination unit 315 may determine which determination result to transmit to the terminal device 42 based on the determination results for multiple passengers, taking into account the position of the terminal device 42 and the direction of movement of the passengers. In this case, the determination unit 315 may decide to transmit to the terminal device 42 the determination result for passengers whose direction of movement is toward the terminal device 42. On the other hand, the determination unit 315 may decide not to transmit to the terminal device 42 the determination result for passengers whose direction of movement is toward the terminal device 42.

[0157] In this case, the terminal device 41 may display an image, as shown in Figure 18, that shows the location of the terminal device 41 and at least some of the locations of the multiple passengers in a planar manner. The location of the terminal device 41 and at least some of the locations of the multiple passengers may be displayed superimposed on the airport floor map. The airport floor map may also include facility information. This facility information may include store information and equipment information (for example, at least one of toilets, stairs, escalators, and elevator lobbies).

[0158] In Figure 18, the black circle M1 indicates the location of terminal device 41. The multiple white circles indicate the locations of passengers. The solid rectangles M11 and M12 surrounding the white circles indicate that the passenger's type is either Category 3 (i.e., a passenger determined to be unidentified) or Category 4 (i.e., a passenger determined to be unauthenticated). The dashed rectangle M13 surrounding the white circle indicates that the passenger's type is Category 2 (i.e., a passenger who is identified but determined to be unable to pass through the facial recognition gate device 23). In addition to the location of terminal device 41 (black circle M1 in Figure 18), the locations of other terminal devices (for example, terminal device 42) may also be displayed on terminal device 41.

[0159] When employee A1, who possesses terminal device 41, taps any of the rectangles M11, M12, and M13, information relating to the passenger corresponding to the tapped (in other words, selected) rectangle may be displayed on terminal device 41. That is, the screen of terminal device 41 may transition to the screen shown in Figure 15, for example.

[0160] Specifically, the terminal device 41 may detect when employee A1 taps the screen of the terminal device 41. If a tap is detected, the terminal device 41 may identify the passenger that employee A1 tapped (for example, the passenger corresponding to any of the rectangles M11, M12, and M13) based on the location of the tapped screen. The terminal device 41 may transition the display from the screen shown in Figure 18 to a screen containing information about the identified passenger (for example, the screen shown in Figure 15).

[0161] Furthermore, for example, if the screen shown in Figure 15 is displayed, the terminal device 41 may detect when employee A1 taps the screen. When a tap is detected, the terminal device 41 may identify the passenger that employee A1 tapped based on the location of the tapped screen. The terminal device 41 may then transition the display from the screen shown in Figure 15 to a screen showing the location of the identified passenger (for example, the screen shown in Figure 18).

[0162] Furthermore, at least one of terminal devices 41 and 42 may acquire one or more determination results from the information processing device 3. If one of terminal devices 41 and 42 acquires multiple determination results from the information processing device 3, that terminal device may change the display order of the multiple determination results based on the location of each of the multiple passengers corresponding to each of the multiple determination results and the location of that terminal device. In this case, the location of that terminal device and at least some of the locations of the multiple passengers may be illustrated (see, for example, Figure 18).

[0163] (Variation 8) Instead of determining priority based on the passenger type and the location of the terminal device (for example, at least one of terminal devices 41 and 42), the determination unit 315 may determine priority based on the passenger's location and the location of the terminal device.

[0164] For example, the determination unit 315 may determine the priority of authentication results among a plurality of authentication results so that they are displayed on the terminal device in order from the authentication results of passengers who are closest to the terminal device (for example, at least one of terminal devices 41 and 42). For example, if the distance between one passenger and terminal device 41 is shorter than the distance between another passenger and terminal device 41, the determination unit 315 may give a higher priority to the determination result relating to one passenger than to the determination results relating to the other passengers. Based on the priority, the determination unit 315 may transmit at least some of the plurality of authentication results and the locations of the passengers corresponding to those at least some authentication results to the terminal device via the communication device 33. In this case, the determination unit 315 may transmit the authentication results to the terminal device in order from the highest priority.

[0165] Furthermore, passenger 1 and other passengers may be Category 2 passengers (i.e., passengers who are identified but determined not to be able to pass through the facial recognition gate device 23), Category 3 passengers (i.e., passengers determined not to be identified), or Category 4 passengers (i.e., passengers determined not to be authenticated). In other words, the determination unit 315 may determine priority based on the passenger's location and the terminal device's location only for the determination results of Category 2 passengers, Category 3 passengers, and Category 4 passengers (in other words, passengers determined not to be able to pass through the facial recognition gate device 23).

[0166] The image acquisition unit 311 may acquire a second image that includes at least one of employee A1 and A2. The second image may be generated by camera CAM capturing images of at least one of employee A1 and A2, or by a camera different from camera CAM capturing images of at least one of employee A1 and A2.

[0167] The tracking unit 313 may detect the face orientation of at least one of employees A1 and A2 based on the second image. Since existing technologies can be applied to the face orientation detection method, a detailed explanation will be omitted. Furthermore, the detection of the face orientation of at least one of employees A1 and A2 may be performed by a functional block different from the tracking unit 313. In this case, the computing unit 31 may have a functional block for detecting the face orientation of at least one of employees A1 and A2. Since the tracking unit 313 can detect face orientation, it may also be referred to as a face orientation detection means.

[0168] The determination unit 315 may determine the priority of the determination results based on the passenger's position, the positions of terminal devices 41 and 42, and the direction of at least one of the faces of staff members A1 and A2. The determination unit 315 may give a lower priority to the determination results for passengers located in a direction that staff member A1 is not facing than to the priority of the determination results for passengers located in the direction that staff member A1 is facing. If there are multiple passengers in the direction that staff member A1 is facing, the determination unit 315 may determine the priority of the determination results for each of the multiple passengers based on the position of each of the multiple passengers and the position of the terminal device 41 (for example, based on the distance between each of the multiple passengers and the terminal device 41). In this case, the determination unit 315 may give a higher priority to the determination results where the distance between the passenger and the terminal device 41 is short than to the determination results where the distance between the passenger and the terminal device 41 is long.

[0169] The decision unit 315 may give a lower priority to the determination result for passengers located in a direction that employee A2 is not facing than to the determination result for passengers located in the direction that employee A2 is facing. If there are multiple passengers in the direction that employee A2 is facing, the decision unit 315 may determine the priority of the determination result for each of the multiple passengers based on the position of each of the multiple passengers and the position of the terminal device 42 (for example, based on the distance between each of the multiple passengers and the terminal device 42). In this case, the decision unit 315 may give a higher priority to the determination result for passengers where the distance between the passenger and the terminal device 42 is short than to the determination result for passengers where the distance between the passenger and the terminal device 42 is long.

[0170] In this case, the tracking unit 313 may estimate the visibility range, which is the range in which at least one of employees A1 and A2 can see, based on the face orientation of at least one of employees A1 and A2. The tracking unit 313 may estimate employee A1's visibility range F1 (see Figure 4) based on employee A1's face orientation. The tracking unit 313 may estimate employee A2's visibility range F2 (see Figure 4) based on employee A2's face orientation. Note that existing technologies can be applied to the method of estimating the visibility range, so a detailed explanation will be omitted. Note that if face orientation detection is performed by a functional block different from the tracking unit 313, the estimation of the visibility range may be performed by a functional block different from the tracking unit 313.

[0171] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F1 of employee A1, based on the passengers' positions. The determination unit 315 may give a higher priority to the determination results for passengers that are within the line of sight F1 of employee A1 than to the determination results for passengers that are not within the line of sight F1. The determination unit 315 may determine the priority of multiple determination results for multiple passengers that are within the line of sight F1 of employee A1, based on the passengers' positions and the position of the terminal device 41 (for example, based on the distance between the passengers and the terminal device 41). In this case, the determination unit 315 may give a higher priority to the determination results for passengers with a short distance between them than to the determination results for passengers with a long distance between them.

[0172] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F2 of employee A2, based on the passenger's position. The determination unit 315 may give a higher priority to the determination result for passengers that are within the line of sight F2 of employee A2 than to the determination result for passengers that are not within the line of sight F2. The determination unit 315 may determine the priority of multiple determination results for multiple passengers that are within the line of sight F2 of employee A2, based on the passenger's position and the position of the terminal device 42 (for example, based on the distance between the passenger and the terminal device 42). In this case, the determination unit 315 may give a higher priority to the determination result for passengers with a short distance between them than to the determination result for passengers with a long distance between them.

[0173] The determination unit 315 may consider the direction of movement of passengers in addition to the line of sight of an employee (for example, at least one of employees A1 and A2) (for example, at least one of line of sight F1 and F2). For example, the tracking unit 313 may estimate the direction of movement of each of several passengers based on several first images (i.e., several first images generated by the camera CAM). Since various existing methods can be applied to estimate the direction of movement from several images, a detailed explanation of these methods will be omitted.

[0174] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F1 of employee A1, based on the passengers' positions. The determination unit 315 may determine the priority of the determination results for one or more passengers that are within the line of sight F1 of employee A1, based on the position of the terminal device 41 and the direction of the passengers' movement. In this case, the determination unit 315 may give a higher priority to the determination result for passengers whose direction of movement is toward the terminal device 41 than to the determination result for passengers whose direction of movement is toward the terminal device 41.

[0175] The determination unit 315 may identify a determination result for one or more passengers that are within the line of sight F2 of employee A2, based on the passenger's position. The determination unit 315 may determine the priority of the determination results for one or more passengers that are within the line of sight F2 of employee A2, based on the position of the terminal device 42 and the direction of the passenger's movement. In this case, the determination unit 315 may give a higher priority to the determination result for passengers whose direction of movement is toward the terminal device 42 than to the determination result for passengers whose direction of movement is toward the terminal device 42.

[0176] Alternatively, the decision unit 315 may determine the priority of the determination result based on the position of the terminal device (for example, at least one of terminal devices 41 and 42) and the direction of the passenger's movement (in this case, the decision unit 315 does not need to consider the line of sight of the staff).

[0177] The determination unit 315 may determine the priority of the determination results based on the position of the terminal device 41 and the direction of movement of the passengers. In this case, the determination unit 315 may give a higher priority to the determination results for passengers whose direction of movement is toward the terminal device 41 than to the determination results for passengers whose direction of movement is toward the terminal device 41.

[0178] The determination unit 315 may determine the priority of the determination results based on the terminal device 42 and the direction of movement of the passenger. In this case, the determination unit 315 may give a higher priority to the determination results for passengers whose direction of movement is toward the terminal device 42 than to the determination results for passengers whose direction of movement is toward the terminal device 42.

[0179] In this case, the terminal device 41 may display an image, as shown in Figure 18, that shows the location of the terminal device 41 and at least some of the locations of the multiple passengers in a planar manner. The location of the terminal device 41 and at least some of the locations of the multiple passengers may be displayed superimposed on the airport floor map. The airport floor map may also include facility information. This facility information may include store information and equipment information (for example, at least one of toilets, stairs, escalators, and elevator lobbies).

[0180] In Figure 18, the black circle M1 indicates the location of terminal device 41. The multiple white circles indicate the locations of passengers. The solid rectangles M11 and M12 surrounding the white circles indicate that the passenger's type is either Category 3 (i.e., a passenger determined to be unidentified) or Category 4 (i.e., a passenger determined to be unauthenticated). The dashed rectangle M13 surrounding the white circle indicates that the passenger's type is Category 2 (i.e., a passenger who is identified but determined to be unable to pass through the facial recognition gate device 23). In addition to the location of terminal device 41 (black circle M1 in Figure 18), the locations of other terminal devices (for example, terminal device 42) may also be displayed on terminal device 41.

[0181] When employee A1, who possesses terminal device 41, taps any of the rectangles M11, M12, and M13, information relating to the passenger corresponding to the tapped (in other words, selected) rectangle may be displayed on terminal device 41. That is, the screen of terminal device 41 may transition to the screen shown in Figure 15, for example.

[0182] Specifically, the terminal device 41 may detect when employee A1 taps the screen of the terminal device 41. If a tap is detected, the terminal device 41 may identify the passenger that employee A1 tapped (for example, the passenger corresponding to any of the rectangles M11, M12, and M13) based on the location of the tapped screen. The terminal device 41 may transition the display from the screen shown in Figure 18 to a screen containing information about the identified passenger (for example, the screen shown in Figure 15).

[0183] Furthermore, for example, if the screen shown in Figure 15 is displayed, the terminal device 41 may detect when employee A1 taps the screen. When a tap is detected, the terminal device 41 may identify the passenger that employee A1 tapped based on the location of the tapped screen. The terminal device 41 may then transition the display from the screen shown in Figure 15 to a screen showing the location of the identified passenger (for example, the screen shown in Figure 18).

[0184] Furthermore, the information processing device 3 does not necessarily have to include a facial recognition unit 314. In this case, similar to the first modified example described above, the facial recognition process may be performed by an authentication device 5 different from the information processing device 3. In this case, the information processing device 3 and the authentication device 5 may constitute a single information processing system. This information processing system can be said to include an image acquisition unit 311 that acquires a first image including an authentication area RA through which multiple passengers pass; a facial recognition unit 51 that performs facial recognition using the first image; an information acquisition unit 312 that acquires the location of a terminal device (for example, at least one of terminal devices 41 and 42) held by an employee (for example, at least one of employees A1 and A2); and a determination unit 315 that determines the priority for notifying multiple authentication results of facial recognition based on the location of the terminal device and the locations of multiple passengers detected based on the first image.

[0185] <Third Embodiment> A third embodiment of the information processing device will be described below. The third embodiment of the information processing device, information processing method, and recording medium will be described using the information processing device 3 and the terminal device 6. In the third embodiment, some of the operation of the determination unit 315 differs from that of the second embodiment described above. Other aspects of the third embodiment may be the same as those of the second embodiment. The terminal device 6 is a terminal device corresponding to at least one of the terminal devices 41 and 42 in the second embodiment described above.

[0186] In Figure 19, the terminal device 6 comprises an arithmetic unit 61, a storage device 62, a communication device 63, an input device 64, and an output device 65. The arithmetic unit 61, storage device 62, communication device 63, input device 64, and output device 65 may be connected via a data bus 66. The arithmetic unit 61 has an information acquisition unit 611 and a determination unit 612, either as a logically implemented functional block or as a physically implemented processing circuit. The terminal device 6 may be connected to the information processing device 3 via a network NW.

[0187] The information acquisition unit 611 of the arithmetic unit 61 may acquire the ID correspondence table 321 from the information processing device 3. The information acquisition unit 611 may store the ID correspondence table 321 in the storage device 62.

[0188] The determination unit 612 of the arithmetic unit 61 may output a determination result for each of the multiple passengers based on the ID correspondence table 321. The determination unit 612 may output one of the following determination results for each of the multiple passengers: (i) a first determination result indicating that there is a matching person and that they can pass through the facial recognition gate device 23; (ii) a second determination result indicating that there is a matching person but they cannot pass through the facial recognition gate device 23; (iii) a third determination result indicating that there is no matching person; and (iv) a fourth determination result indicating that the person is not authenticated. In other words, the determination unit 612 may classify the multiple passengers into one of the following categories: a first category corresponding to the first determination result, a second category corresponding to the second determination result, a third category corresponding to the third determination result, and a fourth category corresponding to the fourth determination result.

[0189] The determination unit 612 may determine the priority of the determination result for a passenger based on the passenger's type based on the determination result and the location of the terminal device 6 (i.e., its own location). Based on the determined priority, the determination unit 612 may decide whether or not to display the determination result for that passenger. In other words, the determination unit 612 may change the display content based on the priority. Since the display content is changed based on the priority, the priority may be called the "display priority".

[0190] In this embodiment, the information processing device 3 does not necessarily have a determination unit 315. Alternatively, the determination unit 315 may output a determination result for each of the multiple passengers based on the ID correspondence table 321. The determination unit 315 may transmit the determination results for each of the multiple passengers to the terminal device 6 via the communication device 33. The determination unit 612 may determine the priority of the determination result for a single passenger based on the type of the passenger and the location of the terminal device 6, based on the determination results for each of the multiple passengers transmitted from the determination unit 315. The priority may be determined by the determination unit 315 of the information processing device 3. In this case, the determination unit 612 may decide whether or not to display the determination result based on the priority determined by the determination unit 315.

[0191] Furthermore, the operation of the terminal device 6 described above may be achieved by the terminal device 6 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium contains a computer program that causes the terminal device 6 to perform the above-described operation.

[0192] (Technical effects) According to the information processing device 3, it is possible to prevent people who cannot pass through the facial recognition gate device 23 from entering the facial recognition gate device 23. Therefore, according to the information processing device 3, it is possible to suppress a decrease in the throughput of the facial recognition gate device 23.

[0193] (modified version) Similar to the eighth modification of the second embodiment described above, the determination unit 612 may determine priority based on the passenger's location and the terminal device's location. The determination unit 612 may change the display content based on the determined priority.

[0194] <Note> The following additional information is disclosed regarding the embodiments described above.

[0195] (Note 1) Image acquisition means for acquiring a first image that includes a predetermined area through which multiple authenticated persons pass, Information acquisition means for obtaining the location of a terminal device owned by the user, A determination means for determining the priority of notifying multiple authentication results of facial recognition performed using the first image, based on the position of the terminal device and the positions of the multiple persons to be authenticated detected based on the first image, An information processing device equipped with the following features.

[0196] (Note 2) The determination means determines the priority so that the authentication results of the authenticated person closest to the terminal device are notified in order from among the plurality of authentication results. The information processing device described in Appendix 1.

[0197] (Note 3) The aforementioned multiple certified persons include the first certified person and the second certified person, The locations of the plurality of certified persons include the location of the first certified person and the location of the second certified person. The plurality of authentication results include a first authentication result which is the result of the facial recognition performed on the first person to be authenticated, and a second authentication result which is the result of the facial recognition performed on the second person to be authenticated. Based on the location of the terminal device, the location of the first person to be authenticated, and the location of the second person to be authenticated, the determination means sets the priority of the first authentication result higher than the priority of the second authentication result if the first person to be authenticated is closer to the terminal device than the second person to be authenticated. The information processing device described in Appendix 2.

[0198] (Note 4) The determination means transmits to the terminal device, based on the priority, at least some of the authentication results of the plurality of authentication results and the location of the authenticated person corresponding to at least some of the authentication results. An information processing device as described in any one of the items 1 to 3 of the appendix.

[0199] (Note 5) The image acquisition means acquires a second image including the user, The information processing device includes a face orientation detection means that detects the user's face orientation based on the second image, The determination means determines the priority based on the position of the terminal device, the detected facial orientation, and the positions of the multiple authenticated persons. An information processing device as described in any one of the items 1 to 4 of the appendix.

[0200] (Note 6) The face orientation detection means estimates the viewing range, which is the range visible to the user, from the detected face orientation. The determination means determines the priority based on the location of the terminal device, the estimated viewing range, and the locations of the multiple authenticated persons. The information processing device described in Appendix 5.

[0201] (Note 7) The determination means estimates the direction of movement of each of the multiple authenticated persons based on the multiple first images, The determination means determines the priority based on the position of the terminal device, the estimated viewing range, and the direction of movement of each of the multiple authenticated persons. The information processing device described in Appendix 6.

[0202] (Note 8) The determination means estimates the direction of movement of each of the multiple authenticated persons based on the multiple first images, The determination means determines the priority based on the position of the terminal device and the direction of movement of each of the multiple authenticated persons. An information processing device as described in any one of the items 1 to 4 of the appendix.

[0203] (Note 9) The aforementioned predetermined area is the area through which a person approaching the facial recognition gate device passes. The authentication result includes either a first type of information indicating that the person to be authenticated can pass through the facial recognition gate device, or a second type of information indicating that the person to be authenticated cannot pass through the facial recognition gate device. The determination means determines the priority of the authentication result that includes the second type information among the plurality of authentication results, based on the location of the terminal device and the locations of the plurality of authenticated persons. An information processing device as described in any one of the items 1 to 8 of the appendix.

[0204] (Note 10) The information processing device includes authentication means for performing facial recognition using the first image. An information processing device as described in any one of the items 1 to 9 of the appendix.

[0205] (Note 11) A first image is obtained that includes a predetermined area through which multiple individuals being authenticated pass. The location of the terminal device owned by the user is obtained, Based on the location of the terminal device and the locations of the multiple authenticated individuals detected based on the first image, the priority for notifying multiple authentication results of facial recognition performed using the first image is determined. Information processing methods.

[0206] (Note 12) On the computer, A first image is obtained that includes a predetermined area through which multiple individuals being authenticated pass. The location of the terminal device owned by the user is obtained, Based on the location of the terminal device and the locations of the multiple authenticated individuals detected based on the first image, the priority for notifying multiple authentication results of facial recognition performed using the first image is determined. A recording medium on which computer programs for executing information processing methods are stored.

[0207] (Note 13) Image acquisition means for acquiring a first image that includes a predetermined area through which multiple authenticated persons pass, An authentication means that performs facial recognition using the first image, Information acquisition means for obtaining the location of a terminal device owned by the user, A determination means for determining the priority of notifying multiple authentication results of the facial recognition based on the position of the terminal device and the positions of the multiple persons to be authenticated detected based on the first image, An information processing system equipped with the following features.

[0208] (Note 14) The authentication results of at least some of the multiple authentication results of facial recognition performed using a first image that includes a predetermined area through which multiple individuals to be authenticated pass are obtained. The display order of at least some of the authentication results is changed based on the location of the terminal device held by the user and the locations of the multiple authenticated persons detected based on the first image. Display method.

[0209] (Note 15) The location of the terminal device and at least some of the locations of the multiple authenticated persons are shown in the diagram. Display method as described in Appendix 14.

[0210] (Note 16) A terminal device owned by the user, Acquisition means for acquiring at least a portion of multiple authentication results of facial recognition performed using a first image which includes a predetermined area through which multiple persons to be authenticated pass; A display means that changes the display content based on the display priority, Equipped with, The displayed content includes at least a portion of the multiple authentication results, The priority is determined based on the location of the terminal device and the locations of the multiple authenticated persons detected based on the first image. Terminal device.

[0211] (Note 17) The terminal device includes a determination means for determining the priority based on the location of the terminal device and the locations of the plurality of authenticated persons detected based on the first image. The terminal device described in Appendix 16.

[0212] This disclosure is not limited to the embodiments described above and may be modified as appropriate, insofar as it does not contradict the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole. Information processing devices, information processing methods, and recording media with such modifications are also included in the technical scope of this disclosure. [Explanation of Symbols]

[0213] 1.3 Information Processing Devices 2 Airport Systems 5 Authentication device 6, 41, 42 Terminal devices 11, 311 Image acquisition unit 12, 312 Information acquisition section 13, 315 Decision Section 21 Management Server 22 Check-in terminals 23. Facial Recognition Gate Device 24. Standard gate device 31 Arithmetic unit 32 Storage device 33 Communication equipment 34 Input devices 35 Output device 36, 52, 211, 232 Face Database 51, 314 Facial Recognition Section 313 Tracking Unit

Claims

1. Image acquisition means for acquiring a first image that includes a predetermined area in front of the facial recognition gate through which multiple authenticated individuals pass, An information acquisition means for acquiring the location of a terminal device held by a user who is responsible for security or guiding the multiple authenticated persons, located in front of the aforementioned facial recognition gate, A determination means for determining the priority of notifying the terminal device of multiple authentication results of facial recognition performed using the first image, based on the position of the terminal device and the positions of the multiple persons to be authenticated detected based on the first image, Equipped with, The aforementioned plurality of certified persons include the first certified person and the second certified person, The locations of the plurality of certified persons include the location of the first certified person and the location of the second certified person. The plurality of authentication results include a first authentication result which is the result of the facial recognition performed on the first person to be authenticated, and a second authentication result which is the result of the facial recognition performed on the second person to be authenticated. The determination means, if the first person to be authenticated is closer to the terminal device than the second person to be authenticated, sets the priority of notifying the first authentication result higher than the priority of notifying the second authentication result. Information processing device.

2. The determination means notifies the terminal device of at least some of the authentication results of the plurality of authentication results and the location of the authenticated person corresponding to at least some of the authentication results, based on the priority. The information processing apparatus according to claim 1.

3. The computer acquires a first image that includes a predetermined area in front of the facial recognition gate through which multiple people to be authenticated pass. The computer acquires the location of a terminal device held by a user who is performing security or guiding the multiple authenticated persons, located in front of the facial recognition gate. The computer determines the priority for notifying the terminal device of multiple authentication results of facial recognition performed using the first image, based on the location of the terminal device and the locations of the multiple persons to be authenticated detected based on the first image. The aforementioned plurality of certified persons include the first certified person and the second certified person, The locations of the plurality of certified persons include the location of the first certified person and the location of the second certified person. The plurality of authentication results include a first authentication result which is the result of the facial recognition performed on the first person to be authenticated, and a second authentication result which is the result of the facial recognition performed on the second person to be authenticated. If the first person being authenticated is closer to the terminal device than the second person being authenticated, the computer sets the priority of notifying the first authentication result higher than the priority of notifying the second authentication result. Information processing methods.

4. The computer notifies the terminal device of at least some of the authentication results of the plurality of authentication results and the location of the authenticated person corresponding to at least some of the authentication results, based on the priority. The information processing method according to claim 3.

5. On the computer, A first image is acquired that includes a predetermined area in front of the facial recognition gate through which multiple people to be authenticated pass. The location of a terminal device held by a user who is responsible for security or guiding the multiple persons to be authenticated is acquired in front of the aforementioned facial recognition gate. Based on the position of the terminal device and the positions of the multiple persons to be authenticated detected based on the first image, the priority for notifying the terminal device of multiple authentication results of facial authentication performed using the first image is determined. The aforementioned plurality of certified persons include the first certified person and the second certified person, The locations of the plurality of certified persons include the location of the first certified person and the location of the second certified person. The plurality of authentication results include a first authentication result which is the result of the facial recognition performed on the first person to be authenticated, and a second authentication result which is the result of the facial recognition performed on the second person to be authenticated. If the first authenticated person is closer to the terminal device than the second authenticated person, the priority of notifying the first authentication result will be set higher than the priority of notifying the second authentication result. A recording medium on which computer programs for executing information processing methods are stored.

6. To the aforementioned computer, Based on the aforementioned priority, the terminal device is notified of at least some of the authentication results of the plurality of authentication results and the location of the authenticated person corresponding to at least some of the authentication results. The recording medium according to claim 5, which stores a computer program for executing an information processing method.

Images