Information processing device, information processing control method, and recording medium

Abstract

The present invention provides an information processing device comprising: an image acquisition means that acquires a first image containing a predetermined area through which a plurality of persons to be authenticated pass; an information acquisition means that acquires the position of a terminal device held by a user; and a determination means that determines priority for notifying a plurality of authentication results of face authentication performed using the first image on the basis of the position of the terminal device and the positions of the plurality of persons to be authenticated that are detected on the basis of the first image.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] For example, a device has been proposed that guides a user to a face recognition lane where identity verification is performed by face recognition or a face-to-face lane where identity verification is performed face-to-face, based on the result of comparing a face image acquired from the user with a plurality of registered face images registered in a database (see Patent Document 1).Other prior art documents related to this disclosure include Patent Documents 2 to 4. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-163457 A [Patent Document 2] Japanese Patent Publication No. 2021-056869 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-053896 [Patent Document 4] International Publication No. 2022 / 044086 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing device includes an image acquisition means for acquiring a first image including a predetermined area through which multiple subjects pass, an information acquisition means for acquiring the position of a terminal device carried by a user, and a determination means for determining the priority of notifying multiple authentication results of face authentication performed using the first image based on the position of the terminal device and the positions of the multiple subjects detected based on the first image.

[0006] One aspect of the information processing method involves acquiring a first image including a predetermined area through which multiple subjects pass, acquiring the position of a terminal device carried by the user, and determining priorities for notifying multiple authentication results of facial authentication performed using the first image based on the position of the terminal device and the positions of the multiple subjects detected based on the first image.

[0007] One embodiment of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that acquires a first image including a predetermined area through which multiple subjects pass, acquires the position of a terminal device carried by the user, and determines the priority for notifying multiple authentication results of facial authentication performed using the first image based on the position of the terminal device and the positions of the multiple subjects detected based on the first image. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram illustrating an example of a configuration of an information processing device. [Figure 2] FIG. 1 is a block diagram showing an example of the configuration of an airport system. [Figure 3] FIG. 1 is a plan view showing an example of a floor where boarding gates are provided at an airport. [Figure 4] FIG. 10 is a plan view showing an example of a virtual authentication area. [Figure 5] FIG. 10 is a block diagram showing another example of the configuration of the information processing device. [Figure 6] FIG. 2 is a diagram illustrating an example of a face database included in the information processing apparatus. [Figure 7] FIG. 10 is a diagram for explaining passenger tracking processing. [Figure 8] FIG. 10 is a diagram illustrating an example of an ID correspondence table. [Figure 9] FIG. 10 is a diagram illustrating an example of an image. [Figure 10] 10 is a flowchart showing a tracking and authentication operation according to the second embodiment. [Figure 11] 10 is a flowchart showing a decision operation according to the second embodiment. [Figure 12] FIG. 10 is a diagram illustrating an example of a screen displayed on a terminal device. [Figure 13] FIG. 2 is a block diagram illustrating an example of the configuration of an authentication device. [Figure 14] FIG. 10 is a diagram illustrating another example of a screen displayed on the terminal device. [Figure 15] FIG. 10 is a diagram illustrating another example of a screen displayed on the terminal device. [Figure 16] FIG. 10 is a diagram illustrating another example of a screen displayed on the terminal device. [Figure 17] FIG. 10 is a diagram illustrating another example of a screen displayed on the terminal device. [Figure 18] FIG. 10 is a diagram illustrating another example of a screen displayed on the terminal device. [Figure 19] FIG. 2 is a block diagram showing an example of the configuration of a terminal device. DETAILED DESCRIPTION OF THE INVENTION

[0009] An information processing device, an information processing method, and a recording medium according to an embodiment will be described.

[0010] First Embodiment A first embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 1. In the following, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1. In Fig. 1, the information processing device 1 includes an image acquisition unit 11, an information acquisition unit 12, and a determination unit 13.

[0011] The image acquisition unit 11 acquires an image including a predetermined area. Here, the predetermined area is an area through which multiple persons to be authenticated pass. Therefore, the image acquired by the image acquisition unit 11 may include one or multiple persons to be authenticated passing through the predetermined area.

[0012] The information acquisition unit 12 acquires the location of the terminal device carried by the user. The terminal device is configured to be able to notify the user of at least a part of the authentication result of the face authentication performed using the image acquired by the image acquisition unit 11. The user may be a person different from the multiple subjects to be authenticated. The user may be at least one of a guide and a security guard.

[0013] The determination unit 13 determines the priority of notifying the plurality of authentication results corresponding to the plurality of subjects, respectively, based on the location of the terminal device and the locations of the plurality of subjects to be authenticated. Here, the plurality of authentication results are authentication results of face authentication performed using images acquired by the image acquisition unit 11. For example, if the distance between one subject to be authenticated and the terminal device is shorter than the distance between another subject to be authenticated and the terminal device, the determination unit 13 may prioritize the authentication result of the one subject to be authenticated higher than the priority of the authentication results of the other subjects to be authenticated.

[0014] The terminal device can notify a user (for example, a guide or a security guard) of at least a portion of the authentication results of the facial authentication. The terminal device may display at least a portion of the authentication results of the facial authentication based on priority. For example, the terminal device may display authentication results with higher priority at the top of the screen than authentication results with lower priority. In other words, the terminal device may determine (or change) the display order of the authentication results based on priority. In other words, the terminal device may change the display content based on priority.

[0015] A user is often located near a terminal device. Therefore, the location of the terminal device can be interpreted as the location of the user. However, it is difficult for a user to handle all of the multiple people to be authenticated. By determining the priority of the authentication results based on the location of the terminal device and the location of the people to be authenticated, and changing the display content of the terminal device based on the priority, it is possible to reduce the number of people to be authenticated that the user must handle.

[0016] When a user deals with a person to be authenticated, it is considered that the time required to deal with a person to be authenticated who is located far from the user will be longer than the time required to deal with a person to be authenticated who is located close to the user. According to the information processing device 1, the priority of the authentication result is determined based on the position of the terminal device and the positions of multiple people to be authenticated (for example, the priority of a person to be authenticated who is close to the terminal device is higher than the priority of a person to be authenticated who is far from the terminal device), so it can be expected that the user will be able to deal with the person to be authenticated efficiently.

[0017] For example, the facial recognition gate device may allow passage of a person whose facial recognition has been successful, but may not allow passage of a person whose facial recognition has been unsuccessful. The facial recognition gate device may determine that facial recognition has been successful when the face of a person attempting to pass through the facial recognition gate device corresponds to a face shown in a pre-registered facial image. In other words, the facial recognition gate device may determine that facial recognition has been successful when there is a person whose pre-registered facial image corresponds to the person attempting to pass through the facial recognition gate device.

[0018] Therefore, if the facial image of a person attempting to pass through the facial recognition gate device is not registered, the facial recognition gate device will not allow that person to pass through (for example, if the facial recognition gate device is a flap-type gate device, the flap will be in a closed state). Therefore, when a person whose facial image is not registered enters the facial recognition gate device, the flow of people passing through the facial recognition gate device is impeded because that person is not allowed to pass through. In other words, the throughput of the facial recognition gate device decreases.

[0019] For example, whether or not the person to be authenticated can pass through the facial recognition gate device may be indicated based on the authentication result of the facial recognition performed using the image acquired by the image acquisition unit 11. In this case, the determination unit 13 may determine the priority of the authentication results based on the position of the terminal device and the positions of multiple people to be authenticated so that the authentication result indicating that the person cannot pass through the facial recognition gate device is notified to the user preferentially.

[0020] With this configuration, a user (for example, at least one of a guide and a security guard) can give priority to those who cannot pass through the facial recognition gate device. As a result, it is possible to prevent those who cannot pass through the facial recognition gate device from entering the facial recognition gate device. Therefore, the information processing device 1 can prevent a decrease in the throughput of the facial recognition gate device.

[0021] In the information processing device 1, the image acquisition unit 11 may acquire an image including a predetermined area through which multiple subjects pass. The information acquisition unit 12 may acquire the position of a terminal device carried by a user. The determination unit 13 may determine the priorities of multiple authentication results of face authentication performed using the image, based on the position of the terminal device and the positions of multiple subjects detected based on the image.

[0022] Such an information processing device 1 may be realized, for example, by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium records a computer program for causing a computer to execute an information processing method for acquiring an image including a predetermined area through which multiple subjects pass, acquiring the position of a terminal device carried by the user, and determining priorities for notifying multiple authentication results of face authentication performed using the image based on the position of the terminal device and the positions of the multiple subjects detected based on the image.

[0023] Second Embodiment A second embodiment of the display control device, the display control method, and the recording medium will be described with reference to Figures 2 to 12. In the following, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 3 used in an airport.

[0024] First, an airport system 2 at an airport will be described with reference to Fig. 2. In Fig. 2, the airport system 2 includes a management server 21, a check-in terminal 22, and a plurality of gate devices installed at boarding gates. The management server 21, the check-in terminal 22, and the plurality of gate devices are connected to one another via a network NW.

[0025] The airport system 2 may include other check-in terminals in addition to the check-in terminal 22. That is, the airport system 2 may include multiple check-in terminals. The network NW may be a wide area network (WAN) such as the Internet, or a local area network (LAN).

[0026] The multiple gate devices have a facial recognition function that performs facial recognition processing, and include a facial recognition gate device 23 that determines whether a passenger is allowed to pass based on the results of the facial recognition processing, and a gate device 24 that determines whether a passenger is allowed to pass based on the airline ticket held by the passenger. The gate device 24 will hereinafter be referred to as a "normal gate device 24" as appropriate. As shown in Figure 3, the airport is assumed to be equipped with boarding gates G1, G2, and G3. The facial recognition gate device 23 and the normal gate device 24 are assumed to be installed at boarding gate G1.

[0027] The term "air ticket" may refer to at least one of a paper airline ticket and an electronic airline ticket. In addition to or instead of at least one of a paper airline ticket and an electronic airline ticket, the term "air ticket" may also be a concept that includes personal information associated with an electronic airline ticket (for example, a passport, a credit card used to purchase the airline ticket, etc.).

[0028] The management server 21 has a face database 211 (hereinafter referred to as "face DB211"), an operation database 212 (hereinafter referred to as "operation DB212"), and a gate database 213 (hereinafter referred to as "gate DB213").

[0029] The face DB 211 stores face images used in face recognition processing. Instead of or in addition to face images, feature quantities related to face images may be stored in the face DB 211. The flight DB 212 stores aircraft flight information (so-called flight information). The flight information may include the flight name of the aircraft, gate identification information for identifying the boarding gate (e.g., boarding gate number), and boarding start time. The flight name, identification information, and boarding start time of the aircraft may be associated with each other.

[0030] The gate DB 213 has registered therein a plurality of pieces of boarding gate information corresponding to a plurality of boarding gates, respectively. Note that the entity that manages and / or operates the airport system 2 may be different from the airport company that manages and operates the airport and the airline that operates the aircraft. In this case, the plurality of pieces of boarding gate information registered in the gate DB 213 may be acquired from a system related to at least one of the airport company and the airline. The gate DB 213 may be shared between the airport system 2 and a system related to at least one of the airport company and the airline.

[0031] The boarding gate information may include gate identification information (e.g., a boarding gate number) for identifying the boarding gate and device information related to the installed gate device. The device information may be information indicating the number of gate devices and at least one of the type, operating status, and installation location of each gate device. Here, the types of gate devices may include a first type capable of facial recognition and a second type not capable of facial recognition. The second type of gate device may include a gate device capable of reading information (e.g., ID) for identifying passengers (e.g., a two-dimensional barcode). The operating status of the gate device may include an operating state in which the gate device is operating and an inactive state in which the gate device is inactive (i.e., not operating). For example, when two or more gate devices are installed at one boarding gate, the installation locations of the gate devices may be expressed as the relative positions of the two or more gate devices. Alternatively, the installation locations of the gate devices may be expressed as the coordinates of each gate device in a coordinate system related to the floor (so-called departure floor) where the airport boarding gates are located. If only one gate device is installed at one boarding gate, the device information does not need to include the installation location of the gate device. The inactive state may include a state in which no power is supplied to the gate device (e.g., a power-off state) and a state in which power is supplied to part of the gate device but the gate device cannot perform its function (a so-called standby state). The multiple boarding gate information registered in gate DB213 may be predetermined according to at least one of the airline and the flight. The multiple boarding gate information registered in gate DB213 may be automatically updated according to the departure time of the aircraft, etc.

[0032] The check-in terminal 22 is a terminal used for boarding procedures (i.e., check-in). The check-in terminal 22 may be operated by an airport staff member or a passenger (i.e., the check-in terminal 22 may be a so-called automatic check-in machine). Note that the term "airport staff member" is not limited to a person who belongs to an airport company that manages and operates the airport, but also includes a person who works at the airport, such as a person who belongs to an airline that operates aircraft.

[0033] The check-in terminal 22 performs check-in procedures for passengers based on the airline tickets held by the passengers. The check-in terminal 22 may acquire facial images of passengers during check-in procedures. The check-in terminal 22 may acquire facial images of passengers by capturing images of the passengers with a camera, or may acquire facial images of passengers by reading facial photographs printed on passports held by the passengers. Note that the check-in terminal 22 does not need to acquire facial images of all passengers.

[0034] The check-in terminal 22 transmits passenger information (e.g., name and flight number) of a passenger who has completed check-in procedures and a facial image of the passenger to the management server 21. Note that the check-in terminal 22 may acquire the passenger information from information printed on an airline ticket (in other words, information associated with the airline ticket).

[0035] The management server 21 associates the passenger information and facial image transmitted from the check-in terminal 22 with each other and registers them in the face DB 211. At this time, the management server 21 may assign passenger identification information for identifying the passenger to the passenger information and facial image. As will be described later, the facial image is used in facial authentication processing. For this reason, the passenger identification information assigned to the passenger information and facial image will hereinafter be referred to as an "authentication ID" as appropriate. Note that the passenger's facial image may be acquired by an application (e.g., an application provided by an airline) installed on a terminal device (e.g., a smartphone) carried by the passenger, in addition to or instead of the check-in terminal 22, or may be acquired by a gate device installed in the departure immigration area of ​​the airport.

[0036] Based on the current time, management server 21 may identify the flight name of an aircraft that is a first predetermined time (e.g., several minutes to several tens of minutes) before the boarding start time from the flight information registered in flight DB 212. Based on the gate identification information associated with the identified flight name, management server 21 may extract gate information corresponding to the gate identification information from multiple pieces of gate information registered in gate DB 213. Based on the extracted gate information, management server 21 may determine whether a facial recognition gate device (e.g., facial recognition gate device 23) is installed at the boarding gate corresponding to the extracted gate information.

[0037] If it is determined that a facial recognition gate device (e.g., the facial recognition gate device 23) is installed, the management server 21 may extract, from the face DB 211, a facial image of a passenger associated with passenger information including the specified flight number (in other words, a passenger scheduled to board an aircraft with the specified flight number). The management server 21 may transmit the extracted facial image to a facial recognition gate device (e.g., the facial recognition gate device 23) specified by the extracted gate information. If it is determined that a facial recognition gate device is not installed, the management server 21 may not perform these processes. If it is determined that a facial recognition gate device is installed, the management server 21 may determine whether the installed facial recognition gate device is operating based on the extracted gate information. If feature amounts related to facial images are registered in the face DB 211, the management server 21 may transmit the feature amounts related to the facial image to the facial recognition gate device instead of or in addition to the facial image.

[0038] The face authentication gate device 23 has a camera 231, a face database 232 (hereinafter referred to as "face DB 232"), and a face authentication unit 233. Face images transmitted from the management server 21 are registered in the face DB 232. The face authentication gate device 23 may have a display device 234. The display device 234 may display at least one of an image captured by the camera 231 and information indicating the result of the face authentication process.

[0039] The face authentication unit 233 performs face authentication processing using an image captured by the camera 231 (for example, an image that includes the passenger's face) and a face image registered in the face DB 232. If face authentication is successful, the face authentication gate device 23 allows the passenger to pass. On the other hand, if face authentication is unsuccessful, the face authentication gate device 23 does not allow the passenger to pass. Note that various existing methods (for example, at least one of a two-dimensional (2D) authentication method and a three-dimensional (3D) authentication method) can be applied to the face authentication processing.

[0040] A specific example of face recognition processing in the face recognition gate device 23 will be described. The face recognition gate device 23 may be a flap-type gate device. The face recognition device 233 may extract features of an image captured by the camera 231. The face recognition device 233 may compare the extracted features with features related to face images registered in the face DB 232. At this time, the face recognition device 233 may calculate a matching score (or a similarity score) based on the extracted features and the features related to face images registered in the face DB 232. If the matching score is equal to or greater than a threshold (i.e., if face recognition is successful), the face recognition device 233 may allow the passenger to pass. At this time, the face recognition device 233 may identify the authentication ID related to the passenger. In this case, the face recognition gate device 23 may open the flap. If the matching score is less than the threshold (i.e., if face recognition is unsuccessful), the face recognition device 233 may not allow the passenger to pass. In this case, the face recognition gate device 23 may close the flap. Note that the face DB 232 may store feature amounts related to face images instead of or in addition to face images.

[0041] Note that a device other than the facial recognition gate device 23 (e.g., the management server 21) may perform part of the facial recognition process. In this case, the facial recognition device 233 of the facial recognition gate device 23 may extract features of the image captured by the camera 231. The facial recognition device 233 may transmit the extracted features to the other device. The other device may compare the features transmitted from the facial recognition device 233 with features related to facial images registered in a face database (e.g., the face DB 211). The other device may transmit information indicating the comparison result (e.g., information indicating whether the comparison score is equal to or greater than a threshold) to the facial recognition gate device 23. Note that if the comparison score is equal to or greater than the threshold, the other device may include an authentication ID related to the passenger in the information indicating the comparison result. If the information indicating the comparison result indicates that the comparison score is equal to or greater than the threshold, the facial recognition device 233 may allow the passenger to pass. If the information indicating the comparison result indicates that the comparison score is less than the threshold, the facial recognition device 233 may not allow the passenger to pass.

[0042] It is expected that passengers will pass through the facial recognition gate device 23 at a faster speed than through the normal gate device 24. In other words, it is expected that the number of passengers passing through the facial recognition gate device 23 in a given period of time will be greater than the number of passengers passing through the normal gate device 24. In other words, the facial recognition gate device 23 can improve throughput at the boarding gate.

[0043] However, as described above, only passengers whose faces have been successfully authenticated are allowed to pass through the facial recognition gate device 23. In order for a passenger to be successful in facial authentication at the facial recognition gate device 23, the passenger's facial image must be registered in the face DB 232 of the facial recognition gate device 23. If a passenger whose facial image is not registered in the face DB 232 enters the facial recognition gate device 23, the passenger will not be permitted to pass through, which will result in a decrease in throughput at the boarding gate.

[0044] To address this problem, it may be possible to extract passengers who are not allowed to pass through the facial recognition gate device 23 (so-called screening) before the passengers enter the facial recognition gate device 23.

[0045] In view of the above-mentioned problems, the information processing device 3 determines whether or not a passenger can pass through the facial recognition gate device 23 before the passenger enters the facial recognition gate device 23. In other words, the information processing device 3 determines whether or not a passenger can pass through the facial recognition gate device 23, separately from the facial recognition gate device 23.

[0046] 4, a virtual authentication area RA is provided around boarding gate G1 where face recognition gate device 23 and normal gate device 24 are installed. The authentication area RA is an area through which multiple passengers heading to either face recognition gate device 23 or normal gate device 24 pass. The authentication area RA corresponds to an example of the "predetermined area" in the first embodiment described above.

[0047] Additionally, airport staff (e.g., at least one of a guide and a security guard) A1 and A2 are stationed around boarding gate G1. Staff A1 possesses a terminal device 41. Staff A2 possesses a terminal device 42. As shown in FIG. 2, the terminal devices 41 and 42 are connected to an information processing device 3 via a network NW. Note that "possessing" does not necessarily mean "wearing." For example, even if staff A1 does not have the terminal device 41 on his or her person, as long as he or she is in substantial control of the terminal device 41, it may be interpreted that staff A1 possesses the terminal device 41. Note that the terminal devices 41 and 42 may be configured as any of a tablet terminal, a smartphone, and AR (Augmented Reality) glasses. Note that staff A1 and A2 correspond to the "user" in the first embodiment described above. Note that at least one of the terminal devices 41 and 42 may constitute a part of the airport system 2. In other words, the airport system 2 may include at least one of the terminal devices 41 and 42. It should be noted that there may be other terminal devices in addition to the terminal devices 41 and 42. In other words, there may be three or more terminal devices.

[0048] The camera CAM is installed so as to be able to capture an image of the authentication area RA. The camera CAM may be connected to the information processing device 3 via a network NW. The camera CAM does not have to be installed so that the entire authentication area RA is included in its angle of view. In other words, the camera CAM may be installed so as to be able to capture an image of at least a part of the authentication area RA. The camera CAM may be installed in a position that does not interfere with the passage of passengers (for example, a position higher than the passengers' heads). As will be described later, images captured by the camera CAM may be used for face recognition processing. For this reason, the camera CAM may be a high-resolution camera such as a 4K resolution camera. The camera CAM does not have to be connected to the information processing device 3 via a network NW. In this case, the camera CAM may be connected to the information processing device 3 via a cable (for example, a USB (Universal Serial Bus) cable).

[0049] The camera CAM may capture an image of the authentication area RA to generate a first image that is an image including the authentication area RA. The first image may be an image equivalent to one frame of a video.

[0050] The information processing device 3 performs face recognition processing using a first image generated by the camera CAM capturing an image of the authentication area RA, and determines whether or not a passenger included in the first image is allowed to pass through the face recognition gate device 23 before the passenger enters the face recognition gate device 23. The information processing device 3 will be described in detail below.

[0051] As shown in FIG. 5, the information processing device 3 includes a calculation device 31, a storage device 32, and a communication device 33. The information processing device 3 may include an input device 34 and an output device 35. The information processing device 3 may include a face database 36 (hereinafter referred to as "face DB 36"). The information processing device 3 does not have to include at least one of the input device 34 and the output device 35. In the information processing device 3, the calculation device 31, the storage device 32, the communication device 33, the input device 34, the output device 35, and the face DB 36 may be connected via a data bus 37. The information processing device 3 is connected to the management server 21 via the communication device 33 and the network NW. The information processing device 3 may constitute a part of the airport system 2. In other words, the airport system 2 may include the information processing device 3.

[0052] The arithmetic device 31 may include, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0053] The storage device 32 may include, for example, at least one of a random access memory (RAM), a read-only memory (ROM), a hard disk device, a magneto-optical disk device, a solid-state drive (SSD), and an optical disk array. In other words, the storage device 32 may include a non-transitory recording medium. The storage device 32 is capable of storing desired data. For example, the storage device 32 may temporarily store a computer program executed by the arithmetic device 31. The storage device 32 may temporarily store data that is temporarily used by the arithmetic device 31 when the arithmetic device 31 is executing a computer program.

[0054] The communication device 33 is capable of communicating with the management server 21 via the network NW. The communication device 33 may be capable of communicating with devices external to the information processing device 3 other than the management server 21 via the network NW. The communication device 33 may perform wired communication or wireless communication.

[0055] The input device 34 is a device capable of accepting information input to the information processing device 3 from outside. It may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 3. The input device 34 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 3, such as a USB memory. Note that when information is input to the information processing device 3 via the communication device 33 (in other words, when the display control device 2 acquires information via the communication device 33), the communication device 33 may function as an input device.

[0056] The output device 35 is a device capable of outputting information to the outside of the information processing device 3. The output device 35 may output visual information such as characters or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 35 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 35 may be capable of outputting information to a recording medium detachable from the information processing device 3, such as a USB memory. Note that when the information processing device 3 outputs information via the communication device 33, the communication device 33 may function as the output device.

[0057] The arithmetic device 31 may have an image acquisition unit 311, an information acquisition unit 312, a tracking unit 313, a face authentication unit 314, and a determination unit 315 as logically realized functional blocks or as physically realized processing circuits. At least one of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 313, the face authentication unit 314, and the determination unit 315 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least some of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 313, the face authentication unit 314, and the determination unit 315 are functional blocks, at least some of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 313, the face authentication unit 314, and the determination unit 315 may be realized by the arithmetic device 31 executing a predetermined computer program.

[0058] The arithmetic device 31 may acquire (in other words, read) the predetermined computer program from the storage device 32. The arithmetic device 31 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 3. The arithmetic device 31 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 3 via the communication device 33. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 31 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0059] The management server 21 transmits at least a portion of the facial image registered in the face DB 211 to the information processing device 3 together with the authentication ID (i.e., passenger identification information) assigned to the facial image. In this case, the management server 21 may transmit gate identification information and boarding start time in addition to the facial image to the information processing device 3. The management server 21 may identify the gate identification information and boarding start time based on the flight name of the aircraft included in the passenger information associated with the facial image registered in the face DB 211 and the flight information registered in the flight DB 212. In other words, the management server 21 may identify the gate identification information and boarding start time related to the aircraft on which the passenger represented by the facial image will board. Note that, when feature amounts related to the facial image are registered in the face DB 211 instead of or in addition to the facial image, the management server 21 may transmit the feature amounts related to the facial image to the information processing device 3 instead of or in addition to the facial image.

[0060] The information processing device 3 registers the facial image transmitted from the management server 21 in the face DB 36. The information processing device 3 may register gate identification information and boarding start times in addition to facial images in the face DB 36. As shown in FIG. 6, the face DB 36 may include (i) a plurality of facial images and (ii) a table that associates authentication IDs, gate identification information (e.g., boarding gate numbers), boarding start times, and facial images with each other. The management server 21 may transmit at least some of the facial images registered in the face DB 211 to the information processing device 3 at predetermined intervals. The information processing device 3 may update the facial images registered in the face DB 36 every time a facial image is transmitted from the management server 21. When the management server 21 transmits feature amounts related to the facial images to the information processing device 3 instead of or in addition to the facial images, the feature amounts related to the facial images may be registered in the face DB 36 instead of or in addition to the facial images.

[0061] The image acquisition unit 311 of the calculation device 31 may acquire one or more first images generated by the camera CAM via the communication device 33. The image acquisition unit 311 may store the acquired one or more first images in the storage device 32. The information acquisition unit 312 of the calculation device 31 acquires boarding gate information related to boarding gate G1 from the gate DB 213 of the management server 21 via the communication device 33. The information acquisition unit 312 may store the acquired boarding gate information in the storage device 32.

[0062] The information acquisition unit 312 of the calculation device 31 acquires terminal location information indicating the location of each of the terminal devices 41 and 42. The information acquisition unit 312 may acquire the terminal location information from each of the terminal devices 41 and 42. In this case, the location of the terminal device 41 may be detected by the location information function of the terminal device 41. Similarly, the location of the terminal device 42 may be detected by the location information function of the terminal device 42.

[0063] The tracking unit 313 of the calculation device 31 tracks one or more passengers passing through the authentication area RA, using the multiple first images acquired by the image acquisition unit 311 (i.e., the multiple first images generated by the camera CAM). The face authentication unit 314 of the calculation device 31 performs face authentication processing on one or more passengers passing through the authentication area RA, using the multiple first images acquired by the image acquisition unit 311.

[0064] A case where the tracking unit 313 performs tracking processing of a passenger P1 passing through the authentication area RA shown in Fig. 4 and the face authentication unit 314 performs face authentication processing of the passenger P1 will be described with reference to Fig. 7. Note that the passenger P1 is also a target of the face authentication processing, and therefore may be referred to as a person to be authenticated.

[0065] Images IMG1, IMG2, and IMG3 shown in FIG. 7 are images including passenger P1 (in other words, images in which passenger P1 appears). Image IMG1 is an image generated by camera CAM capturing an image of authentication area RA at time t1. Image IMG2 is an image generated by camera CAM capturing an image of authentication area RA at time t2, which is later than time t1. Image IMG3 is an image generated by camera CAM capturing an image of authentication area RA at time t3, which is later than time t2.

[0066] Each of images IMG1, IMG2, and IMG3 may be an image corresponding to one frame of a video. In this case, image IMG2 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG1. In other words, image IMG2 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG1. Similarly, image IMG3 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG2. In other words, image IMG3 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG2.

[0067] The tracking unit 313 detects the head of passenger P1 contained in image IMG1 from image IMG1. Note that the method for detecting a person's head from an image is an existing technique, so a detailed description thereof will be omitted. Based on the detected head of passenger P1, the tracking unit 313 sets an area including the head of passenger P1 as a tracking area TA1.

[0068] When the tracking unit 313 sets the tracking area TA1, it sets a tracking ID, which is identification information for identifying the passenger P1 related to the tracking area TA1, to the passenger P1. The tracking unit 313 calculates the position of the passenger P1 based on the tracking area TA1. Note that, since existing technology can be applied to a method for calculating the position of a subject included in an image from the image, a detailed description thereof will be omitted. The tracking unit 313 may associate the tracking ID with the position of the passenger P1 and register them in an ID correspondence table 321 stored in the storage device 32.

[0069] When the tracking area TA1 is set, the tracking unit 313 may determine whether or not the face of passenger P1 is captured in the tracking area TA1. In other words, the tracking unit 313 may perform face detection on the tracking area TA1. When it is determined that the face of passenger P1 is captured in the tracking area TA1, the tracking unit 313 generates a face image including the face area of ​​passenger P1. The tracking unit 313 associates the generated face image with the tracking ID related to passenger P1 and transmits it to the face authentication unit 314. Note that when it is determined that the face of passenger P1 is not captured in the tracking area TA1, the tracking unit 313 does not need to generate a face image.

[0070] The face authentication unit 314 performs face authentication processing using the face image transmitted from the tracking unit 313 and the face images registered in the face DB 36. The face authentication unit 314 may extract features of the face image transmitted from the tracking unit 313. The face authentication unit 314 may compare the features of the face image transmitted from the tracking unit 313 with features related to face images registered in the face DB 36. At this time, the face authentication unit 314 may calculate a matching score (or a similarity score) based on the extracted features and the features related to face images registered in the face DB 36. The face authentication unit 314 may compare the matching score with a threshold. If the matching score is equal to or greater than the threshold, the face authentication unit 314 may determine that the face indicated by the face image transmitted from the tracking unit 313 corresponds to the face indicated by one of the face images registered in the face DB 36. If the matching score is less than the threshold value, it may be determined that a face image indicating a face corresponding to the face indicated by the face image transmitted from the tracking unit 313 is not registered in the face DB 36.

[0071] If the face indicated by the facial image transmitted from the tracking unit 313 corresponds to the face indicated by one of the facial images registered in the face DB 36 (in other words, if facial authentication is successful), the facial authentication unit 314 registers the authentication ID associated with the one facial image in the ID correspondence table 321 in association with the tracking ID associated with the facial image transmitted from the tracking unit 313. The facial authentication unit 314 may register the authentication time, which is the time when the facial authentication process was performed, in the ID correspondence table 321 in addition to the authentication ID.

[0072] If a facial image indicating a face corresponding to the face indicated by the facial image sent from the tracking unit 313 is not registered in the face DB36 (in other words, if facial authentication fails), the facial authentication unit 314 may register information indicating that there is no corresponding person (for example, "N / A (Not Applicable)") in the ID correspondence table 321, in association with the tracking ID associated with the facial image sent from the tracking unit 313.

[0073] In this case, the face authentication unit 314 may register failure reason information indicating the reason for the face authentication failure in the ID correspondence table 321. The reasons for the face authentication failure may include a first reason indicating that the face authentication failed because the image (e.g., a face image) was inappropriate for face authentication, and a second reason indicating that the face authentication failed even though the image (e.g., a face image) was appropriate for face authentication. Images inappropriate for face authentication may include an image in which the face of a passenger (e.g., passenger P1) is facing downward or to the side, or part of the face is hidden by an obstruction, making the passenger's facial region inappropriate for face authentication; an image of a passenger that is unusual (in other words, different from the face represented by the face image registered in the face DB 36) (e.g., a face image including at least one of beard, glasses, and a mask); and an image that is out of focus or blurred. The second reason for the face authentication failure may be when a face image representing the face of the passenger (e.g., passenger P1) to be subjected to face authentication processing is not registered in the face DB 36.

[0074] The tracking unit 313 may use the image IMG2 and the image IMG1 to identify the passenger P1 included in the image IMG2. Identifying the passenger P1 included in the image IMG2 is synonymous with associating the passenger P1 included in the image IMG1 with the passenger P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method related to association between images can be applied to identifying the passenger P1 included in the image IMG2. Note that various existing methods can be applied to each of the matching method and the optical flow method, and therefore detailed explanations thereof will be omitted.

[0075] When passenger P1 included in image IMG2 is identified, the tracking unit 313 detects the head of passenger P1. Based on the detected head of passenger P1, the tracking unit 313 sets an area including the head of passenger P1 as tracking area TA2. Since passenger P1 included in image IMG1 and passenger P1 included in image IMG2 are the same passenger, the tracking ID of passenger P1 related to tracking area TA2 is the same as the tracking ID of passenger P1 related to tracking area TA1. The tracking unit 313 calculates the position of passenger P1 based on the tracking area TA2.

[0076] The tracking unit 313 registers the position of passenger P1 in the ID correspondence table 321 in association with the tracking ID related to passenger P1. In this case, since the position of passenger P1 calculated based on tracking area TA1 is registered in the ID correspondence table 321, the tracking unit 313 registers the position of passenger P1 calculated based on tracking area TA2 in the ID correspondence table 321, thereby updating the position of passenger P1.

[0077] When the tracking area TA2 is set, the tracking unit 313 may determine whether the face of the passenger P1 is captured in the tracking area TA2. In other words, the tracking unit 313 may perform face detection on the tracking area TA2. When it is determined that the face of the passenger P1 is captured in the tracking area TA2, the tracking unit 313 generates a face image including the face area of ​​the passenger P1. The tracking unit 313 associates the generated face image with the tracking ID related to the passenger P1 and transmits the image to the face authentication unit 314. When it is determined that the face of the passenger P1 is not captured in the tracking area TA2, the tracking unit 313 does not need to generate a face image. When it is determined that the face of the passenger P1 is captured in the tracking area TA2, the tracking unit 313 does not need to generate a face image if the tracking ID related to the passenger P1 is associated with the authentication ID in the ID correspondence table 321 (i.e., if face authentication has already been successful), the tracking unit 313 does not need to generate a face image.

[0078] The face authentication unit 314 performs face authentication processing using the face image transmitted from the tracking unit 313 and the face images registered in the face DB 36. If the face indicated by the face image transmitted from the tracking unit 313 corresponds to the face indicated by one of the face images registered in the face DB 36 (in other words, if face authentication is successful), the face authentication unit 314 registers the authentication ID associated with the one face image in the ID correspondence table 321 in association with the tracking ID associated with the face image transmitted from the tracking unit 313. The face authentication unit 314 may register, in the ID correspondence table 321, the authentication time, which is the time when the face authentication processing was performed, in addition to the authentication ID. Note that if the authentication time has already been registered in the ID correspondence table 321 (i.e., if face authentication was successful in the past), the face authentication unit 314 may update the authentication time registered in the ID correspondence table 321.

[0079] If a face image indicating a face corresponding to the face indicated by the face image transmitted from the tracking unit 313 is not registered in the face DB 36 (in other words, if face authentication fails), the face authentication unit 314 may register information indicating that there is no match in the ID correspondence table 321, in association with the tracking ID associated with the face image transmitted from the tracking unit 313. In this case, the face authentication unit 314 may register failure reason information indicating the reason for the failure of face authentication in the ID correspondence table 321.

[0080] The tracking unit 313 may use the image IMG3 and the image IMG2 to identify the passenger P1 included in the image IMG3. When the passenger P1 included in the image IMG3 is identified, the tracking unit 313 detects the head of the passenger P1. Based on the detected head of the passenger P1, the tracking unit 313 sets the area including the head of the passenger P1 as a tracking area TA3. Since the passenger P1 included in the image IMG2 and the passenger P1 included in the image IMG3 are the same passenger, the tracking ID of the passenger P1 related to the tracking area TA3 is the same as the tracking ID of the passenger P1 related to the tracking area TA2. The tracking unit 313 calculates the position of the passenger P1 based on the tracking area TA3.

[0081] The tracking unit 313 registers the position of passenger P1 in the ID correspondence table 321 in association with the tracking ID related to passenger P1. In this case, since the position of passenger P1 calculated based on tracking area TA2 is registered in the ID correspondence table 321, the tracking unit 313 registers the position of passenger P1 calculated based on tracking area TA3 in the ID correspondence table 321, thereby updating the position of passenger P1.

[0082] When the tracking area TA3 is set, the tracking unit 313 may determine whether the face of the passenger P1 is captured in the tracking area TA3. In other words, the tracking unit 313 may perform face detection on the tracking area TA3. When it is determined that the face of the passenger P1 is captured in the tracking area TA3, the tracking unit 313 generates a face image including the face area of ​​the passenger P1. The tracking unit 313 associates the generated face image with the tracking ID related to the passenger P1 and transmits the image to the face authentication unit 314. When it is determined that the face of the passenger P1 is not captured in the tracking area TA3, the tracking unit 313 does not need to generate a face image. When it is determined that the face of the passenger P1 is captured in the tracking area TA3, the tracking unit 313 does not need to generate a face image if the tracking ID related to the passenger P1 is associated with the authentication ID in the ID correspondence table 321 (i.e., if face authentication has already been successful), the tracking unit 313 does not need to generate a face image.

[0083] The face authentication unit 314 performs face authentication processing using the face image transmitted from the tracking unit 313 and the face images registered in the face DB 36. If the face indicated by the face image transmitted from the tracking unit 313 corresponds to the face indicated by one of the face images registered in the face DB 36 (in other words, if face authentication is successful), the face authentication unit 314 registers the authentication ID associated with the one face image in the ID correspondence table 321 in association with the tracking ID associated with the face image transmitted from the tracking unit 313. The face authentication unit 314 may register, in the ID correspondence table 321, the authentication time, which is the time when the face authentication processing was performed, in addition to the authentication ID. Note that if the authentication time has already been registered in the ID correspondence table 321 (i.e., if face authentication was successful in the past), the face authentication unit 314 may update the authentication time registered in the ID correspondence table 321.

[0084] If a face image indicating a face corresponding to the face indicated by the face image transmitted from the tracking unit 313 is not registered in the face DB 36 (in other words, if face authentication fails), the face authentication unit 314 may register information indicating that there is no match in the ID correspondence table 321, in association with the tracking ID associated with the face image transmitted from the tracking unit 313. In this case, the face authentication unit 314 may register failure reason information indicating the reason for the failure of face authentication in the ID correspondence table 321.

[0085] The tracking unit 313 and the face authentication unit 314 may repeat the above-described process until the passenger P1 passes through the authentication area RA. The tracking unit 313 calculates the position of the passenger P1 as described above. In other words, it can be said that the tracking unit 313 detects the position of the passenger P1. For this reason, the tracking unit 313 may be referred to as a position detection means.

[0086] An example of the ID correspondence table 321 will now be described with reference to FIG. 8. As shown in FIG. 8, in the ID correspondence table 321, a tracking ID, a tracking location (for example, the location of passenger P1), an authentication ID, and an authentication time may be associated with one another. In the ID correspondence table 321, when a tracking ID is associated with a specific authentication ID, this indicates that a facial image of a person corresponding to the passenger to whom the tracking ID is set is registered in the face DB 36. When a tracking ID is associated with the character string "N / A", this indicates that a facial image of a person corresponding to the passenger to whom the tracking ID is set is not registered in the face DB 36. When a tracking ID is not associated with an authentication ID (i.e., when the authentication ID field is blank), this indicates that a facial authentication process has never been performed.

[0087] However, it may become difficult for the tracking unit 313 to continue tracking passenger P1, for example, because the head of passenger P1 is hidden behind another person. When tracking of passenger P1 is interrupted, the tracking unit 313 may perform the following process. After tracking of passenger P1 is interrupted, the tracking unit 313 may determine whether a new passenger has been detected from the first image acquired by the image acquisition unit 311 (i.e., the first image generated by the camera CAM). A "new passenger" means a passenger for whom a tracking ID has not been set.

[0088] When a new passenger is detected, the tracking unit 313 may compare the feature amount of the tracking area related to passenger P1 (e.g., at least one of tracking areas TA1, TA2, and TA3) with the feature amount of the tracking area related to the new passenger to determine whether passenger P1 and the new passenger are the same person. If it is determined that passenger P1 and the new passenger are the same person, the tracking unit 313 may assign the tracking ID related to passenger P1 to the new passenger. As a result, the tracking unit 313 can track passenger P1 again. Note that the feature amount may be a feature amount related to the passenger's head, a feature amount related to the passenger's upper body, or a feature amount related to the passenger's entire body. Therefore, the tracking area may include the passenger's head, the passenger's upper body, or the passenger's entire body. Note that the feature amount may be obtained, for example, by person re-identification technology.

[0089] The tracking unit 313 and the face authentication unit 314 may perform the above-described tracking process and face authentication process for each of the multiple passengers included in one first image generated by the camera CAM. Here, the authentication area RA may be, for example, an area of ​​5 meters by 5 meters. A distance of 5 meters is a distance that allows 5 to 6 passengers to pass through in a line. If the authentication area RA is an area of ​​5 meters by 5 meters, 20 to 30 passengers may exist within the authentication area RA. Therefore, as shown in FIG. 9, the information processing device 3 can perform tracking process and face authentication process for multiple passengers based on one first image generated by the camera CAM. Note that the multiple dotted rectangles in FIG. 9 represent the tracking area.

[0090] The tracking area (for example, at least one of the tracking areas TA1, TA2, and TA3) may include parts of the passenger other than the head (for example, shoulders) in addition to the head of the passenger (for example, passenger P1) that is tracked by the tracking unit 313. The tracking area may be set to include the upper body of the passenger, or may be set to include the entire body of the passenger.

[0091] The operations of the tracking unit 313 and the face authentication unit 314 will be further described with reference to the flowchart of Fig. 10. In Fig. 10, the tracking unit 313 detects one or more passengers (i.e., people) from a first image acquired by the image acquisition unit 311 (i.e., a first image generated by the camera CAM) (step S101). In the processing of step S101, the tracking unit 313 may detect the head of the passenger. In the processing of step S101, the tracking unit 313 may set a tracking region including the detected head of the passenger based on the detected head of the passenger. In the processing of step S101, the tracking unit 313 may perform face detection of the detected one or more passengers.

[0092] The tracking unit 313 performs tracking processing of at least one of the one or more passengers detected in the processing of step S101 using another first image acquired by the image acquisition unit 311 (step S102). In the processing of step S102, the tracking unit 313 may perform face detection of the detected one or more passengers. When the face of at least one of the one or more passengers is detected in the processing of at least one of steps S101 and S102, the tracking unit 313 transmits a face image including a facial region of at least one passenger to the face authentication unit 314.

[0093] The face authentication unit 314 performs face authentication processing using the face image transmitted from the tracking unit 313 (step S103). The face authentication unit 314 registers the result of the face authentication processing in the ID correspondence table 321, or updates the ID correspondence table 321 based on the result of the face authentication processing (step S104).

[0094] Next, the operation of the determination unit 315 of the arithmetic device 31 will be described. Here, passenger P2 will be described as an example. The determination unit 315 may determine whether passenger P2 is allowed to pass through the face recognition gate device 23 based on the ID correspondence table 321. If the tracking ID of passenger P2 is associated with a specific authentication ID in the ID correspondence table 321, the determination unit 315 may determine that passenger P2 is a "matching person." If the tracking ID of passenger P2 is associated with the character string "N / A" in the ID correspondence table 321, the determination unit 315 may determine that passenger P2 is a "matching person." If the tracking ID of passenger P2 is not associated with an authentication ID (i.e., the authentication ID field is blank), the determination unit 315 may determine that passenger P2 is "unauthenticated."

[0095] If failure reason information is registered in the ID correspondence table 321, the determination unit 315 may make the following determination: If the tracking ID related to passenger P2 is associated with the character string "N / A" and the failure reason information is the second reason (i.e., a reason indicating that facial recognition failed even though the image was appropriate for facial recognition), the determination unit 315 may determine that passenger P2 is "no match." If the tracking ID related to passenger P2 is associated with the character string "N / A" and the failure reason information is the first reason (i.e., a reason indicating that facial recognition failed because the image was inappropriate for facial recognition), the determination unit 315 may determine that passenger P2 is "unauthenticated."

[0096] If it is determined that passenger P2 is a "matching person," the determination unit 315 may determine whether or not passenger P2 is allowed to pass through the facial recognition gate device 23, based on the authentication ID of passenger P2 and the face DB 36. For example, the determination unit 315 may determine whether or not the boarding gate number (see FIG. 6 ) associated with the authentication ID in the face DB 36 matches the boarding gate number at which the facial recognition gate device 23 is installed. If the boarding gate number associated with the authentication ID does not match the boarding gate number at which the facial recognition gate device 23 is installed, the determination unit 315 may determine that the passenger is not allowed to pass through the facial recognition gate device 23. If it is determined that the boarding gate number associated with the authentication ID matches the boarding gate number at which the facial recognition gate device 23 is installed, the determination unit 315 may determine that the passenger is allowed to pass through the facial recognition gate device 23. Alternatively, if it is determined that the boarding gate number associated with the authentication ID matches the boarding gate number where the facial recognition gate device 23 is installed, the determination unit 315 may compare the boarding start time associated with the authentication ID in the face DB 36 with the current time to determine whether the passenger is allowed to pass through the facial recognition gate device 23.

[0097] As shown in FIG. 3, the facial recognition gate device 23 is installed at boarding gate G1. If the boarding gate of the aircraft that passenger P2 is boarding is not boarding gate G1, the decision unit 315 may determine that passenger P2 cannot pass through the facial recognition gate device 23. If the boarding gate of the aircraft that passenger P2 is boarding is boarding gate G1 but the current time is more than a second predetermined time (for example, from several tens of minutes to several tens of minutes) before the boarding start time, the decision unit 315 may determine that passenger P2 cannot pass through the facial recognition gate device 23. If the boarding gate of the aircraft that passenger P2 is boarding is boarding gate G1 and the current time is not more than the second predetermined time before the boarding start time, the decision unit 315 may determine that passenger P2 can pass through the facial recognition gate device 23.

[0098] The determination unit 315 may output, as the determination result for passenger P2, any of the following: (i) a first determination result indicating that a match is found and that the passenger P2 can pass through the facial recognition gate device 23; (ii) a second determination result indicating that a match is found but that the passenger P2 cannot pass through the facial recognition gate device 23; (iii) a third determination result indicating that the match is not found; or (iv) a fourth determination result indicating that the passenger P2 has not been authenticated. That is, the determination unit 315 may classify multiple passengers into any of a first type corresponding to the first determination result, a second type corresponding to the second determination result, a third type corresponding to the third determination result, and a fourth type corresponding to the fourth determination result. The third and fourth types can be said to be types indicating that facial authentication has failed. The determination result by the determination unit 315 is based on the result of the facial recognition processing performed by the facial recognition unit 314. Therefore, the determination result by the determination unit 315 may be referred to as the result of the facial recognition processing or the authentication result. In addition, since the determination unit 315 classifies passengers by determining the type of passenger, the determination unit 315 may be referred to as type determination means.

[0099] The determination unit 315 determines the priority of the determination result for passenger P2 based on the type for passenger P2 based on the determination result and the respective locations of the terminal devices 41 and 42 indicated by the terminal location information. The determination unit 315 may determine, based on the determined priority, whether to transmit the determination result for passenger P2 to at least one of the terminal devices 41 and 42. Alternatively, the determination unit 315 may determine, based on the determined priority, whether to preferentially transmit the determination result for passenger P2 to at least one of the terminal devices 41 and 42.

[0100] The method of determining the priority by the determination unit 315 (in other words, the rules or criteria for prioritization) is arbitrary. An example of the method of determining the priority by the determination unit 315 will be described below. If the priority of the determination result is higher than the criterion, the determination result is transmitted to at least one of the terminal devices 41 and 42, and if the priority of the determination result is lower than the criterion, the determination result is not transmitted to either of the terminal devices 41 and 42. Note that if the priority and the criterion are "equal," it may be treated as being included in either case. Note that the priority may be expressed numerically or as a category (for example, high, medium, low).

[0101] The decision unit 315 may lower the priority of the judgment result relating to the first type of passenger (i.e., a passenger who is determined to be eligible and able to pass through the facial recognition gate device 23) below the standard so that the judgment result is not transmitted to the terminal devices 41 and 42.

[0102] The determination unit 315 may set the priority of the determination results relating to the second type of passengers (i.e., passengers who are determined to be eligible but unable to pass through the facial recognition gate device 23), the third type of passengers (i.e., passengers who are determined to be uneligible), and the fourth type of passengers (i.e., passengers who are determined to be unauthenticated) higher than the standard so that these determination results are transmitted to at least one of the terminal devices 41 and 42. In other words, the determination unit 315 may set the priority of the determination results relating to passengers who are unable to pass through the facial recognition gate device 23 higher than the standard so that the determination results are transmitted to at least one of the terminal devices 41 and 42.

[0103] The determination unit 315 may set the priority of the determination result related to the second type of passengers, among the determination results transmitted to the terminal device 41, lower than the priority of the determination result related to the third type of passengers and the priority of the determination result related to the fourth type of passengers. Note that the priority of the determination result related to the second type of passengers is higher than the standard. In this case, the determination unit 315 may set the priority of the determination result related to the third type of passengers higher than the priority of the determination result related to the fourth type of passengers.

[0104] The determination unit 315 may set the priority of the determination result related to the second type of passengers higher than the priority of the determination result related to the third type of passengers and the priority of the determination result related to the fourth type of passengers, among the determination results transmitted to the terminal device 42. Note that the priority of the determination result related to the third type of passengers and the priority of the determination result related to the fourth type of passengers are higher than a standard. In this case, the determination unit 315 may set the priority of the determination result related to the third type of passengers higher than the priority of the determination result related to the fourth type of passengers.

[0105] Note that even if failure reason information is registered in the ID correspondence table 321, if the tracking ID of passenger P2 is associated with the character string “N / A,” the determination unit 315 may determine that passenger P2 is “not a match” regardless of the failure reason information (i.e., determine that passenger P2 is a third type of passenger). In this case, the determination unit 315 may determine the priority of the determination result of passenger P2 based on the failure reason information. The determination unit 315 may set the priority of the determination result of passenger P2 when the failure reason information indicates a first reason (i.e., a reason indicating that facial recognition failed because the image was inappropriate for facial recognition) lower than the priority of the determination result of passenger P2 when the failure reason information indicates a second reason (i.e., a reason indicating that facial recognition failed even though the image was appropriate for facial recognition).

[0106] 4, the distance between the terminal device 41 and the facial recognition gate device 23 is different from the distance between the terminal device 42 and the facial recognition gate device 23. Therefore, it can be said that the determination unit 315 may determine (or change) the priority of the determination result related to the passenger (e.g., passenger P2) based on the type related to the passenger based on the determination result and the positional relationship between the position of the terminal device 41 or 42 and the facial recognition gate device 23.

[0107] For example, the distance from the facial recognition gate device 23 to the end of the authentication area RA on the facial recognition gate device 23 side is set as the predetermined distance. In Fig. 4, the distance between the terminal device 41 and the facial recognition gate device 23 can be said to be shorter than the predetermined distance. On the other hand, the distance between the terminal device 41 and the facial recognition gate device 23 can be said to be longer than the predetermined distance.

[0108] As described above, the determination unit 315 may set a lower priority for the determination result related to the second type of passenger than the priority for the determination result related to the third type of passenger and the priority for the determination result related to the fourth type of passenger, among the determination results transmitted to the terminal device 41. In other words, when the distance between the terminal device 41 and the facial recognition gate device 23 is shorter than a predetermined distance and the type related to the passenger is the third type or the fourth type, the determination unit 315 may set a higher priority for the determination result related to the passenger than when the distance between the terminal device 41 and the facial recognition gate device 23 is shorter than the predetermined distance and the type related to the passenger is the second type.

[0109] As described above, the determination unit 315 may set a higher priority for the determination result related to the second type of passenger than the priority for the determination result related to the third type of passenger and the priority for the determination result related to the fourth type of passenger, among the determination results transmitted to the terminal device 42. In other words, when the distance between the terminal device 42 and the facial recognition gate device 23 is longer than a predetermined distance and the type related to the passenger is the second type, the determination unit 315 may set a higher priority for the determination result related to the passenger than when the distance between the terminal device 42 and the facial recognition gate device 23 is longer than the predetermined distance and the type related to the passenger is the third type or the fourth type.

[0110] The operation of the determination unit 315 will be described with reference to the flowchart of FIG. 11. In FIG. 11, the determination unit 315 determines the priority of each of a plurality of determination results corresponding to a plurality of passengers (step S201). The determination unit 315 generates information to be transmitted to at least one of the terminal devices 41 and 42 based on the determined priority and the plurality of determination results (step S202). The determination unit 315 transmits the information generated in the processing of step S202 to at least one of the terminal devices 41 and 42 via the communication device 33. As a result, the information transmitted to at least one of the terminal devices 41 and 42 is displayed on at least one of the terminal devices 41 and 42, thereby notifying at least one of the staff members A1 and A2 (step S203). In this case, the terminal devices 41 and 42 may determine the display order of the notification information based on the priority determined by the determination unit 315.

[0111] The information transmitted from the determination unit 315 to at least one of the terminal devices 41 and 42 via the communication device 33 is displayed on at least one of the terminal devices 41 and 42, thereby notifying at least one of the staff members A1 and A2. Therefore, the information generated by the determination unit 315 in the processing of step S202 may be referred to as notification information. Hereinafter, the information generated by the determination unit 315 in the processing of step S202 will be referred to as "notification information" as appropriate.

[0112] The notification information may include information indicating the determination result and information indicating the priority of the determination result. The notification information may include information indicating the determination result, information indicating the priority of the determination result, and an image of the passenger detected by the tracking unit 313 from the first image (i.e., the first image generated by the camera CAM). If the determination result is a determination result related to a second type of passenger, the determination unit 315 may include, in the notification information, information indicating the determination result, information indicating the priority of the determination result, and information related to the second type of passenger (for example, at least one of name, face image, and boarding gate number).

[0113] For example, FIG. 12 shows an example of the screen of the terminal device 42 when the notification information transmitted from the determination unit 315 is displayed on the terminal device 42. In FIG. 12, images 421, 422, and 423 including a human figure represent images including passengers (i.e., persons to be authenticated). The images 421, 422, and 423 (i.e., images including passengers) may be images of the entire body of a passenger actually captured. Such images may be extracted from the first image generated by the camera CAM. Note that the images including passengers may be facial images used in the facial authentication process by the facial authentication unit 314, or may be symbols (e.g., icons) indicating a person. The dashed frame lines surrounding the images 421 and 422 indicate that the passenger type is the second type (i.e., passengers who are identified but are determined not to be able to pass through the facial authentication gate device 23). The fact that the border of image 423 is solid indicates that the passenger type is either the third type (i.e., a passenger who has been determined to be unsuitable) or the fourth type (i.e., a passenger who has been determined to be unauthenticated).

[0114] If the notification information generated by the determination unit 315 includes information related to the second type of passenger, the terminal device 42 may display the passenger's name and a specific guide destination on the screen based on the information related to the second type of passenger (see dotted circle C1 in FIG. 12). The terminal device 42 may set the specific guide destination for the third type of passenger and the fourth type of passenger to a normal gate device.

[0115] As described above, the determination unit 315 may prioritize the determination results related to the second type of passengers higher than the priorities of the determination results related to the third type of passengers and the determination results related to the fourth type of passengers, among the determination results transmitted to the terminal device 42. The terminal device 42 may determine or change the display order of the determination results based on the priorities of the determination results. The terminal device 42 may generate display information to be displayed on the screen based on the determined or changed display order of the determination results. As a result, the terminal device 42 displays information related to the second type of passengers with higher priority than information related to the third or fourth type of passengers.

[0116] For example, staff member A2 may identify a passenger who should be given priority based on the information displayed on the terminal device 42. When staff member A2 has completed the passenger's assistance (e.g., when the passenger has been guided to the appropriate gate device), staff member A2 may tap a "Guidance Completed" button (see FIG. 12) displayed on the terminal device 42. As a result, the terminal device 42 may update the screen so that information related to the passenger for whom the "Guidance Completed" button was tapped disappears from the screen (in other words, it may change the display information displayed on the screen). The terminal device 42 may further transmit information indicating the passenger served by staff member A2 (e.g., a tracking ID related to the passenger) to the information processing device 3. Upon receiving the information indicating the passenger served by staff member A2 from the terminal device 42, the information processing device 3 may delete the information related to the passenger indicated by the received information from the ID correspondence table 321.

[0117] Although an example of the screen of the terminal device 42 has been described with reference to FIG. 12 , the same applies to the terminal device 41. However, the determination unit 315 may prioritize the determination results related to the third type of passengers and the fourth type of passengers, among the determination results transmitted to the terminal device 41, higher than the priority of the determination results related to the second type of passengers. The terminal device 41 may determine or change the display order of the determination results based on the priorities of the determination results. The terminal device 41 may generate display information to be displayed on the screen based on the determined or changed display order of the determination results. As a result, the terminal device 41 displays information related to the third type or the fourth type of passengers with priority over information related to the second type of passengers.

[0118] The above-described operations of the information processing device 3 may be realized by the information processing device 3 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium records a computer program for causing the information processing device 3 to perform the above-described operations.

[0119] (Technical Effects) The information processing device 3 determines the priorities of at least some of the determination results corresponding to each of the passengers based on the types of the passengers and the locations of their terminal devices (e.g., at least one of the terminal devices 41 and 42). Therefore, the information processing device 3 notifies the airport staff (e.g., at least one of the staff members A1 and A2) who possess the terminal device of the determination results with higher priority. As a result, the airport staff can easily identify passengers who should be given priority. For example, the airport staff can easily identify (or extract) passengers who cannot pass through the facial recognition gate device 23. Furthermore, if the airport staff gives priority to those who cannot pass through the facial recognition gate device 23, passengers who cannot pass through the facial recognition gate device 23 can be prevented from entering the facial recognition gate device 23. Therefore, the information processing device 3 can prevent a decrease in the throughput of the facial recognition gate device.

[0120] In addition to airport boarding gates, the information processing device 3 may be applied to, for example, at least one of airport security gates (i.e., gates installed at airport security checkpoints) and immigration gates. In addition to airports, the display control device 3 may be applied to, for example, at least one of offices, train stations, theme parks, and event venues that use face recognition gate devices for at least one of entry and exit.

[0121] (First Modification) In the second embodiment described above, the information processing device 3 (specifically, the face authentication unit 314) performs face authentication processing. However, the information processing device 3 does not have to perform face authentication processing. In this case, the information processing device 3 does not have to include the face authentication unit 314 and the face DB 36. In this case, the face authentication processing may be performed by an authentication device 5 different from the information processing device 3. In this case, as shown in FIG. 13 , the information processing device 3 and the authentication device 5 may be connected via a network NW. The information processing device 3 and the authentication device 5 may constitute one system. The one system may be referred to as an information processing system or an authentication system. At least one of the terminal devices 41 and 42 may constitute a part of the system. In other words, the system may include the information processing device 3, the authentication device 5, and the terminal devices 41 and 42.

[0122] The authentication device 5 includes a face authentication unit 51 and a face database 52 (hereinafter referred to as "face DB 52"). The face authentication unit 51 is configured to be able to execute face authentication processing. In other words, the authentication device 5 is an authentication device having a face authentication function. The management server 21 of the airport system 2 may transmit at least a portion of the face images registered in the face DB 211 to the authentication device 5 together with an authentication ID (i.e., passenger identification information) assigned to the face image. In this case, the management server 21 may transmit gate identification information and boarding start time in addition to the face image to the authentication device 5. The authentication device 5 may register the face image transmitted from the management server 21 in the face DB 52. The authentication device 5 may register gate identification information and boarding start time in addition to the face image in the face DB 52.

[0123] The tracking unit 313 of the information processing device 3 may detect a passenger (e.g., passenger P1) included in the image acquired by the image acquisition unit 311. The tracking unit 313 may set a tracking area including the head of the detected passenger. The tracking unit 313 may perform face detection of the detected passenger. When the passenger's face is detected, the tracking unit 313 may transmit a face image including the passenger's facial area to the authentication device 5 via the communication device 33.

[0124] The face authentication unit 51 of the authentication device 5 may perform face authentication processing using a face image transmitted from the information processing device 3 (specifically, the tracking unit 313) and the face DB 52. The face authentication unit 51 may transmit information indicating the result of the face authentication processing to the information processing device 3. The information processing device 3 may register the result of the face authentication processing indicated by the information transmitted from the authentication device 5 (specifically, the face authentication unit 51) in the ID correspondence table 321.

[0125] (Second Modification) The tracking unit 313 may identify the location of a passenger determined by the determination unit 315 to be unauthenticated (i.e., a fourth type of passenger) based on the tracking ID of the passenger. If the passenger is located in a line formed by passengers waiting to pass through the facial recognition gate device 23 (i.e., if the passenger is standing in line), the tracking unit 313 may perform face detection of the passenger using a plurality of first images (i.e., a plurality of first images generated by the camera CAM). In this case, the tracking unit 313 may detect the face of the passenger more frequently than the face detection of other passengers. With this configuration, the face authentication unit 314 can perform face authentication processing on the passenger relatively frequently.

[0126] Alternatively, when failure reason information is registered in the ID correspondence table 321, the tracking unit 313 may identify the location of a passenger based on the tracking ID of the passenger whose failure reason information indicates a first reason (i.e., a reason indicating that facial authentication failed due to the image being inappropriate for facial authentication). When the passenger is located in a line formed by passengers waiting to pass through the facial authentication gate device 23 (i.e., when the passenger is waiting in line), the tracking unit 313 may perform face detection of the passenger using multiple first images (i.e., multiple first images generated by the camera CAM). In this case, the tracking unit 313 may detect the passenger's face more frequently than the other passengers. This configuration allows the facial authentication unit 314 to perform the facial authentication process on the passenger relatively more frequently. In other words, it can be said that the facial authentication unit 314 may repeatedly perform the facial authentication process using multiple first images for a passenger whose failure reason information indicates the first reason.

[0127] (Third Modification) The determination unit 315 may determine (change) the priority of the judgment results (for example, judgment results of passengers who have been determined not to be able to pass through the facial recognition gate device 23) sent to the terminal device 41 so that the priority is higher for judgment results of passengers closer to the facial recognition gate device 23.

[0128] (Fourth Modification) The determination unit 315 may determine the priority of the determination result (specifically, the determination result related to the second type of passengers, the third type of passengers, and the fourth type of passengers) transmitted to at least one of the terminal devices 41 and 42 as either "high" or "low." That is, the determination unit 315 may classify the priority into two types. The determination unit 315 may also classify the priority into three or more types. The determination unit 315 may calculate the priority as a numerical value.

[0129] The priority of the determination result included in the notification information transmitted from the determination unit 315 is assumed to be either a "high" priority or a "low" priority. In this case, as shown in FIG. 14 , the terminal device 42 may display the notification information transmitted from the determination unit 315 by priority using a tab display function. As described above, the determination unit 315 may set the priority of the determination result related to the second type of passengers higher than the priority of the determination result related to the third type of passengers and the priority of the determination result related to the fourth type of passengers, among the determination results (in other words, the notification information) transmitted to the terminal device 42. That is, the determination unit 315 may determine the priority of the determination result related to the second type of passengers to be a "high" priority. The determination unit 315 may determine the priority of the determination result related to the third type of passengers and the priority of the determination result related to the fourth type of passengers to be a "low" priority. Therefore, the terminal device 42 may display information related to the second type of passengers in a tab labeled "high priority." The terminal device 42 may display information related to the third type of passengers and information related to the fourth type of passengers in a tab labeled "Priority: Low" (not shown).

[0130] As shown in FIG. 15 , the terminal device 41 may display the notification information transmitted from the determination unit 315 by priority using a tab display function. As described above, the determination unit 315 may set the priority of the determination result related to the third type or fourth type passengers higher than the priority of the determination result related to the second type passengers, among the determination results (in other words, the notification information) transmitted to the terminal device 41. That is, the determination unit 315 may determine the priority of the determination result related to the third type passengers and the determination result related to the fourth type passengers to be "high." The determination unit 315 may determine the priority of the determination result related to the second type passengers to be "low." Therefore, the terminal device 41 may display information related to the third type or fourth type passengers in a tab labeled "Priority: High." The terminal device 41 may display information related to the second type passengers in a tab labeled "Priority: Low" (not shown).

[0131] The notification information transmitted from the determination unit 315 may include failure reason information in the determination result related to the third type of passenger (i.e., the determination result indicating that there is no match). When displaying the information related to the third type of passenger, the terminal device 41 may display the reason for the facial authentication failure on the screen based on the failure reason information. When the determination result related to the third type of passenger includes failure reason information indicating a first reason (a reason indicating that facial authentication failed because the image was inappropriate for facial authentication), the terminal device 41 may include the description "Error: Unauthenticated Person" in the information related to the third type of passenger (see dotted circle C3 in FIG. 15). When the determination result related to the third type of passenger includes failure reason information indicating a second reason (a reason indicating that facial authentication failed even though the image was appropriate for facial authentication), the terminal device 41 may include the description "Error: Unregistered Person" in the information related to the third type of passenger (see dotted circle C2 in FIG. 15). The terminal device 41 may include the description "Error: Unregistered Person" in the information related to the fourth type of passenger.

[0132] The terminal devices 41 and 42 may display information about passengers for whom one of the staff members A1 and A2 has completed their handling in a tab called "Guidance Completed." When the "Guidance Completed" button is tapped by one of the staff members A1 and A2, one of the terminal devices 41 and 42 may transmit status information indicating the status of the passenger for whom the "Guidance Completed" button was tapped (i.e., guidance completed) to the information processing device 3. The status information may include a tracking ID related to the passenger and information indicating "Guidance Completed." The information processing device 3, upon receiving status information from one of the terminal devices 41 and 42, may transmit information corresponding to the received status information to the other of the terminal devices 41 and 42. Based on the information received from the information processing device 3, the other of the terminal devices 41 and 42 may display information about the corresponding passenger in a tab called "Guidance Completed." As a result, the staff members A1 and A2 can share information about passengers for whom guidance has been completed.

[0133] (Fifth Modification) Two staff members may be stationed near the face recognition gate device 23 (for example, near staff member A1 in FIG. 4). In this case, the two staff members may carry terminal devices 41a and 41b, respectively. In this case, the same information (i.e., notification information) may be transmitted from the information processing device 3 to the terminal devices 41a and 41b. Therefore, the information displayed on the terminal devices 41a and 41b may be the same. For example, as shown in FIGS. 16 and 17, information on passengers P11 and P12 is displayed on the terminal devices 41a and 41b.

[0134] In this case, there is a possibility that the staff member carrying the terminal device 41a and the staff member carrying the terminal device 41b will be handling the same passenger. Therefore, when the staff member carrying the terminal device 41a is handling passenger P11, information related to passenger P11 may be pinned as shown in Fig. 16. In Fig. 16, "guide a" refers to the staff member carrying the terminal device 41a.

[0135] When a staff member carrying the terminal device 41a pins information related to passenger P11 by performing a predetermined operation, the terminal device 41a may determine that the staff member will respond to passenger P11. In this case, the terminal device 41a may change the status (e.g., status) related to passenger P11 from "not responding" to "responding." The terminal device 41a may further transmit status information indicating the status related to passenger P11 to the information processing device 3. Note that the status information may include information for identifying the staff member carrying the terminal device 41a, a tracking ID related to passenger P11, and information indicating the status related to passenger P11 (e.g., responding).

[0136] The information processing device 3 that receives the status information from the terminal device 41a may transmit information corresponding to the received status information to the terminal device 41b via the communication device 33. The information corresponding to the status information may include information for identifying the staff member carrying the terminal device 41a, a tracking ID related to passenger P11, and information indicating the status of passenger P11 (e.g., currently being handled).

[0137] Based on the information received from the information processing device 3, the terminal device 41b may change the status of passenger P11 from "not attended" to "guide a is attending." As a result, the staff member carrying the terminal device 41b may be notified that the staff member carrying the terminal device 41a is attending to passenger P11. With this configuration, the staff member carrying the terminal device 41b can attend to passenger P12, who has not yet attended to. In other words, it is possible to prevent the staff member carrying the terminal device 41a and the staff member carrying the terminal device 41b from attending to the same passenger.

[0138] The terminal device 41a may fix the display position of the pinned information related to the passenger P11. This configuration can prevent the display position of the information related to the passenger P11 from being changed while the staff member carrying the terminal device 41a is serving the passenger.

[0139] (Sixth Modification) The tracking unit 313 may detect a change in at least one of the facial direction and the line of sight of each of the multiple passengers based on the first image (i.e., the first image generated by the camera CAM). Existing technology can be applied to the method of detecting the facial direction and the line of sight. Existing technology can also be applied to the method of detecting a change in at least one of the facial direction and the line of sight based on the detected facial direction and the line of sight. Therefore, detailed explanations of these methods will be omitted. Note that the tracking unit 313 may be referred to as a detection means, as it may detect a change in at least one of the facial direction and the line of sight.

[0140] The determination unit 315 may determine the priority based on the detected change in at least one of the facial direction and the line of sight, in addition to the position of the passenger and the position of the terminal device (for example, at least one of the terminal devices 41 and 42). In this case, the determination unit 315 may assign a higher priority to the passenger as the detected change in at least one of the facial direction and the line of sight increases.

[0141] (Seventh Modification) The determination unit 315 does not need to determine the priority. In this case, the determination unit 315 may determine the determination result to be sent to the terminal devices 41 and 42 (in other words, the determination result to be notified to at least one of the staff members A1 and A2) based on the positions of the passengers and the terminal devices 41 and 42. Note that there may be other terminal devices in addition to the terminal devices 41 and 42. In other words, there may be three or more terminal devices.

[0142] For example, if the distance between one passenger and the terminal device 41 is shorter than the distance between another passenger and the terminal device 41, the determination unit 315 may transmit the determination result related to the one passenger to the terminal device 41 in preference to the determination results related to the other passengers. Note that the one passenger and the other passengers may be second type passengers (i.e., passengers who are determined to be a match but cannot pass through the face recognition gate device 23), third type passengers (i.e., passengers who are determined to be a match but not a match), or fourth type passengers (i.e., passengers who are determined to be unauthenticated).

[0143] The image acquisition unit 311 may acquire a second image including at least one of staff members A1 and A2. The second image may be generated by a camera CAM capturing an image of at least one of staff members A1 and A2, or may be generated by a camera different from the camera CAM capturing an image of at least one of staff members A1 and A2.

[0144] The tracking unit 313 may detect the facial orientation of at least one of staff members A1 and A2 based on the second image. Since existing technology can be applied to the method of detecting facial orientation, detailed explanations thereof will be omitted. The detection of the facial orientation of at least one of staff members A1 and A2 may be performed by a functional block different from the tracking unit 313. In this case, the calculation device 31 may have a functional block that detects the facial orientation of at least one of staff members A1 and A2. Since the tracking unit 313 may detect the facial orientation, it may be referred to as a facial orientation detection means.

[0145] The determination unit 315 may determine the determination result to be sent to the terminal devices 41 and 42 (in other words, the determination result to be notified to at least one of the staff members A1 and A2) based on the position of the passenger, the positions of the terminal devices 41 and 42, and the facial orientation of at least one of the staff members A1 and A2.

[0146] The decision unit 315 may determine, based on the facial orientation of staff member A1, from the determination results related to one or more passengers located in the direction in which staff member A1's face is facing, based on the position of the passenger and the position of the terminal device 41 (for example, based on the distance between the passenger and the terminal device 41). Based on the facial orientation of staff member A1, the decision unit 315 may decide not to transmit to the terminal device 41 the determination results related to one or more passengers located in the direction in which staff member A1's face is not facing.

[0147] The decision unit 315 may determine, based on the facial orientation of staff member A2, from the determination results related to one or more passengers located in the direction in which staff member A2's face is facing, based on the position of the passenger and the position of the terminal device 42 (for example, based on the distance between the passenger and the terminal device 42). The decision unit 315 may determine, based on the facial orientation of staff member A2, not to transmit to the terminal device 42 the determination results related to one or more passengers located in the direction in which staff member A2's face is not facing.

[0148] In this case, the tracking unit 313 may estimate a visibility range, which is the range within which at least one of staff members A1 and A2 is visible, based on the facial orientation of at least one of staff members A1 and A2. The tracking unit 313 may estimate a visibility range F1 (see FIG. 4) of staff member A1 based on the facial orientation of staff member A1. The tracking unit 313 may estimate a visibility range F2 (see FIG. 4) of staff member A2 based on the facial orientation of staff member A2. Note that existing technology can be applied to the method of estimating the visibility range, and therefore detailed explanations thereof will be omitted. Note that if facial orientation detection is performed by a functional block different from the tracking unit 313, the visibility range estimation may be performed by a functional block different from the tracking unit 313.

[0149] The decision unit 315 may identify the determination results for one or more passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers. The decision unit 315 may determine the determination results to be transmitted to the terminal device 41 from the determination results for one or more passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers and the position of the terminal device 41 (for example, based on the distance between the passengers and the terminal device 41). The decision unit 315 may decide not to transmit to the terminal device 41 the determination results for one or more passengers not included in the visible range F1 of the staff member A1.

[0150] The decision unit 315 may identify determination results for one or more passengers included in the visual range F2 of staff member A2 based on the positions of the passengers. The decision unit 315 may determine the determination results to be transmitted to the terminal device 42 from the determination results for one or more passengers included in the visual range F2 of staff member A2 based on the positions of the passengers and the position of the terminal device 42 (e.g., based on the distance between the passengers and the terminal device 42). The decision unit 315 may decide not to transmit to the terminal device 42 the determination results for one or more passengers not included in the visual range F2 of staff member A2.

[0151] The determination unit 315 may consider the movement direction of the passengers in addition to the visual range (e.g., at least one of the visual ranges F1 and F2) of the staff (e.g., at least one of the staff members A1 and A2). For example, the tracking unit 313 may estimate the movement direction of each of the multiple passengers based on multiple first images (i.e., multiple first images generated by the camera CAM). Note that existing technology can be applied to the method of estimating the movement direction from multiple images, and therefore detailed description thereof will be omitted.

[0152] The decision unit 315 may identify a determination result related to one or more passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers. The decision unit 315 may determine a determination result to be transmitted to the terminal device 41 from the determination results related to one or more passengers included in the visible range F1 of the staff member A1 based on the position of the terminal device 41 and the movement direction of the passengers. In this case, the decision unit 315 may determine to transmit to the terminal device 41 a determination result related to a passenger whose movement direction is toward the terminal device 41. On the other hand, the decision unit 315 may determine not to transmit to the terminal device 41 a determination result related to a passenger whose movement direction is away from the terminal device 41.

[0153] The decision unit 315 may identify a determination result related to one or more passengers included in the visible range F2 of the staff member A2 based on the position of the passenger. The decision unit 315 may determine a determination result to be transmitted to the terminal device 42 from the determination results related to one or more passengers included in the visible range F2 of the staff member A2 based on the position of the terminal device 42 and the movement direction of the passenger. In this case, the decision unit 315 may determine to transmit to the terminal device 42 a determination result related to a passenger whose movement direction is toward the terminal device 42. On the other hand, the decision unit 315 may determine not to transmit to the terminal device 42 a determination result related to a passenger whose movement direction is away from the terminal device 42.

[0154] Alternatively, the determination unit 315 may determine the judgment result to be sent to the terminal device based on the position of the terminal device (e.g., at least one of the terminal devices 41 and 42) and the direction of movement of the passenger (in this case, the determination unit 315 does not need to take into account the visible range of the staff).

[0155] The determination unit 315 may determine, from the determination results related to a plurality of passengers, the determination result to be transmitted to the terminal device 41 based on the position of the terminal device 41 and the moving direction of the passenger. In this case, the determination unit 315 may determine to transmit to the terminal device 41 the determination result related to the passenger whose moving direction is toward the terminal device 41. On the other hand, the determination unit 315 may determine not to transmit to the terminal device 41 the determination result related to the passenger whose moving direction is away from the terminal device 41.

[0156] The decision unit 315 may determine, from the determination results related to a plurality of passengers, the determination result to be transmitted to the terminal device 42 based on the position of the terminal device 42 and the moving direction of the passenger. In this case, the decision unit 315 may determine to transmit, to the terminal device 42, the determination result related to a passenger whose moving direction is toward the terminal device 42. On the other hand, the decision unit 315 may determine not to transmit, to the terminal device 42, the determination result related to a passenger whose moving direction is away from the terminal device 42.

[0157] In this case, the terminal device 41 may display an image in which the position of the terminal device 41 and at least some of the positions of the multiple passengers are illustrated in a plan view, as shown in Fig. 18. The position of the terminal device 41 and at least some of the positions of the multiple passengers may be displayed superimposed on a floor map of the airport. The floor map of the airport may include facility information. The facility information may include store information and equipment information (for example, at least one of toilets, stairs, escalators, and elevator halls).

[0158] In FIG. 18, a black circle M1 indicates the position of the terminal device 41. A plurality of white circles indicate the positions of passengers. Solid-line rectangles M11 and M12 surrounding the white circle indicate that the type of the passenger is the third type (i.e., a passenger determined to be a matched person) or the fourth type (i.e., a passenger determined to be unauthenticated). A dashed-line rectangle M13 surrounding the white circle indicates that the type of the passenger is the second type (i.e., a passenger determined to be a matched person but unable to pass through the face recognition gate device 23). Note that the terminal device 41 may display the positions of other terminal devices (e.g., terminal device 42) in addition to the position of the terminal device 41 (black circle M1 in FIG. 18).

[0159] When staff member A1 carrying terminal device 41 taps on any of rectangles M11, M12, and M13, information about the passenger corresponding to the tapped (in other words, selected) rectangle may be displayed on terminal device 41. That is, the screen of terminal device 41 may transition to, for example, the screen shown in FIG.

[0160] Specifically, the terminal device 41 may detect that the staff member A1 has tapped on the screen of the terminal device 41. When the tap is detected, the terminal device 41 may identify the passenger tapped by the staff member A1 (for example, the passenger corresponding to one of the rectangles M11, M12, and M13) based on the position of the tap on the screen. The terminal device 41 may transition the display from the screen shown in FIG. 18 to a screen including information related to the identified passenger (for example, the screen shown in FIG. 15).

[0161] 15 is displayed, the terminal device 41 may detect that the staff member A1 taps on the screen of the terminal device 41. When the tap is detected, the terminal device 41 may identify the passenger who was tapped by the staff member A1 based on the position of the tap on the screen. The terminal device 41 may transition the display from the screen shown in FIG. 15 to a screen indicating the position of the identified passenger (for example, the screen shown in FIG. 18).

[0162] At least one of the terminal devices 41 and 42 may acquire one or more determination results from the information processing device 3. When one of the terminal devices 41 and 42 acquires multiple determination results from the information processing device 3, the one terminal device may change the display order of the multiple determination results based on the positions of multiple passengers corresponding to the multiple determination results and the position of the one terminal device. In this case, the one terminal device may illustrate the position of the one terminal device and at least some of the positions of the multiple passengers (see, for example, FIG. 18 ).

[0163] (Eighth Modification) Instead of determining the priority based on the type of passenger and the location of the terminal device (e.g., at least one of terminal devices 41 and 42), the determination unit 315 may determine the priority based on the location of the passenger and the location of the terminal device.

[0164] For example, the determination unit 315 may determine the priority so that, among the multiple authentication results, authentication results of passengers who are closest to the terminal device (e.g., at least one of the terminal devices 41 and 42) are displayed on the terminal device in descending order. For example, if the distance between one passenger and the terminal device 41 is shorter than the distance between another passenger and the terminal device 41, the determination unit 315 may prioritize the determination results related to the one passenger over the priorities of the determination results related to the other passengers. Based on the priority, the determination unit 315 may transmit at least some of the multiple authentication results and the locations of passengers corresponding to the at least some of the authentication results to the terminal device via the communication device 33. In this case, the determination unit 315 may transmit the authentication results with the highest priority to the terminal device.

[0165] The one passenger and the other passengers may be second type passengers (i.e., passengers who are determined to be eligible but unable to pass through the facial recognition gate device 23), third type passengers (i.e., passengers who are determined to be uneligible), or fourth type passengers (i.e., passengers who are determined to be unauthenticated). That is, the determination unit 315 may determine priorities based on the positions of the passengers and the terminal devices only for the determination results of the second type passengers, the third type passengers, and the fourth type passengers (in other words, passengers who are determined to be unable to pass through the facial recognition gate device 23).

[0166] The image acquisition unit 311 may acquire a second image including at least one of staff members A1 and A2. The second image may be generated by a camera CAM capturing an image of at least one of staff members A1 and A2, or may be generated by a camera different from the camera CAM capturing an image of at least one of staff members A1 and A2.

[0167] The tracking unit 313 may detect the facial orientation of at least one of staff members A1 and A2 based on the second image. Since existing technology can be applied to the method of detecting facial orientation, detailed explanations thereof will be omitted. The detection of the facial orientation of at least one of staff members A1 and A2 may be performed by a functional block different from the tracking unit 313. In this case, the calculation device 31 may have a functional block that detects the facial orientation of at least one of staff members A1 and A2. Since the tracking unit 313 may detect the facial orientation, it may be referred to as a facial orientation detection means.

[0168] The determination unit 315 may determine the priority of the determination results based on the positions of the passengers and the positions of the terminal devices 41 and 42, as well as the facial orientation of at least one of the staff members A1 and A2. The determination unit 315 may lower the priority of a determination result for a passenger located in a direction away from the face of staff member A1 than the priority of a determination result for a passenger located in a direction toward which the face of staff member A1 is facing. When there are multiple passengers in the direction toward which staff member A1 is facing, the determination unit 315 may determine the priority of the determination results for each of the multiple passengers based on the positions of each of the multiple passengers and the position of the terminal device 41 (for example, based on the distance between each of the multiple passengers and the terminal device 41). In this case, the determination unit 315 may prioritize a determination result in which the distance between the passenger and the terminal device 41 is short over a determination result in which the distance between the passenger and the terminal device 41 is long.

[0169] The determination unit 315 may assign a lower priority to a determination result relating to a passenger located in a direction away from staff member A2's face than to a determination result relating to a passenger located in a direction toward which staff member A2's face is facing. When there are multiple passengers in the direction toward which staff member A2's face is facing, the determination unit 315 may determine the priority of the determination result for each of the multiple passengers based on the position of each of the multiple passengers and the position of the terminal device 42 (for example, based on the distance between each of the multiple passengers and the terminal device 42). In this case, the determination unit 315 may assign a higher priority to a determination result in which the distance between the passenger and the terminal device 42 is short than to a determination result in which the distance between the passenger and the terminal device 42 is long.

[0170] In this case, the tracking unit 313 may estimate a visibility range, which is the range within which at least one of staff members A1 and A2 is visible, based on the facial orientation of at least one of staff members A1 and A2. The tracking unit 313 may estimate a visibility range F1 (see FIG. 4) of staff member A1 based on the facial orientation of staff member A1. The tracking unit 313 may estimate a visibility range F2 (see FIG. 4) of staff member A2 based on the facial orientation of staff member A2. Note that existing technology can be applied to the method of estimating the visibility range, and therefore detailed explanations thereof will be omitted. Note that if facial orientation detection is performed by a functional block different from the tracking unit 313, the visibility range estimation may be performed by a functional block different from the tracking unit 313.

[0171] The determination unit 315 may identify determination results related to one or more passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers. The determination unit 315 may prioritize determination results related to passengers included in the visible range F1 of the staff member A1 over determination results related to passengers not included in the visible range F1. The determination unit 315 may determine priorities for multiple determination results related to multiple passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers and the position of the terminal device 41 (for example, based on the distance between the passengers and the terminal device 41). In this case, the determination unit 315 may prioritize determination results related to a short distance between the passengers and the terminal device 41 over determination results related to a long distance between the passengers and the terminal device 41.

[0172] The determination unit 315 may identify determination results related to one or more passengers included in the visible range F2 of the staff member A2 based on the positions of the passengers. The determination unit 315 may prioritize determination results related to passengers included in the visible range F2 of the staff member A2 over determination results related to passengers not included in the visible range F2. The determination unit 315 may determine priorities for multiple determination results related to multiple passengers included in the visible range F2 of the staff member A2 based on the positions of the passengers and the position of the terminal device 42 (e.g., based on the distance between the passengers and the terminal device 42). In this case, the determination unit 315 may prioritize determination results related to a short distance between the passengers and the terminal device 42 over determination results related to a long distance between the passengers and the terminal device 42.

[0173] The determination unit 315 may consider the movement direction of the passengers in addition to the visual range (e.g., at least one of the visual ranges F1 and F2) of the staff (e.g., at least one of the staff members A1 and A2). For example, the tracking unit 313 may estimate the movement direction of each of the multiple passengers based on multiple first images (i.e., multiple first images generated by the camera CAM). Note that various existing methods can be applied to the method of estimating the movement direction from multiple images, and therefore detailed description thereof will be omitted.

[0174] The determination unit 315 may identify the determination results for one or more passengers included in the visible range F1 of the staff member A1 based on the positions of the passengers. The determination unit 315 may determine the priority of the determination results for one or more passengers included in the visible range F1 of the staff member A1 based on the position of the terminal device 41 and the movement direction of the passengers. In this case, the determination unit 315 may prioritize the determination results for passengers who are moving toward the terminal device 41 higher than the priority of the determination results for passengers who are moving away from the terminal device 41.

[0175] The determination unit 315 may identify the determination results for one or more passengers included in the visible range F2 of the staff member A2 based on the positions of the passengers. The determination unit 315 may determine the priority of the determination results for one or more passengers included in the visible range F2 of the staff member A2 based on the position of the terminal device 42 and the direction of movement of the passengers. In this case, the determination unit 315 may prioritize the determination results for passengers who are moving toward the terminal device 42 higher than the priority of the determination results for passengers who are moving away from the terminal device 42.

[0176] Alternatively, the determination unit 315 may determine the priority of the judgment result based on the position of the terminal device (e.g., at least one of the terminal devices 41 and 42) and the direction of movement of the passenger (in this case, the determination unit 315 does not need to take into account the staff's visual range).

[0177] The determination unit 315 may determine the priority of the determination result based on the position of the terminal device 41 and the moving direction of the passenger. In this case, the determination unit 315 may set a higher priority to the determination result of a passenger who is moving toward the terminal device 41 than to the determination result of a passenger who is moving away from the terminal device 41.

[0178] The determination unit 315 may determine the priority of the determination result based on the terminal device 42 and the moving direction of the passenger. In this case, the determination unit 315 may set a higher priority to the determination result of a passenger who is moving toward the terminal device 42 than to the determination result of a passenger who is moving away from the terminal device 42.

[0179] In this case, the terminal device 41 may display an image in which the position of the terminal device 41 and at least some of the positions of the multiple passengers are illustrated in a plan view, as shown in Fig. 18. The position of the terminal device 41 and at least some of the positions of the multiple passengers may be displayed superimposed on a floor map of the airport. The floor map of the airport may include facility information. The facility information may include store information and equipment information (for example, at least one of toilets, stairs, escalators, and elevator halls).

[0180] In FIG. 18, a black circle M1 indicates the position of the terminal device 41. A plurality of white circles indicate the positions of passengers. Solid-line rectangles M11 and M12 surrounding the white circle indicate that the type of the passenger is the third type (i.e., a passenger determined to be a matched person) or the fourth type (i.e., a passenger determined to be unauthenticated). A dashed-line rectangle M13 surrounding the white circle indicates that the type of the passenger is the second type (i.e., a passenger determined to be a matched person but unable to pass through the face recognition gate device 23). Note that the terminal device 41 may display the positions of other terminal devices (e.g., terminal device 42) in addition to the position of the terminal device 41 (black circle M1 in FIG. 18).

[0181] When staff member A1 carrying terminal device 41 taps on any of rectangles M11, M12, and M13, information about the passenger corresponding to the tapped (in other words, selected) rectangle may be displayed on terminal device 41. That is, the screen of terminal device 41 may transition to, for example, the screen shown in FIG.

[0182] Specifically, the terminal device 41 may detect that the staff member A1 has tapped on the screen of the terminal device 41. When the tap is detected, the terminal device 41 may identify the passenger tapped by the staff member A1 (for example, the passenger corresponding to one of the rectangles M11, M12, and M13) based on the position of the tap on the screen. The terminal device 41 may transition the display from the screen shown in FIG. 18 to a screen including information related to the identified passenger (for example, the screen shown in FIG. 15).

[0183] 15 is displayed, the terminal device 41 may detect that the staff member A1 taps on the screen of the terminal device 41. When the tap is detected, the terminal device 41 may identify the passenger who was tapped by the staff member A1 based on the position of the tap on the screen. The terminal device 41 may transition the display from the screen shown in FIG. 15 to a screen indicating the position of the identified passenger (for example, the screen shown in FIG. 18).

[0184] The information processing device 3 does not necessarily have to include the face authentication unit 314. In this case, as in the first modified example described above, the face authentication process may be performed by an authentication device 5 different from the information processing device 3. In this case, the information processing device 3 and the authentication device 5 may constitute a single information processing system. It can be said that the information processing system includes an image acquisition unit 311 that acquires a first image including a predetermined area RA through which multiple passengers pass, a face authentication unit 51 that performs face authentication using the first image, an information acquisition unit 312 that acquires the position of a terminal device (e.g., at least one of terminal devices 41 and 42) carried by a staff member (e.g., at least one of staff members A1 and A2), and a determination unit 315 that determines the priority of notifying multiple authentication results of the face authentication based on the position of the terminal device and the positions of multiple passengers detected based on the first image.

[0185] Third Embodiment A third embodiment of the information processing device will be described below. Hereinafter, the third embodiment of the information processing device, information processing method, and recording medium will be described using the information processing device 3 and the terminal device 6. In the third embodiment, part of the operation of the determination unit 315 differs from that of the second embodiment described above. Other aspects of the third embodiment may be the same as those of the second embodiment. Note that the terminal device 6 is a terminal device corresponding to at least one of the terminal devices 41 and 42 in the second embodiment described above.

[0186] 19, the terminal device 6 includes a calculation device 61, a storage device 62, a communication device 63, an input device 64, and an output device 65. The calculation device 61, the storage device 62, the communication device 63, the input device 64, and the output device 65 may be connected via a data bus 66. The calculation device 61 includes an information acquisition unit 611 and a decision unit 612 as logically realized functional blocks or as physically realized processing circuits. The terminal device 6 may be connected to the information processing device 3 via a network NW.

[0187] The information acquisition unit 611 of the arithmetic device 61 may acquire the ID correspondence table 321 from the information processing device 3. The information acquisition unit 611 may store the ID correspondence table 321 in the storage device 62.

[0188] The determination unit 612 of the arithmetic device 61 may output a determination result for each of the multiple passengers based on the ID correspondence table 321. The determination unit 612 may output, as the determination result for each of the multiple passengers, any of (i) a first determination result indicating that a corresponding person is found and that the passenger can pass through the facial recognition gate device 23, (ii) a second determination result indicating that a corresponding person is found but that the passenger cannot pass through the facial recognition gate device 23, (iii) a third determination result indicating that a corresponding person is not found, and (iv) a fourth determination result indicating that the passenger has not been authenticated. In other words, the determination unit 612 may classify the multiple passengers into any of a first type corresponding to the first determination result, a second type corresponding to the second determination result, a third type corresponding to the third determination result, and a fourth type corresponding to the fourth determination result.

[0189] The determination unit 612 may determine the priority of the determination result for the passenger based on the passenger type based on the determination result and the location of the terminal device 6 (i.e., its own location). The determination unit 612 may determine whether to display the determination result for the passenger based on the determined priority. That is, the determination unit 612 may change the display content based on the priority. Since the display content is changed based on the priority, the priority may be referred to as "display priority."

[0190] In the present embodiment, the information processing device 3 may not include the determination unit 315. Alternatively, the determination unit 315 may output a determination result for each of the plurality of passengers based on the ID correspondence table 321. The determination unit 315 may transmit the determination result for each of the plurality of passengers to the terminal device 6 via the communication device 33. The determination unit 612 may determine the priority of the determination result for one passenger based on the type of the passenger based on the determination result for each of the plurality of passengers transmitted from the determination unit 315 and the location of the terminal device 6. The priority may be determined by the determination unit 315 of the information processing device 3. In this case, the determination unit 612 may determine whether to display the determination result based on the priority determined by the determination unit 315.

[0191] The above-described operations of the terminal device 6 may be realized by the terminal device 6 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium records a computer program for causing the terminal device 6 to execute the above-described operations.

[0192] (Technical Effects) The information processing device 3 can prevent people who are not allowed to pass through the facial recognition gate device 23 from entering the facial recognition gate device 23. Therefore, the information processing device 3 can prevent a decrease in the throughput of the facial recognition gate device 23.

[0193] (Variation) As in the eighth modified example of the second embodiment described above, the determination unit 612 may determine the priority based on the position of the passenger and the position of the terminal device, and may change the display content based on the determined priority.

[0194] <Additional Notes> The following additional notes are provided regarding the above-described embodiment.

[0195] (Appendix 1) an image acquisition means for acquiring a first image including a predetermined area through which a plurality of persons to be authenticated pass; an information acquisition means for acquiring the location of a terminal device carried by a user; a determination means for determining priorities for notifying a plurality of authentication results of the face authentication performed using the first image based on a position of the terminal device and the positions of the plurality of people to be authenticated detected based on the first image; An information processing device comprising:

[0196] (Appendix 2) The determining means determines the priority so that, of the plurality of authentication results, the authentication results of the person to be authenticated who is closest to the terminal device are notified in descending order. 2. The information processing device according to claim 1.

[0197] (Appendix 3) the plurality of authenticatees include a first authenticatee and a second authenticatee, the locations of the plurality of authenticatees include a location of the first authenticatee and a location of the second authenticatee; the plurality of authentication results include a first authentication result which is a result of the face authentication performed on the first person to be authenticated, and a second authentication result which is a result of the face authentication performed on the second person to be authenticated, The determining means determines, based on the location of the terminal device, the location of the first person to be authenticated, and the location of the second person to be authenticated, that if the first person to be authenticated is closer to the terminal device than the second person to be authenticated, the priority of the first authentication result is higher than the priority of the second authentication result. 3. The information processing device according to claim 2.

[0198] (Appendix 4) The determining means transmits at least a part of the authentication results of the plurality of authentication results and the location of the person to be authenticated corresponding to the at least a part of the authentication results to the terminal device based on the priority. 4. The information processing device according to claim 1.

[0199] (Appendix 5) the image acquisition means acquires a second image including the user; the information processing device includes a face direction detection means for detecting a face direction of the user based on the second image; The determining means determines the priority based on the position of the terminal device, the detected facial orientation, and the positions of the plurality of persons to be authenticated. 5. The information processing device according to any one of claims 1 to 4.

[0200] (Appendix 6) the face direction detection means estimates a visible range, which is a range that can be viewed by the user, from the detected face direction; The determining means determines the priority based on the position of the terminal device, the estimated visible range, and the positions of the plurality of users to be authenticated. 6. The information processing device according to claim 5.

[0201] (Appendix 7) the determining means estimates a movement direction of each of the plurality of persons to be authenticated based on the plurality of first images; The determining means determines the priority based on the position of the terminal device, the estimated visible range, and the direction of movement of each of the plurality of persons to be authenticated. 7. The information processing device according to claim 6.

[0202] (Appendix 8) the determining means estimates a movement direction of each of the plurality of persons to be authenticated based on the plurality of first images; The determining means determines the priority based on the position of the terminal device and the direction of movement of each of the plurality of persons to be authenticated. 5. The information processing device according to any one of claims 1 to 4.

[0203] (Appendix 9) the predetermined area is an area through which a person heading towards the face recognition gate device passes, the authentication result includes either first type information indicating that the person to be authenticated is allowed to pass through the face recognition gate device or second type information indicating that the person to be authenticated is not allowed to pass through the face recognition gate device, The determining means determines the priority of the authentication results including the second type information among the plurality of authentication results based on the location of the terminal device and the locations of the plurality of persons to be authenticated. 9. An information processing device according to any one of appendices 1 to 8.

[0204] (Appendix 10) The information processing device includes an authentication means for performing face authentication using the first image. 10. An information processing device according to any one of Supplementary Notes 1 to 9.

[0205] (Appendix 11) A first image including a predetermined area through which a plurality of subjects pass is acquired; Obtaining the location of a terminal device carried by the user; determining priorities for notifying a plurality of authentication results of face authentication performed using the first image based on a position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; Information processing methods.

[0206] (Appendix 12) On the computer, A first image including a predetermined area through which a plurality of subjects pass is acquired; Obtaining the location of a terminal device carried by the user; determining priorities for notifying a plurality of authentication results of face authentication performed using the first image based on a position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; A recording medium on which a computer program for executing an information processing method is recorded.

[0207] (Appendix 13) an image acquisition means for acquiring a first image including a predetermined area through which a plurality of persons to be authenticated pass; an authentication means for performing face authentication using the first image; an information acquisition means for acquiring the location of a terminal device carried by a user; a determination means for determining priorities for notifying the plurality of authentication results of the face authentication based on the position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; An information processing system comprising:

[0208] (Appendix 14) acquiring at least some of a plurality of authentication results of face authentication performed using a first image including a predetermined area through which a plurality of subjects pass; changing a display order of the at least some of the authentication results based on a position of a terminal device carried by a user and the positions of the plurality of persons to be authenticated detected based on the first image; Display method.

[0209] (Appendix 15) Illustrating the location of the terminal device and at least some of the locations of the plurality of subjects. Display method as described in Appendix 14.

[0210] (Appendix 16) A terminal device owned by a user, an acquisition means for acquiring at least a part of a plurality of authentication results of face authentication performed using a first image including a predetermined area through which a plurality of persons to be authenticated pass; a display means for changing the display content based on the display priority; Equipped with the display content includes at least a part of the plurality of authentication results, The priority is determined based on the position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image. Terminal device.

[0211] (Appendix 17) The terminal device includes a determination means for determining the priority based on the position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image. 17. The terminal device of claim 16.

[0212] This disclosure is not limited to the above-described embodiments, but may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention as can be read from the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical scope of this disclosure. [Explanation of symbols]

[0213] 1, 3 Information processing device 2. Airport System 5 Authentication Device 6, 41, 42 Terminal equipment 11, 311 Image acquisition unit 12, 312 Information acquisition section 13, 315 Decision Section 21 Management Server 22 Check-in terminal 23 Facial Recognition Gate Device 24 Normal gate device 31 Arithmetic unit 32 Storage device 33 Communication equipment 34 Input Devices 35 Output Device 36, 52, 211, 232 face database 51, 314 Face Recognition Unit 313 Tracking Department

Claims

1. an image acquisition means for acquiring a first image including a predetermined area in front of the face recognition gate through which a plurality of persons to be authenticated pass; an information acquisition means for acquiring the location of a terminal device carried by a user who is in charge of security or guiding the plurality of subjects to be authenticated, on the side closer to the face recognition gate; a determination means for determining a priority for notifying the terminal device of a plurality of authentication results of the face authentication performed using the first image, based on a position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; Equipped with the plurality of authenticatees include a first authenticatee and a second authenticatee, the locations of the plurality of authenticatees include a location of the first authenticatee and a location of the second authenticatee; the plurality of authentication results include a first authentication result that is a result of the face authentication performed on the first person to be authenticated, and a second authentication result that is a result of the face authentication performed on the second person to be authenticated, the determining means, when the first person to be authenticated is closer to the terminal device than the second person to be authenticated, sets a priority of the notification of the first authentication result higher than a priority of the notification of the second authentication result; Information processing device.

2. The determining means notifies the terminal device of at least some of the authentication results and the location of the person to be authenticated corresponding to the at least some of the authentication results based on the priority. The information processing device according to claim 1 .

3. The computer acquires a first image including a predetermined area in front of the face recognition gate through which a plurality of persons to be authenticated pass, the computer acquires the position of a terminal device carried by a user who is performing security or guiding the plurality of subjects to be authenticated, on the side closer to the face recognition gate; the computer determines priorities for notifying the terminal device of a plurality of authentication results of the face authentication performed using the first image, based on the position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; the plurality of authenticatees include a first authenticatee and a second authenticatee, the locations of the plurality of authenticatees include a location of the first authenticatee and a location of the second authenticatee; the plurality of authentication results include a first authentication result that is a result of the face authentication performed on the first person to be authenticated, and a second authentication result that is a result of the face authentication performed on the second person to be authenticated, When the first person to be authenticated is closer to the terminal device than the second person to be authenticated, the computer sets a priority of the notification of the first authentication result higher than a priority of the notification of the second authentication result. Information processing methods.

4. The computer notifies the terminal device of at least some of the authentication results and the location of the person to be authenticated corresponding to the at least some of the authentication results based on the priority. The information processing method according to claim 3 .

5. On the computer, acquiring a first image including a predetermined area in front of the face recognition gate through which a plurality of subjects pass; acquire the position of a terminal device carried by a user who is in charge of security or guiding the plurality of subjects to be authenticated, on the side closer to the face authentication gate; determining a priority for notifying the terminal device of a plurality of authentication results of the face authentication performed using the first image based on a position of the terminal device and the positions of the plurality of persons to be authenticated detected based on the first image; the plurality of authenticatees include a first authenticatee and a second authenticatee, the locations of the plurality of authenticatees include a location of the first authenticatee and a location of the second authenticatee; the plurality of authentication results include a first authentication result that is a result of the face authentication performed on the first person to be authenticated, and a second authentication result that is a result of the face authentication performed on the second person to be authenticated, If the first person to be authenticated is closer to the terminal device than the second person to be authenticated, a priority of the notification of the first authentication result is set higher than a priority of the notification of the second authentication result. A recording medium on which a computer program for executing an information processing method is recorded.

6. The computer, Notifying the terminal device of at least some of the authentication results and the location of the person to be authenticated corresponding to the at least some of the authentication results based on the priority.

6. The recording medium according to claim 5, wherein a computer program for executing the information processing method is recorded.

Images