Information processing device, information processing control method, and recording medium

Abstract

This information processing device comprises: a setting means that, on the basis of gate information of a plurality of gate devices including a facial recognition gate device, sets a first region including at least a portion of a route in which there is a flow of people moving toward the facial recognition gate device; an image acquiring means that acquires a first image including the first region; and a first determining means that, on the basis of the results of facial recognition performed using the acquired first image, determines, for a first recognized person who is a person contained in the acquired first image and who is present in the first region, whether the first recognized person is able to pass through the facial recognition gate device.

Description

Information processing device, information processing control method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] For example, a system has been proposed that detects a user who is a predetermined distance away from a gate device connected to a biometric authentication control unit as an authenticatee, initiates biometric authentication and tracking of the authenticatee, and allows the authenticatee to pass through the gate device if the biometric authentication and tracking of the authenticatee are successful at the entrance to the gate device (see Patent Document 1).Other prior art documents related to this disclosure include Patent Documents 2 to 5.

[0003] International Publication No. 2022 / 149376 International Publication No. 2022 / 003853 Patent No. 7108243 International Publication No. 2022 / 044086 Japanese Patent Application Laid-Open No. 2011-204160

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing device comprises a setting means for setting a first area including at least a portion of a route along which people flow toward a facial recognition gate device based on gate information of a plurality of gate devices including the facial recognition gate device; an image acquisition means for acquiring a first image including the first area; and a first determination means for determining whether a first person to be authenticated, who is included in the acquired first image and is present in the first area, can pass through the facial recognition gate device based on the result of facial authentication performed using the acquired first image.

[0006] One aspect of the information processing method involves setting a first area including at least a portion of a route along which people flow toward a facial recognition gate device based on gate information from multiple gate devices including a facial recognition gate device, acquiring a first image including the first area, and determining whether a first person to be authenticated, who is included in the acquired first image and present in the first area, can pass through the facial recognition gate device based on the results of facial authentication performed using the acquired first image.

[0007] One aspect of the recording medium has a computer program recorded on it for causing a computer to execute an information processing method that sets a first area including at least a portion of a route along which people flow toward a facial recognition gate device based on gate information from multiple gate devices including the facial recognition gate device, acquires a first image including the first area, and determines whether a first person to be authenticated, who is included in the acquired first image and present in the first area, can pass through the facial recognition gate device based on the results of facial authentication performed using the acquired first image.

[0008] Another aspect of the information processing device comprises a route identification means for identifying a route along which people flow toward a facial recognition gate device; an image acquisition means for acquiring a third image including the identified route; a position detection means for detecting the position of a third person to be authenticated included in the third image based on the acquired third image; a first determination means for determining whether or not the third person to be authenticated can pass through the facial recognition gate device based on the result of facial authentication performed on the third person using the acquired third image; and a second determination means for determining whether or not to output third person information indicating the third person to be authenticated based on the direction of movement of the third person based on a change in the position of the third person to be authenticated and the identified route when the first determination means determines that the third person to be authenticated cannot pass through the facial recognition gate device.

[0009] 1 is a block diagram showing an example of the configuration of an information processing device. FIG. 1 is a block diagram showing an example of the configuration of an airport system. FIG. 2 is a plan view showing an example of a floor where airport boarding gates are provided. FIG. 3 is a plan view showing an example of a virtual authentication area. FIG. 4 is a block diagram showing another example of the configuration of an information processing device. FIG. 5 is a diagram showing an example of a face database provided in the information processing device. FIG. 6 is a diagram for explaining passenger tracking processing. FIG. 7 is a diagram showing an example of an ID correspondence table. FIG. 8 is a diagram showing an example of an image. FIG. 9 is a flowchart showing tracking and authentication operations according to a second embodiment. FIG. 10 is a diagram showing an example of a terminal device. FIG. 11 is a flowchart showing a determination operation according to the second embodiment. FIG. 11 is a block diagram showing an example of the configuration of an authentication device. FIG. 12 is a plan view showing another example of a virtual authentication area.

[0010] An information processing device, an information processing method, and a recording medium according to an embodiment will be described.

[0011] First Embodiment A first embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 1. Below, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1. In Fig. 1, the information processing device 1 includes an image acquisition unit 11, a setting unit 12, and a determination unit 13.

[0012] The setting unit 12 sets a first area including at least a portion of a route along which people flow toward the facial recognition gate device based on gate information of multiple gate devices including the facial recognition gate device. The multiple gate devices may be installed in one location (e.g., one entrance / exit) or multiple locations (e.g., multiple entrance / exit). The gate information may include at least one of the operating status of each of the multiple gate devices, identification information of each of the multiple gate devices (i.e., information for identifying each gate device), location, and device type. The gate information may also include at least one of the number of operating facial recognition gate devices, the location of the operating facial recognition gates, and identification information set for the facial recognition gate devices.

[0013] The operating state of a gate device may include an active state (e.g., a state in which a process related to determining whether to allow a person to pass through can be executed) and an inactive state (e.g., a state in which a process related to determining whether to allow a person to pass through cannot be executed). The inactive state may include a state in which power is not supplied to the gate device (e.g., a power-off state) and a state in which power is supplied to a portion of the gate device but the gate device cannot perform its function (a so-called standby state). The facial recognition gate device is not limited to a gate device having only the function of determining whether to allow a person to pass through using facial recognition processing, but may also include a gate device in which the function of determining whether to allow a person to pass through using facial recognition processing is active (i.e., a gate device functioning as a facial recognition gate device), among gate devices that can switch between the function of determining whether to allow a person to pass through using facial recognition processing and the function of determining whether to allow a person to pass through using a process other than facial recognition processing (e.g., reading a two-dimensional barcode).

[0014] The setting unit 12 may set the first area based on a map (e.g., a floor map) of a location where multiple gate devices are installed. Here, the first area is an area that includes at least a portion of a route along which people flow toward the facial recognition gate device. The setting unit 12 may, for example, estimate a route along which people flow toward the facial recognition gate device based on the position of the facial recognition gate device on the map and the shape of a passage leading to the facial recognition gate device. The setting unit 12 may set the first area based on the estimated route. Note that the map (e.g., a floor map) may include facility information. The facility information may include store information and equipment information (e.g., at least one of restrooms, stairs, escalators, and elevator halls). The setting unit 12 may set the first area based on the facility information included in the map. In this case, the setting unit 12 may estimate a route along which people flow toward the facial recognition gate device based on the facility information.

[0015] The first area may be a virtually set area. If the gate information indicates that the facial recognition gate device is not operating (i.e., if the facial recognition gate device is in a dormant state), the setting unit 12 does not need to set the first area. In other words, the setting unit 12 may set the first area only if the gate information indicates that the facial recognition gate device is operating.

[0016] The facial recognition gate device allows people whose facial authentication is successful to pass through, but does not allow people whose facial authentication is unsuccessful to pass through (for example, if the facial recognition gate device is a flap-type gate device, the flap is closed). The facial recognition gate device may determine that facial authentication is successful when the face of a person attempting to pass through the facial recognition gate device corresponds to a face shown in a pre-registered facial image. In other words, the facial recognition gate device may determine that facial authentication is successful when there is a person whose pre-registered facial image corresponds to the person attempting to pass through the facial recognition gate device.

[0017] Therefore, if the facial image of a person attempting to pass through the facial recognition gate device is not registered, the facial recognition gate device will not allow that person to pass through. Therefore, when a person whose facial image is not registered enters the facial recognition gate device, the flow of people passing through the facial recognition gate device is obstructed because that person is not allowed to pass through. In other words, the throughput of the facial recognition gate device decreases.

[0018] The image acquisition unit 11 acquires a first image, which is an image including a first area. The first image may be an image captured by a camera capable of capturing an image of the first area. The first image is an image including the first area. Therefore, the first image may include a person heading toward the facial recognition gate device. A person included in the first image and present in the first area is referred to as a first person to be authenticated. The determination unit 13 determines whether or not the first person to be authenticated can pass through the facial recognition gate device based on the result of facial authentication performed using the first image for the first person to be authenticated.

[0019] The determination result by the determination unit 13 may be output to a display device (not shown). Note that the display device may be included in the information processing device 1, or may be a device different from the information processing device 1. For example, at least one of a guide and a security guard near the facial recognition gate device can refer to the determination result by the determination unit 13 to determine who cannot pass through the facial recognition gate device. Then, at least one of the guide and the security guard can guide people who cannot pass through the facial recognition gate device not to enter the facial recognition gate device. Therefore, the information processing device 1 can prevent people who cannot pass through the facial recognition gate device from entering the facial recognition gate device. Therefore, the information processing device 1 can prevent a decrease in throughput of the facial recognition gate device.

[0020] In the information processing device 1, first, the setting unit 12 may set a first area including at least a part of a route along which people flow toward the facial recognition gate device based on gate information of multiple gate devices including the facial recognition gate device. Next, the image acquisition unit 12 may acquire a first image that is an image including the first area. Next, the determination unit 13 may determine whether or not a first person to be authenticated, who is included in the acquired first image and is present in the first area, can pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image.

[0021] Such an information processing device 1 may be realized, for example, by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium has recorded thereon a computer program for causing the computer to execute an information processing method for setting a first area including at least a part of a route along which people flow toward the facial recognition gate device based on gate information of multiple gate devices including the facial recognition gate device, acquiring a first image including the first area, and determining, for a first person to be authenticated who is included in the acquired first image and is present in the first area, whether the first person to be authenticated is allowed to pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image.

[0022] Second Embodiment A second embodiment of the display control device, the display control method, and the recording medium will be described with reference to Fig. 2 to Fig. 12. In the following, the second embodiment of the display control device, the display control method, and the recording medium will be described using an information processing device 3 used in an airport.

[0023] First, an airport system 2 at an airport will be described with reference to Fig. 2. In Fig. 2, the airport system 2 includes a management server 21, a check-in terminal 22, and a plurality of gate devices installed at boarding gates. The management server 21, the check-in terminal 22, and the plurality of gate devices are connected to one another via a network NW.

[0024] The airport system 2 may include other check-in terminals in addition to the check-in terminal 22. That is, the airport system 2 may include a plurality of check-in terminals. The network NW may be a wide area network (WAN) such as the Internet, or a local area network (LAN).

[0025] The multiple gate devices have a facial recognition function that performs facial recognition processing, and include a facial recognition gate device 23 that determines whether a passenger can pass through based on the results of the facial recognition processing, and a gate device 24 that determines whether a passenger can pass through based on the airline ticket held by the passenger. Hereinafter, the gate device 24 will be referred to as a "normal gate device 24" as appropriate. As shown in Figure 3, the airport is assumed to be equipped with boarding gates G1, G2, and G3. The facial recognition gate device 23 and the normal gate device 24 are assumed to be installed at boarding gate G1.

[0026] The term "air ticket" may refer to at least one of a paper air ticket and an electronic air ticket. The term "air ticket" may also refer to a concept including, in addition to or instead of at least one of a paper air ticket and an electronic air ticket, personal information associated with an electronic air ticket (for example, a passport, a credit card used to purchase the air ticket, etc.).

[0027] The management server 21 has a face database 211 (hereinafter referred to as "face DB211"), an operation database 212 (hereinafter referred to as "operation DB212"), and a gate database 213 (hereinafter referred to as "gate DB213").

[0028] The face DB 211 stores face images used in face authentication processing. Instead of or in addition to face images, feature quantities related to face images may be stored in the face DB 211. The flight DB 212 stores aircraft flight information (so-called flight information). The flight information may include the flight name of the aircraft, gate identification information for identifying the boarding gate (e.g., boarding gate number), and boarding start time. The flight name, identification information, and boarding start time of the aircraft may be associated with each other.

[0029] The gate DB 213 stores a plurality of pieces of boarding gate information corresponding to a plurality of boarding gates. Note that the entity that manages and / or operates the airport system 2 may be different from the airport company that manages and operates the airport and the airline that operates the aircraft. In this case, the plurality of pieces of boarding gate information stored in the gate DB 213 may be acquired from a system related to at least one of the airport company and the airline. The gate DB 213 may be shared between the airport system 2 and a system related to at least one of the airport company and the airline.

[0030] The boarding gate information may include gate identification information (e.g., a boarding gate number) for identifying the boarding gate and device information related to the installed gate device. The device information may be information indicating the number of gate devices and at least one of the type, operating status, and installation location of each gate device. Here, the types of gate devices may include a first type capable of facial authentication and a second type not capable of facial authentication. Note that the second type of gate device may include a gate device capable of reading information (e.g., an ID) for identifying a passenger (e.g., a two-dimensional barcode, etc.).

[0031] The operational state of a gate device may include an operating state in which the gate device is operating and an inactive state in which the gate device is inactive (i.e., not operating). For example, when two or more gate devices are installed at one boarding gate, the installation location of the gate device may be expressed as the relative positional relationship between the two or more gate devices. Alternatively, the installation location of the gate device may be expressed as the coordinates of each gate device in a coordinate system related to the floor (the so-called departure floor) on which the airport boarding gates are located. Note that, when only one gate device is installed at one boarding gate, the device information does not need to include the installation location of the gate device. Note that the multiple boarding gate information registered in the gate DB 213 may be predetermined according to at least one of the airline and the flight. Note that the multiple boarding gate information registered in the gate DB 213 may be automatically updated according to the departure time of the aircraft, etc. Note that the boarding gate information corresponds to an example of "gate information" in the first embodiment.

[0032] The check-in terminal 22 is a terminal used for boarding procedures (i.e., check-in). The check-in terminal 22 may be operated by an airport staff member or a passenger (i.e., the check-in terminal 22 may be a so-called automatic check-in machine). Note that the term "airport staff member" is not limited to a person who belongs to an airport company that manages and operates the airport, but also includes a person who works at the airport, such as a person who belongs to an airline that operates aircraft.

[0033] The check-in terminal 22 performs check-in procedures for passengers based on the airline tickets held by the passengers. The check-in terminal 22 may acquire facial images of passengers during check-in procedures. The check-in terminal 22 may acquire facial images of passengers by capturing images of the passengers with a camera, or may acquire facial images of passengers by reading facial photographs printed on the passports held by the passengers. Note that the check-in terminal 22 does not need to acquire facial images of all passengers.

[0034] The check-in terminal 22 transmits passenger information (e.g., name and flight number) of a passenger who has completed check-in procedures and a facial image of the passenger to the management server 21. Note that the check-in terminal 22 may obtain the passenger information from information printed on the airline ticket (in other words, information associated with the airline ticket).

[0035] The management server 21 associates the passenger information and facial image transmitted from the check-in terminal 22 with each other and registers them in the face DB 211. At this time, the management server 21 may assign passenger identification information for identifying the passenger to the passenger information and facial image. As will be described later, the facial image is used in facial authentication processing. For this reason, the passenger identification information assigned to the passenger information and facial image will hereinafter be referred to as an "authentication ID" as appropriate. Note that the passenger's facial image may be acquired by an application (e.g., an application provided by an airline) installed on a terminal device (e.g., a smartphone) carried by the passenger, in addition to or instead of the check-in terminal 22, or may be acquired by a gate device installed in the departure immigration area of ​​the airport.

[0036] Based on the current time, the management server 21 may identify the flight name of an aircraft that is a first predetermined time (e.g., several minutes to several tens of minutes) before the boarding start time from the flight operation information registered in the flight operation DB 212. Based on the gate identification information associated with the identified flight name, the management server 21 may extract boarding gate information corresponding to the gate identification information from multiple boarding gate information registered in the gate DB 213. Based on the extracted boarding gate information, the management server 21 may determine whether a facial recognition gate device (e.g., facial recognition gate device 23) is installed at the boarding gate corresponding to the extracted boarding gate information.

[0037] If it is determined that a facial recognition gate device (e.g., the facial recognition gate device 23) is installed, the management server 21 may extract, from the face DB 211, a facial image of a passenger associated with passenger information including the specified flight name (in other words, a passenger scheduled to board an aircraft with the specified flight name). The management server 21 may transmit the extracted facial image to a facial recognition gate device (e.g., the facial recognition gate device 23) identified by the extracted boarding gate information. If it is determined that a facial recognition gate device is not installed, the management server 21 may not perform these processes. If it is determined that a facial recognition gate device is installed, the management server 21 may determine whether the installed facial recognition gate device is operating based on the extracted boarding gate information. If feature amounts related to facial images are registered in the face DB 211, the management server 21 may transmit the feature amounts related to the facial image to the facial recognition gate device instead of or in addition to the facial image.

[0038] The facial recognition gate device 23 has a camera 231, a face database 232 (hereinafter referred to as "face DB 232"), and a facial recognition device 233. Facial images transmitted from the management server 21 are registered in the face DB 232. The facial recognition gate device 23 may have a display device 234. The display device 234 may display at least one of an image captured by the camera 231 and information indicating the result of the facial recognition processing.

[0039] The face authentication device 233 performs face authentication processing using an image captured by the camera 231 (for example, an image that includes the passenger's face) and a face image registered in the face DB 232. If face authentication is successful, the face authentication gate device 23 allows the passenger to pass. On the other hand, if face authentication is unsuccessful, the face authentication gate device 23 does not allow the passenger to pass. Note that various existing methods (for example, at least one of a two-dimensional (2D) authentication method and a three-dimensional (3D) authentication method) can be applied to the face authentication processing.

[0040] A specific example of facial recognition processing in the facial recognition gate device 23 will be described. The facial recognition gate device 23 may be a flap-type gate device. The facial recognition device 233 may extract features of an image captured by the camera 231. The facial recognition device 233 may compare the extracted features with features related to facial images registered in the face DB 232. In this case, the facial recognition device 233 may calculate a matching score (or a similarity score) based on the extracted features and the features related to facial images registered in the face DB 232. If the matching score is equal to or greater than a threshold (i.e., if facial recognition is successful), the facial recognition device 233 may allow the passenger to pass. In this case, the facial recognition device 233 may identify an authentication ID related to the passenger. In this case, the facial recognition gate device 23 may open the flap. If the matching score is less than the threshold (i.e., if facial recognition is unsuccessful), the facial recognition device 233 may not allow the passenger to pass. In this case, the facial recognition gate device 23 may close the flap. Note that, instead of or in addition to a facial image, feature quantities related to the facial image may be registered in the face DB 232. Note that a device other than the facial recognition gate device 23 (e.g., the management server 21) (e.g., the management server 21) may perform part of the facial recognition process. In this case, the facial recognition device 233 of the facial recognition gate device 23 may extract feature quantities from the image captured by the camera 231. The facial recognition device 233 may transmit the extracted feature quantities to another device. The other device may compare the feature quantities transmitted from the facial recognition device 233 with feature quantities related to facial images registered in a face database (e.g., the face DB 211). The other device may transmit information indicating the comparison result (e.g., information indicating whether the comparison score is equal to or greater than a threshold) to the facial recognition gate device 23. Note that, if the comparison score is equal to or greater than a threshold, the other device may include the passenger's authentication ID in the information indicating the comparison result. If the information indicating the matching result indicates that the matching score is equal to or greater than the threshold, the face authentication device 233 may allow the passenger to pass. If the information indicating the matching result indicates that the matching score is less than the threshold, the face authentication device 233 may not allow the passenger to pass.

[0041] It is expected that passengers will pass through the facial recognition gate device 23 at a faster speed than through the normal gate device 24. In other words, it is expected that the number of passengers passing through the facial recognition gate device 23 in a given period of time will be greater than the number of passengers passing through the normal gate device 24. In other words, the facial recognition gate device 23 can improve throughput at the boarding gate.

[0042] However, as described above, only passengers who have successfully passed face authentication are allowed to pass through the face authentication gate device 23. In order for a passenger to pass face authentication at the face authentication gate device 23, the passenger's face image must be registered in the face DB 232 of the face authentication gate device 23. If a passenger whose face image is not registered in the face DB 232 enters the face authentication gate device 23, the passenger will not be permitted to pass through, which will result in a decrease in throughput at the boarding gate.

[0043] In view of the above-mentioned problems, the information processing device 3 determines whether or not a passenger can pass through the facial recognition gate device 23 before the passenger enters the facial recognition gate device 23. In other words, the information processing device 3 determines whether or not a passenger can pass through the facial recognition gate device 23, separately from the facial recognition gate device 23.

[0044] 4, a virtual authentication area RA is provided around boarding gate G1 where the facial recognition gate device 23 and the normal gate device 24 are installed. The authentication area RA is an area through which multiple passengers heading to either the facial recognition gate device 23 or the normal gate device 24 pass.

[0045] The camera CAM is installed so as to be able to capture an image of the authentication area RA. The camera CAM may be connected to the information processing device 3 via a network NW. The camera CAM does not have to be installed so that the entire authentication area RA is included in its angle of view. In other words, the camera CAM may be installed so as to be able to capture an image of at least a portion of the authentication area RA. The camera CAM may be installed in a position that does not interfere with the passage of passengers (e.g., higher than the passengers' heads). As will be described later, images captured by the camera CAM may be used for facial recognition processing. For this reason, the camera CAM may be a high-resolution camera such as a 4K resolution camera. The camera CAM does not have to be connected to the information processing device 3 via a network NW. In this case, the camera CAM may be connected to the information processing device 3 via a cable (e.g., a USB (Universal Serial Bus) cable).

[0046] The camera CAM may capture an image of the authentication area RA to generate a first image that includes the authentication area RA. The first image may be an image that corresponds to one frame of a video.

[0047] The information processing device 3 performs face recognition processing using a first image generated by the camera CAM capturing an image of the recognition area RA, and determines whether or not a passenger included in the first image is allowed to pass through the face recognition gate device 23 before the passenger enters the face recognition gate device 23. The information processing device 3 will be described in detail below.

[0048] As shown in FIG. 5 , the information processing device 3 includes a calculation device 31, a storage device 32, and a communication device 33. The information processing device 3 may include an input device 34 and an output device 35. The information processing device 3 may include a face database 36 (hereinafter referred to as "face DB 36"). The information processing device 3 does not need to include at least one of the input device 34 and the output device 35. In the information processing device 3, the calculation device 31, the storage device 32, the communication device 33, the input device 34, the output device 35, and the face DB 36 may be connected via a data bus 37. The information processing device 3 is connected to the management server 21 via the communication device 33 and the network NW. The information processing device 3 may constitute a part of the airport system 2. In other words, the airport system 2 may include the information processing device 3.

[0049] The arithmetic device 31 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0050] The storage device 32 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 32 may include a non-transitory recording medium. The storage device 32 is capable of storing desired data. For example, the storage device 32 may temporarily store a computer program executed by the arithmetic device 31. The storage device 32 may temporarily store data that is temporarily used by the arithmetic device 31 when the arithmetic device 31 is executing a computer program.

[0051] The communication device 33 is capable of communicating with the management server 21 via the network NW. The communication device 33 may be capable of communicating with devices external to the information processing device 3 other than the management server 21 via the network NW. The communication device 33 may perform wired communication or wireless communication.

[0052] The input device 34 is a device capable of accepting information input to the information processing device 3 from outside. It may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 3. The input device 34 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 3, such as a USB memory. Note that when information is input to the information processing device 3 via the communication device 33 (in other words, when the display control device 2 acquires information via the communication device 33), the communication device 33 may function as an input device.

[0053] The output device 35 is a device capable of outputting information to the outside of the information processing device 3. The output device 35 may output visual information such as characters or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 35 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 35 may be capable of outputting information to a recording medium detachable from the information processing device 3, such as a USB memory. Note that when the information processing device 3 outputs information via the communication device 33, the communication device 33 may function as the output device.

[0054] The arithmetic device 31 may have, as logically realized functional blocks or physically realized processing circuits, an image acquisition unit 311, an information acquisition unit 312, a setting unit 313, a tracking unit 314, a face authentication unit 315, a determination unit 316, and a guidance unit 317. Note that at least one of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 314, the face authentication unit 315, the determination unit 316, and the guidance unit 317 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. If at least a portion of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 314, the face authentication unit 315, the judgment unit 316 and the guidance unit 317 are functional blocks, at least a portion of the image acquisition unit 311, the information acquisition unit 312, the setting unit 313, the tracking unit 314, the face authentication unit 315, the judgment unit 316 and the guidance unit 317 may be realized by the calculation device 31 executing a predetermined computer program.

[0055] The arithmetic device 31 may acquire (in other words, read) the predetermined computer program from the storage device 32. The arithmetic device 31 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 3. The arithmetic device 31 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 3 via the communication device 33. Note that the recording medium on which the predetermined computer program executed by the arithmetic device 31 is recorded may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0056] The management server 21 transmits at least a portion of the facial image registered in the face DB 211 to the information processing device 3 together with the authentication ID (i.e., passenger identification information) assigned to the facial image. In this case, the management server 21 may transmit gate identification information and boarding start time in addition to the facial image to the information processing device 3. The management server 21 may identify the gate identification information and boarding start time based on the flight name of the aircraft included in the passenger information associated with the facial image registered in the face DB 211 and the flight information registered in the flight DB 212. In other words, the management server 21 may identify the gate identification information and boarding start time related to the aircraft on which the passenger represented by the facial image will board. Note that if feature amounts related to the facial image are registered in the face DB 211 instead of or in addition to the facial image, the management server 21 may transmit the feature amounts related to the facial image to the display control device 3 instead of or in addition to the facial image.

[0057] The information processing device 3 registers the facial image transmitted from the management server 21 in the face DB 36. The information processing device 3 may register gate identification information and boarding start times in addition to the facial images in the face DB 36. As shown in FIG. 6 , the face DB 36 may include (i) a plurality of facial images and (ii) a table that associates authentication IDs, gate identification information (e.g., boarding gate numbers), boarding start times, and facial images with one another. The management server 21 may transmit at least some of the facial images registered in the face DB 211 to the information processing device 3 at predetermined intervals. The information processing device 3 may update the facial images registered in the face DB 36 every time a facial image is transmitted from the management server 21. When the management server 21 transmits feature amounts related to the facial images to the display control device 3 instead of or in addition to the facial images, the feature amounts related to the facial images may be registered in the face DB 36 instead of or in addition to the facial images.

[0058] The image acquisition unit 311 of the calculation device 31 may acquire one or more first images generated by the camera CAM via the communication device 33. The image acquisition unit 311 may store the acquired one or more first images in the storage device 32. The information acquisition unit 312 of the calculation device 31 acquires boarding gate information related to boarding gate G1 from the gate DB 213 of the management server 21 via the communication device 33. The information acquisition unit 312 may store the acquired boarding gate information in the storage device 32.

[0059] The setting unit 313 of the calculation device 31 may identify the gate device installed at the boarding gate G1 based on the device information included in the boarding gate information related to the boarding gate G1. Here, it is assumed that the boarding gate G1 is equipped with the facial recognition gate device 23 and normal gate devices 24a and 24b as the normal gate device 24 (see FIG. 4).

[0060] The setting unit 313 may identify an operating gate device among the identified gate devices based on the device information. The setting unit 313 may identify the location of the operating gate device based on the device information. Here, it is assumed that the face recognition gate device 23 and the normal gate devices 24a and 24b are operating.

[0061] The setting unit 313 may set a virtual area Ar1 that includes at least a portion of a route along which people flow toward the facial recognition gate device 23 based on the position of the facial recognition gate device 23 (see FIG. 4). The setting unit 313 may set a virtual area Ar2 that includes at least a portion of a route along which people flow toward the normal gate devices 24a and 24b based on the positions of the normal gate devices 24a and 24b (see FIG. 4). Note that in FIG. 4, areas Ar1 and Ar2 are set as areas within the authentication area RA. However, at least a portion of area Ar1 may be outside the authentication area RA. Similarly, at least a portion of area Ar2 may be outside the authentication area RA.

[0062] Note that when the facial recognition gate device 23 is not operating (i.e., when the facial recognition gate device 23 is in an inactive state), the setting unit 313 does not need to set the area Ar1. When the normal gate devices 24a and 24b are not operating (i.e., when the normal gate devices 24a and 24b are in an inactive state), the setting unit 313 does not need to set the area Ar2. When one of the normal gate devices 24a and 24b is operating and the other of the normal gate devices 24a and 24b is not operating, the setting unit 313 may change at least one of the position and the size of the area Ar2 based on the position of one of the normal gate devices 24a and 24b.

[0063] That is, the setting unit 313 may determine whether to set an area (e.g., at least one of areas Ar1 and Ar2) based on the operating status of each of a plurality of gate devices including the facial recognition gate device 23 and the normal gate devices 24a and 24b, and may determine at least one of the position and size of the area to be set. The setting unit 313 may associate the set area with device identification information for identifying the gate device. The setting unit 313 may associate the area Ar1 with device identification information related to the facial recognition gate device 23. The setting unit 313 may associate the area Ar2 with device identification information related to each of the normal gate devices 24a and 24b.

[0064] The operation status of each of the multiple gate devices may be changed according to aircraft operation information. The operation status of a gate device may be changed from an active state to an inactive state when the current time passes the departure time of a certain aircraft. The operation status of a gate device may be changed from an inactive state to an active state when the current time is a second predetermined time (e.g., 30 minutes) before the boarding start time of a certain aircraft. The setting unit 313 may acquire boarding gate information from the gate DB 213 of the management server 21 based on the aircraft operation information. For example, when the current time passes the departure time of a certain aircraft, the setting unit 313 may acquire boarding gate information from the gate DB 213. Then, for a gate device whose operation status has been changed from an active state to an inactive state, the setting unit 313 may cancel the setting of the area (e.g., at least one of areas Ar1 and Ar2) that was set when the gate device was in the active state. For example, when the current time is a second predetermined time before the boarding start time of a certain aircraft, the setting unit 313 may acquire boarding gate information from the gate DB 213. Then, for a gate device whose operating state has been changed from a dormant state to an active state, the setting unit 313 may set a new area (for example, at least one of areas Ar1 and Ar2) according to the position of the gate device.

[0065] The operational status of the gate device may be predetermined for each flight. That is, the operational status of each of the multiple gate devices when boarding one aircraft and the operational status of each of the multiple gate devices when boarding another aircraft may be predetermined. For example, when the current time passes the departure time of the one aircraft or when the current time is a second predetermined time before the boarding start time of the other aircraft, the setting unit 313 may acquire boarding gate information for boarding the other aircraft from the gate DB 213. In this case, the setting unit 313 may change the area (e.g., at least one of areas Ar1 and Ar2) set when boarding the one aircraft based on the acquired boarding gate information (specifically, the operational status of the gate device).

[0066] For example, the setting unit 313 may change the size of the area Ar1 depending on the number of facial recognition gate devices 23 installed at the boarding gate G1. For example, the setting unit 313 may change the position of the area Ar1 depending on the positions of the facial recognition gate devices 23 at the boarding gate G1. For example, the setting unit 313 may determine the vertical width of the area Ar1 (e.g., the width in a direction along the direction of travel of passengers when passing through the facial recognition gate devices 23) depending on the number of facial recognition gate devices 23 installed at the boarding gate G1, and may determine the horizontal width of the area Ar1 (e.g., the width in a direction intersecting the direction of travel of passengers when passing through the facial recognition gate devices 23) depending on the positions of the facial recognition gate devices 23. In this case, the setting unit 313 may determine at least one of the maximum and minimum values ​​of the vertical width and horizontal width of the area Ar1 based on an airport floor map. For example, the setting unit 313 may determine the shape of the area Ar1 (e.g., square, rectangular, L-shaped, etc.) based on the airport floor map.

[0067] For example, the setting unit 313 may change the size of the region Ar2 depending on the number of normal gate devices 24 installed at the boarding gate G1. For example, the setting unit 313 may change the position of the region Ar2 depending on the positions of the normal gate devices 24 at the boarding gate G1. For example, the setting unit 313 may determine the vertical width of the region Ar2 (e.g., the width along the direction of travel of passengers passing through the normal gate devices 24) depending on the number of normal gate devices 24 installed at the boarding gate G1, and may determine the horizontal width of the region Ar2 (e.g., the width in a direction intersecting the direction of travel of passengers passing through the normal gate devices 24) depending on the positions of the normal gate devices 24. In this case, the setting unit 313 may determine at least one of the maximum and minimum values ​​of the vertical width and horizontal width of the region Ar2 based on a floor map of the airport. For example, the setting unit 313 may determine the shape of the region Ar2 (e.g., square, rectangular, L-shaped, etc.) based on the floor map of the airport.

[0068] The airport floor map may also include facility information, such as store information and equipment information (for example, at least one of toilets, stairs, escalators, and elevator halls).

[0069] The operation patterns of multiple gate devices at a certain boarding gate (e.g., boarding gate G1) may be associated in advance with the positions and sizes of areas (e.g., at least one of areas Ar1 and Ar2). In this case, the setting unit 313 may identify the operation pattern based on boarding gate information acquired from the gate DB 213. Then, the setting unit 313 may set the area based on the positions and sizes of the areas associated with the identified operation patterns.

[0070] The tracking unit 314 of the calculation device 31 tracks one or more passengers passing through the authentication area RA, using the multiple first images acquired by the image acquisition unit 311 (i.e., the multiple first images generated by the camera CAM). The face authentication unit 315 of the calculation device 31 performs face authentication processing on one or more passengers passing through the authentication area RA, using the multiple first images acquired by the image acquisition unit 311.

[0071] A case where the tracking unit 314 performs tracking processing of a passenger P1 passing through the authentication area RA shown in Fig. 4 and the face authentication unit 315 performs face authentication processing of the passenger P1 will be described with reference to Fig. 7. Note that the passenger P1 is also a target of the face authentication processing, and therefore may also be referred to as a person to be authenticated.

[0072] Images IMG1, IMG2, and IMG3 shown in Figure 7 are images including passenger P1 (in other words, images in which passenger P1 is captured). Image IMG1 is an image generated by camera CAM capturing an image of authentication area RA at time t1. Image IMG2 is an image generated by camera CAM capturing an image of authentication area RA at time t2, which is later than time t1. Image IMG3 is an image generated by camera CAM capturing an image of authentication area RA at time t3, which is later than time t2.

[0073] Each of images IMG1, IMG2, and IMG3 may be an image corresponding to one frame of a video. In this case, image IMG2 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG1. In other words, image IMG2 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG1. Similarly, image IMG3 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG2. In other words, image IMG3 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG2.

[0074] The tracking unit 314 detects the head of passenger P1 contained in image IMG1 from image IMG1. Note that the method for detecting a person's head from an image is an existing technique, so a detailed description thereof will be omitted. Based on the detected head of passenger P1, the tracking unit 314 sets an area including the head of passenger P1 as a tracking area TA1.

[0075] When the tracking unit 314 sets the tracking area TA1, it sets a tracking ID, which is identification information for identifying the passenger P1 related to the tracking area TA1, to the passenger P1. The tracking unit 314 calculates the position of the passenger P1 based on the tracking area TA1. Note that, since existing technology can be applied to a method for calculating the position of a subject included in an image from the image, a detailed description thereof will be omitted. The tracking unit 314 may associate the tracking ID with the position of the passenger P1 and register them in an ID correspondence table 321 stored in the storage device 32.

[0076] When the tracking area TA1 is set, the tracking unit 314 may determine whether or not the face of passenger P1 is captured in the tracking area TA1. In other words, the tracking unit 314 may perform face detection on the tracking area TA1. When it is determined that the face of passenger P1 is captured in the tracking area TA1, the tracking unit 314 generates a face image including the face area of ​​passenger P1. The tracking unit 314 associates the generated face image with the tracking ID related to passenger P1 and transmits it to the face authentication unit 315. Note that when it is determined that the face of passenger P1 is not captured in the tracking area TA1, the tracking unit 314 does not need to generate a face image.

[0077] The face authentication unit 315 performs face authentication processing using the face image transmitted from the tracking unit 314 and the face images registered in the face DB 36. The face authentication unit 315 may extract features of the face image transmitted from the tracking unit 314. The face authentication unit 315 may compare the features of the face image transmitted from the tracking unit 314 with features related to face images registered in the face DB 36. At this time, the face authentication unit 315 may calculate a matching score (or a similarity score) based on the extracted features and the features related to the face images registered in the face DB 36. The face authentication unit 315 may compare the matching score with a threshold. If the matching score is equal to or greater than the threshold, the face authentication unit 315 may determine that the face indicated by the face image transmitted from the tracking unit 314 corresponds to the face indicated by one of the face images registered in the face DB 36. If the matching score is less than the threshold value, it may be determined that a face image indicating a face corresponding to the face indicated by the face image transmitted from the tracking unit 314 is not registered in the face DB 36 .

[0078] When the face indicated by the facial image transmitted from the tracking unit 314 corresponds to the face indicated by one of the facial images registered in the face DB 36 (in other words, when facial authentication is successful), the facial authentication unit 315 associates the authentication ID associated with the one facial image with the tracking ID associated with the facial image transmitted from the tracking unit 314, and registers the same in the ID correspondence table 321. The facial authentication unit 315 may register, in the ID correspondence table 321, the authentication time, which is the time when the facial authentication process was performed, in addition to the authentication ID.

[0079] If a facial image showing a face corresponding to the face indicated by the facial image transmitted from the tracking unit 314 is not registered in the face DB 36 (in other words, if facial authentication fails), the facial authentication unit 315 may register information indicating that there is no corresponding person (for example, “N / A (Not Applicable)”) in the ID correspondence table 321 in association with the tracking ID associated with the facial image transmitted from the tracking unit 314.

[0080] The tracking unit 314 may use the image IMG2 and the image IMG1 to identify the passenger P1 included in the image IMG2. Identifying the passenger P1 included in the image IMG2 is equivalent to associating the passenger P1 included in the image IMG1 with the passenger P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method related to image association can be applied to identifying the passenger P1 included in the image IMG2. Note that various existing methods can be applied to both the matching method and the optical flow method, and therefore detailed description thereof will be omitted.

[0081] When passenger P1 included in image IMG2 is identified, the tracking unit 314 detects the head of passenger P1. Based on the detected head of passenger P1, the tracking unit 314 sets an area including the head of passenger P1 as tracking area TA2. Because passenger P1 included in image IMG1 and passenger P1 included in image IMG2 are the same passenger, the tracking ID of passenger P1 related to tracking area TA2 is the same as the tracking ID of passenger P1 related to tracking area TA1. The tracking unit 314 calculates the position of passenger P1 based on tracking area TA2.

[0082] The tracking unit 314 associates the position of passenger P1 with the tracking ID related to passenger P1 and registers it in the ID correspondence table 321. In this case, since the position of passenger P1 calculated based on tracking area TA1 is registered in the ID correspondence table 321, the tracking unit 314 registers the position of passenger P1 calculated based on tracking area TA2 in the ID correspondence table 321, thereby updating the position of passenger P1.

[0083] When the tracking area TA2 is set, the tracking unit 314 may determine whether the face of passenger P1 is captured in the tracking area TA2. In other words, the tracking unit 314 may perform face detection on the tracking area TA2. When it is determined that the face of passenger P1 is captured in the tracking area TA2, the tracking unit 314 generates a face image including the face area of ​​passenger P1. The tracking unit 314 associates the generated face image with the tracking ID related to passenger P1 and transmits the image to the face authentication unit 315. Note that, when it is determined that the face of passenger P1 is not captured in the tracking area TA2, the tracking unit 314 does not need to generate a face image. Note that, even when it is determined that the face of passenger P1 is captured in the tracking area TA2, if the tracking ID related to passenger P1 is associated with the authentication ID in the ID correspondence table 321 (i.e., if face authentication has already been successful), the tracking unit 314 does not need to generate a face image.

[0084] The face authentication unit 315 performs face authentication processing using the face image transmitted from the tracking unit 314 and the face images registered in the face DB 36. If the face indicated by the face image transmitted from the tracking unit 314 corresponds to the face indicated by one of the face images registered in the face DB 36 (in other words, if face authentication is successful), the face authentication unit 315 registers the authentication ID associated with the one face image in the ID correspondence table 321 in association with the tracking ID associated with the face image transmitted from the tracking unit 314. The face authentication unit 315 may register, in the ID correspondence table 321, the authentication time, which is the time when the face authentication processing was performed, in addition to the authentication ID. Note that if the authentication time has already been registered in the ID correspondence table 321 (i.e., if face authentication was successful in the past), the face authentication unit 315 may update the authentication time registered in the ID correspondence table 321.

[0085] If a facial image showing a face corresponding to the face indicated by the facial image sent from the tracking unit 314 is not registered in the face DB 36 (in other words, if facial authentication fails), the facial authentication unit 315 may register information indicating that there is no corresponding person in the ID correspondence table 321, by associating it with the tracking ID associated with the facial image sent from the tracking unit 314.

[0086] The tracking unit 314 may use the image IMG3 and the image IMG2 to identify the passenger P1 included in the image IMG3. When the passenger P1 included in the image IMG3 is identified, the tracking unit 314 detects the head of the passenger P1. Based on the detected head of the passenger P1, the tracking unit 314 sets an area including the head of the passenger P1 as a tracking area TA3. Because the passenger P1 included in the image IMG2 and the passenger P1 included in the image IMG3 are the same passenger, the tracking ID of the passenger P1 related to the tracking area TA3 is the same as the tracking ID of the passenger P1 related to the tracking area TA2. The tracking unit 314 calculates the position of the passenger P1 based on the tracking area TA3.

[0087] The tracking unit 314 associates the position of passenger P1 with the tracking ID related to passenger P1 and registers it in the ID correspondence table 321. In this case, since the position of passenger P1 calculated based on tracking area TA2 is registered in the ID correspondence table 321, the tracking unit 314 registers the position of passenger P1 calculated based on tracking area TA3 in the ID correspondence table 321, thereby updating the position of passenger P1.

[0088] When the tracking area TA3 is set, the tracking unit 314 may determine whether the face of passenger P1 is captured in the tracking area TA3. In other words, the tracking unit 314 may perform face detection on the tracking area TA3. When it is determined that the face of passenger P1 is captured in the tracking area TA3, the tracking unit 314 generates a face image including the face area of ​​passenger P1. The tracking unit 314 associates the generated face image with the tracking ID related to passenger P1 and transmits the image to the face authentication unit 315. Note that, when it is determined that the face of passenger P1 is not captured in the tracking area TA3, the tracking unit 314 does not need to generate a face image. Note that, even when it is determined that the face of passenger P1 is captured in the tracking area TA3, if the tracking ID related to passenger P1 is associated with the authentication ID in the ID correspondence table 321 (i.e., if face authentication has already been successful), the tracking unit 314 does not need to generate a face image.

[0089] The face authentication unit 315 performs face authentication processing using the face image transmitted from the tracking unit 314 and the face images registered in the face DB 36. If the face indicated by the face image transmitted from the tracking unit 314 corresponds to the face indicated by one of the face images registered in the face DB 36 (in other words, if face authentication is successful), the face authentication unit 315 registers the authentication ID associated with the one face image in the ID correspondence table 321 in association with the tracking ID associated with the face image transmitted from the tracking unit 314. The face authentication unit 315 may register, in the ID correspondence table 321, the authentication time, which is the time when the face authentication processing was performed, in addition to the authentication ID. Note that if the authentication time has already been registered in the ID correspondence table 321 (i.e., if face authentication was successful in the past), the face authentication unit 315 may update the authentication time registered in the ID correspondence table 321.

[0090] If a facial image showing a face corresponding to the face indicated by the facial image sent from the tracking unit 314 is not registered in the face DB 36 (in other words, if facial authentication fails), the facial authentication unit 315 may register information indicating that there is no corresponding person in the ID correspondence table 321, by associating it with the tracking ID associated with the facial image sent from the tracking unit 314.

[0091] The tracking unit 314 and the face authentication unit 315 may repeat the above-described process until the passenger P1 passes through the authentication area RA. The tracking unit 314 calculates the position of the passenger P1 as described above. In other words, it can be said that the tracking unit 314 detects the position of the passenger P1. For this reason, the tracking unit 314 may be referred to as a position detection means.

[0092] An example of the ID correspondence table 321 will now be described with reference to FIG. 8 . As shown in FIG. 8 , in the ID correspondence table 321, a tracking ID, a tracking location (e.g., the location of passenger P1), an authentication ID, and an authentication time may be associated with one another. When a tracking ID is associated with a specific authentication ID in the ID correspondence table 321, this indicates that a facial image of a person corresponding to the passenger to whom the tracking ID is set is registered in the face DB 36. When a tracking ID is associated with the character string "N / A", this indicates that a facial image of a person corresponding to the passenger to whom the tracking ID is set is not registered in the face DB 36. When a tracking ID is not associated with an authentication ID (i.e., when the authentication ID field is blank), this indicates that a facial authentication process has never been performed.

[0093] However, it may be difficult for the tracking unit 314 to continue tracking passenger P1, for example, because the head of passenger P1 is hidden behind another person. When tracking of passenger P1 is interrupted, the tracking unit 314 may perform the following process. After tracking of passenger P1 is interrupted, the tracking unit 314 may determine whether a new passenger has been detected from the first image acquired by the image acquisition unit 311 (i.e., the first image generated by the camera CAM). A "new passenger" refers to a passenger for whom a tracking ID has not been set.

[0094] When a new passenger is detected, the tracking unit 314 may determine whether passenger P1 and the new passenger are the same person by comparing the feature amount of the tracking area (e.g., at least one of tracking areas TA1, TA2, and TA3) related to passenger P1 with the feature amount of the tracking area related to the new passenger. If it is determined that passenger P1 and the new passenger are the same person, the tracking unit 314 may assign the tracking ID related to passenger P1 to the new passenger. As a result, the tracking unit 314 can track passenger P1 again. Note that the feature amount may be a feature amount related to the passenger's head, a feature amount related to the passenger's upper body, or a feature amount related to the passenger's entire body. Therefore, the tracking area may include the passenger's head, the passenger's upper body, or the passenger's entire body. Note that the feature amount may be obtained, for example, by person re-identification technology.

[0095] The tracking unit 314 and the face authentication unit 315 may perform the above-described tracking process and face authentication process for each of the multiple passengers included in one first image generated by the camera CAM. Here, the authentication area RA may be, for example, an area of ​​5 meters by 5 meters. A distance of 5 meters is a distance that allows 5 to 6 passengers to pass through in a line. If the authentication area RA is an area of ​​5 meters by 5 meters, 20 to 30 passengers may exist within the authentication area RA. Therefore, as shown in FIG. 9, the information processing device 3 can perform tracking process and face authentication process for multiple passengers based on one first image generated by the camera CAM. Note that the multiple dotted rectangles in FIG. 9 represent the tracking area.

[0096] The tracking area (e.g., at least one of the tracking areas TA1, TA2, and TA3) may include parts of the passenger other than the head (e.g., shoulders) in addition to the head of the passenger (e.g., passenger P1) that is tracked by the tracking unit 314. The tracking area may be set to include the upper body of the passenger, or may be set to include the entire body of the passenger.

[0097] The operations of the tracking unit 314 and the face authentication unit 315 will be described with reference to the flowchart of Fig. 10 . In Fig. 10 , the tracking unit 314 detects one or more passengers (i.e., people) from a first image acquired by the image acquisition unit 311 (i.e., a first image generated by the camera CAM) (step S101). In the processing of step S101, the tracking unit 314 may detect the head of the passenger. In the processing of step S101, the tracking unit 314 may set a tracking region including the detected head of the passenger based on the detected head of the passenger. In the processing of step S101, the tracking unit 314 may perform face detection of the detected one or more passengers.

[0098] The tracking unit 314 performs a tracking process of at least one of the one or more passengers detected in the process of step S101 using another first image acquired by the image acquisition unit 311 (step S102). In the process of step S102, the tracking unit 314 may perform face detection of the detected one or more passengers. When the face of at least one of the one or more passengers is detected in the process of at least one of steps S101 and S102, the tracking unit 314 transmits a face image including a facial region of at least one passenger to the face authentication unit 315.

[0099] The face authentication unit 315 performs face authentication processing using the face image transmitted from the tracking unit 314 (step S103). The face authentication unit 315 registers the result of the face authentication processing in the ID correspondence table 321, or updates the ID correspondence table 321 based on the result of the face authentication processing (step S104).

[0100] Next, the operations of the determination unit 316 and the guidance unit 317 of the calculation device 31 will be described. Here, the description will be given taking passenger P2 as an example. The determination unit 316 acquires the position of passenger P2 from the ID correspondence table 321 based on the tracking ID related to passenger P2. The position of passenger P2 may be represented by the value of the tracking position associated with the tracking ID related to passenger P2 in the ID correspondence table 321.

[0101] The determination unit 316 may determine whether or not passenger P2 is allowed to pass through the facial recognition gate device 23, based on the ID correspondence table 321. When the tracking ID of passenger P2 is associated with a specific authentication ID in the ID correspondence table 321, the determination unit 316 may determine that passenger P2 is allowed to pass through the facial recognition gate device 23. When the tracking ID of passenger P2 is associated with the character string "N / A" in the ID correspondence table 321, or when the tracking ID of passenger P2 is not associated with an authentication ID (i.e., when the authentication ID field is blank), the determination unit 316 may determine that passenger P2 is not allowed to pass through the facial recognition gate device 23.

[0102] If it is determined that passenger P2 can pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 will use the facial recognition gate device 23. The determination unit 316 acquires information related to the area Ar1 (e.g., information indicating at least one of the position and size of the area Ar1) associated with the device identification information related to the facial recognition gate device 23. Note that the determination unit 316 may acquire the information related to the area Ar1 from the setting unit 313.

[0103] The determination unit 316 determines whether or not passenger P2 is within area Ar1 based on the position of passenger P2 and the information related to area Ar1. As described above, area Ar1 is an area that includes at least a portion of a route along which people flow toward the facial recognition gate device 23. If it is determined that passenger P2 is within area Ar1, the determination unit 316 determines that passenger P2 is heading toward the facial recognition gate device 23. If it is determined that passenger P2 is not within area Ar1, the determination unit 316 determines that passenger P2 is not heading toward the facial recognition gate device 23. In this case, the determination unit 316 transmits information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0104] The guidance unit 317 may transmit information identifying passenger P2 and information identifying the gate device that passenger P2 should use to a terminal device 4 (see FIG. 11 ) used by airport staff (e.g., at least one of a guidance staff member and a security guard) near boarding gate G1. As a result, a screen such as that shown in FIG. 11 may be displayed on the terminal device 4. The airport staff may guide passenger P2 to the facial recognition gate device 23 based on the information displayed on the terminal device 4.

[0105] The information processing device 3 may be connected to a terminal device 4 via a network NW. The terminal device 4 may be configured as any one of a tablet terminal, a smartphone, and a notebook PC (Personal Computer).

[0106] If it is determined that passenger P2 cannot pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 will use the normal gate device 24a or 24b. The determination unit 316 acquires information related to the area Ar2 associated with the device identification information related to the normal gate device 24a or 24b (e.g., information indicating at least one of the position and size of the area Ar2). Note that the determination unit 316 may acquire the information related to the area Ar2 from the setting unit 313.

[0107] The determination unit 316 determines whether passenger P2 is within area Ar2 based on the position of passenger P2 and information related to area Ar2. As described above, area Ar2 is an area that includes at least a portion of a route along which people flow toward the normal gate devices 24a and 24b. If it is determined that passenger P2 is within area Ar2, the determination unit 316 determines that passenger P2 is heading toward one of the normal gate devices 24a and 24b. If it is determined that passenger P2 is not within area Ar2, the determination unit 316 determines that passenger P2 is not heading toward one of the normal gate devices 24a and 24b. In this case, the determination unit 316 transmits information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0108] The guidance unit 317 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the terminal device 4. Based on the information displayed on the terminal device 4, airport staff may guide passenger P2 to one of the normal gate devices 24a and 24b.

[0109] Instead of or in addition to transmitting information indicating passenger P2 and information indicating the gate device to which passenger P2 should be guided to the terminal device 4, the guiding unit 317 may, for example, emit a sound via a speaker (not shown) to guide passenger P2 to the facial recognition gate device 23, or may project an image via a projection device (not shown) to guide passenger P2 to the facial recognition gate device 23. The guiding unit 317 may, for example, transmit information indicating the gate device that passenger P2 should use to a mobile device (e.g., at least one of a smartphone and a tablet device) carried by passenger P2.

[0110] The operation of the determination unit 316 will be described with reference to the flowchart of Fig. 12. In Fig. 12, the determination unit 316 acquires the position of a passenger (e.g., passenger P2) as a target person from the ID correspondence table 321 based on the tracking ID of the passenger (step S201). The determination unit 316 may determine the gate device used by the passenger based on the tracking ID of the passenger and the ID correspondence table 321. The determination unit 316 acquires device identification information related to the gate device used by the passenger (step S202).

[0111] Based on the device identification information acquired in step S202, the determination unit 316 acquires information related to the area (e.g., one of areas Ar1 and Ar2) associated with the gate device used by the passenger (step S203). Based on the passenger's position acquired in step S201 and the area-related information acquired in step S203, the determination unit 316 determines whether the passenger is within a predetermined area (step S204). Here, the "predetermined area" refers to the area associated with the gate device used by the passenger.

[0112] If it is determined in the process of step S204 that the passenger is within the predetermined area (step S204: Yes), the determination unit 316 may change the target person (e.g., change from one passenger to another passenger) and perform the process of step S201. If it is determined in the process of step S204 that the passenger is not within the predetermined area (step S204: No), the determination unit 316 may transmit information indicating the passenger and information indicating the gate device that the passenger should use to the guidance unit 317 (step S205). Thereafter, the determination unit 316 may change the target person and perform the process of step S201.

[0113] The determination unit 316 may determine whether the gate device is operating based on boarding gate information. The operations of the information processing device 3 described above may be realized by the information processing device 3 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium has recorded thereon a computer program for causing the information processing device 3 to perform the operations described above.

[0114] (Technical Effect) The information processing device 3 determines whether each of the multiple passengers is heading toward the gate device they should use, based on the location of each of the multiple passengers and information related to the area (e.g., one of the areas Ar1 and Ar2) associated with the gate device that each of the multiple passengers will use. The information processing device 3 may transmit, to the terminal device 4, for example, information indicating which of the multiple passengers is not heading toward the gate device they should use, and information indicating the gate device that each passenger should use.

[0115] For example, if an airport staff member (e.g., at least one of a guide and a security guard) can determine who cannot pass through the facial recognition gate device 23 based on the information displayed on the terminal device 4, the staff member can guide the person who cannot pass through the facial recognition gate device 23 not to enter the facial recognition gate device 23. Therefore, the information processing device 3 can prevent people who cannot pass through the facial recognition gate device 23 from entering the facial recognition gate device 23. Therefore, the information processing device 3 can prevent a decrease in the throughput of the facial recognition gate device 23.

[0116] In addition to airport boarding gates, the information processing device 3 may be applied to, for example, at least one of airport security gates (i.e., gates installed at airport security checkpoints) and immigration gates. In addition to airports, the display control device 3 may be applied to, for example, at least one of offices, train stations, theme parks, and event venues that use facial recognition gate devices for at least one of entry and exit.

[0117] (First Modification) In the second embodiment described above, the information processing device 3 (specifically, the face authentication unit 315) performs face authentication processing. However, the information processing device 3 does not have to perform face authentication processing. In this case, the information processing device 3 does not have to include the face authentication unit 315 and the face DB 36. In this case, the face authentication processing may be performed by an authentication device 5 different from the information processing device 3. In this case, as shown in FIG. 13 , the information processing device 3 and the authentication device 5 may be connected via a network NW. Note that the information processing device 3 and the authentication device 5 may form one system. The one system may be referred to as an information processing system or an authentication system.

[0118] The authentication device 5 includes a face authentication unit 51 and a face database 52 (hereinafter referred to as "face DB 52"). The face authentication unit 51 is configured to be able to execute face authentication processing. In other words, the authentication device 5 is an authentication device having a face authentication function. The management server 21 of the airport system 2 may transmit at least a portion of the face images registered in the face DB 211 to the authentication device 5 together with an authentication ID (i.e., passenger identification information) assigned to the face image. In this case, the management server 21 may transmit gate identification information and boarding start time in addition to the face image to the authentication device 5. The authentication device 5 may register the face image transmitted from the management server 21 in the face DB 52. The authentication device 5 may register gate identification information and boarding start time in addition to the face image in the face DB 52.

[0119] The tracking unit 312 of the information processing device 3 may detect a passenger (e.g., passenger P1) included in the image acquired by the image acquisition unit 311. The tracking unit 312 may set a tracking area including the head of the detected passenger. The tracking unit 312 may perform face detection of the detected passenger. When the passenger's face is detected, the tracking unit 312 may transmit a face image including the passenger's facial area to the authentication device 5 via the communication device 33.

[0120] The face authentication unit 51 of the authentication device 5 may perform face authentication processing using a face image transmitted from the information processing device 3 (specifically, the tracking unit 312) and the face DB 52. The face authentication unit 51 may transmit information indicating the result of the face authentication processing to the information processing device 3. The information processing device 3 may register the result of the face authentication processing indicated by the information transmitted from the authentication device 5 (specifically, the face authentication unit 51) in the ID correspondence table 321.

[0121] (Second Variant) The determination unit 316 may determine whether to transmit information indicating the passenger and information indicating the boarding gate information to be used by the passenger to the guidance unit 317 based on the passenger's position, the area corresponding to the gate device to be used by the passenger (for example, one of area Ar1 and area Ar2), and the direction of movement of the passenger.

[0122] For example, if it is determined that passenger P2 can pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 will use the facial recognition gate device 23. The determination unit 316 acquires information related to the area Ar1 (e.g., information indicating at least one of the position and size of the area Ar1) associated with the device identification information related to the facial recognition gate device 23. The determination unit 316 may estimate the movement direction of passenger P2 based on a change in the position of passenger P2.

[0123] The determination unit 316 determines whether or not the passenger P2 is within the area Ar1 based on the position of the passenger P2 and the information related to the area Ar1. If it is determined that the passenger P2 is within the area Ar1, the determination unit 316 may determine whether or not the direction of movement of the passenger P2 is toward the facial recognition gate device 23. If it is determined that the direction of movement of the passenger P2 is toward the facial recognition gate device 23, the determination unit 316 may determine that the passenger P2 is heading toward the facial recognition gate device 23.

[0124] If it is determined that the movement direction of passenger P2 is not a direction toward the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 is not toward the facial recognition gate device 23. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0125] Alternatively, when it is determined that passenger P2 is within area Ar1, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward the end of the line formed by passengers waiting to pass through the facial recognition gate device 23. When it is determined that the direction of movement of passenger P2 is toward the end of the line, the determination unit 316 may determine that passenger P2 is heading toward the facial recognition gate device 23.

[0126] If it is determined that the movement direction of passenger P2 is not toward the end of the line, the determination unit 316 may determine that passenger P2 is not heading toward the face recognition gate device 23. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0127] If it is determined that passenger P2 is not within area Ar1, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward the facial recognition gate device 23. If it is determined that the direction of movement of passenger P2 is toward the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 is heading toward the facial recognition gate device 23.

[0128] If it is determined that the movement direction of passenger P2 is not a direction toward the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 is not toward the facial recognition gate device 23. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0129] Alternatively, when it is determined that passenger P2 is not within area Ar1, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward the end of the line formed by passengers waiting to pass through the facial recognition gate device 23. When it is determined that the direction of movement of passenger P2 is toward the end of the line, the determination unit 316 may determine that passenger P2 is heading toward the facial recognition gate device 23.

[0130] If it is determined that the movement direction of passenger P2 is not toward the end of the line, the determination unit 316 may determine that passenger P2 is not heading toward the face recognition gate device 23. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0131] If it is determined that passenger P2 cannot pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P2 will use the normal gate device 24a or 24b. The determination unit 316 acquires information related to the area Ar2 associated with the device identification information related to the normal gate device 24a or 24b (e.g., information indicating at least one of the position and size of the area Ar2). The determination unit 316 may estimate the movement direction of passenger P2 based on a change in the position of passenger P2.

[0132] The determination unit 316 determines whether or not the passenger P2 is within the area Ar2 based on the position of the passenger P2 and the information related to the area Ar2. If it is determined that the passenger P2 is within the area Ar2, the determination unit 316 may determine whether or not the direction of movement of the passenger P2 is toward one of the normal gate devices 24a and 24b. If it is determined that the direction of movement of the passenger P2 is toward one of the normal gate devices 24a and 24b, the determination unit 316 may determine that the passenger P2 is heading toward one of the normal gate devices 24a and 24b.

[0133] If it is determined that the movement direction of passenger P2 is not toward one of the normal gate devices 24a and 24b, the determination unit 316 may determine that passenger P2 is not toward one of the normal gate devices 24a and 24b. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0134] Alternatively, when it is determined that passenger P2 is within area Ar2, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward the end of a line formed by passengers waiting to pass through one of the regular gate devices 24a and 24b. When it is determined that the direction of movement of passenger P2 is toward the end of the line, the determination unit 316 may determine that passenger P2 is heading toward one of the regular gate devices 24a and 24b.

[0135] If it is determined that the movement direction of passenger P2 is not toward the end of the line, the determination unit 316 may determine that passenger P2 is not heading toward the normal gate devices 24a and 24b. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0136] If it is determined that passenger P2 is not within area Ar2, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward one of the normal gate devices 24a and 24b. If it is determined that the direction of movement of passenger P2 is toward one of the normal gate devices 24a and 24b, the determination unit 316 may determine that passenger P2 is heading toward one of the normal gate devices 24a and 24b.

[0137] If it is determined that the movement direction of passenger P2 is not toward one of the normal gate devices 24a and 24b, the determination unit 316 may determine that passenger P2 is not toward one of the normal gate devices 24a and 24b. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0138] Alternatively, if it is determined that passenger P2 is not within area Ar2, the determination unit 316 may determine whether the direction of movement of passenger P2 is toward the end of a line formed by passengers waiting to pass through one of the regular gate devices 24a and 24b. If it is determined that the direction of movement of passenger P2 is toward the end of the line, the determination unit 316 may determine that passenger P2 is heading toward one of the regular gate devices 24a and 24b.

[0139] If it is determined that the movement direction of passenger P2 is not toward the end of the line, the determination unit 316 may determine that passenger P2 is not heading toward the normal gate devices 24a and 24b. In this case, the determination unit 316 may transmit information indicating passenger P2 and information indicating the gate device that passenger P2 should use to the guidance unit 317.

[0140] 14 , at least one of a first line formed by passengers waiting to pass through the facial recognition gate device 23 and a second line formed by passengers waiting to pass through one of the normal gate devices 24a and 24b may bend midway. In this case, the setting unit 313 may set an area Ar3 (i.e., an area corresponding to the area Ar1 in FIG. 4 ) that includes at least a portion of the first line based on the shape of the first line. Furthermore, the setting unit 313 may set an area Ar4 (i.e., an area corresponding to the area Ar2 in FIG. 4 ) that includes at least a portion of the second line based on the shape of the second line.

[0141] The setting unit 313 may estimate the shape of at least one of the first and second rows based on multiple images acquired by the image acquisition unit 311. For example, the setting unit 313 may calculate multiple trajectories corresponding to multiple passengers, respectively, based on changes in the positions of each of the multiple passengers included in the images. The setting unit 313 may estimate the shape of at least one of the first and second rows based on the multiple trajectories. In addition to or instead of the multiple trajectories, the setting unit 313 may estimate the shape of at least one of the first and second rows based on the arrangement of partition poles included in the images.

[0142] (Fourth Variant) When one aircraft and another aircraft depart from a certain boarding gate (e.g., boarding gate G1), after the departure of the first aircraft, the gate device may be powered on (in other words, the gate device is in operation) but not in operation until boarding instructions for the other aircraft begin (e.g., until boarding time for the other aircraft arrives).

[0143] The setting unit 313 may set an area (e.g., at least one of Ar1 and Ar2) based on the operation status of the gate device and aircraft operation information. The setting unit 313 may also identify a time period during which the gate device is not in operation based on the aircraft operation information. The setting unit 313 may not set an area (e.g., at least one of areas Ar1 and Ar2) for a time period during which the gate device is not in operation, even if the operation status of the gate device is in an operating state. In this case, the information processing device 3 may not perform the tracking process and face authentication process described above during a time period during which the gate device is not in operation. In other words, the information processing device 3 may stop functions related to the tracking process and face authentication process during a time period during which the gate device is not in operation.

[0144] <Third Embodiment> A third embodiment of an information processing device will be described. Below, the third embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 3. In the third embodiment, some of the operations of the setting unit 313 and the determination unit 316 differ from those of the second embodiment described above. Other aspects of the third embodiment may be the same as those of the second embodiment.

[0145] The setting unit 313 does not need to set a virtual area (e.g., at least one of areas Ar1 and Ar3) that includes at least a portion of the route along which people flow toward the facial recognition gate device 23, and a virtual area (e.g., at least one of areas Ar2 and Ar4) that includes at least a portion of the route along which people flow toward the normal gate devices 24a and 24b.

[0146] The setting unit 313 may identify a first line formed by passengers waiting to pass through the facial recognition gate device 23 and a second line formed by passengers waiting to pass through one of the normal gate devices 24a and 24b. The setting unit 313 may identify at least one of the first line and the second line based on a plurality of images acquired by the image acquisition unit 311. For example, the setting unit 313 may calculate a plurality of trajectories corresponding to the plurality of passengers, respectively, based on changes in the positions of the plurality of passengers included in the images. The setting unit 313 may identify at least one of the first line and the second line based on the plurality of trajectories.

[0147] Alternatively, the setting unit 313 may specify the first row based on, for example, at least one of the position and orientation of the facial recognition gate device 23, rather than the row actually formed by passengers. Similarly, the setting unit 313 may specify the second row based on, for example, at least one of the position and orientation of at least one of the normal gate devices 24a and 24b.

[0148] The operation of the determination unit 316 will be described using passenger P3 as an example. The determination unit 316 may determine whether passenger P3 can pass through the facial recognition gate device 23 based on the ID correspondence table 321. If it is determined that passenger P3 can pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P3 will use the facial recognition gate device 23. The determination unit 316 may determine, based on a change in the position of passenger P3, whether the movement direction of passenger P3 is toward the end of the first line (i.e., the line formed by passengers waiting to pass through the facial recognition gate device 23).

[0149] If the direction of movement of passenger P3 is toward the end of the first row, the determination unit 316 may determine that passenger P3 is heading toward the facial recognition gate device 23. If the direction of movement of passenger P3 is not toward the end of the first row, the determination unit 316 may determine that passenger P3 is not heading toward the facial recognition gate device 23. In this case, the determination unit 316 may transmit information indicating passenger P3 and information indicating the gate device that passenger P3 should use to the guidance unit 317.

[0150] If it is determined that passenger P3 cannot pass through the facial recognition gate device 23, the determination unit 316 may determine that passenger P3 will use one of the normal gate devices 24a and 24b. Based on the change in position of passenger P3, the determination unit 316 may determine whether the movement direction of passenger P3 is toward the end of the second queue (i.e., the queue formed by passengers waiting to pass through one of the normal gate devices 24a and 24b).

[0151] If the direction of movement of passenger P3 is toward the end of the second row, the determination unit 316 may determine that passenger P3 is heading toward one of the regular gate devices 24a and 24b. If the direction of movement of passenger P3 is not toward the end of the second row, the determination unit 316 may determine that passenger P3 is not heading toward one of the regular gate devices 24a and 24b. In this case, the determination unit 316 may transmit information indicating passenger P3 and information indicating the gate device that passenger P3 should use to the guidance unit 317.

[0152] The above-described operations of the information processing device 3 may be realized by the information processing device 3 reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium has recorded thereon a computer program for causing the information processing device 3 to execute the above-described operations.

[0153] (Technical Effect) The information processing device 3 can prevent people who are not allowed to pass through the facial recognition gate device 23 from entering the facial recognition gate device 23. Therefore, the information processing device 3 can prevent a decrease in the throughput of the facial recognition gate device 23.

[0154] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0155] (Supplementary Note 1) An information processing device comprising: a setting means for setting a first area including at least a part of a route along which people flow toward a facial recognition gate device based on gate information of a plurality of gate devices including the facial recognition gate device; an image acquisition means for acquiring a first image including the first area; and a first determination means for determining whether a first person to be authenticated, who is included in the acquired first image and is present in the first area, can pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image.

[0156] (Supplementary Note 2) The information processing device according to Supplementary Note 1, further comprising an output means for outputting first authenticated person information indicating the first authenticated person when the first determination means determines that the first authenticated person cannot pass through the face recognition gate device.

[0157] (Supplementary Note 3) The information processing device according to Supplementary Note 2 comprises: a detection means for detecting a change in the position of the first person to be authenticated based on a plurality of first images acquired by the image acquisition means; and a second determination means for determining whether or not to output the first person to be authenticated information based on the change in the position of the person to be authenticated, wherein the output means outputs the first person to be authenticated information when the first determination means determines that the first person to be authenticated cannot pass through the face recognition gate device and the second determination means determines that the first person to be authenticated information should be output.

[0158] (Supplementary Note 4) The information processing device described in Supplementary Note 3, wherein the second determination means determines to output the first authenticated person information when the first determination means determines that the first authenticated person cannot pass through the facial recognition gate device and when the direction of movement of the first authenticated person based on a change in the position of the first authenticated person is a direction toward the facial recognition gate device.

[0159] (Supplementary Note 5) The information processing device described in Supplementary Note 3, wherein the second determination means determines to output the first authenticated person information when the first determination means determines that the first authenticated person cannot pass through the facial recognition gate device and when, based on a change in the position of the first authenticated person, the direction of movement of the first authenticated person is toward the end of a line formed by people waiting to pass through the facial recognition gate device.

[0160] (Supplementary Note 6) The information processing device according to any one of Supplementary Notes 1 to 5, wherein the gate information includes location information indicating a location of the face recognition gate device.

[0161] (Supplementary Note 7) The information processing device according to any one of Supplementary Notes 1 to 6, further comprising: an authentication unit configured to perform face authentication using the first image acquired by the image acquisition unit.

[0162] (Supplementary Note 8) The information processing device described in any one of Supplementary Notes 1 to 7, wherein the plurality of gate devices include other gate devices different from the facial recognition gate device, the setting means sets a second area including at least a part of a route along which there is a flow of people heading toward the other gate device based on the gate information, the image acquisition means acquires a second image including the second area, and the first determination means determines whether a second person to be authenticated, who is included in the acquired second image and is present in the second area, can pass through the facial recognition gate device based on a result of facial authentication performed using the acquired second image.

[0163] (Supplementary Note 9) The information processing device according to Supplementary Note 8, further comprising an output means for outputting second authenticated person information indicating the second authenticated person when the first determination means determines that the second authenticated person can pass through the face recognition gate device.

[0164] (Supplementary Note 10) The information processing device according to Supplementary Note 9 comprises: a detection means for detecting a change in the position of the second person to be authenticated based on a plurality of second images acquired by the image acquisition means; and a second determination means for determining whether or not to output the second person to be authenticated information based on the change in the position of the second person to be authenticated; and the output means outputs the second person to be authenticated information when the first determination means determines that the second person to be authenticated can pass through the face recognition gate device and the second determination means determines that the second person to be authenticated information should be output.

[0165] (Supplementary Note 11) The information processing device described in Supplementary Note 10, wherein the second determination means determines to output the second authenticated person information when the first determination means determines that the second authenticated person can pass through the facial recognition gate device and when the direction of movement of the second authenticated person based on a change in the position of the second authenticated person is not a direction toward the facial recognition gate device.

[0166] (Supplementary Note 12) The information processing device described in Supplementary Note 10, wherein the second determination means determines to output the second authenticated person information when the first determination means determines that the second authenticated person can pass through the facial recognition gate device and when the direction of movement of the second authenticated person based on a change in the position of the second authenticated person is not a direction toward the end of a line formed by people waiting to pass through the facial recognition gate device.

[0167] (Supplementary Note 13) An information processing method comprising: setting a first area including at least a part of a route along which a flow of people is heading toward a facial recognition gate device based on gate information of a plurality of gate devices including the facial recognition gate device; acquiring a first image including the first area; and determining, for a first person to be authenticated who is included in the acquired first image and is present in the first area, whether or not the first person to be authenticated is able to pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image.

[0168] (Supplementary Note 14) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the method comprising: setting a first area including at least a part of a route along which a flow of people is heading toward a facial recognition gate device based on gate information of a plurality of gate devices including the facial recognition gate device; acquiring a first image including the first area; and determining, for a first person to be authenticated who is included in the acquired first image and is present in the first area, whether or not the first person to be authenticated is allowed to pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image.

[0169] (Supplementary Note 15) An information processing device comprising: a route identification means for identifying a route along which a flow of people is heading toward a facial recognition gate device; an image acquisition means for acquiring a third image including the identified route; a position detection means for detecting a position of a third person to be authenticated included in the third image based on the acquired third image; a first determination means for determining whether or not the third person to be authenticated can pass through the facial recognition gate device based on a result of facial authentication performed on the third person using the acquired third image; and a second determination means for determining whether or not to output third person information indicating the third person to be authenticated based on the identified route and a direction of movement of the third person to be authenticated based on a change in the position of the third person to be authenticated, when the first determination means determines that the third person to be authenticated cannot pass through the facial recognition gate device.

[0170] (Supplementary Note 16) An information processing system comprising: a facial recognition gate device; a setting means for setting a first area including at least a part of a route along which people flow toward the facial recognition gate device based on gate information of a plurality of gate devices including the facial recognition gate device; an image acquisition means for acquiring a first image including the first area; a first determination means for determining whether a first person to be authenticated, who is included in the acquired first image and is present in the first area, can pass through the facial recognition gate device based on a result of facial authentication performed using the acquired first image; and an authentication means for performing facial authentication using the acquired first image.

[0171] This disclosure is not limited to the above-described embodiments, but may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention as can be read from the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical scope of this disclosure.

[0172] 1, 3 Information processing device 2 Airport system 4 Terminal device 5 Authentication device 11, 311 Image acquisition unit 12, 313 Setting unit 13, 316 Determination unit 21 Management server 22 Check-in terminal 23 Face recognition gate device 24 Normal gate device 31 Arithmetic unit 32 Storage device 33 Communication device 34 Input device 35 Output device 36, 52, 211, 232 Face database 51, 315 Face recognition unit 312 Information acquisition unit 314 Tracking unit

Claims

1. A setting means for setting a first area including at least a part of a route along which a flow of people headed toward the facial recognition gate device is present, based on gate information of a plurality of gate devices including the facial recognition gate device; an image capture means for capturing a first image including the first region; a first determination means for determining whether or not a first person to be authenticated, who is included in the acquired first image and is present in the first area, is allowed to pass through the face recognition gate device based on a result of face recognition performed using the acquired first image; An information processing device comprising:

2. The information processing device includes an output unit that outputs first authenticated person information indicating the first authenticated person when the first determination unit determines that the first authenticated person cannot pass through the face recognition gate device. The information processing device according to claim 1 .

3. The information processing device includes: a detection means for detecting a change in a position of the first person to be authenticated based on a plurality of first images acquired by the image acquisition means; a second determination means for determining whether or not to output the first authenticated user information based on a change in the position of the authenticated user; Equipped with The output means outputs the first authenticated user information when the first determination means determines that the first authenticated user cannot pass through the face recognition gate device and the second determination means determines that the first authenticated user information is to be output. The information processing device according to claim 2 .

4. The second determination means determines to output the first authenticated person information when the first determination means determines that the first authenticated person cannot pass through the face recognition gate device and when a moving direction of the first authenticated person based on a change in position of the first authenticated person is a direction toward the face recognition gate device. The information processing device according to claim 3 .

5. The second determination means determines to output the first authenticated person information when the first determination means determines that the first authenticated person cannot pass through the face recognition gate device and when a moving direction of the first authenticated person based on a change in position of the first authenticated person is a direction toward the end of a line formed by people waiting to pass through the face recognition gate device. The information processing device according to claim 3 .

6. The gate information includes location information indicating a location of the face recognition gate device. The information processing device according to claim 1 .

7. The information processing device includes an authentication unit that performs face authentication using the first image acquired by the image acquisition unit. The information processing device according to claim 1 .

8. the plurality of gate devices include another gate device different from the face recognition gate device, The setting means sets a second area including at least a part of a route along which a flow of people headed toward the other gate device exists, based on the gate information; the image acquisition means acquires a second image including the second region; The first determination means determines whether or not a second person to be authenticated, who is included in the acquired second image and is present in the second area, is allowed to pass through the face recognition gate device based on a result of face recognition performed using the acquired second image. The information processing device according to claim 1 .

9. A computer comprising: setting a first area including at least a part of a route along which a flow of people headed toward the facial recognition gate device is present, based on gate information of a plurality of gate devices including the facial recognition gate device; acquiring a first image including the first region; For a first person to be authenticated who is included in the acquired first image and is present in the first area, a determination is made as to whether or not the first person to be authenticated is allowed to pass through the face recognition gate device based on a result of face recognition performed using the acquired first image. Information processing methods.

10. On the computer, setting a first area including at least a part of a route along which a flow of people headed toward the facial recognition gate device is present, based on gate information of a plurality of gate devices including the facial recognition gate device; acquiring a first image including the first region; For a first person to be authenticated who is included in the acquired first image and is present in the first area, a determination is made as to whether or not the first person to be authenticated is allowed to pass through the face recognition gate device based on a result of face recognition performed using the acquired first image. A computer program for executing an information processing method.