Authentication system, authentication device, authentication method, and computer program

Abstract

An authentication system (10) is provided with an acquisition means (110) for acquiring a face image of a subject (500) passing through a gate (200), a face authentication means (120) for performing face authentication to determine whether the subject is a registered subject or not by collating information obtained from the face image of the subject with information on the faces of a plurality of registered subjects, and a determination means (130) for determining whether the subject is allowed to pass through the gate on the basis of the number of times of successful authentication when the face authentication is performed multiple times. With such authentication system, it is possible to appropriately determine whether or not a subject is allowed to pass through a gate.

Description

Technical Field

[0001] This disclosure relates to the technical field of authentication systems, authentication devices, authentication methods, and computer programs for persons passing through gates and the like.

Background Art

[0002] As this type of system, a system that determines whether a person can pass through a gate using face authentication is known. For example, Patent Document 1 discloses a technique for extracting feature amounts from a face image, obtaining the similarity of the feature amounts, and determining a registered person. Patent Document 2 discloses a technique for executing recognition processing using the average likelihood of accumulated face images. Patent Document 3 discloses a technique for executing main authentication after narrowing down the targets to be collated in pre-authentication.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] This disclosure aims to improve the techniques disclosed in the above-mentioned prior art documents.

Means for Solving the Problems

[0005] One aspect of the authentication system of this disclosure includes an acquisition means for acquiring a face image of a subject passing through a gate, a face authentication means for collating information obtained from the face image of the subject with information regarding faces of a plurality of registered subjects to perform face authentication as to whether the subject is a registered subject, and a determination means for determining whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

[0006] One aspect of the authentication device of this disclosure includes an acquisition means for acquiring a face image of a subject passing through a gate, a face authentication means for collating information obtained from the face image of the subject with information regarding faces of a plurality of registered subjects to perform face authentication as to whether the subject is a registered subject, and a determination means for determining whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

[0007] One aspect of the authentication method of this disclosure is to acquire a face image of a subject passing through a gate, collate information obtained from the face image of the subject with information regarding faces of a plurality of registered subjects to perform face authentication as to whether the subject is a registered subject, and determine whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

[0008] One aspect of the computer program of this disclosure is to cause a computer to operate so as to acquire a face image of a subject passing through a gate, collate information obtained from the face image of the subject with information regarding faces of a plurality of registered subjects to perform face authentication as to whether the subject is a registered subject, and determine whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of an authentication system, an authentication device, an authentication method, and a computer program will be described with reference to the drawings.

[0011] <First Embodiment> The authentication system according to the first embodiment will be described with reference to FIGS. 1 to 6.

[0012] (Hardware Configuration) First, with reference to FIG. 1, the hardware configuration of the authentication system according to the first embodiment will be described. FIG. 1 is a block diagram showing the hardware configuration of the authentication system according to the first embodiment.

[0013] As shown in FIG. 1, the authentication system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The authentication system 10 may further include an input device 15 and an output device 16. The processor 11, the RAM 12, the ROM 13, the storage device 14, the input device 15, and the output device 16 are connected via a data bus 17.

[0014] Processor 11 reads a computer program. For example, processor 11 is configured to read a computer program stored in at least one of RAM 12, ROM 13, and storage device 14. Alternatively, processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown). Processor 11 may obtain (i.e., read) a computer program from a device (not shown) disposed outside authentication system 10 via a network interface. By executing the read computer program, processor 11 controls RAM 12, storage device 14, input device 15, and output device 16. In particular, in this embodiment, when the computer program read by processor 11 is executed, a functional block for determining whether or not to pass through a target gate is realized within processor 11. As processor 11, one of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (field-programmable gate array), DSP (Demand-Side Platform), and ASIC (Application Specific Integrated Circuit) may be used, or a plurality of them may be used in parallel.

[0015] RAM 12 temporarily stores the computer program executed by processor 11. RAM 12 temporarily stores data temporarily used by processor 11 when processor 11 is executing a computer program. RAM 12 may be, for example, D-RAM (Dynamic RAM).

[0016] ROM 13 stores the computer program executed by processor 11. ROM 13 may also store other fixed data. ROM 13 may be, for example, P-ROM (Programmable ROM).

[0017] The storage device 14 stores data that the authentication system 10 stores long-term. The storage device 14 may operate as a temporary storage device of the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives an input instruction from a user of the authentication system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel.

[0019] The output device 16 is a device that outputs information regarding the authentication system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) capable of displaying information regarding the authentication system 10.

[0020] (Functional configuration) Next, with reference to FIG. 2, the functional configuration of the authentication system 10 according to the first embodiment will be described. FIG. 2 is a block diagram showing the functional configuration of the authentication system according to the first embodiment.

[0021] In FIG. 2, the authentication system 10 according to the first embodiment is configured as a system that determines whether a target can pass through a gate, for example, at a boarding gate at an airport or the like. In the following embodiments, the case where the target is a target person (i.e., a human) will be described as an example, but the target may be other than a human (e.g., an animal such as a dog or a cat). The authentication system 10 includes a face image acquisition unit 110, a face authentication unit 120, and a determination unit 130 as processing blocks for realizing its functions or as physical processing circuits. The face image acquisition unit 110, the face authentication unit 120, and the determination unit 130 can be realized, for example, by the above-described processor 11 (see FIG. 1).

[0022] The face image acquisition unit 110 acquires a face image of a target person who is about to pass through the gate from, for example, a camera installed around the gate. Note that the camera may be installed directly on the gate or at a location other than the gate around the gate. The face image acquisition unit 110 controls the camera to capture a face image, for example, at the timing when the target person reaches a predetermined position (for example, a position close to the gate to a certain extent), and acquires an image of the target person captured by the camera. Note that the criterion for determining whether the target person has arrived at the predetermined position may be any technique that can determine whether the target person has arrived at the predetermined position, such as a method of analyzing the video captured by the camera (determining that the target person has arrived at the predetermined position when the interpupillary distance of the target is equal to or greater than a threshold value) or a method of using a proximity sensor installed on the gate. The face image acquisition unit 110 may be configured to acquire a face image of the target person from one camera or may be configured to acquire a face image of the target person from each of a plurality of cameras. Information about the image acquired by the face image acquisition unit 110 is output to the face authentication unit 120.

[0023] The face authentication unit 120 is configured to be able to perform face authentication using the face image of the target person acquired by the face image acquisition unit 110. Specifically, the face authentication unit 120 collates the face image of the target person with the face images of a plurality of registered persons to perform face authentication (that is, perform 1:N authentication processing). Note that as for the specific method of face authentication, an existing technique can be adopted as appropriate. For example, a method of extracting feature amounts from a face image and comparing the feature amounts can be cited as an example. Note that the face authentication unit 120 may have a function related to the authentication processing outside the system. For example, the face authentication unit 120 may be configured to transmit information about the face image of the target person to an external server, cloud, etc., and receive and output the result of the authentication processing executed at the transmission destination. The authentication result by the face authentication unit 120 is output to the determination unit 130.

[0024] The determination unit 130 is configured to be able to determine whether the target person can pass through the gate based on the authentication result of the face authentication unit 120. More specifically, the determination unit 130 is configured to be able to determine whether the target person can pass through the gate based on the number of successful face authentications executed by the face authentication unit 120. Here, the "number of successful times" means the number of times determined as successful authentication when face authentication is performed multiple times. When the determination unit 130 determines from the number of successful face authentications that the target person can pass through the gate, it may control the gate so that the target person can pass through. On the other hand, when the determination unit 130 determines from the number of successful face authentications that the target person cannot pass through the gate, it may control the gate so that the target person cannot pass through.

[0025] (Configuration of the gate device) Next, with reference to FIG. 3, the configuration of the gate device controlled by the authentication system 10 according to the first embodiment will be described. FIG. 3 is a perspective view showing the configuration of the gate device according to the first embodiment. Hereinafter, the description will proceed by taking as an example the gate device installed at the boarding gate of an airport.

[0026] As shown in FIG. 3, a plurality of gate devices 200 are arranged side by side, and passengers can pass between them. The gate device 200 is provided with a reading device 210, a display for staff 220, an imaging display device 230, and an opening / closing bar 240.

[0027] The reading device 210 is installed on the entrance side of the gate device 200 (that is, the side where passengers enter). The reading device 210 is configured to be able to read, for example, passport information and ticket information. Note that when determining whether to pass through the gate only based on the result of face authentication by the face authentication unit 120 (that is, without checking a passport, ticket, etc.), the reading unit 210 may not be installed.

[0028] The attendant display 220 is installed on the exit side of the gate device 200 (i.e., the side where passengers exit). The attendant display 220 is configured to be able to display information of passengers passing through the gate for an attendant (e.g., a ground staff at an airport, etc.) who guides passengers on the exit side of the gate device 200. The attendant display 220 may be configured to be able to read passport information and ticket information like the reading device 210. The attendant display 220 may display the determination result of the determination unit 130 (i.e., whether the passenger can pass through the gate).

[0029] The imaging display device 230 is installed on the upper part of the gate device 200. The imaging display device 230 includes a camera that images the face image of a passenger (i.e., the target person) passing through the gate, and a display that can display various information to the passenger. The face image of the target person imaged by the camera of the imaging display device 230 is configured to be output to the face image acquisition unit 110. Note that two or more cameras (e.g., two above and below sandwiching the display) for imaging the face image of the target person may be installed in the imaging display device 230, or may be installed at a location other than the imaging display device 230. For example, a camera may be installed on the wall or ceiling around the gate. The determination result of the determination unit 130 (i.e., whether the passenger can pass through the gate) may be displayed on the display of the imaging display device 230.

[0030] The opening and closing bar 240 is installed between two gate devices 200. The opening and closing bar 240 is normally closed and may be configured to open when the determination unit 130 determines that the gate can be passed through. Alternatively, the opening and closing bar 240 is normally open and may be configured to close when the determination unit 130 determines that the gate cannot be passed through.

[0031] (Flow of operation) Next, with reference to FIG. 4, the flow of operation of the authentication system 10 according to the first embodiment will be described. FIG. 4 is a flowchart showing the flow of operation of the authentication system according to the first embodiment.

[0032] As shown in FIG. 4, when the authentication system 10 according to the first embodiment operates, first, the face image acquisition unit 110 acquires a face image of a person passing through the gate (step S101). Then, the face authentication unit 120 performs face authentication using the information obtained from the face image of the person (step S102).

[0033] Subsequently, the authentication system 10 determines whether the number of times of face authentication by the face authentication unit 120 is equal to or greater than a predetermined value (step S103). Here, the "predetermined value" is a value preset as the number of times of face authentication, and a value of at least "2" or more is set. The predetermined value may be set to the same value as the number of successful face authentications determined by the determination unit 130 that the person can pass through the gate. If it is determined that the number of times of face authentication by the face authentication unit 120 is less than the predetermined value (step S103: NO), the process is repeated from step S101. As a result, the face authentication by the face authentication unit 120 is performed a plurality of times.

[0034] On the other hand, if it is determined that the number of times of face authentication by the face authentication unit 120 is equal to or greater than the predetermined value (step S103: YES), the determination unit 130 determines whether the person can pass through the gate based on the number of successful face authentications by the face authentication unit 120 (step S104). As described above, since the face authentication by the face authentication unit 120 is performed a plurality of times, if all face authentications are successful, the number of successful face authentications is also a plurality of times. The determination unit 130 may determine, for example, that the person can pass through the gate when the number of successful face authentications is a plurality of times, and determine that the person cannot pass through the gate when the number of successful face authentications is not a plurality of times.

[0035] In addition, in a situation where two people pass through the gate simultaneously, such as when an adult holding a small child attempts to pass through the gate, face authentication may be executed for both of them simultaneously, or face authentication may be executed for only one of them (for example, only the adult). When face authentication is executed for only one of them, for the other person for whom face authentication cannot be performed (for example, a small child), face authentication may be separately and manually performed by a staff member or the like. Also, when one person is determined to be able to pass through the gate while the other person is determined not to be able to pass through the gate, for example, by displaying the face of the person who can pass through the gate (or the person who cannot pass through the gate) on the staff display 220, it may be instructed to execute face authentication again only for the person who cannot pass through the gate.

[0036] (Technical Effect) Next, the technical effect obtained by the authentication system 10 according to the first embodiment will be described.

[0037] As described with reference to FIGS. 1 to 4, in the authentication system 10 according to the first embodiment, face authentication is executed multiple times, and whether or not the gate can be passed is determined based on the number of successful face authentications at that time. By doing so, it is possible to more appropriately determine whether or not a target person can pass through the gate compared to the case where face authentication is performed only once. In other words, it is possible to determine with high accuracy whether or not the target person is a registered passenger. Also, at boarding gates in airports and the like, it is required to accurately execute the authentication process for many target persons. In such a situation, the authentication system 10 according to the present embodiment exhibits extremely beneficial effects.

[0038] <Second Embodiment> The authentication system 10 according to the second embodiment will be described with reference to FIG. 5. Note that the second embodiment is different from the first embodiment described above only in some operations (specifically, in the point of executing the process of determining whether or not the number of successful face authentications is equal to or more than a predetermined number), and the configuration of the system and the gate may be the same as that of the first embodiment (see FIGS. 1 to 3). Therefore, hereinafter, the parts different from the first embodiment will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0039] (Flow of operations) Referring to FIG. 5, the flow of operations of the authentication system 10 according to the second embodiment will be described. FIG. 5 is a flowchart showing the flow of operations of the authentication system according to the second embodiment. In FIG. 5, the same reference numerals are assigned to the same processes as those shown in FIG. 4.

[0040] As shown in FIG. 5, when the authentication system 10 according to the second embodiment operates, first, the face image acquisition unit 110 acquires a face image of a person passing through the gate (step S101). Then, the face authentication unit 120 performs face authentication using the information obtained from the face image of the person (step S102).

[0041] Subsequently, the authentication system 10 determines whether the number of times of face authentication by the face authentication unit 120 is equal to or greater than a predetermined value (step S103). If it is determined that the number of times of face authentication by the face authentication unit 120 is less than the predetermined value (step S103: NO), the process is repeated from step S101.

[0042] On the other hand, if it is determined that the number of times of face authentication by the face authentication unit 120 is equal to or greater than the predetermined value (step S103: YES), the determination unit 130 determines whether the number of successful face authentications by the face authentication unit 120 is equal to or greater than a predetermined number of times (step S201). Here, the "predetermined number of times" is a threshold for determining whether the person can pass through the gate and is set in advance. The predetermined number of times can be set as an arbitrary value, but it is required to be set as a value less than or equal to the predetermined value in step S103 (i.e., the number of times of face authentication execution).

[0043] When it is determined that the number of successful face authentications by the face authentication unit 120 is equal to or greater than a predetermined number (step S201: YES), the determination unit 130 determines that the target person can pass through the gate (step S202). On the other hand, when it is determined that the number of successful face authentications by the face authentication unit 120 is less than the predetermined number (step S201: NO), the determination unit 130 determines that the target person cannot pass through the gate (step S203).

[0044] Note that the determination process of step S201 may be executed in parallel during the loop of the processes of steps S101 to S103 (that is, it may be executed before the number of times of face authentication reaches a predetermined value). In this case, even if the number of times of face authentication has not reached the predetermined value, when the number of successful face authentications becomes equal to or greater than the predetermined number, it may be determined that the target person can pass through the gate. For example, if the predetermined value of step S103 is "5" and the predetermined number of step S201 is "2", when the first two face authentications are both successful, it may be determined at that time (that is, without performing face authentication five times) that the target person can pass through the gate.

[0045] Also, the predetermined number of step S201 may be set as a value corresponding to the number of consecutive successful times. In this case, even if the cumulative number of successful times is equal to or greater than the predetermined number, if the number of consecutive successful times is less than the predetermined number, the target person is determined not to be able to pass through the gate. For example, similar to the case described above, if the predetermined value of step S103 is "5" and the predetermined number of step S201 is "2", when the face authentication results are in order of "○, ×, ○, ×, ○" (○ represents success, × represents failure), the target person is determined not to be able to pass through the gate. This is because although the cumulative number of successful times is 3 times, the number of consecutive successful times remains at 1 time. On the other hand, when the face authentication results are in order of "×, ×, ×, ○, ○", the target person is determined to be able to pass through the gate. This is because although the authentication has failed continuously in the first three times, the authentication has been successful continuously in the last two times.

[0046] Alternatively, the predetermined number of times (i.e., the cumulative number of successful times) and the consecutive number of successful times may be set as separate conditions. For example, if the predetermined number of times is set to "3" and the consecutive number of successful times is set to "2", when the face authentication results are in order of "×, ○, ×, ○, ×", the subject is determined not to be able to pass through the gate. This is because the cumulative number of successful times is 2 times and the consecutive number of successful times remains at 1 time. On the other hand, when the face authentication results are in order of "○, ×, ○, ×, ○", the subject is determined to be able to pass through the gate. This is because although the consecutive number of successful times remains at 1 time, the cumulative number of successful times is 3 times. Also, when the face authentication results are in order of "○, ○, ×, ×, ×", the subject is determined to be able to pass through the gate. This is because although the cumulative number of successful times remains at 2 times, the consecutive number of successful times is 2 times.

[0047] Furthermore, when capturing face images with a plurality of cameras, the above-mentioned predetermined number of times and consecutive number of successful times may be set for each camera. In this case, the number of successful times of face authentication is counted for each camera, and it is determined whether the subject can pass through the gate for each camera. For example, assume that for the first camera, the predetermined number of times is set to "3" and the consecutive number of successful times is set to "2", and for the second camera, the predetermined number of times is set to "5" and the consecutive number of successful times is set to "3". Here, if the cumulative number of successful times of face authentication using the image of the first camera is 4 times, even if the cumulative number of successful times of face authentication using the image of the second camera is only 1 time, the subject is determined to be able to pass through the gate. Also, even if the consecutive number of successful times of face authentication using the image of the first camera is 1 time, if the cumulative number of successful times of face authentication using the image of the second camera is 3 times, the subject is determined to be able to pass through the gate.

[0048] (Technical Effect) Next, the technical effects obtained by the authentication system 10 according to the second embodiment will be described.

[0049] As described with reference to FIG. 4, in the authentication system 10 according to the second embodiment, when the number of successful face authentications reaches a predetermined number or more, it is determined that the subject can pass through the gate. Therefore, by setting the predetermined number to an appropriate value, it is possible to appropriately determine whether the subject can pass through the gate. For example, if the predetermined number is set to a relatively small value (e.g., "2"), it is possible to prevent misjudging that the subject who should originally pass through the gate is not allowed to pass while accurately verifying the subject through multiple face authentications. On the other hand, if the predetermined number is set to a relatively large value (e.g., "5"), it is possible to prevent misjudging that the subject who should originally not be allowed to pass through the gate is allowed to pass.

[0050] <Third Embodiment> The authentication system 10 according to the third embodiment will be described with reference to FIGS. 6 and 7. Note that the third embodiment is only different from the above-described first and second embodiments in some configurations and operations, and the hardware configuration and the configuration of the gate may be the same as those of the first embodiment (see FIGS. 1 and 3). Therefore, hereinafter, the parts different from the parts already described will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0051] (Functional Configuration) First, with reference to FIG. 6, the functional configuration of the authentication system 10 according to the third embodiment will be described. FIG. 6 is a block diagram showing the functional configuration of the authentication system according to the third embodiment. In FIG. 6, the same reference numerals are given to the elements similar to those shown in FIG. 2.

[0052] In FIG. 6, the authentication system 10 according to the third embodiment includes a face image acquisition unit 110, a face authentication unit 120, a determination unit 130, and a face image storage unit 140 as processing blocks for realizing its functions or as physical processing circuits. The face image storage unit 140 can be realized by, for example, the above-described storage device 14 (see FIG. 1).

[0053] The face image storage unit 140 is configured to be able to store the face images acquired by the face image acquisition unit 110 (i.e., the face images of the subject captured by the camera). The face image storage unit 140 stores, for example, about 10 face images of the subject passing through the gate. When the determination of whether the subject can pass through the gate is completed, the face image storage unit 140 may delete the stored face images of that subject. The face images of the subject stored in the face image storage unit 140 are configured to be output to the face authentication unit 120 as appropriate.

[0054] The face authentication unit 120 according to the third embodiment is configured to be able to select an image suitable for face authentication from among the face images of the subject stored in the face image storage unit 140 and perform face authentication. The face authentication unit 120 may select, for example, an image in which the subject is facing forward, an image in which the distance between the eyes in the face image is a certain value or more, an image in which a part of the subject's face is not missing, an image in which the subject's face is not blurred, an image in which the subject's face is not out of focus, an image with a resolution greater than a predetermined value (when using multiple cameras with different resolutions), etc. as an image suitable for face authentication.

[0055] (Flow of operations) With reference to FIG. 7, the flow of operations of the authentication system 10 according to the third embodiment will be described. FIG. 7 is a flowchart showing the flow of operations of the authentication system according to the third embodiment. In FIG. 7, the same reference numerals are given to the same processes as those shown in FIGS. 4 and 5.

[0056] As shown in FIG. 7, when the authentication system 10 according to the third embodiment operates, first, the face image acquisition unit 110 acquires a face image of the subject passing through the gate (step S101). Here, particularly in the second embodiment, the face image acquisition unit 110 acquires the face image of the subject, and the face image storage unit 140 stores it (step S301). Although detailed illustration in the flowchart is omitted, the storage of face images by the face image storage unit 140 is continuously performed, for example, until the number of stored face images reaches a predetermined number or until a predetermined period elapses. That is, the processes of step S101 and step S103 are executed in a loop multiple times.

[0057] Next, the face authentication unit 120 selects a face image suitable for face authentication from among the multiple face images stored in the face image storage unit 140 (step S302). Then, the face authentication unit 120 executes face authentication using information obtained from the selected face image (step S102).

[0058] Next, the authentication system 10 judges whether or not the number of face authentications by the face authentication unit 120 is equal to or greater than a predetermined value (step S103). If it is judged that the number of face authentications by the face authentication unit 120 is not equal to or greater than the predetermined value (step S103: NO), the process is repeated from step S101. On the other hand, if it is judged that the number of face authentications by the face authentication unit 120 is equal to or greater than the predetermined value (step S103: YES), the judgment unit 130 judges whether or not the target person can pass through the gate based on the number of successful face authentications by the face authentication unit 120 (step S104).

[0059] (Technical effect) Next, technical effects obtained by the authentication system 10 according to the third embodiment will be described.

[0060] As described in FIG. 6 and FIG. 7, in the authentication system 10 according to the third embodiment, face images of subjects are stored, and face authentication is performed using a face image selected from the stored face images. In this way, face authentication can be performed using an image suitable for face authentication, and the accuracy of face authentication can be improved. In addition, in face authentication, a condition may be imposed that a predetermined interval (e.g., 250 ms) is required between requesting one process and requesting the next process, or between performing one process and performing the next process, so as not to saturate the process. In this case, if the face image storage unit 140 is configured to store face images for a period corresponding to the above-mentioned predetermined interval, face authentication can be performed without reducing throughput. Such a technical effect is particularly evident in cases where it is required to perform authentication processing for many subjects in a short period of time, such as at an airplane boarding gate.

[0061] <Fourth embodiment> The authentication system 10 according to the fourth embodiment will be described with reference to FIG. 8. Note that, compared with the above-described embodiments, the fourth embodiment is different only in the part related to camera control, and the other configurations and operation flows may be the same as those of the already described embodiments. Therefore, hereinafter, the parts different from the already described parts will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0062] (Position control of the camera) With reference to FIG. 8, the position control of the camera by the authentication system 10 according to the fourth embodiment will be described. FIG. 8 is a conceptual diagram showing the movement mode of the camera in the authentication system according to the fourth embodiment. Note that, in FIG. 8, the same reference numerals are given to the same components as those shown in FIG. 3.

[0063] As shown in FIG. 8, the authentication system 10 according to the fourth embodiment is configured to be able to change the position of the camera that captures the face image of the subject. More specifically, the imaging display unit 230 having the camera is configured to be movable on the gate device. Note that, hereinafter, the movement of the imaging display unit 230 will be specifically described. However, when a camera is provided other than the imaging display unit 230, the position of that camera may also be configured to be changeable in the same manner.

[0064] The imaging display unit 230 may be configured to be movable up and down so that its height changes. The imaging display unit 230 may be configured to move up and down, for example, by the telescopic movement of the support column. The imaging display unit 230 is moved up and down, for example, so that the camera is at the height of the subject's face. In this case, the position of the subject's face may be detected by a sensor or the like, and the imaging display unit 230 may be moved up and down according to the detected height.

[0065] The imaging display unit 230 may be configured to be horizontally movable so that its horizontal position changes. The imaging display unit 230 may be configured to move horizontally, for example, by moving horizontally on the gate device 200. The imaging display unit 230 is horizontally moved so that, for example, a camera follows a person passing through the gate. In this case, the position of the person may be detected by a sensor or the like, and the imaging display unit 230 may be horizontally moved in accordance with the direction of travel of the person.

[0066] The imaging display unit 230 may be configured to be rotatable so that its horizontal orientation changes. The imaging display unit 230 may be configured to rotate in conjunction with the rotation of a support column, for example. The imaging display unit 230 is rotated so that, for example, a camera follows a person passing through the gate. In this case, the position of the person may be detected by a sensor or the like, and the imaging display unit 230 may be rotated in the direction of travel of the person.

[0067] The imaging display unit 230 may be configured to be capable of realizing the above-described vertical movement, horizontal movement, and rotation in combination. Note that the above-described movement modes are merely examples, and the imaging display unit 230 may be configured to be movable in other directions.

[0068] When moving the camera, blurring is more likely to occur in the image compared to when the camera is fixed. To suppress this blurring, for example, the shutter speed may be increased. When increasing the shutter speed, since the image becomes darker, illumination may be applied to the person or the intensity of the illumination may be changed. Also, when asking the person to face the direction of the camera, there is a possibility that the person may not know which direction to face when the camera is moved. In this case, for example, the imaging display unit 230 may display the currently captured image to inform the person of the position of the camera. Also, a speaker may be provided in the imaging display unit 230, and a sound may be emitted in accordance with the movement of the camera or the imaging timing to ask the person to face the direction of the camera. Note that the speaker may be installed at a location other than the imaging display unit 230 (for example, near the gate or the gate device 200 itself) as long as the sound reaches the person.

[0069] Also, when the camera is moved, the imaging range changes significantly. For example, there is a possibility that a person other than the target person (e.g., a passenger passing through the adjacent gate) may be included in the image. However, in the authentication system 10 according to the present embodiment, as already described, after multiple face authentications are performed, it is determined whether the gate can be passed. Therefore, even if another person is reflected in the image, the occurrence of misauthentication can be suppressed compared to the case where face authentication is performed only once.

[0070] (Technical Effect) Next, the technical effect obtained by the authentication system 10 according to the fourth embodiment will be described.

[0071] As described with reference to FIGS. 6 and 7, in the authentication system 10 according to the fourth embodiment, the position of the camera can be moved. Thereby, it becomes possible to more appropriately image the face image of the target person. For example, it becomes possible to image so that the face of the target person is surely included in the imaging area. Also, it becomes possible to image the target person from different angles. As a result, it becomes possible to appropriately perform face authentication using the face image of the target person.

[0072] <Fifth Embodiment> The authentication system 10 according to the fifth embodiment will be described with reference to FIG. 9. Note that the fifth embodiment is only different from each of the above-described embodiments in some operations (particularly, operations related to face authentication). For example, the system configuration and the overall operation flow may be the same as those of the already described embodiments. Therefore, hereinafter, the parts different from the already described parts will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0073] (Face Authentication Using Front and Profile Faces) The face authentication of the authentication system 10 according to the fifth embodiment will be described with reference to FIG. 9. FIG. 9 is a diagram showing two face images used in the authentication system according to the fifth embodiment.

[0074] As shown in FIG. 9, the authentication system 10 according to the fifth embodiment uses an image obtained by imaging the subject 500 from the front for the first face authentication. Then, for the second face authentication, an image obtained by imaging the side face of the subject 500 is used. That is, in the face authentication of the fifth embodiment, in each of the multiple face authentications, a face image of the subject 500 captured from different angles is used. In this case, it is preferable that the registered images used for face authentication are also multiple images captured from different angles. Alternatively, for example, information representing the face three-dimensionally, such as a 3D model, may be used instead of the registered images. Note that the "front" and "side face" shown in the figure are merely examples, and face images captured from other angles may also be used.

[0075] Face images from different angles can be captured, for example, by moving the position of the camera as described in the fourth embodiment. For example, at the timing when the subject 500 approaches the gate, if the camera is directed toward the entrance direction of the gate, a front face image of the subject 500 can be captured. Also, at the timing when the subject 500 passes through the gate, if the camera is directed inside the gate, a side face image of the subject 500 can be captured.

[0076] Alternatively, even without moving the position of the camera, face images can be captured from different angles. For example, if the subject 500 moves, the relative position between the camera and the subject 500 will inevitably change. Therefore, by capturing multiple face images at different timings during the movement of the subject 500, face images of the subject 500 from different angles can be captured. Also, by using multiple cameras, face images can be captured from different angles. For example, if the subject 500 is imaged by a camera installed in the gate device 200 and a camera installed on the wall or ceiling around the gate respectively, face images of the subject 500 from different angles can be captured.

[0077] (Technical Effects) Next, the technical effects obtained by the authentication system 10 according to the fifth embodiment will be described.

[0078] As described with reference to FIG. 9, in the authentication system 10 according to the fifth embodiment, face authentication is performed using face images captured from different angles. By doing so, since face images captured from a plurality of angles can be used, it is possible to improve the accuracy of face authentication compared to the case where only a face image captured from one direction is used.

[0079] <Sixth Embodiment> The authentication system 10 according to the sixth embodiment will be described with reference to FIGS. 10 and 11. Note that the sixth embodiment describes specific display examples in the imaging display unit 230, and the configuration and operation flow thereof may be the same as those of the already described embodiments. Therefore, hereinafter, parts different from the already described parts will be described in detail, and other overlapping parts will be omitted as appropriate.

[0080] (Display Example of Imaging Display Unit) With reference to FIGS. 10 and 11, a display example in the authentication system 10 according to the sixth embodiment will be described. FIG. 10 is a diagram (part 1) showing a display example by the authentication system according to the sixth embodiment. FIG. 11 is a diagram (part 2) showing a display example by the authentication system according to the sixth embodiment.

[0081] As shown in FIG. 10(a), in the authentication system 10 according to the sixth embodiment, information indicating which time the ongoing face authentication process is may be displayed together with the face image of the subject 500 (i.e., the image used for face authentication). In the example shown in the figure, the text "During 1st authentication..." is displayed on the face image of the subject 500. This indicates that the currently executed face authentication is the first one among multiple executions of face authentication.

[0082] As shown in FIG. 10(b), in the authentication system 10 according to the sixth embodiment, information indicating which time the ongoing face authentication process is, and information indicating the number of successful face authentications so far may be displayed together with the face image of the subject 500. In the example shown in the figure, texts "Authenticating for the 3rd time..." and "Number of successful authentications: 2" are displayed on the face image of the subject 500. This indicates that the currently executed face authentication is the third one among multiple face authentications executed, and that 2 out of the past 2 face authentications have been successful (in other words, neither has failed). Note that the number of successful or failed authentications may be displayed not as text but as icons, images, etc. For example, "○" may be displayed when the face authentication is successful, and "×" may be displayed when it fails. In this case, when the first and second authentications fail and the third and fourth authentications are successful, it may be displayed as "××○○".

[0083] As shown in FIG. 11, in the authentication system 10 according to the sixth embodiment, information indicating the determination result of whether the subject 500 can pass through the gate may be displayed together with the face image of the subject 500. In the example shown in FIG. 11(a), texts "Authentication successful" and "You can pass through the gate" are displayed on the face image of the subject 500. This indicates that the face authentication has been successful a predetermined number of times or more, and it has been determined that the subject 500 can pass through the gate. On the other hand, in the example shown in FIG. 11(b), texts "Authentication failed" and "You cannot pass through the gate" are displayed on the face image of the subject 500. This indicates that the face authentication has not been successful a predetermined number of times or more, and it has been determined that the subject 500 cannot pass through the gate.

[0084] The above-described display examples are merely examples, and other information handled by the authentication system 10 may be displayed in addition to or instead of the above information. Also, although the above-described display examples are assumed to be displayed on the display of the imaging display device 230, they may be displayed by display means other than the imaging display device 230 (for example, the display 220 for staff, etc.).

[0085] (Technical effects) Next, the technical effects obtained by the authentication system 10 according to the sixth embodiment will be described.

[0086] As described with reference to FIGS. 10 and 11, in the authentication system 10 according to the sixth embodiment, an image used for face authentication and various types of information related to face authentication are displayed on the display of the imaging display device 230. In this way, it is possible to appropriately present the progress status and determination result of face authentication to the subject 500 or the like.

[0087] <Seventh Embodiment> The authentication system 10 according to the seventh embodiment will be described with reference to FIGS. 12 to 15. Note that the seventh embodiment is only different from the above-described embodiments in some configurations and operations, and the hardware configuration and gate configuration may be the same as those of the already described embodiments. For this reason, hereinafter, the parts different from the already described parts will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0088] (Functional Configuration) First, with reference to FIG. 12, the functional configuration of the authentication system 10 according to the seventh embodiment will be described. FIG. 12 is a block diagram showing the functional configuration of the authentication system according to the seventh embodiment. In FIG. 12, the same reference numerals are assigned to the elements similar to the elements shown in FIGS. 2 and 6.

[0089] As shown in FIG. 12, the authentication system 10 according to the seventh embodiment includes a face image acquisition unit 110, a face authentication unit 120, a determination unit 130, and an attribute acquisition unit 150 as processing blocks for realizing its functions or as physical processing circuits. That is, the authentication system 10 according to the seventh embodiment is configured to further include an attribute acquisition unit 150 in addition to the components of the first embodiment (see FIG. 2). The attribute acquisition unit 150 may be realized by, for example, the above-described processor 11 (see FIG. 1).

[0090] The attribute acquisition unit 150 is configured to be able to acquire information regarding the attributes of the person 500 passing through the gate (hereinafter, appropriately referred to as "attribute information"). The "attribute information" here is information belonging to the individual of the person, and examples thereof include name, age, gender, occupation, etc., and in addition, information regarding boarding. As an example of information regarding boarding, information regarding the number of the boarding gate, the name of the flight to board, the seat to board, the status rank of the airline to board, etc. can be mentioned. Further, the attribute information may include information regarding the companion of the person rather than the person himself / herself.

[0091] The attribute acquisition unit 50 may acquire attribute information from the registration information associated with the passport or ticket of the person 500. Alternatively, the attribute acquisition unit 50 may acquire attribute information from the registration information associated as a result of the face authentication by the face authentication unit 120. The attribute acquisition unit 50 may estimate (for example, estimate gender, age, etc.) and acquire attribute information from the face image of the person 500. The attribute information acquired by the attribute acquisition unit 150 is configured to be output to the determination unit 130.

[0092] (Flow of operations) Next, with reference to FIG. 13, the flow of operations of the authentication system 10 according to the seventh embodiment will be described. FIG. 13 is a flowchart showing the flow of operations of the authentication system according to the seventh embodiment. In FIG. 13, the same reference numerals are given to the same processes as those shown in FIGS. 4, 5, and 7.

[0093] As shown in FIG. 13, when the authentication system 10 according to the seventh embodiment operates, first, the face image acquisition unit 110 acquires a face image of the person passing through the gate (step S101). Then, the face authentication unit 120 performs face authentication using the information obtained from the face image of the person (step S102).

[0094] Next, the authentication system 10 determines whether the number of face authentications by the face authentication unit 120 is equal to or greater than a predetermined value (step S103). If it is determined that the number of face authentications by the face authentication unit 120 is less than the predetermined value (step S103: NO), the process is repeated from step S101.

[0095] On the other hand, if it is determined that the number of face authentications by the face authentication unit 120 is equal to or greater than the predetermined value (step S103: YES), the attribute acquisition unit 150 acquires the attribute information of the target person 500 (step S401). However, the attribute acquisition unit 150 may acquire the attribute information in parallel with the processes of steps S101 to S103 described above.

[0096] Thereafter, the determination unit 130 determines whether the target person 500 can pass through the gate based on the number of successful face authentications by the face authentication unit 120 and the attribute information of the target person 500 (step S402). For example, the determination unit 130 may determine that the target person 500 can pass through the gate when the conditions regarding the attribute information are satisfied in addition to the conditions regarding the number of successful face authentications. The determination unit 130 may determine that the target person 500 cannot pass through the gate when either the conditions regarding the number of successful face authentications or the conditions regarding the attribute information are not satisfied.

[0097] Also, the determination unit 130 may change the conditions regarding the number of successful face authentications (for example, the predetermined number of times in step S201 of FIG. 5) based on the attribute information. For example, when the predetermined number of times is increased according to the attribute information, the target person 500 is more likely to be determined as not being able to pass through the gate. On the other hand, when the predetermined number of times is decreased according to the attribute information, the target person 500 is more likely to be determined as being able to pass through the gate.

[0098] (Example of utilization of attribute information) Next, a specific utilization example of the attribute information in the authentication system 10 according to the seventh embodiment will be described with reference to FIGS. 14 and 15. FIG. 14 is a diagram showing a display example by the authentication system according to the seventh embodiment. FIG. 15 is a perspective view showing an example of a gate device in which a dedicated gate is set. The display example in FIG. 14 is displayed, for example, on the display of the imaging display device 230. Hereinafter, the case where the attribute information is "airline status rank" or "boarding seat rank" will be described as an example.

[0099] An airline may, for example, assign a special status to a passenger according to past boarding records and the like. A passenger to whom a status is assigned is, for example, called an elite member and can receive special services when using the airline's flights. There is a rank in the airline's status, and the higher the rank, the higher-quality services can be received. Also, regardless of the airline's status, similar services may be received depending on the class of the seat on the airplane used. For example, passengers in first class or business class may receive different services from economy class passengers.

[0100] For example, elite members, as well as first-class and business-class passengers, can use priority boarding when boarding an airplane (specifically, they can board at a timing earlier than ordinary passengers). Note that there may be a priority order determined according to the rank for priority boarding. For example, the elite member with the highest rank can board the airplane at the earliest timing, while an elite member with a lower rank may not be able to board until after the boarding of the elite member with a higher rank is completed. Similarly, first-class passengers can board the airplane at the earliest timing, while business-class passengers may not be able to board until after the boarding of first-class passengers is completed.

[0101] When the above-mentioned priority boarding is carried out, depending on the status and seat rank, there will be passengers who can pass through the gate and passengers who cannot pass through the gate. In addition to determining whether a gate can be passed based on the number of successful face authentication attempts, the authentication system 10 according to the seventh embodiment may also determine whether a gate can be passed according to the above-mentioned rank (i.e., attribute information).

[0102] As shown in Fig. 14(a), when priority boarding is carried out, if there is no information regarding the status and seat rank in the attribute information of the target person 500 (in other words, if the target person 500 does not have the qualification to be the target of priority boarding), or if the rank of the status indicated by the attribute information of the target person 500 is low (i.e., the target person 500 cannot board yet in the current priority boarding), it may be configured to display that the target person cannot pass through the gate, along with the reason. Specifically, as shown in the figure, it may be configured to display the text "You cannot use priority boarding. Please board after priority boarding ends."

[0103] In addition to the above-mentioned priority boarding, elite members, and passengers in first class and business class may be able to use a priority lane when boarding an airplane. Since the number of passengers who can use the priority lane is limited, it is often relatively empty. Therefore, even when there is a long queue in the normal lane, boarding may be possible without waiting time by using the priority lane. Similar to priority boarding, there may be usage qualifications set according to the rank for the priority lane. For example, while there is a priority lane that any elite member can use, there is also a priority lane that only the elite member with the highest rank can use. Similarly, while there is a priority lane that passengers in first class and business class can use, there is also a priority lane that only first-class passengers can use (i.e., business-class passengers cannot use it).

[0104] When the priority lane as described above is installed, depending on the status and seat rank, there will be passengers who can pass through the gate and passengers who cannot pass through the gate. In addition to determining whether a gate can be passed based on the number of successful face authentication attempts, the authentication system 10 according to the seventh embodiment may also determine whether a gate can be passed according to the rank described above.

[0105] As shown in FIG. 14(b), in the priority lane, when the attribute information of the target person 500 (that is, the status and seat rank) does not meet the gate usage qualification, it may be configured to display that the gate cannot be passed, together with the reason. Specifically, as shown in the figure, it may be configured to display text such as "You cannot use this gate. Please use another gate."

[0106] As shown in FIG. 15, among the three lanes, assume that the frontmost lane is set as the priority lane and the other lanes are set as normal lanes (the priority lane and the normal lane can be arbitrarily set by staff, etc.). In this case, any passenger can use the two normal lanes. On the other hand, for the priority lane, only passengers with a predetermined attribute (for example, elite members or upper-class passengers) can use it. When the priority lane is set, information indicating that the lane is a priority lane may be displayed on the display of the imaging display unit 230 corresponding to the priority lane. Furthermore, information regarding the attributes that can use the priority lane may be displayed on the display of the imaging display unit 230 corresponding to the priority lane. Also, information indicating that the lane is a normal lane may be displayed on the display of the imaging display unit 230 corresponding to the normal lane. Furthermore, information indicating that all users can use it may be displayed on the display of the imaging display unit 230 corresponding to the normal lane. Also, information regarding the priority lane and the normal lane may be displayed other than on the display of the imaging display unit 230. For example, the information may be projected and displayed on the floor following each gate.

[0107] In addition, for elite members, first-class and business-class passengers, measures may be taken to relax the conditions related to face authentication in the determination unit 130. For example, for elite members, first-class and business-class passengers, they may be determined to be able to pass through the gate with fewer successful attempts than ordinary passengers. That is, depending on the status or seat rank, the predetermined number of times used for determining whether to pass through the gate may be changed. Also, the predetermined number of times may be changed step by step depending on the status or seat rank.

[0108] (Other usage examples) When the attribute information of the target person 500 includes information related to the flight name of the flight to board, the registered person information to be verified in the face authentication unit 120 can be narrowed down to only the passengers of that flight. Alternatively, when the attribute information of the target person 500 includes information related to the airline to board, the registered person information to be verified in the face authentication unit 120 can be narrowed down to only the passengers of the flights of that airline. Alternatively, when the attribute information of the target person 500 includes information related to the departure time of the airplane to board, the registered person information to be verified in the face authentication unit 120 can be narrowed down to only the passengers of the flights departing at that time. As described above, if the number of verifications in face authentication can be reduced, it is possible to effectively improve the accuracy of face authentication.

[0109] (Technical effects) Next, the technical effects obtained by the authentication system 10 according to the seventh embodiment will be described.

[0110] As described with reference to FIGS. 12 to 15, in the authentication system 10 according to the seventh embodiment, when determining whether to pass through the gate, the attribute information of the target person 500 is used. In this way, compared with the case where only the number of successful face authentication attempts is considered, it is possible to more appropriately determine whether to pass through the gate.

[0111] <Eighth Embodiment> The authentication system 10 according to the eighth embodiment will be described with reference to FIGS. 16 to 20. Note that the eighth embodiment is only different from the above-described embodiments in some configurations and operations, and the hardware configuration and gate configuration may be the same as those of the already described embodiments. For this reason, hereinafter, the parts different from the already described parts will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0112] (Functional configuration) First, with reference to FIG. 16, the functional configuration of the authentication system 10 according to the eighth embodiment will be described. FIG. 16 is a block diagram showing the functional configuration of the authentication system according to the eighth embodiment. In FIG. 16, the same reference numerals are given to the elements similar to those shown in FIGS. 2, 6, and 12.

[0113] As shown in FIG. 16, the authentication system 10 according to the eighth embodiment includes a face image acquisition unit 110, a face authentication unit 120, a determination unit 130, and a body temperature acquisition unit 160 as processing blocks for realizing its functions or as physical processing circuits. That is, the authentication system 10 according to the eighth embodiment is configured to further include a body temperature acquisition unit 160 in addition to the components of the first embodiment (see FIG. 2). The body temperature acquisition unit 160 may be realized by, for example, the above-described processor 11 (see FIG. 1).

[0114] The body temperature acquisition unit 160 is configured to be able to acquire information regarding the body temperature of the subject 500 passing through the gate (hereinafter, appropriately referred to as "body temperature information"). The body temperature may be, for example, the surface temperature of the subject. The body temperature information may indicate a specific body temperature (i.e., a numerical value), or may be information indicating whether it is higher or lower than the normal body temperature.

[0115] The body temperature acquisition unit 160 may acquire body temperature information from, for example, a thermographic camera. In this case, the body temperature acquisition unit 160 may acquire body temperature information multiple times in accordance with the timing at which the face image acquisition unit 110 acquires the face image of the subject 500. When the body temperature acquisition unit 160 acquires body temperature information multiple times, it may acquire the body temperature from different locations. For example, the body temperature acquisition unit 160 may acquire body temperature information from the lacrimal gland for the first time, from the tip of the nose for the second time, and from the forehead for the third time. The body temperature information acquired by the body temperature acquisition unit 160 is configured to be output to the determination unit 130.

[0116] (Flow of operations) Next, with reference to FIG. 17, the flow of operations of the authentication system 10 according to the eighth embodiment will be described. FIG. 17 is a flowchart showing the flow of operations of the authentication system according to the eighth embodiment. In FIG. 17, the same reference numerals are given to the same processes as those shown in FIGS. 4, 5, 7, and 13.

[0117] As shown in FIG. 17, when the authentication system 10 according to the eighth embodiment operates, first, the face image acquisition unit 110 acquires a face image of the subject passing through the gate (step S101). Then, the face authentication unit 120 performs face authentication using the information obtained from the face image of the subject (step S102).

[0118] Subsequently, the authentication system 10 determines whether the number of times of face authentication by the face authentication unit 120 is equal to or greater than a predetermined value (step S103). If it is determined that the number of times of face authentication by the face authentication unit 120 is less than the predetermined value (step S103: NO), the process is repeated from step S101.

[0119] On the other hand, if it is determined that the number of times of face authentication by the face authentication unit 120 is equal to or greater than the predetermined value (step S103: YES), the body temperature acquisition unit 150 acquires the body temperature information of the subject 500 (step S501). However, the body temperature acquisition unit 150 may acquire the body temperature information in parallel with the processes from step S101 to step S103 described above.

[0120] After that, the determination unit 130 determines whether the subject 500 can pass through the gate based on the number of successful face authentications by the face authentication unit 120 and the body temperature information of the subject 500 (step S502). For example, the determination unit 130 may determine that the subject 500 can pass through the gate when the conditions regarding the body temperature information are satisfied in addition to the conditions regarding the number of successful face authentications. The determination unit 130 may determine that the subject 500 cannot pass through the gate when either the condition regarding the number of successful face authentications or the condition regarding the body temperature information is not satisfied.

[0121] The conditions regarding the body temperature information may be set in consideration of, for example, the possibility of being infected with an infectious disease. For example, when the body temperature of the subject 500 is normal body temperature, it may be determined that the possibility of being infected with an infectious disease is low and the subject 500 can pass through the gate. On the other hand, when the body temperature of the subject is higher than the normal body temperature, it may be determined that the possibility of being infected with an infectious disease is high and the subject 500 cannot pass through the gate. Also, when the body temperature is acquired from a plurality of locations of the subject (for example, the lacrimal gland, forehead, etc.), if the normal body temperature is high at any of the respective locations, it may be determined that the subject cannot pass through the gate. Alternatively, the body temperature of each location may be comprehensively determined to determine whether the subject can pass through the gate. For example, the average value of the body temperatures acquired from a plurality of locations may be calculated. Also, while attaching a high slope to the body temperature acquired from the lacrimal gland, attaching a low slope to the body temperature acquired from the forehead, and calculating an index regarding the body temperature may be performed.

[0122] (Specific determination process) Next, with reference to FIG. 18, the flow of the determination process of the authentication system 10 according to the eighth embodiment will be described. FIG. 18 is a flowchart showing the flow of the determination process of the authentication system according to the eighth embodiment. Note that each process shown in FIG. 18 is a process executed in step S502 of FIG. 17.

[0123] As shown in FIG. 18, in the determination process of the authentication system 10 according to the eighth embodiment, first, the determination unit 130 determines whether a condition regarding the number of successful face authentication attempts is satisfied (step S601). For example, the determination unit 130 determines whether the number of successful face authentication attempts is equal to or greater than a predetermined number.

[0124] When the condition regarding the number of successful face authentication attempts is satisfied (step S601: YES), the determination unit 130 uses the body temperature information acquired by the body temperature acquisition unit 160 to determine whether the body temperature of the subject 500 is 37 degrees or higher (step S602). When it is determined that the body temperature of the subject 500 is not 37 degrees or higher (step S602: NO), the determination unit 130 determines that the subject 300 can board (i.e., can pass through the gate) (step S603).

[0125] On the other hand, when it is determined that the body temperature of the subject 500 is 37 degrees or higher (step S602: YES), the determination unit 130 uses the body temperature information acquired by the body temperature acquisition unit 160 to determine whether the body temperature of the subject 500 is 37.5 degrees or higher (step S604). When it is determined that the body temperature of the subject 500 is not 37.5 degrees or higher (step S604: NO), the determination unit 130 determines that the subject 300 can board (i.e., can pass through the gate), but since there is a suspicion of being infected with an infectious disease, it is determined that the seat should be changed to a predetermined seat area (step S605).

[0126] The "predetermined seat area" here is, for example, an area installed at the very front or the very rear of an airplane, and is an area where passengers suspected of being infected with an infectious disease are gathered. In the predetermined seat area, for example, in order to prevent droplet infection, a plastic sheet, a partition, etc. may be installed. In addition, when the subject 500 is to move to the predetermined seat area, it is preferable to also move their accompanying person (e.g., family member, etc.) to the predetermined seat area. This is because if the subject 500 is infected with an infectious disease, their accompanying person is also highly likely to be infected with the infectious disease.

[0127] When it is determined that the body temperature of the subject 500 is 37.5 degrees or higher (step S604: YES), the determination unit 130 determines that the subject 300 is not allowed to board (that is, cannot pass through the gate) because there is a high possibility that the subject 300 has developed an infectious disease (step S606). Even when the conditions regarding the number of successful face authentication attempts are not satisfied (step S601: NO), the determination unit 130 determines that the subject 300 is not allowed to board (that is, cannot pass through the gate) (step S606).

[0128] As described above, in the determination process using body temperature information, a plurality of thresholds for body temperature may be set, and different responses may be taken according to the height of the body temperature. Note that the above-described thresholds (that is, 37 degrees and 37.5 degrees) are merely examples and can be set as appropriate. Also, three or more thresholds may be set for the body temperature.

[0129] (Display example) Next, a display example of body temperature information in the authentication system 10 according to the eighth embodiment will be described with reference to FIGS. 19 and 20. FIG. 19 is a diagram (part 1) showing a display example by the authentication system according to the eighth embodiment. FIG. 20 is a diagram (part 2) showing a display example by the authentication system according to the eighth embodiment. The display examples in FIGS. 19 and 20 are displayed, for example, on the display of the imaging display device 230 or the staff display 220.

[0130] As shown in FIG. 19, in the authentication system 10 according to the eighth embodiment, in addition to the face image of the subject 500 used for face authentication, body temperature information and information indicating whether the subject can pass through the gate may be displayed. For example, as shown in FIG. 19(a), when the body temperature of the subject 500 is normal body temperature (36.5 degrees), the text "You can board" is displayed together with the body temperature. That is, information indicating that it is possible to pass through the gate is displayed because the possibility of being infected with an infectious disease is low. Also, as shown in FIG. 19(b), when the body temperature of the subject 500 is high fever (37.8 degrees), the text "You cannot board" is displayed together with the body temperature. That is, information indicating that it is not possible to pass through the gate is displayed because the possibility of being infected with an infectious disease is high.

[0131] The display example shown in FIG. 19 may be displayed in combination with, for example, the display example described in the sixth embodiment (see FIGS. 10 and 11). That is, in addition to the body temperature information, the number of face authentication executions currently being performed, the number of successful face authentications, the determination result of whether or not the gate can be passed based on the face authentication, etc. may be displayed.

[0132] As shown in FIG. 20, in the authentication system 10 according to the eighth embodiment, when the seat is changed due to the body temperature of the subject 500 (that is, in the case of step S605 in FIG. 18), various information regarding the seat change may be displayed. For example, as shown in FIG. 20(a), information notifying that the seat has been changed may be displayed on the display of the imaging display device 230. In this case, the seat before the change, the seat after the change, the reason for the seat change, the measured body temperature, etc. may be displayed. Also, as shown in FIG. 20(b), information notifying the staff that there is a passenger whose seat has been changed may be displayed on the staff display 220. In this case, a face photo of the subject 500 whose seat has been changed and various information regarding the subject 500 (for example, name, seat before the change, seat after the change, reason for the seat change, and measured body temperature, etc.) may be displayed. Further, when there is a companion for the subject 500 whose seat has been changed, various information regarding the companion (for example, name, relationship with the subject 500 whose seat has been changed, seat before the change, seat after the change, measured body temperature, etc.) may be displayed.

[0133] (Other utilization examples) The body temperature information of the subject 500 can also be used for liveness determination (that is, biometric determination). Specifically, if the body temperature indicated by the body temperature information acquired from the subject 500 is close to the normal temperature, it can be determined that the imaged subject 500 is a living body. On the other hand, if the body temperature indicated by the body temperature information acquired from the subject 500 is low, it can be determined that the imaged subject is not a living body (for example, a photo, etc.).

[0134] The thermography used to acquire body temperature information can also be utilized to determine the distance to the subject 500. For example, if the applicable range of the thermography is set to a relatively short distance (e.g., 1 m), the subject 500 approaching the gate can be detected. More specifically, when there are multiple people within the imaging range, it is possible to determine which person is the subject 500 for whom the gate passage permission needs to be determined. If the subject 500 can be detected in this way, it can also be used to control the timing of capturing the face image of the subject 500. Note that it is also possible to determine the distance to the subject in cooperation with various devices such as not only thermography but also the analysis result of camera images and the information of proximity sensors.

[0135] In the determination process using body temperature information (see Fig. 18), in addition to the body temperature information, it is also possible to utilize the attribute information described in the seventh embodiment. For example, the threshold value for the body temperature may be changed according to the attribute information. For example, in first class or business class with a high seat rank, the distance between passengers is wider compared to economy class. Therefore, the possibility of the spread of infectious diseases among passengers is low. Thus, for passengers with a high seat rank, the threshold value of body temperature for which boarding is not permitted may be changed to a higher value.

[0136] (Technical effects) Next, the technical effects obtained by the authentication system 10 according to the eighth embodiment will be described.

[0137] As described with reference to Figs. 16 to 20, in the authentication system 10 according to the eighth embodiment, when determining whether the subject can pass through the gate, the body temperature information of the subject 500 is utilized. By doing so, it is possible to more appropriately determine whether the subject can pass through the gate compared to the case where only the number of successful face authentication times is considered.

[0138] <Supplementary Note> Regarding the embodiments described above, they can be further described as follows in the supplementary note below, but are not limited thereto.

[0139] (Supplementary Note 1) The authentication system described in Supplementary Note 1 includes an acquisition unit that acquires a face image of a subject passing through a gate, a face authentication unit that collates information obtained from the face image of the subject with information regarding the faces of a plurality of registration targets to perform face authentication as to whether the subject is a registration target, and a determination unit that determines whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed a plurality of times. The authentication system is characterized by this configuration.

[0140] (Supplementary Note 2) The authentication system described in Supplementary Note 2 is the authentication system described in Supplementary Note 1, wherein the determination unit determines that the subject can pass through the gate when at least one of the following conditions is met: the number of successful authentications is equal to or greater than a predetermined number, and the face authentication has been successful continuously for a predetermined number of times or more.

[0141] (Supplementary Note 3) The authentication system described in Supplementary Note 3 further includes a storage unit that stores a plurality of face images of the subject, and the face authentication unit selects a face image suitable for the face authentication from among the plurality of face images of the subject stored in the storage unit and performs the face authentication. The authentication system is the authentication system described in Supplementary Note 1 or 2, characterized by this configuration.

[0142] (Supplementary Note 4) The authentication system described in Supplementary Note 4 is the authentication system described in any one of Supplementary Notes 1 to 3, wherein the acquisition unit moves at least one of the position, height, and angle of a camera that images the face of the subject to acquire a plurality of face images captured from different angles.

[0143] (Supplementary Note 5) The authentication system described in Supplementary Note 5 is the authentication system described in any one of Supplementary Notes 1 to 4, wherein the face authentication unit performs face authentication using a face image of the subject captured from a first direction and face authentication using a face image of the subject captured from a second direction different from the first direction.

[0144] (Supplementary Note 6) The authentication system described in Supplementary Note 6 further includes display means for displaying at least one or more of information regarding the number of times the face authentication is executed, information regarding the number of successful face authentication times, and information regarding whether the subject can pass through the gate, and is the authentication system according to any one of Supplementary Notes 1 to 5.

[0145] (Supplementary Note 7) The authentication system described in Supplementary Note 7 further includes attribute acquisition means for acquiring information regarding the attributes of the subject, and the determination means determines whether the subject can pass through the gate based on the number of successful authentication times when the face authentication is executed multiple times and the information regarding the attributes, and is the authentication system according to any one of Supplementary Notes 1 to 6.

[0146] (Supplementary Note 8) The authentication system described in Supplementary Note 8 further includes body temperature acquisition means for acquiring information regarding the body temperature of the subject, and the determination means determines whether the subject can pass through the gate based on the number of successful authentication times when the face authentication is executed multiple times and the information regarding the body temperature, and is the authentication system according to any one of Supplementary Notes 1 to 7.

[0147] (Supplementary Note 9) The authentication device described in Supplementary Note 9 includes acquisition means for acquiring a face image of a subject passing through a gate, face authentication means for performing face authentication to check whether the subject is a registered subject by comparing information obtained from the face image of the subject with information regarding the faces of a plurality of registered subjects, and determination means for determining whether the subject can pass through the gate based on the number of successful authentication times when the face authentication is executed multiple times.

[0148] (Supplementary Note 10) The authentication method described in Supplementary Note 10 is characterized by acquiring a face image of a subject passing through a gate, collating information obtained from the face image of the subject with information on the faces of a plurality of registration targets, performing face authentication as to whether the subject is one of the registration targets, and determining whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

[0149] (Supplementary Note 11) The computer program described in Supplementary Note 11 is a computer program characterized by causing a computer to operate so as to acquire a face image of a subject passing through a gate, collate information obtained from the face image of the subject with information on the faces of a plurality of registration targets, perform face authentication as to whether the subject is one of the registration targets, and determine whether the subject can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times.

[0150] (Supplementary Note 12) The recording medium described in Supplementary Note 12 is a recording medium characterized by having recorded thereon the computer program described in Supplementary Note 11.

[0151] This disclosure can be appropriately modified within a range not contrary to the gist or idea of the invention that can be read from the claims and the entire specification, and an authentication system, authentication device, authentication method, and computer program involving such modifications are also included in the technical idea of this disclosure.

Explanation of Reference Numerals

[0152] 10 Authentication system 11 Processor 110 Face image acquisition unit 120 Face authentication unit 130 Determination unit 140 Face image storage unit 150 Attribute acquisition unit 160 Body temperature acquisition unit 200 Gate device 210 Reading unit 220 Display for staff 230 Imaging display device 240 Opening / closing bar 500 Subject

Claims

1. Reading means for reading either the passport or ticket held by the object passing through the gate; Attribute information acquisition means for acquiring, as attribute information, one or more pieces of boarding-related information selected from the boarding gate number, flight name to board, seat to board, and status rank of the airline to board, which are associated with the passport or ticket read by the reading means; Acquisition means for acquiring a face image of the object passing through the gate; Accumulation means for accumulating the face image of the object over a period corresponding to the interval at which face authentication is performed; Face authentication means for selecting, from the plurality of face images of the object accumulated by the accumulation means, those suitable for face authentication, and collating the information obtained from the selected face image of the object with the information on each face of a plurality of registration targets to perform face authentication as to whether the object is any one of the plurality of registration targets; Determination means for determining whether the object can pass through the gate based on the number of successful authentications when the face authentication is performed multiple times and a threshold value set based on the attribute information acquired by the attribute information acquisition means; An authentication system, characterized by comprising the above.

2. The determination means determines that the object can pass through the gate when at least one of the cases where the number of successful authentications is equal to or more than a predetermined number and the case where the face authentication is successful continuously for a predetermined number of times or more. The authentication system according to claim 1.

3. The acquisition means moves at least one of the position, height, and angle of the camera that images the face of the object to acquire a plurality of face images captured from different angles. The authentication system according to any one of claims 1 or 2.

4. The face authentication means performs face authentication using the face image of the object captured from a first direction and face authentication using the face image of the object captured from a second direction different from the first direction. The authentication system according to any one of claims 1 to 3.

5. The authentication system according to any one of claims 1 to 4, further comprising display means for displaying at least one of the information regarding the number of times the face authentication is performed, the information regarding the number of successful face authentications, and the information regarding whether the object can pass through the gate.

6. The authentication system further comprises body temperature acquisition means for acquiring information regarding the body temperature of the object. The determination means determines whether the target can pass through the gate based on the number of successful authentication times when the face authentication is performed multiple times, a threshold value set based on the attribute information acquired by the attribute information acquisition means, the information regarding the body temperature, and a temperature set based on the attribute information acquired by the attribute information acquisition means. The authentication system according to any one of claims 1 to 5, characterized in that.

7. By at least one computer, Reads either the passport or ticket possessed by the target passing through the gate, Acquires, as attribute information, one or more pieces of boarding-related information selected from the boarding gate number, flight name to board, seat to board, and status rank of the airline to board associated with the passport or ticket read by the reading means, Acquires a face image of the target passing through the gate, Accumulates the face image of the target over a period corresponding to the interval at which face authentication is performed, Selects a face image suitable for face authentication from the accumulated multiple face images of the target, collates the information obtained from the selected face image of the target with the information regarding each face of a plurality of registered targets, and performs face authentication as to whether the target is any one of the plurality of registered targets, Determines whether the target can pass through the gate based on the number of successful authentication times when the face authentication is performed multiple times and a threshold value set based on the acquired attribute information. An authentication method characterized by that.

8. Reads either the passport or ticket possessed by the target passing through the gate, Acquires, as attribute information, one or more pieces of boarding-related information selected from the boarding gate number, flight name to board, seat to board, and status rank of the airline to board associated with the passport or ticket read by the reading means, Acquires a face image of the target passing through the gate, Accumulates the face image of the target over a period corresponding to the interval at which face authentication is performed, Selects a face image suitable for face authentication from the accumulated multiple face images of the target, collates the information obtained from the selected face image of the target with the information regarding each face of a plurality of registered targets, and performs face authentication as to whether the target is any one of the plurality of registered targets, Determines whether the target can pass through the gate based on the number of successful authentication times when the face authentication is performed multiple times and a threshold value set based on the acquired attribute information. A computer program characterized by operating a computer as described.

Images