A program that controls the mobile device used in conjunction with the authentication device.

By linking mobile device registration information with facial images and using beacon information to prioritize matching results, the system addresses misauthentication issues in large-scale face authentication systems, improving accuracy and reliability.

JP2026099913APending Publication Date: 2026-06-18PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
Filing Date
2026-04-03
Publication Date
2026-06-18

AI Technical Summary

Technical Problem

In large-scale face authentication systems, the increasing number of registered users with similar face features leads to a risk of misauthentication, limiting the accuracy of existing face-based authentication methods.

Method used

A system that links registration information from a mobile terminal with registered facial images, using a mobile device's beacon information to prioritize matching results, and performs a subtraction process on authentication thresholds to enhance accuracy by favoring matches linked to registration information over those not linked.

Benefits of technology

Improves authentication accuracy by preferentially treating matching results linked to registration information, reducing misidentification and enhancing the reliability of face authentication systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026099913000001_ABST
    Figure 2026099913000001_ABST
Patent Text Reader

Abstract

This technology provides authentication that allows users to enjoy the benefits of gate devices that support facial recognition while also improving authentication accuracy. [Solution] In a system comprising at least a mobile terminal, a gate device, a beacon device, and an authentication device, the program controlling the mobile terminal in the system causes the mobile terminal's computer to execute a process that, when receiving beacon information, determines whether the beacon information originated from the beacon device, and based on the determination result, controls the computer to transmit the registration information to the authentication device. The computer processes registration information that indicates the user of the mobile terminal, transmitted from the mobile terminal, to link it with one of a plurality of face registration images, and then processes the authentication process that authenticates the entrant based on the comparison result between each of the plurality of face registration images and the face image information of the person entering the gate device, and the score, which is a value indicating the probability that the person corresponding to each of the face registration images and the entrant are the same person, and the authentication threshold.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a program for controlling a mobile terminal used with an authentication device.

Background Art

[0002] A technique for managing the entry and exit of people passing through gate devices installed at stations, airports, etc. by face authentication is known. For example, Patent Document 1 discloses a gate device capable of performing face authentication of an entrant based on a face feature amount registered corresponding to an identifier transmitted from a wireless tag possessed by the entrant entering the gate device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, when an authentication system including a gate device corresponding to face authentication in the future is deployed at a station or the like with a large number of users, the number of registered users of the authentication system may become extremely large. As the number of registered users increases, the number of registered users with similar face features also increases, so there is a risk of misauthentication in the face authentication of entrants to the gate device.

[0005] In a gate device corresponding to face authentication, it is an advantage that an entrant can pass without using a special device for authentication processing. However, as described above, when authentication is performed only based on face features, there is a certain limit to the authentication accuracy. Therefore, there is a need for a device, method, system, and program that can further improve the authentication accuracy while enjoying the advantage.

[0006] An object of the present disclosure is to provide an authentication device, authentication method, authentication system, and program capable of enhancing the authentication accuracy while enjoying the advantage of a gate device corresponding to face authentication. [Means for solving the problem]

[0007] The authentication device related to this disclosure is A processing unit that, when a mobile terminal is located near a gate device, performs a process of linking registration information indicating the user of the mobile terminal with one of several registered facial images. In an authentication process that authenticates an entrant based on a comparison result between a score, which is a value indicating the probability that the person corresponding to each of the multiple registered facial images and the entrant are the same person, and an authentication threshold, corresponding to the matching result between each of the multiple registered facial images and the facial image information of the entrant to the gate device, By performing a predetermined subtraction process on the authentication threshold, which is compared with a score corresponding to the matching result between the face registration image linked to the registration information and the face image information of the intruder, the matching result between the face registration image linked to the registration information and the face image information of the intruder is given preferential treatment over the matching result between the face registration image not linked to the registration information and the face image information of the intruder. An authentication unit that authenticates whether the person corresponding to the face registration image used to obtain the matching result with the highest difference between the score and the authentication threshold is the same person as the intruder, among the matching results that are favored because the face registration image is linked to the registration information and the matching results that are not favored because the face registration image is not linked to the registration information, It is equipped with.

[0008] The authentication method related to this disclosure is: When a mobile device is located near the gate device, the system performs a process to link registration information indicating the user of the mobile device with one of several registered facial images. In an authentication process that authenticates an entrant, based on the results of comparing each of the multiple registered facial images with the facial image information of the entrant to the gate device, and based on the results of comparing a score, which is a value indicating the probability that the person corresponding to each of the registered facial images and the entrant are the same person, with an authentication threshold, By performing a predetermined subtraction process on the authentication threshold, which is compared with a score corresponding to the matching result between the face registration image linked to the registration information and the face image information of the intruder, the matching result between the face registration image linked to the registration information and the face image information of the intruder is given preferential treatment over the matching result between the face registration image not linked to the registration information and the face image information of the intruder. The system authenticates whether the person corresponding to the face registration image used to obtain the matching result with the highest difference between the score and the authentication threshold is the same person as the intruder, considering both the favored matching result due to the face registration image being linked to the registration information and the unfavored matching result due to the face registration image not being linked to the registration information.

[0009] The authentication system related to this disclosure is A gate device that allows entrants to enter, An imaging device is provided in correspondence with the gate device and captures facial image information of the person entering, A beacon device provided in correspondence with the aforementioned gate device, which transmits beacon information to a mobile terminal, Upon receiving the beacon information, the mobile terminal links the registration information indicating the user of the mobile terminal with one of the multiple registered facial images. In an authentication process that authenticates an entrant based on a comparison result between a score, which is a value indicating the probability that the person corresponding to each of the multiple registered facial images and the entrant are the same person, and an authentication threshold, corresponding to the matching result between each of the multiple registered facial images and the facial image information of the entrant to the gate device, By performing a predetermined subtraction process on the authentication threshold, which is compared with a score corresponding to the matching result between the face registration image linked to the registration information and the face image information of the intruder, the matching result between the face registration image linked to the registration information and the face image information of the intruder is given preferential treatment over the matching result between the face registration image not linked to the registration information and the face image information of the intruder. An authentication device that authenticates whether the person corresponding to the face registration image used to obtain the matching result with the highest difference between the score and the authentication threshold is the same person as the intruder, among the matching results that are favored because the face registration image is linked to the registration information and the matching results that are not favored because the face registration image is not linked to the registration information, It is equipped with.

[0010] The program related to this disclosure is A program for controlling a mobile terminal used in conjunction with an authentication device, The authentication device is, The process involves linking registration information indicating the user of the mobile device, which is transmitted from the mobile device, with one of several registered facial images. In an authentication process that authenticates an entrant, based on the results of comparing each of the aforementioned multiple face registration images with the face image information of the entrant, and based on the results of comparing a score, which is a value indicating the probability that the person corresponding to each of the face registration images and the entrant are the same person, with an authentication threshold, By performing a predetermined subtraction process on the authentication threshold, which is compared with a score corresponding to the matching result between the face registration image linked to the registration information and the face image information of the intruder, the matching result between the face registration image linked to the registration information and the face image information of the intruder is given preferential treatment over the matching result between the face registration image not linked to the registration information and the face image information of the intruder. The system authenticates whether the person corresponding to the face registration image used to obtain the matching result with the highest difference between the score and the authentication threshold is the same person as the intruder, considering both the preferential matching result where the face registration image is linked to the registration information and the unpreferential matching result where the face registration image is not linked to the registration information. The program causes the mobile terminal's computer to execute a process that controls the transmission of the beacon information and the registration information when it receives beacon information. [Effects of the Invention]

[0011] According to the present disclosure, while enjoying the advantages of a gate device corresponding to face authentication, the authentication accuracy can be improved.

Brief Description of Drawings

[0012] [Figure 1] It is a diagram showing a configuration example of an authentication system according to the present disclosure. [Figure 2] It is a diagram showing an example of association between a face registration image and beacon catch information in a user management server. [Figure 3] It is a diagram showing the processed scores of each of a plurality of authentication candidates. [Figure 4] It is a flowchart showing an operation example of authentication control in an authentication device. [Figure 5] It is a flowchart showing an operation example of registration control of beacon catch information in an authentication device. [Figure 6] It is a flowchart showing an operation example of transmission control of beacon catch information in a mobile terminal. [Figure 7] It is a diagram showing the processed scores of each of a plurality of authentication candidates in an authentication device according to a modification example. [Figure 8] It is a flowchart showing an operation example of authentication control in an authentication device according to a modification example. [Figure 9] It is a diagram showing the arrangement relationship of beacon devices in a configuration having a plurality of beacon devices. [Figure 10] It is a diagram showing the arrangement relationship of beacon devices in a configuration having a plurality of beacon devices.

Embodiments for Carrying Out the Invention

[0013] (Embodiment) Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. FIG. 1 is a diagram showing a configuration example of an authentication system according to the present disclosure.

[0014] As shown in Figure 1, the authentication system 1 according to this embodiment is a system that controls gate devices (entrance gates, ticket gates, etc.) installed at the entrances and exits of facilities such as airports, train stations, and event venues.

[0015] In the authentication system 1 according to this embodiment, the management of entry and exit of users using the facility is performed by facial recognition. For example, when an intruder enters a gate device and passes through the gate device to enter the facility, facial recognition determines whether or not the intruder is a person authorized to enter the facility. Similarly, when an intruder passes through the gate device to exit the facility, facial recognition determines whether or not the intruder is a person authorized to exit the facility. It should be noted that "facial recognition" can be understood as a concept included in "matching using facial images."

[0016] The authentication system 1 comprises a gate device 10, an imaging device 20, a beacon device 30, a user management server 40, a passage history management server 50, and an authentication device 100.

[0017] The gate device 10 is an automatic ticket gate installed in facilities such as train stations, and is configured to allow people to enter. The gate device 10 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and input / output circuits (not shown).

[0018] The gate device 10 includes a facial recognition control unit, a ticket gate control unit, and a gate opening and closing function unit, and controls the entry of persons who are permitted to enter and exit the facility, and prevents the entry of persons who are not permitted to enter and exit the facility.

[0019] The imaging device 20 is a camera that captures facial images of people entering the gate device 10, and is installed in conjunction with the gate device 10. In the gate device 10, the facial recognition control unit transmits the facial image information captured by the imaging device 20 to the authentication device 100 to request verification of the entrant's facial image. The facial recognition control unit then obtains the facial image verification result from the authentication device 100, and based on the verification result, the ticket gate control unit controls the gate opening and closing function unit to control the opening and closing of the gate.

[0020] The beacon device 30 is a device that transmits beacon information and is installed in conjunction with the gate device 10. The beacon information is a signal that, when received by a receiving device, allows the detection of an identification number, etc., assigned to the beacon device 30 that transmitted the beacon information. The beacon information transmitted by the beacon device 30 is received by a mobile terminal 2 carried by a person entering the gate device 10. In this embodiment, the beacon device 30 transmits beacon information using Bluetooth®. However, the beacon device 30 may transmit beacon information using other wireless communication methods. Furthermore, if the receiving device is always exposed, the beacon device 30 may transmit beacon information using light such as infrared light instead of radio waves.

[0021] Furthermore, the beacon device 30 may be powered by the gate device 10. This eliminates the need to consider operating time limitations, as is the case with battery-powered beacon devices, allowing for flexible settings of the beacon information transmission cycle and other parameters.

[0022] Mobile terminal 2 is, for example, a portable device such as a smartphone carried by an intruder, and is equipped with a CPU, ROM, RAM, and input / output circuits (not shown). Mobile terminal 2 has a dedicated application installed that corresponds to authentication system 1 and is configured to receive beacon information transmitted by beacon device 30. When mobile terminal 2 receives beacon information, beacon catch information is transmitted to authentication device 100.

[0023] The beacon catch information is information indicating that the mobile terminal 2 has received beacon information, and includes the time the mobile terminal 2 received the beacon information, the registration information of the intruder, the beacon information of the beacon device 30, etc. The beacon catch information may be transmitted from the beacon device 30 to the authentication device 100, or from the mobile terminal 2 to the authentication device 100. In this embodiment, it is assumed that the information is transmitted from the mobile terminal 2 to the authentication device 100.

[0024] The intruder's registration information is, for example, the intruder's registration number registered in the dedicated application of authentication system 1. However, the registration information may be other numbers, strings, etc., as long as it can identify the intruder. Furthermore, information that indirectly identifies the individual intruder, such as the application's identification number or the mobile device 2's identification number, may also be used as registration information.

[0025] The user management server 40 is a server that manages the identification information of registered users registered with the authentication system 1. The user management server 40 has pre-registered facial images of registered users. The registered facial images (hereinafter referred to as "registered facial images") are stored in the user management server 40, linked to the identification information that identifies the person in the registered facial image (see, for example, Figure 2).

[0026] This identification information is identical to, or can be considered identical to, the registration information registered by the intruder (registrant) in the dedicated application installed on the mobile terminal 2, and is, for example, a number composed of a random combination of multiple alphanumeric characters.

[0027] The passage history management server 50 is a server that records information indicating the history of entrants passing through the gate device 10 after authentication by the authentication device 100. The history information recorded in the passage history management server 50 includes information such as the time of entry into the gate device 10 and the time of exit from the gate device 10.

[0028] The authentication device 100 is, for example, a server located at a different location from the gate device 10, and includes a CPU, ROM, RAM, and input / output circuits (not shown). The authentication device 100 is configured to control the authentication of entrants based on a pre-set program. The authentication device 100 includes a receiving unit 110, a processing unit 120, and an authentication unit 130.

[0029] The receiving unit 110 receives beacon capture information transmitted from the mobile terminal 2. The authentication device 100 converts the beacon information based on the beacon capture information received by the receiving unit 110 into location information of the gate device 10 associated with that beacon information.

[0030] The processing unit 120 performs a process to link the registration information of the intruder registered in the mobile terminal 2 with one of the multiple face registration images. Specifically, when the processing unit 120 obtains registration information from the mobile terminal 2, it refers to the user management server 40 and compares the registration information with the identification information of the registrant linked to the multiple face registration images in the user management server 40.

[0031] If a registered user matching the intruder exists, the processing unit 120 performs a process to link the registration information with the face registration image related to the identification information. Specifically, the processing unit 120 links the registered user's identification information with the beacon capture information related to the registration information that matches the identification information and registers it with the user management server 40.

[0032] For example, in the example shown in Figure 2, the user management server 40 has a table that links identification information with registered face images, and a column for beacon catch information is provided. In the beacon catch information column of the identification information linked to the beacon catch information, for example, the information contained in the beacon catch information is entered. In the beacon catch information column of identification information not linked to the beacon catch information, no information is entered.

[0033] Furthermore, as long as it is recognizable that beacon capture information is associated with the face registration image in the user management server 40, the format in which the beacon capture information is associated is not important. In addition, the beacon capture information associated with the face registration image may be registered in the user management server 40 in a way that allows recognition of the transmission time and / or reception time of the beacon capture information, as well as the location information of the gate device 10 corresponding to the beacon device 30 that transmitted the beacon information. In addition, the beacon capture information may include the reception time of the beacon information on the mobile terminal 2.

[0034] The authentication unit 130 authenticates the entrant from among multiple registered face images based on the entrant's face image information. Specifically, when the authentication unit 130 receives a face image matching request from the gate device 10, it obtains the entrant's face image information from the imaging device 20.

[0035] The authentication unit 130 refers to the user management server 40 and compares multiple face registration images in the user management server 40 with face image information to calculate multiple scores for each of the multiple face registration images. These scores are values ​​that indicate the matching result, and in this embodiment, the better the matching result (i.e., the higher the probability that they are the same person), the higher the score. A known method is used for calculating the score of the face registration image.

[0036] The authentication unit 130 then extracts authentication candidates according to the multiple scores calculated. More specifically, the authentication unit 130 excludes face registration images whose scores are below the authentication threshold from the authentication candidates, and selects face registration images whose scores are equal to or greater than the authentication threshold as authentication candidates. In this embodiment, as will be described later, scores may be added based on beacon capture information linked to the mobile terminal 2, so even if an authentication candidate has a very low score, the score may be added and the intruder may be authenticated as a person authorized to enter the facility. However, if the score is extremely low, there is a high possibility that it is someone else who is carrying the mobile terminal 2 for some reason, and if such a person is authenticated as the real person by adding the score, a misauthentication will occur. Therefore, in this embodiment, the occurrence of such misauthentication is suppressed by excluding face registration images with clearly low scores from the authentication candidates in advance. Note that the same effect can be obtained by not excluding face registration images with low scores from the authentication candidates, but by excluding them from the score addition process.

[0037] The authentication threshold is a score that indicates a level of similarity between the facial image information and the registered facial image, and can be set as appropriate.

[0038] If there are no registered face images with a score equal to or greater than the authentication threshold, the authentication unit 130 authenticates the intruder as an unregistered person not registered in the authentication system 1. If there is one registered face image with a score equal to or greater than the authentication threshold, the authentication unit 130 authenticates the intruder as a registered person associated with that registered face image.

[0039] If there are multiple face registration images whose scores are equal to or greater than the authentication threshold, the authentication unit 130 checks whether there is a registered face image among the multiple face registration images that is linked to beacon capture information whose time information included in the beacon capture information is up to a certain time before the current time.

[0040] The authentication unit 130 then performs a predetermined addition process to the score of the registered face image if such a face image exists. In other words, in the authentication process for authenticating an intruder, the authentication unit 130 gives preferential treatment to the result of matching the registered face image linked to the registration information with the intruder's face image information, compared to the result of matching the registered face image not linked to the registration information with the intruder's face image information. Any time information included in the beacon catch information may be used as the time information used in this process. For example, this could be the time the beacon information was received by the mobile terminal 2, the time the beacon catch information was transmitted from the mobile terminal 2, or the time the user management server 40 received the beacon catch information. In this embodiment, as an example, the information of the time the beacon information was received by the mobile terminal 2 is used. As an example of a certain period of time, it is set based on the standard travel time from the beacon device 30 corresponding to the beacon information to the authentication device 100. This is because it is unlikely that the person currently seeking authentication corresponds to extremely old beacon information. However, if the distance from the beacon device 30 to the authentication device 100 is long, or if there are other facilities present, the time limit may be set to be longer, as the person may get lost or stop at other facilities.

[0041] Furthermore, if the location information of the gate device 10, converted using the beacon information included in the beacon capture information linked to the face registration image, matches the location information of the gate device 10 that requested face image matching, the score of the face registration image will be added.

[0042] The authentication unit 130 authenticates the intruder as a registrant associated with the face registration image corresponding to the highest score among multiple scores, including scores that have undergone summation processing.

[0043] For example, as shown in Figure 3, suppose authentication candidate A1 with a score of 659, authentication candidate A2 with a score of 630, and authentication candidate A3 with a score of 627 have been extracted. In this case, if the identification information of the face registration image of authentication candidate A2 is linked to the beacon capture information, the authentication unit 130 adds, for example, 100 as an additional score to the score of authentication candidate A2, which is 630.

[0044] As a result, the post-processing score for authentication candidate A2 becomes 730, making authentication candidate A2 the highest score among the multiple authentication candidates. Consequently, the authentication unit 130 authenticates the intruder as a registrant associated with authentication candidate A2.

[0045] The authentication unit 130 transmits the authentication result to the gate device 10 when it authenticates an entrant as either a registered or unregistered person. When the gate device 10 receives the authentication result from the authentication unit 130, it controls the opening and closing of the gate according to the authentication result.

[0046] Specifically, the gate device 10 controls the gate to close if the authentication result indicates that the entrant is not registered. The gate device 10 also controls the gate to open if the authentication result indicates that the entrant is registered.

[0047] By doing so, the presence or absence of beacon capture information can be taken into consideration when authenticating intruders, thereby improving the authentication accuracy of authentication system 1.

[0048] Now, let's assume that beacon capture information is linked to at least two of the multiple authentication candidates. Specifically, for example, suppose two intruders with similar facial features (e.g., twins) attempt to enter the gate device 10 side by side in the direction of travel, and the mobile terminals 2 of both intruders receive beacon information from the beacon device 30.

[0049] In this case, the authentication unit 130 may extract authentication candidates according to the time of reception of the beacon information. Specifically, the authentication unit 130 extracts the one with the earlier beacon information reception time from among several authentication candidates as the authentication candidate. This is because it determines that of the two intruders, the one with the earlier reception time will reach the gate device 10 first.

[0050] This makes it easier to extract authentication candidates, for example, when multiple intruders with similar faces enter the gate device 10 at the same time. In other words, by considering the reception time of the beacon capture information, it becomes easier to estimate which authentication candidate arrived at the gate device 10 first, even if the beacon capture information is linked to at least two of the multiple authentication candidates. Therefore, by determining that the authentication candidate who arrived at the gate device 10 first is likely to pass through the gate device 10, it becomes easier to estimate that authentication candidate as the intruder and, consequently, to authenticate the intruder.

[0051] Furthermore, the authentication unit 130 may extract authentication candidates according to the electric field strength of the beacon information. Specifically, the authentication unit 130 extracts the beacon information with the stronger electric field strength related to the beacon capture information from among multiple authentication candidates as the authentication candidate. This is because it is determined that of the two intruders, the one with the stronger electric field strength of the beacon information is located closer to the gate device 10.

[0052] The electric field strength information from the beacon may be included in the beacon capture information. Alternatively, the electric field strength information may be identified by receiving it, for example, on a mobile terminal 2.

[0053] This makes it easier to extract authentication candidates, for example, when multiple intruders with similar faces enter the gate device 10 at the same time. In other words, by considering the electric field strength of the beacon information, it becomes easier to estimate which authentication candidate arrived at the gate device 10 first, even if beacon capture information is associated with at least two of the multiple authentication candidates. Therefore, by determining that the authentication candidate who arrived at the gate device 10 first is likely to pass through the gate device 10, it becomes easier to estimate that authentication candidate as an intruder and, consequently, to authenticate the intruder.

[0054] Furthermore, for example, even if several entrants (pedestrians) with similar faces approach the gate device 10, and some of the pedestrians do not enter the gate device 10, the pedestrians who do not enter the gate device 10 can be excluded from the authentication candidates by considering the change in the electric field strength of the beacon information. In other words, by considering the electric field strength of the beacon information, the accuracy of extracting authentication candidates can be improved, and consequently, authentication of entrants can be made easier.

[0055] Furthermore, the authentication unit 130 may determine which person reaches the gate device 10 first based on the acceleration sensor information of the mobile terminal 2.

[0056] The acceleration sensor information of the mobile device 2 is, for example, information on the movement vector obtained by the acceleration sensor built into the mobile device 2, and it is preferable to include this in the beacon capture information.

[0057] By doing this, even if two beacon capture signals are received at approximately the same time, it is estimated that the authentication candidate with the faster movement speed will arrive at the gate device 10 first, thereby making it easier to authenticate the intruder.

[0058] Furthermore, the authentication unit 130 may extract authentication candidates based on the number of times the gate device 10 has been used, and determine a face registration image that will be given preferential treatment in the authentication process. Specifically, the authentication unit 130 records and stores the number of times beacon catch information has been received for each gate device 10 each time it is received. The number of receptions may be recorded by the authentication unit or by a recording unit other than the authentication unit. If no beacon catch information is associated with any of the multiple authentication candidates, the authentication unit 130 authenticates the entrant using the face registration image of the authentication candidate with the highest number of receptions of beacon catch information corresponding to the same gate device that the entrant is trying to enter. The authentication unit may also perform the same process using the number of receptions of beacon catch information corresponding to gate devices installed in the same location as the gate device that the entrant is trying to enter. This is because, in facilities such as stations where multiple gate devices are installed in the same location, it is unlikely that the same gate device will be used every time. Furthermore, the authentication unit 130 may extract authentication candidates according to the frequency of use of the gate device 10 by performing the above process based on the number of receptions within a certain period of time.

[0059] This makes authentication easier even if the intruder forgets to bring their mobile device 2 or if the mobile device 2 is turned off. In the above example, the facial registration image of the authentication candidate with the most beacon capture information receptions is extracted, but it is also possible to extract facial registration images of multiple authentication candidates based on the number of receptions or reception frequency. For example, it is conceivable to extract facial registration images whose reception number or frequency is above a predetermined threshold, or to extract facial registration images whose reception number or reception frequency ranks from the highest to the lowest rank.

[0060] Furthermore, if the intruder is carrying a properly functioning mobile device 2, processing may be performed using the number or frequency of beacon capture information receptions. For example, the score could be increased if the number of past beacon capture information receptions is high or the reception frequency is high, or a negative score could be added if the number of receptions is low or the reception frequency is low.

[0061] Furthermore, the processing unit 120 may also perform a process to delete the beacon capture information (registration information) associated with the face registration image from the user management server 40 after the intruder has passed through the gate device 10.

[0062] This method prevents beacon capture information from remaining linked to the registered facial image after the intruder's authentication is complete.

[0063] An example of the operation of authentication control in the authentication system 1 configured as described above will now be explained. First, an example of the operation of authentication control in the authentication device 100 will be explained. Figure 4 is a flowchart of an example of the operation of authentication control in the authentication device 100. The process in Figure 4 is executed as appropriate, for example, while the gate device 10 is in operation.

[0064] As shown in Figure 4, the authentication device 100 determines whether or not a facial image matching request has been made (step S101). If the determination is that there is no facial image matching request (step S101, NO), the process in step S101 is repeated. On the other hand, if there is a facial image matching request (step S101, YES), the authentication device 100 acquires facial image information (step S102).

[0065] Next, the authentication device 100 compares the acquired facial image information with the registered facial image and determines whether or not there are any authentication candidates (step S103). If the determination is that there are no authentication candidates (step S103, NO), the authentication device 100 authenticates the intruder as an unregistered person (step S104). On the other hand, if there are authentication candidates (step S103, YES), the authentication device 100 determines whether or not there are multiple authentication candidates (step S105).

[0066] If the determination results in only one authentication candidate (step S105, NO), the process proceeds to step S108. On the other hand, if there are multiple authentication candidates (step S105, YES), the authentication device 100 determines whether or not there is an authentication candidate among the multiple authentication candidates that is associated with beacon capture information (step S106).

[0067] If the determination results in no authentication candidate associated with beacon capture information (step S106, NO), the process proceeds to step S108. On the other hand, if there is an authentication candidate associated with beacon capture information (step S106, YES), the authentication device 100 performs an addition process to the score of that authentication candidate (step S107).

[0068] The authentication device 100 then authenticates the intruder with the authentication candidate that has the highest score (step S108). After step S104 or step S108, this control ends.

[0069] Next, an example of the operation of the registration control of beacon capture information in the authentication device 100 will be described. Figure 5 is a flowchart showing an example of the operation of the registration control of beacon capture information in the authentication device 100. The process in Figure 5 is executed as appropriate, for example, while the gate device 10 is in operation.

[0070] As shown in Figure 5, the authentication device 100 determines whether or not it has received beacon capture information (step S201). If the determination is that beacon capture information has not been received (step S201, NO), the process in step S201 is repeated. On the other hand, if beacon capture information has been received (step S201, YES), the authentication device 100 determines whether or not there is identification information that matches the registration information based on the beacon capture information (step S202).

[0071] If the determination result shows no identification information matching the registered information (step S202, NO), this control terminates. On the other hand, if there is identification information matching the registered information (step S202, YES), the authentication device 100 converts the beacon information based on the beacon capture information into location information of the gate device 10 (step S203), and registers the beacon capture information linked to the face registration image (step S204). After step S204, this control terminates.

[0072] Finally, we will explain the control of beacon capture information transmission in the mobile terminal 2. Figure 6 is a flowchart showing an example of the operation of the beacon capture information transmission control in the mobile terminal 2. The process in Figure 6 is executed as appropriate, for example, while the mobile terminal 2 is powered on.

[0073] As shown in Figure 6, the mobile terminal 2 determines whether or not it has received beacon information (step S301). If the determination is that it has not received beacon information (step S301, NO), the process proceeds to step S305. On the other hand, if it has received beacon information (step S301, YES), the mobile terminal 2 determines whether or not the beacon information belongs to the system of this embodiment (this system) (step S302).

[0074] If the determination shows that the beacon information does not belong to the system of this embodiment (step S302, NO), the process proceeds to step S305. This is because the facility may also contain beacons intended for systems other than the system of this embodiment, and such beacons are ignored. On the other hand, if the beacon information does belong to the system of this embodiment (step S302, YES), the mobile terminal 2 transmits beacon capture information (step S303).

[0075] Next, the mobile terminal 2 determines whether a predetermined time has elapsed (step S304). If the determination is that the predetermined time has not elapsed (step S304, NO), the process in step S304 is repeated. On the other hand, if the predetermined time has elapsed (step S304, YES), the mobile terminal 2 determines whether there is a power-off command (step S305).

[0076] The predetermined time is set appropriately, taking into consideration the timing of beacon capture information transmission. By setting this predetermined time, it is possible to suppress the frequent transmission of beacon capture information, and consequently reduce the power consumption of the mobile terminal 2.

[0077] If the determination shows no power-off command (step S305, NO), the process returns to step S301. On the other hand, if there is a power-off command (step S305, YES), this control terminates.

[0078] According to this embodiment configured as described above, when authenticating an intruder, it is possible to consider whether or not beacon capture information has been acquired. For example, if there are multiple face registration images with very similar facial features, when an intruder corresponding to one of those face registration images enters the gate device 10, the authentication device 100 acquires beacon capture information transmitted from the mobile terminal 2 when the intruder's mobile terminal 2 receives beacon information transmitted from the beacon device 30.

[0079] This allows the registration information of the intruder in the beacon capture information to be compared with the identification information in the facial registration image, and the identification information in the facial registration image is linked to the registration information. As a result, it becomes easier to authenticate the intruder as the registrant of the facial registration image linked to the beacon capture information, and consequently, the authentication accuracy of authentication system 1 can be improved.

[0080] Furthermore, by using a smartphone or the like as the entrant's mobile terminal 2, the entrant can pass through the gate device 10 without possessing any special device compatible with the authentication system 1. In other words, in this embodiment, it is possible to enjoy the benefits of a gate device 10 that supports facial recognition while improving authentication accuracy.

[0081] Incidentally, in a configuration that does not use beacon capture information, suppose the first of two entrants with similar facial features enters through gate device 10. In this case, an entry record for the first entrant is recorded in the passage history management server 50. Then, before the first entrant exits through gate device 10, if the second entrant, also with similar facial features, attempts to enter through gate device 10, and the second entrant is mistakenly authenticated as the first entrant, a problem may arise where the second entrant is unable to enter gate device 10.

[0082] In contrast, in this embodiment, by considering beacon capture information, the first and second entrants can be accurately authenticated, thus suppressing the occurrence of the above-mentioned problems. For example, when a second entrant carrying a mobile terminal 2 attempts to enter the gate device 10, the authentication score of the correct face registration image is added considering the beacon capture information, thereby reducing the possibility of misidentification as the same person as the first entrant.

[0083] Furthermore, if the facial features of the first and second entrants are similar, there is a possibility that the first entrant may be misidentified as the second entrant. However, by using the beacon capture information of the first entrant, the possibility of the first authenticated person being mistakenly identified as the second entrant can be reduced. This also makes it less likely that the problem of the second authenticated person being unable to enter the gate device 10 as a result of the first entrant being misidentified as the second entrant can occur.

[0084] In the above embodiment, the score was added based on whether or not the beacon capture information was linked to the face registration image, but this disclosure is not limited to this. For example, the entrant may be authenticated based on the information of the passage history to the gate device 10.

[0085] For example, suppose there are multiple authentication candidates, and beacon capture information has been linked to the facial registration images of multiple authentication candidates within a certain time period, and an intruder attempts to enter through the gate device 10.

[0086] In this case, the authentication unit 130, for example, refers to the passage history management server 50, excludes authentication candidates who have already passed through the gate device 10, and performs authentication processing for authentication candidates who have not passed through the gate device 10. If all of the multiple authentication candidates have passed through the gate device 10, they may be treated as multiple entries, or the authentication process may be performed as usual.

[0087] Furthermore, suppose there are multiple authentication candidates, and beacon capture information has been linked to the facial registration images of multiple authentication candidates within a certain time period, and an intruder attempts to exit through the gate device 10.

[0088] In this case, the authentication unit 130 refers to the passage history management server 50, excludes authentication candidates who do not have an entry history to the gate device 10, and performs authentication processing for authentication candidates who do have an entry history to the gate device 10. If all of the multiple authentication candidates do not have an entry history to the gate device 10, they may be treated as being denied exit, or the authentication process may be performed as usual.

[0089] With this configuration, the authentication process can be simplified by using information on the entry history of visitors. Furthermore, by making decisions based on the entry history of visitors, for example, if there are multiple visitors with very similar scores on both the entry and exit sides of the gate device 10, they can be easily distinguished based on the difference between entry and exit. As a result, the accuracy of authentication in the authentication system 1 can be improved.

[0090] Furthermore, in the above embodiment, when there are multiple authentication candidates, the processing result of the processing unit 120 is always used, but this disclosure is not limited thereto. For example, the authentication unit 130 may decide whether or not to use the processing result of the processing unit 120 based on the score difference of the multiple authentication candidates.

[0091] Specifically, if there are multiple face registration images whose scores are equal to or greater than the authentication threshold, the authentication unit 130 extracts a predetermined number of face registration images as authentication candidates, in descending order of their scores.

[0092] The predetermined number is, for example, 3, or any other number that can be set as appropriate. In this embodiment, the predetermined number is set to 3.

[0093] The authentication unit 130 decides whether or not to use the processing result of the processing unit 120 based on the score differences of the extracted authentication candidates. If there is an authentication candidate among the multiple authentication candidates whose score difference from the highest-scoring authentication candidate is greater than or equal to a threshold, the authentication unit 130 decides not to use the processing result of the processing unit 120. In other words, if the score difference is greater than or equal to a threshold, the authentication unit 130 performs the authentication process without giving preferential treatment to the matching result between the face registration image linked to the registration information and the face image information of the intruder.

[0094] In this case, the authentication unit 130 authenticates the intruder as a registrant associated with the face registration image of the authentication candidate with the highest score among multiple authentication candidates. The threshold is a small value such that the score difference is slight, and is set as appropriate.

[0095] The authentication unit 130 decides to use the processing result of the processing unit 120 if the score difference between the authentication candidate with the highest score among multiple authentication candidates is less than a threshold. If, among the multiple authentication candidates, the processing unit 120 has determined that there is a face registration image associated with the registration information of the intruder, the authentication unit 130 performs a predetermined addition process to the score of the authentication candidate related to that face registration image.

[0096] For example, as shown in Figure 7, suppose authentication candidate B1 with a score of 568 and authentication candidate B2 with a score of 569 have been extracted. In this case, if the identification information of the face registration image of authentication candidate B1 is linked to the beacon capture information, the authentication unit 130 adds, for example, 5 to the score of authentication candidate B1, which is 568.

[0097] As a result, authentication candidate B1's score becomes 573, which is the highest score among the multiple authentication candidates. Consequently, the authentication unit 130 authenticates the intruder as a registrant associated with authentication candidate B1.

[0098] Furthermore, if beacon capture information is associated with at least two authentication candidates among several authentication candidates with very small score differences, the authentication unit 130 may authenticate the intruder according to the registration date of the face registration image.

[0099] The older the registration date of the face registration image, the more likely it is that the registrant's facial features have changed. Therefore, by extracting face registration images with more recent registration dates as authentication candidates, it becomes easier to extract authentication candidates.

[0100] An example of the operation of authentication control in the authentication system 1 configured as described above will now be explained. First, an example of the operation of authentication control in the authentication device 100 will be explained. Figure 8 is a flowchart of an example of the operation of authentication control in the authentication device 100. The process in Figure 8 is executed as appropriate, for example, while the gate device 10 is in operation.

[0101] As shown in Figure 8, the authentication device 100 determines whether or not a facial image matching request has been made (step S401). If the determination is that there is no facial image matching request (step S401, NO), the process in step S401 is repeated. On the other hand, if there is a facial image matching request (step S401, YES), the authentication device 100 acquires facial image information (step S402).

[0102] Next, the authentication device 100 extracts three authentication candidates (step S403). Note that this flowchart assumes that there are authentication candidates with a score of 1 or higher that results in an authentication formula.

[0103] Once three authentication candidates have been selected, the authentication device 100 determines whether the difference between the first score of the authentication candidate with the highest score and the third score of the authentication candidate with the third highest score is less than a threshold (step S404). If the result of the determination is that the difference between the first score and the third score is less than a threshold (step S404, YES), the process proceeds to step S406.

[0104] On the other hand, if the difference between the first score and the third score is greater than or equal to the threshold (step S404, NO), the authentication device 100 determines whether the difference between the first score and the second score of the authentication candidate, which is the second-highest score, is less than the threshold (step S405). If the result of the determination is that the difference between the first score and the second score is greater than or equal to the threshold (step S405, NO), the process proceeds to step S408.

[0105] On the other hand, if the difference between the first score and the second score is less than the threshold (step S405, YES), the authentication device 100 determines whether or not there is an authentication candidate among the three authentication candidates that has beacon capture information associated with them (step S406).

[0106] If the determination results in no authentication candidate associated with beacon capture information (step S406, NO), the process proceeds to step S408. On the other hand, if there is an authentication candidate associated with beacon capture information (step S406, YES), the authentication device 100 performs an addition process to the score of that authentication candidate (step S407).

[0107] The authentication device 100 then authenticates the intruder with the authentication candidate that has the highest score (step S408). After that, this control is terminated.

[0108] With this configuration, the presence or absence of beacon capture information is considered only when the score difference is small, thus eliminating unnecessary processing. Furthermore, if an entrant other than the owner of mobile terminal 2 attempts to pass through gate device 10 with said mobile terminal 2, the face registration image to which the beacon capture information is linked will be that of the owner of mobile terminal 2, and will not be linked to that of the entrant. Therefore, when an entrant enters gate device 10, it is possible to suppress the addition process to the score of the face registration image related to the entrant.

[0109] Furthermore, by using a summation process linked to beacon capture information to select the most accurate face registration image for face registration images with very small score differences, the accuracy of authentication can be improved.

[0110] Furthermore, the threshold may be varied according to the score level of the extracted authentication candidates. For example, if the score level is low, the threshold range may be widened. If the score level is low, it is highly likely that the accuracy of face recognition itself is reduced due to factors such as face orientation, lighting, and the degree of face concealment. Therefore, if the score level is low, it is more likely that a correct authentication result will be obtained by making a judgment using beacon capture information in combination with face recognition rather than relying solely on face recognition with reduced accuracy. In this embodiment, if the scores are determined to be very close, a judgment using beacon capture information is made, so by widening the threshold range when the score level is low, it is possible to control the system so that a judgment using beacon capture information is more likely to occur. Note that if the score level is high and the accuracy of face recognition is sufficiently reliable, it is highly likely that an accurate judgment will be made even if the score difference between authentication candidates is small. Therefore, if an addition process using beacon capture information is performed, there is a risk that the judgment result will be incorrect, so if the score level is high, the threshold range may be narrowed to make the addition process less likely to occur.

[0111] Furthermore, in the above embodiment, one beacon device 30 was provided corresponding to one gate device 10, but this disclosure is not limited thereto. For example, multiple beacon devices 30 may be provided corresponding to one gate device 10.

[0112] For example, the gate device 10 shown in Figure 9 is equipped with four beacon devices 31, 32, 33, and 34. The gate device 10 in Figure 9 has an entrance 11 and an exit 12, and in Figure 9, the direction from the entrance 11 to the exit 12 is considered to be the direction in which an intruder enters the gate device 10.

[0113] The first beacon device 31 is located in front of the entrance 11 of the gate device 10 (upstream in the direction of entry for visitors). The first beacon device 31 is installed on the ceiling or the like within the facility where the gate device 10 is located.

[0114] The second beacon device 32 is installed at a location corresponding to the entrance 11 of the gate device 10. The third beacon device 33 is installed at a location corresponding to the exit 12 of the gate device 10. In other words, the third beacon device 33 is installed downstream of the second beacon device 32 in the gate device 10, in the direction of entry for entrants.

[0115] The fourth beacon device 34 is located further back than the exit 12 of the gate device 10 (downstream in the direction of entry for visitors). The fourth beacon device 34 is installed on the ceiling or other part of the facility where the gate device 10 is located.

[0116] With this configuration, it becomes easier to determine the direction of travel of pedestrians passing near the gate device 10, making it easier to determine whether or not a pedestrian is an intruder.

[0117] For example, the authentication unit 130 can more easily determine the direction of travel of a pedestrian based on the reception time of beacon capture information, which is based on the beacon information transmitted from each beacon device 31, 32, 33, and 34.

[0118] Specifically, when beacon information transmitted from each beacon device 31, 32, 33, and 34 is received by a passerby's mobile terminal 2 and the authentication device 100 acquires beacon catch information, the authentication device 100 records the first reception time, the second reception time, the third reception time, and the fourth reception time of the beacon catch information.

[0119] The first reception time is the time of reception of beacon catch information based on the first beacon device 31. The second reception time is the time of reception of beacon catch information based on the second beacon device 32. The third reception time is the time of reception of beacon catch information based on the third beacon device 33. The fourth reception time is the time of reception of beacon catch information based on the fourth beacon device 34.

[0120] When a passerby enters the gate device 10, for example, the authentication device 100 acquires beacon capture information in the order of the first reception time, second reception time, third reception time, and fourth reception time, so it can be estimated that the passerby is an entrant.

[0121] Furthermore, if a passerby approaches the gate device 10 but turns back without entering, the authentication device 100 will only acquire beacon capture information at the first and second reception times, allowing it to be inferred that the passerby is not an entrant.

[0122] In other words, with this configuration, if beacon capture information is associated with at least two facial registration images among multiple authentication candidates, it becomes easier to exclude authentication candidates related to facial registration images that were not estimated to be intruders. As a result, the accuracy of intruder authentication can be improved.

[0123] Furthermore, in this configuration, depending on the transmission range of the beacon information from the beacon device, multiple reception times from the first to the fourth reception times may be recorded in the authentication device 100 even if the pedestrian does not pass through the gate device 10.

[0124] Therefore, the authentication device 100 may estimate the intruder by considering the electric field strength of the beacon information transmitted from each beacon device 31, 32, 33, and 34.

[0125] For example, suppose pedestrian C passes near the first beacon device 31 in the gate device 10. In this case, the authentication device 100 records beacon capture information related to the first beacon device 31 and beacon capture information related to the second beacon device 32.

[0126] Since the first beacon device 31 is located closer to pedestrian C than the second beacon device 32, the electric field strength of the beacon information from the first beacon device 31 is greater than the electric field strength of the beacon information from the second beacon device 32. Therefore, it can be estimated that pedestrian C is located in a position before entering the gate device 10.

[0127] Furthermore, as pedestrian C approaches the entrance 11 of the gate device 10, they move away from the first beacon device 31 while moving closer to the second beacon device 32. As a result, the electric field strength of the beacon information from the second beacon device 32 becomes greater than the electric field strength of the beacon information from the first beacon device 31. Therefore, it can be estimated that pedestrian C is located closer to the gate device 10 and is approaching the gate device 10.

[0128] Furthermore, when pedestrian C enters the gate device 10, the authentication device 100 records at least the beacon capture information related to the second beacon device 32 and the beacon capture information related to the third beacon device 33.

[0129] When pedestrian C is located inside the gate device 10, pedestrian C will be located near the midpoint between the second beacon device 32 and the third beacon device 33, so the electric field strengths of each beacon will be approximate values. Therefore, it can be estimated that pedestrian C is located inside the gate device 10, and consequently, it can be easily extracted as an authentication candidate.

[0130] Furthermore, if pedestrian C approaches the gate device 10 but then turns back, the beacon capture information related to the third beacon device 33 will not be recorded in the authentication device 100, or the electric field strength of the beacon information will be low. Therefore, it can be presumed that pedestrian C has no intention of entering the gate device 10, and consequently, it can be easily excluded from the list of authentication candidates.

[0131] Furthermore, when pedestrian C passes through the gate device 10, they move away from the third beacon device 33 while moving closer to the fourth beacon device 34. As a result, the electric field strength of the beacon information from the fourth beacon device 34 becomes greater than the electric field strength of the beacon information from the third beacon device 33. Therefore, it can be inferred that pedestrian C has passed through the gate device 10.

[0132] This allows for the accurate estimation of the location of passerby C (entrant), enabling precise management of the entry and exit records of entrants.

[0133] Furthermore, by accurately estimating the position of pedestrian C, the authentication result by the authentication device 100 may be determined, for example, by confirming that pedestrian C has passed through the gate device 10.

[0134] For example, suppose several pedestrians with similar facial features approach the gate device 10 at the same time, and one pedestrian (entrant) passes through the gate device 10 while the other pedestrians do not.

[0135] In this case, the authentication device 100 may not be able to accurately extract authentication candidates because the beacon capture information for all of the multiple passersby is linked to each registered face image.

[0136] Therefore, when the intruder has not yet passed through the gate device 10, the authentication result of the authentication device 100 is not finalized, and the authentication device 100 is made to acquire the beacon capture information again.

[0137] In this way, it becomes possible to confirm that pedestrians who do not pass through the gate device 10 stop in front of the gate device 10, and that entrants proceed to a position beyond the gate device 10. As a result, the authentication results of the authentication device 100 can be made more accurate.

[0138] Furthermore, if multiple beacon devices are installed, the application on the mobile terminal 2 may be configured to consolidate the beacon information received within a predetermined time and transmit it as beacon catch information. The predetermined time can be arbitrarily set based on the amount of information that can be transmitted, the operating hours of the facility, etc. For example, in the case of a typical facility with set daily operating hours, the likelihood of a situation requiring facial recognition to span across days is low, so the predetermined time may be set to one day. Alternatively, the predetermined time may be adjustable depending on the arrangement of each beacon device, the speed of movement of passersby, etc.

[0139] Furthermore, if the electric field strength of the beacon information changes to a predetermined value or higher after the mobile terminal 2 has transmitted the beacon capture information, it may transmit the beacon capture information again.

[0140] Furthermore, in the configuration shown in Figure 9, multiple beacon devices were arranged in a line in the direction of the intruder's movement. However, if multiple gate devices are arranged in a line, the multiple beacon devices may also be arranged in a line in the direction of the line of gate devices.

[0141] For example, as shown in Figure 10, when multiple gate devices 10 are arranged in a direction perpendicular to the direction of travel of an entrant, a beacon device 30 is provided corresponding to each gate device 10. The beacon device 30 is installed, for example, on the ceiling of the facility where the gate devices 10 are located.

[0142] In this case, the difference in electric field strength of the beacon information transmitted from each beacon device 30 makes it possible to estimate which gate device 10 the intruder is trying to enter.

[0143] For example, when intruder D1 enters the second gate device 10 from the right in Figure 10, the electric field strength related to the beacon information will be greatest for the second beacon device 30 from the right in Figure 10. Therefore, it can be estimated that intruder D1 will pass through the second gate device 10 from the right in Figure 10.

[0144] Furthermore, when intruder D2 enters the second gate device 10 from the left in Figure 10, the electric field strength related to the beacon information is greatest for the electric field strength related to the beacon information of the second beacon device 30 from the left in Figure 10. Therefore, it can be estimated that intruder D1 will pass through the second gate device 10 from the left in Figure 10.

[0145] In this way, by estimating the gate device through which an intruder will pass, it becomes easier to identify the intruder.

[0146] Furthermore, in the above embodiment, the authentication device 100 acquired beacon capture information based on beacon information, but this disclosure is not limited thereto, and the authentication device may acquire information other than beacon capture information, as long as it includes the registration information of the intruder.

[0147] Furthermore, in the above embodiment, if a face registration image linked to beacon capture information exists among multiple authentication candidates, a predetermined addition process was performed on the score of the authentication candidate related to the face registration image. However, this disclosure is not limited to this. For example, if a face registration image linked to beacon capture information exists among multiple authentication candidates, the intruder may be authenticated using the registrant associated with that face registration image.

[0148] Furthermore, in the above embodiment, the authentication unit 130 excluded face registration images with scores below the authentication threshold from the authentication candidates, and designated face registration images with scores equal to or greater than the authentication threshold as authentication candidates, and then decided whether or not to perform score addition processing on those authentication candidates using beacon capture information. However, the process of excluding face registration images with scores below the authentication threshold from the authentication candidates may be omitted. In other words, all face registration images may be considered as authentication candidates, and it may be decided whether or not they are subject to score addition processing.

[0149] Furthermore, although the above embodiment describes a gate device 10 with an opening and closing function as an example, it is not limited to this. The configuration of the above embodiment may also be applied to a gate device without an opening and closing function. An example of a gate device without an opening and closing function is a pole-shaped device used for monitoring and recording pedestrians.

[0150] Furthermore, although the above embodiment included a receiving unit, a processing unit, and an authentication unit in the authentication device, this disclosure is not limited to this, and the receiving unit, processing unit, and authentication unit may be provided separately. In particular, many facial recognition methods are known, including methods in which a series of processes are completed by a single device and methods in which multiple devices cooperate to perform the processing, but the method of the above embodiment can be applied regardless of the process or configuration for calculating the score, as long as it is a method of performing facial recognition based on a score.

[0151] Furthermore, in the above embodiment, the score of the face registration image corresponding to the beacon capture information was added, but other methods may be used. If the result of matching the face image information of a user attempting to enter the gate device 10 with the face registration image corresponding to the beacon capture information is given preferential treatment over the result of matching the user's face image information with other face registration images (i.e., the user is more likely to be authenticated as a person permitted to pass through the gate device 10), then the method is not limited to adding a score. For example, it is conceivable to lower the authentication threshold only when evaluating the result of matching with the face registration image corresponding to the beacon capture information.

[0152] Furthermore, in the above embodiment, the user management server and the transit history management server were provided separately from the authentication device, but this disclosure is not limited thereto, and the user management server and the transit history management server may be included in the authentication device.

[0153] Furthermore, the embodiments described above are merely examples of how this disclosure may be implemented, and the technical scope of this disclosure should not be limited by them. In other words, this disclosure can be implemented in various ways without departing from its essence or its main features. [Industrial applicability]

[0154] The authentication device described herein is useful as an authentication device and authentication system that can improve authentication accuracy while enjoying the advantages of a gate device that supports facial recognition. [Explanation of symbols]

[0155] 1. Authentication System 2 Mobile devices 10 Gate device 20 Imaging device 30 Beacon devices 40 User Management Server 50. Passage History Management Server 100 Authentication Devices 110 Receiving unit 120 Processing Unit 130 Authentication Department

Claims

1. A program for controlling a mobile terminal in a system comprising at least a mobile terminal, a gate device, a beacon device, and an authentication device that performs a process of associating registration information indicating the user of the mobile terminal transmitted from the mobile terminal with one of a plurality of face registration images, and performs an authentication process that authenticates the entrant based on the comparison result between each of the plurality of face registration images and the face image information of the person entering the gate device, and a score which is a value indicating the probability that the person corresponding to each of the face registration images and the entrant are the same person, and an authentication threshold, the program controls the mobile terminal in such a system. The program causes the computer of the mobile terminal to execute a process that, upon receiving beacon information, determines whether the beacon information originated from the beacon device, and, based on the determination result, controls the computer to transmit the registration information to the authentication device. program.

2. The aforementioned program is installed on the computer of the mobile terminal. After transmitting the registration information, if the electric field strength of the beacon information changes to a value greater than or equal to a specified value, the system will execute a process to transmit the registration information to the authentication device again. The program according to claim 1.