SYSTEM, GATE DEVICE, AND METHOD AND PROGRAM FOR CONTROLLING GATE DEVICE

A three-stage biometric authentication system for gate systems addresses high-throughput challenges by using a server for initial authentication and subsequent checks at the gate, ensuring secure and efficient user passage.

JP7582458B2Active Publication Date: 2024-11-13NEC CORP

Patent Information

Application Number
JP2023518549
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-06
Publication Date
2024-11-13
Estimated Expiration
2041-05-06

AI Technical Summary

Technical Problem

Gate systems with biometric authentication face challenges in high-throughput scenarios, such as railway ticket gates, where delayed or rushed authentication decisions lead to user confusion and potential unauthorized passage.

Method used

A three-stage biometric authentication system involving a server device and gate device, where initial authentication is performed by the server for users at a distance, followed by subsequent authentications at closer proximity using a list of successful users, allowing only authenticated users to pass through.

Benefits of technology

Ensures smooth and secure passage for authorized users while preventing unauthorized access by immediately confirming eligibility, reducing wait times and enhancing user confidence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007582458000001
    Figure 0007582458000001
  • Figure 0007582458000002
    Figure 0007582458000002
  • Figure 0007582458000003
    Figure 0007582458000003
Patent Text Reader

Abstract

Provided is a system whereby a user can pass through a gate with peace of mind. A gate device according to the present invention comprises an authentication request unit, a first authentication unit, a second authentication unit, and a gate control unit. The authentication request unit requests that a server device implement first biometric authentication pertaining to a first user detected in an authentication area, and registers, in a list of successfully authenticated persons, biometric information of the first user who successfully passed the first biometric authentication. The first authentication unit executes second biometric authentication that uses biometric information of a second user detected at a first position and biometric information registered in the list of successfully authenticated persons. The second authentication unit executes third biometric authentication that uses biometric information, in a host device, of a third user detected at a second position and biometric information registered in the list of successfully authenticated persons. If the third biometric authentication is successfully passed, the gate control unit allows the third user to pass through the gate. When the second biometric authentication is successfully passed, the first authentication unit notifies the second user that it is possible to pass through the gate.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a system, a gate device, a control method for a gate device, and a storage medium. [Background technology]

[0002] Services using facial recognition are becoming more widespread. For example, facial recognition is being applied to various procedures at airports (e.g., check-in, baggage drop-off, security checks, etc.). Development of ticket gates that support facial recognition is also underway.

[0003] Various technologies related to biometric authentication are being developed.

[0004] For example, Patent Document 1 describes that an automatic ticket gate system with a face matching function, a face matching server, and an automatic ticket gate with a face matching function are provided, which determine whether a user is allowed to pass through. The face matching registration device of Patent Document 1 acquires a face image of a user, generates face matching data, and transmits it to a face matching registration server. The face matching registration server receives the face matching data from the face matching registration device and registers it in a face matching database. The automatic ticket gate with a face matching function includes a passage control means that controls whether or not a user is allowed to pass based on the matching result of a face matching means that matches the face matching data received from the face matching database with the face data of the user, and the discrimination result of a medium discrimination means that discriminates the medium of use held by the user.

[0005] Patent Document 2 describes that there is provided a pass permission device, a pass permission method, and a pass permission program that can prevent unauthorized passage and smoothly grant a user pass permission even when face authentication cannot be performed. In Patent Document 2, a user carries a recording medium capable of wireless communication. The recording medium records an identification ID of the user. The pass permission device includes an ID reading unit, an imaging unit, a biometric information reading unit, a communication unit, a control unit, and an alarm unit. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2005-135059 A [Patent Document 2] JP 2019-079264 A Summary of the Invention [Problem to be solved by the invention]

[0007] Gate devices with a large number of people passing through, such as ticket gates for railways, require extremely high processing performance, since they need to control the passage of several tens of people per minute during rush hour. In this regard, ticket gates that employ biometric authentication technology also require similar performance. Here, ticket gates that support biometric authentication determine whether or not a person can pass through the ticket gate based on the results of the biometric authentication. In this case, if the decision on whether or not to pass is slow, the user cannot decide whether or not to pass through the ticket gate, and so the user stops in front of the ticket gate. On the other hand, if the decision on whether or not to pass is made too quickly, the authentication is completed in front of the ticket gate, and another person is allowed to cut in line and pass through.

[0008] This problem cannot be solved by applying the technologies disclosed in Patent Documents 1 and 2. Patent Document 1 discloses a basic automatic ticket gate using biometric authentication, while Patent Document 2 only discloses a technology to complement biometric authentication.

[0009] A primary object of the present invention is to provide a system, a gate device, a control method for a gate device, and a storage medium that contribute to enabling users to pass through a gate with peace of mind. [Means for solving the problem]

[0010] According to a first aspect of the present invention, a system includes a server device that performs a first biometric authentication using biometric information of each of a plurality of users, and a gate device connected to the server device, wherein the gate device includes an authentication request unit that, when a first user is detected in an authentication area that is a predetermined distance away from the gate device, requests the server device to perform the first biometric authentication of the detected first user, and registers the biometric information of the first user who has succeeded in the first biometric authentication in a list of successful authentication users, and, when a second user is detected at a first position that is closer to the gate device than the authentication area, registers the biometric information of the second user detected at the first position in a list of successful authentication users. a first authentication unit that performs a second biometric authentication using the biometric information of the third user detected at the second location and the biometric information registered in the successful authentication list when a third user is detected at a second location within the device, and a gate control unit that allows the third user to pass through a gate if the third biometric authentication is successful, wherein the first authentication unit notifies the second user that he or she can pass through the gate if the second biometric authentication is successful.

[0011] According to a second aspect of the present invention, there is provided a gate device comprising: an authentication request unit that, when a first user is detected in an authentication area away from the gate device, requests a server device that performs a first biometric authentication using biometric information of each of a plurality of users to perform the first biometric authentication of the detected first user, and registers the biometric information of the first user who succeeds in the first biometric authentication in a list of successful authentications; a first authentication unit that, when a second user is detected at a first position closer to the gate device than the authentication area, performs a second biometric authentication using the biometric information of the second user detected at the first position and the biometric information registered in the successful authentication list; a second authentication unit that, when a third user is detected at a second position within the gate device, performs a third biometric authentication using the biometric information of the third user detected at the second position and the biometric information registered in the successful authentication list; and a gate control unit that, if the third biometric authentication is successful, allows the third user to pass through a gate, and the first authentication unit notifies the second user that he or she can pass through the gate if the second biometric authentication is successful.

[0012] According to a third aspect of the present invention, there is provided a control method for a gate device, wherein, when a first user is detected in an authentication area away from the gate device by a predetermined distance, the gate device requests a server device that performs a first biometric authentication on the detected first user using biometric information of each of a plurality of users, and registers the biometric information of the first user who has succeeded in the first biometric authentication in a list of successful authentication recipients, when a second user is detected at a first position closer to the gate device than the authentication area, a second biometric authentication is performed using the biometric information of the second user detected at the first position and the biometric information registered in the list of successful authentication recipients, when a third user is detected at a second position within the gate device, a third biometric authentication is performed using the biometric information of the third user detected at the second position and the biometric information registered in the list of successful authentication recipients, and if the third biometric authentication is successful, the gate device allows the third user to pass through the gate, and if the second biometric authentication is successful, notifies the second user that he or she can pass through the gate.

[0013] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium storing a program for causing a computer mounted on a gate device to execute the following processes: when a first user is detected in an authentication area a predetermined distance from the device, requesting the first biometric authentication of the detected first user from a server device that performs first biometric authentication using biometric information of each of a plurality of users; registering the biometric information of the first user who succeeds in the first biometric authentication in a list of successful authentication recipients; when a second user is detected at a first position closer to the device than the authentication area, executing a second biometric authentication using the biometric information of the second user detected at the first position and the biometric information registered in the successful authentication recipients list; when a third user is detected at a second position within the device, executing a third biometric authentication using the biometric information of the third user detected at the second position and the biometric information registered in the successful authentication recipients list; if the third biometric authentication is successful, allowing the third user to pass through the gate; and if the second biometric authentication is successful, notifying the second user that he or she can pass through the gate. Effect of the Invention

[0014] According to each aspect of the present invention, a system, a gate device, a control method for a gate device, and a storage medium are provided that contribute to enabling a user to pass through a gate with peace of mind. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram for explaining an overview of an embodiment. [Diagram 2] 1 is a diagram illustrating an example of a schematic configuration of an authentication system according to a first embodiment. [Diagram 3] 1 is a plan view showing an example of a schematic configuration of a gate apparatus according to a first embodiment. [Figure 4]FIG. 2 is a diagram for explaining a schematic operation of the authentication system according to the first embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a processing configuration of a gate device according to the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of a list of successful authentication persons according to the first embodiment. [Figure 7] 5 is a flowchart showing an example of the operation of the gate device according to the first embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of a processing configuration of a server device according to the first embodiment. [Figure 9] FIG. 2 is a diagram illustrating an example of a user information database according to the first embodiment. [Figure 10] FIG. 4 is a diagram illustrating an example of an authentication status database according to the first embodiment. [Figure 11] 5 is a flowchart showing an example of an operation of the server device according to the first embodiment. [Figure 12] FIG. 4 is a sequence diagram showing an example of the operation of the authentication system according to the first embodiment. [Figure 13] FIG. 2 is a diagram for explaining the operation of the gate device according to the first embodiment. [Figure 14] FIG. 2 is a diagram for explaining the operation of the gate device according to the first embodiment. [Figure 15] FIG. 2 is a diagram for explaining the operation of the gate device according to the first embodiment. [Figure 16] FIG. 2 is a diagram illustrating an example of a hardware configuration of a gate device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] First, an outline of one embodiment will be described. The reference numerals in the drawings are added to each element for convenience as an example to aid in understanding, and the description of the outline is not intended to be limiting. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units rather than hardware units. The connection lines between the blocks in each drawing include both bidirectional and unidirectional. The unidirectional arrows are used to diagrammatically indicate the flow of the main signal (data) and do not exclude bidirectionality. In this specification and the drawings, elements that can be similarly described may be given the same reference numerals to avoid redundant description.

[0017] The system according to an embodiment includes a server device 101 and a gate device 102 (see FIG. 1). The server device 101 performs a first biometric authentication using biometric information of each of a plurality of users. The gate device 102 is connected to the server device 101. The gate device 102 includes an authentication request unit 111, a first authentication unit 112, a second authentication unit 113, and a gate control unit 114. When a first user is detected in an authentication area that is a predetermined distance away from the gate device, the authentication request unit 111 requests the server device 101 to perform a first biometric authentication for the detected first user, and registers biometric information of the first user who has succeeded in the first biometric authentication in a list of successful authenticatees. When a second user is detected at a first position that is closer to the gate device than the authentication area, the first authentication unit 112 performs a second biometric authentication using the biometric information of the second user detected at the first position and the biometric information registered in the list of successful authenticatees. When a third user is detected at a second position within the device, the second authentication unit 113 performs a third biometric authentication using the biometric information of the third user detected at the second position and the biometric information registered in the successful authentication list. If the third biometric authentication is successful, the gate control unit 114 permits the third user to pass through the gate. If the second biometric authentication is successful, the first authentication unit 112 notifies the second user that he or she can pass through the gate.

[0018] In the above system, three stages of biometric authentication are performed. The first biometric authentication is performed by the server device 101 connected to the gate device 102. The server device 101 identifies a user (a user in the authentication area) walking toward the gate device 102 by biometric authentication, and determines whether the identified user has the right (qualification) to pass through the gate device 102. If the biometric authentication is successful, the server device 101 transmits the biometric information of the user to the gate device 102. The gate device 102 manages the biometric information of those who have been successfully authenticated using a list of those who have been successfully authenticated. When the gate device 102 detects a user near the entrance of the gate device itself (for example, two or three steps before the entrance), it performs biometric authentication of the user (second biometric authentication). At that time, the gate device 102 performs the biometric authentication using the biometric information listed in the list of those who have been successfully authenticated. Here, the list of those who have been successfully authenticated contains biometric information of users who have been successfully authenticated in the first biometric authentication, so the number of entries is small. Therefore, the second biometric authentication by the gate device 102 ends immediately. If the second biometric authentication is successful, the gate device 102 notifies the user near the entrance that he or she may enter the gate device 102. The user who receives this notification can enter the gate device 102 without stopping in front of the gate device 102 (hesitating to enter). Furthermore, if a user who has not undergone the first biometric authentication (a user who is uncertain as to whether or not he or she is qualified to pass through the gate device 102) enters from the side of the gate device 102, the biometric information of the user is not stored in the list of successful authentication users, and the third biometric authentication fails. If the third biometric authentication fails, the gate device 102 closes the gate and denies the user passage through the gate. In this way, a user who has the right to pass through the gate device 102 can pass through the gate device 102 with peace of mind, whereas a user who is uncertain as to whether or not he or she is qualified to pass through the gate device 102 cannot pass through the gate device 102.

[0019] Specific embodiments will be described in more detail below with reference to the drawings.

[0020] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0021] [System Configuration] Fig. 2 is a diagram showing an example of a schematic configuration of the authentication system according to the first embodiment. Referring to Fig. 2, the authentication system includes a server device 10 and a plurality of gate devices 20-1 to 20-3.

[0022] In the following description, unless there is a particular reason to distinguish between the gate devices 20-1 to 20-3, they will simply be referred to as "gate device 20." Similarly, for other components, the reference numerals to the left of the hyphen will represent the respective components.

[0023] The server device 10 and the gate device 20 are configured to be able to communicate with each other via wired or wireless communication means. The server device 10 may be installed in the same building as the gate device 20, or may be installed on a network (cloud).

[0024] The server device 10 is a device that controls the entire authentication system. The server device 10 is a device that performs biometric authentication of a user who is about to pass through the gate device 20. The server device 10 performs a first biometric authentication using biometric information of each of a plurality of users. If the user has the qualifications (rights, authority) to pass through the gate device 20, the server device 10 allows the user to pass through. If the user does not have the qualifications to pass through the gate device 20, the server device 10 denies the user passage.

[0025] The gate device 20 is a device installed in, for example, an airport or a station. The gate device 20 controls the passage of users. The gate device 20 is capable of passing through from both directions. In the first embodiment, the gate device 20 is described as a ticket gate installed in a station. However, it is needless to say that the gate device 20 is not intended to be limited to a ticket gate installed in a station.

[0026] Fig. 3 is a diagram showing an example of a plan view of gate device 20 when viewed from above. As shown in Fig. 3, gate device 20 is equipped with camera 31. Camera 31 is installed so as to be able to capture an image of a user approaching gate device 20 from the left side. Since gate device 20 can accommodate passage from both directions, it is also equipped with a camera that captures an image of a user approaching gate device 20 from the right side, but this is omitted from the drawings including Fig. 3.

[0027] The gate device 20 includes two monitors 32 and 33. The monitor 32 is installed so that a user walking from the left side can be seen. The monitor 33 is installed so that a user walking from the right side can be seen.

[0028] The gate device 20 includes detection sensors for detecting users. Specifically, the gate device 20 includes a detection sensor 34 for detecting a user 41 present near the left entrance, and a detection sensor 35 for detecting a user 42 who has entered the inside of the gate device 20. Note that sensors for detecting a user at the right entrance or a user who has entered the gate device 20 from the right side are not shown in Fig. 3 and other figures.

[0029] The gate device 20 includes a gate 36. The gate 36 controls the passage of users who have entered the gate device 20.

[0030] 3 and other drawings are not intended to limit the configuration or number of devices included in the gate device 20. For example, the gate 36 that restricts the passage of users who enter the gate device 20 from the left side may be different from the gate 36 that restricts the passage of users who enter the gate device 20 from the right side.

[0031] [System operation overview] Next, an overview of the operation of the authentication system according to the first embodiment will be described with reference to the drawings. Fig. 4 is a diagram for explaining the overview of the operation of the authentication system according to the first embodiment. With reference to Fig. 4, the operation when a user approaches the gate device 20 from the left side will be described. The operation when a user approaches the gate device 20 from the right side will be omitted since it is only necessary to switch the left and right in the following description.

[0032] The gate device 20 acquires biometric information (e.g., a face image) of a person who reaches an authentication area (positions X1 to X2) set in front of the gate device 20. The gate device 20 detects a user who reaches the authentication area by photographing the authentication area.

[0033] When the gate device 20 detects a user in an authentication area that is a predetermined distance away from the gate device 20, the gate device 20 requests biometric authentication of the detected user from the server device 10. Specifically, the gate device 20 transmits an "authentication request" including biometric information of the user to the server device 10.

[0034] The server device 10, which has received the authentication request, identifies the user through a matching process (authentication process; first biometric authentication) using pre-registered biometric information. The server device 10 determines whether the identified user is qualified to pass through the gate device 20. For example, the server device 10 checks the charge amount of the pre-registered user, etc., and determines whether the authenticated person is allowed to pass through. Note that the server device 10 may query an external server, etc., when determining whether the authenticated person is allowed to pass through. Whether or not to query an external server, etc. depends on the system specifications, design, etc., and is also different from the purpose of the present disclosure, so a description of the configuration of the system including the external server will be omitted.

[0035] The server device 10 transmits a response to the authentication request (authentication result) to the gate device 20 that is the sender of the request. Specifically, when the server device 10 determines that the user is "allowed to pass," the server device 10 transmits an affirmative response indicating successful authentication to the gate device 20. The server device 10 transmits the affirmative response including the user ID of the user who has been successfully authenticated and the biometric information (feature amount) of the successfully authenticated user to the gate device 20.

[0036] If it is determined that the user is "not permitted to pass," the server device 10 transmits to the gate device 20 a negative response indicating that the authentication has failed.

[0037] By setting the authentication area sufficiently away from the gate device 20, the biometric authentication by the server device 10 is completed before the user (person to be authenticated) reaches the vicinity of the entrance of the gate device 20 (position X3). That is, the authentication result is transmitted to the gate device 20 before the user reaches the entrance of the gate device 20. In other words, the position of the authentication area (distance to the gate device 20) is determined so that the biometric authentication by the server device 10 is completed before the user in the authentication area reaches the entrance of the gate device 20.

[0038] When a negative response (authentication failure) is received, the gate apparatus 20 discards the authentication result related to the authentication failure.

[0039] When receiving a positive response (authentication success), the gate device 20 registers the biometric information (feature amount) and the user ID acquired from the server device 10 in a "successfully authenticated person list."

[0040] The user passes through the authentication area and reaches the entrance (position X3) of the gate device 20. The gate device 20 uses the detection sensor 34 to detect the user at the entrance.

[0041] The gate device 20 acquires biometric information (face image) of a user who reaches the entrance using the camera 31. The gate device 20 executes a matching process (authentication process; second biometric authentication) using the acquired biometric information and biometric information recorded in the successful authentication list.

[0042] If the biometric authentication is successful, the gate device 20 displays "Entry permitted" or "Pass permitted" on the monitor 32. In addition, the gate device 20 displays "Entry prohibited" or "Pass prohibited" on the monitor 33 opposite the monitor 32.

[0043] If the biometric authentication fails, the gate device 20 displays on the monitor 32 a message such as "No entry" or "No passage."

[0044] A user (person to be authenticated) who sees a display such as "Passing OK" can proceed safely into the gate device 20. On the other hand, a user who sees a display such as "No Passing" will turn back without proceeding into the gate device 20.

[0045] A user who has entered inside the gate device 20 arrives just before the gate (reaches position X4). The gate device 20 detects the user who has arrived just before the gate using the detection sensor .

[0046] The gate device 20 acquires biometric information (face image) of a user who has arrived at the gate 36 using the camera 31. The gate device 20 executes a matching process (authentication process; third biometric authentication) using the acquired biometric information and biometric information recorded in the successful authentication list.

[0047] If the biometric authentication is successful, the gate device 20 keeps the gate 36 open and allows the user to pass through the gate. If the biometric authentication is unsuccessful, the gate device 20 closes the gate 36 and denies the user from passing through the gate.

[0048] Furthermore, if the third biometric authentication is successful, the gate device 20 notifies the server device 10 of the user's passage through the gate device 20. Specifically, the gate device 20 transmits to the server device 10 a "gate passage notification" including the user ID of the user permitted to pass through the gate (the user who succeeded in the third biometric authentication).

[0049] The server device 10 identifies the user (passenger) who passed through the gate device 20 by using the user ID, and records the fact that the identified user passed through the gate device 20. In other words, the server device 10 records that the user who succeeded in the third biometric authentication exercised the right to pass through the gate device 20.

[0050] Examples of the biometric information of a user include data (feature amounts) calculated from physical features unique to an individual, such as the pattern of the face or iris. Alternatively, the biometric information of a user may be image data such as a face image or iris image. The biometric information of a user may be anything that includes the user's physical features as information. In the first embodiment, a description will be given using a person's face image or feature amounts generated from the face image as the biometric information.

[0051] The configuration shown in Fig. 2 etc. is merely an example and is not intended to limit the configuration of the system. For example, the authentication system may include at least one or more gate devices 20. The gate devices 20 may be installed in the same location (for example, the same station) or in different locations.

[0052] Next, the gate device 20 and the server device 10 included in the authentication system according to the first embodiment will be described in detail.

[0053] [Gate device] Fig. 5 is a diagram showing an example of a processing configuration (processing module) of the gate device 20 according to the first embodiment. Referring to Fig. 5, the gate device 20 includes a communication control unit 201, an authentication-subject detection unit 202, an authentication request unit 203, a list management unit 204, a first authentication unit 205, a second authentication unit 206, a gate control unit 207, and a storage unit 208.

[0054] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes the data received from the other devices to the other processing modules. The communication control unit 201 transmits the data acquired from the other processing modules to the other devices. In this way, the other processing modules transmit and receive data to and from the other devices via the communication control unit 201.

[0055] The authentication-subject detection unit 202 is a means for detecting an authentication-subject (first user) in the authentication area. The authentication-subject detection unit 202 acquires image data from the camera 31 periodically or at a predetermined timing. The authentication-subject detection unit 202 attempts to extract a face image from the acquired image data.

[0056] Since existing technology can be used for the facial image extraction process by authentication-subject detection unit 202, detailed description will be omitted. For example, authentication-subject detection unit 202 may extract a facial image (facial region) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, authentication-subject detection unit 202 may extract a facial image using a method such as template matching.

[0057] When the face image is extracted, the authentication-subject detection unit 202 calculates the eye distance from the face image. Specifically, the authentication-subject detection unit 202 extracts the left and right eyes from the face image, and calculates the length (number of pixels) of the straight line connecting the extracted eyes.

[0058] Authentication-subject detection unit 202 performs threshold processing on the calculated eye-to-eye distance, and judges whether or not the authentication-subject is present in the authentication area (positions X1 to X2) according to the result. Specifically, if the eye-to-eye distance is within a predetermined range, authentication-subject detection unit 202 judges that the authentication-subject is detected in the authentication area. If the eye-to-eye distance is outside the predetermined range, authentication-subject detection unit 202 judges that the authentication-subject is not present in the authentication area. In this way, authentication-subject detection unit 202 detects the authentication-subject based on the eye-to-eye distance calculated from a face image included in image data obtained by photographing the predetermined area (positions X1 to X2).

[0059] Authentication-subject detection unit 202 passes a face image of the person to be authenticated upon detection to authentication request unit 203 .

[0060] Authentication request unit 203 is a means for requesting server device 10 to authenticate the person to be authenticated detected by person to be authenticated detection unit 202. When acquiring a face image from person to be authenticated detection unit 202, authentication request unit 203 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the acquired face image.

[0061] Since existing technology can be used for the generation of feature amounts, detailed description thereof will be omitted. For example, the authentication request unit 203 extracts the eyes, nose, mouth, etc. as feature points from the face image. After that, the authentication request unit 203 calculates the position of each feature point and the distance between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the face image) consisting of multiple feature amounts.

[0062] The authentication request unit 203 generates an authentication request including the generated feature amount (biometric information) and a gate ID, and transmits the request to the server device 10. The gate ID is identification information for identifying the gate device 20. The gate ID may be a media access control (MAC) address or an internet protocol (IP) address of the gate device 20. Alternatively, the gate ID may be identification information (identification ID) unique to the system. By holding the identification ID as a master on the server device 10 side, it is possible to determine that the transmitted authentication request is from an authorized gate device 20. Furthermore, even for a single gate device 20, the gate ID when entering a station and the gate ID when exiting the station may be set to different values.

[0063] The authentication request unit 203 receives a response (a response including an authentication result) from the server device 10 to the authentication request.

[0064] If an authentication failure (negative response) is received, authentication request unit 203 discards the received negative response.

[0065] When authentication success (positive response) is received, the authentication request unit 203 registers the user ID and biometric information (feature amount) included in the positive response in the "successfully authenticated person list" (see FIG. 6). In addition, the authentication request unit 203 records the time when the user ID, etc., is registered in the successful authentication person list.

[0066] In this way, when a first user is detected in an authentication area at a predetermined distance from the authentication request unit 203, the authentication request unit 203 requests the server device 10 to perform a first biometric authentication for the first user. The authentication request unit 203 registers at least the biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list.

[0067] The list management unit 204 is a means for managing the list of successful authentication users. The list management unit 204 accesses the list of successful authentication users periodically or at a predetermined timing, and deletes unnecessary entries.

[0068] The list management unit 204 checks the registration time field of each entry, and deletes any entry for which a predetermined period of time has passed since it was added to the successful authentication person list. That is, the list management unit 204 deletes any entry for which a predetermined period of time has passed since its registration.

[0069] By such an operation of the list management unit 204, even if a user detected as an authentication subject moves elsewhere instead of heading toward the gate apparatus 20, the entry of such an authentication subject is deleted.

[0070] When an entry is deleted after a predetermined period of time has passed since registration, the list management unit 204 may notify the server device 10 of the deletion. The list management unit 204 may notify the server device 10 of the user ID and cancel the authentication of the corresponding authentication subject.

[0071] Furthermore, the list management unit 204 acquires a "gate passing notification" from the gate control unit 207. The list management unit 204 deletes the entry (the entry in the successful authentication user list) corresponding to the user ID included in the notification.

[0072] In this way, the list management unit 204 deletes entries (biometric information, user ID) that have been registered in the successful authentication person list for a predetermined period of time. Furthermore, in response to the third user passing through the gate 36, the list management unit 204 deletes the entry (biometric information, user ID) of the third user from the successful authentication person list.

[0073] The first authentication unit 205 is a means for authenticating a person to be authenticated (user) who has arrived near the entrance of the gate device 20. The first authentication unit 205 detects the person to be authenticated who has arrived near the entrance of the gate device 20, based on a detection signal from the detection sensor 34. In the example of FIG. 3, the first authentication unit 205 detects the user 41.

[0074] When a person to be authenticated is detected, the first authentication unit 205 acquires biometric information (face image) of the person to be authenticated using the camera 31. The first authentication unit 205 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the acquired face image.

[0075] The first authentication unit 205 sets the generated feature amount (biometric information) as a matching target, and performs matching processing with the feature amount (biometric information) recorded in the authentication success person list. More specifically, the first authentication unit 205 sets the feature amount generated by photographing the person to be authenticated (user) near the entrance as a matching target, and performs 1:N (N is a positive integer, the same applies below) matching with the multiple feature amounts registered in the authentication success person list.

[0076] The first authentication unit 205 calculates the similarity between the feature amount (feature vector) to be matched and each of the multiple feature amounts on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0077] If the feature quantity having a similarity equal to or greater than the predetermined value is not registered in the list of authenticated successful persons, the first authentication unit 205 sets the authentication result to "authentication failure."

[0078] If a feature amount having a similarity equal to or greater than a predetermined value is registered in the list of authenticated persons, the first authentication unit 205 sets the authentication result as "authentication successful."

[0079] If the authentication result is "authentication successful", the first authentication unit 205 displays "Entry permitted" or the like on the monitor 32 on the side where the user was detected. Also, the first authentication unit 205 displays "Entry prohibited" or the like on the monitor 33 on the opposite side to the side where the user was detected.

[0080] If the authentication result is “authentication failed”, the first authentication unit 205 displays on the monitor 32 a message such as “Entry not permitted”.

[0081] In this way, when the first authentication unit 205 detects a second user at a first position (the entrance of the gate device 20) closer to its own device than the authentication area, the first authentication unit 205 executes a second biometric authentication using the biometric information of the second user and the biometric information registered in the successful authentication list. If the second biometric authentication is successful, the first authentication unit 205 notifies the second user that he or she can pass through its own device (gate device 20, gate 36). In addition, if the second biometric authentication is successful, the first authentication unit 205 notifies a fourth user on the opposite side to the side where the second user was detected that he or she cannot pass through the gate device 20.

[0082] The second authentication unit 206 is a means for authenticating a person to be authenticated (user) who arrives just before the gate 36. The second authentication unit 206 detects the person to be authenticated who arrives just before the gate 36, based on a detection signal from the detection sensor 35. In the example of FIG. 3, the second authentication unit 206 detects the user 42.

[0083] When a person to be authenticated is detected, the second authentication unit 206 acquires biometric information (face image) of the person to be authenticated using the camera 31. The second authentication unit 206 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the acquired face image.

[0084] The second authentication unit 206 performs biometric authentication using the generated feature amount and the feature amount registered in the successful authentication person list. The second authentication unit 206 notifies the gate control unit 207 of the authentication result (successful authentication, failure of authentication). When notifying the gate control unit 207 of successful authentication, the second authentication unit 206 notifies the gate control unit 207 of the user ID of the successful authentication person.

[0085] In this way, when the second authentication unit 206 detects a third user at a second position within its own device (just before gate 36), it performs a third biometric authentication using the biometric information of the third user detected at the second position and the biometric information registered in the successful authentication list.

[0086] The gate control unit 207 is a means for controlling the gate 36. If the third biometric authentication is successful, the gate control unit 207 allows the third user to pass through the gate 36. More specifically, if the authentication result acquired from the second authentication unit 206 is "authentication successful", the gate control unit 207 keeps the gate 36 open. If the authentication result acquired is "authentication failed", the gate control unit 207 closes the gate 36 to block the passage of the user.

[0087] When the gate control unit 207 permits the user to pass through the gate, it transmits a "gate passage notification" including the user ID and gate ID of the user to the server device 10. The gate control unit 207 also transmits the gate passage notification to the list management unit 204.

[0088] The storage unit 208 is a means for storing information necessary for the operation of the gate device 20.

[0089] FIG. 7 is a flowchart showing an example of the operation of the gate apparatus 20 according to the first embodiment.

[0090] The gate device 20 detects a user in the authentication area (step S101).

[0091] The gate device 20 transmits an authentication request including the biometric information and gate ID of the user to the server device 10 (step S102).

[0092] The gate device 20 receives the authentication result from the server device 10 (step S103). The gate device 20 receives the result of the first biometric authentication by the server device 10.

[0093] If the gate device 20 receives a message indicating successful authentication, the gate device 20 registers the user ID and biometric information notified by the server device 10 in a list of those who have been successfully authenticated (step S104).

[0094] When the user reaches immediately before the entrance of the gate apparatus 20, the gate apparatus 20 executes a second biometric authentication using the biometric information of the user and the biometric authentication registered in the successful authentication person list (step S105).

[0095] If the second biometric authentication is successful, the gate device 20 displays a message such as "enter" on the monitor 32 or 33 on the side that detected the user, indicating that the user is permitted to enter the gate device 20.

[0096] When the user arrives just before gate 36 installed inside gate device 20, gate device 20 performs a third biometric authentication using the user's biometric information and the biometric information registered in the successful authentication list (step S106).

[0097] The gate apparatus 20 controls the opening and closing of the gate 36 based on the result of the third biometric authentication (step S107).

[0098] When the user is permitted to pass through the gate 36 (step S108, Yes branch), the gate device 20 transmits a gate passage notification including the user ID and gate ID of the gate passer to the server device 10 (step S109).

[0099] When the gate device 20 refuses the passage of the user through the gate 36 (step S108, No branch), the gate device 20 does not take any particular action. Alternatively, the gate device 20 may output a message to the user informing him or her that the user cannot pass through the gate device 20 and encouraging the user to approach an attendant (station staff member).

[0100] [Server device] Fig. 8 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to Fig. 8, the server device 10 includes a communication control unit 301, a user registration unit 302, an authentication request processing unit 303, a gate passage notification processing unit 304, and a storage unit 305.

[0101] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the gate device 20. The communication control unit 301 also transmits data to the gate device 20. The communication control unit 301 passes the data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, the other processing modules transmit and receive data to and from other devices via the communication control unit 301.

[0102] The user registration unit 302 is a means for system-registering users who are allowed to pass through the gate apparatus 20. The user registration unit 302 acquires biometric information (for example, a face image) of users who are allowed to pass through the gate apparatus 20 using any means.

[0103] For example, a system user inputs biometric information and personal information (such as name and address) into the server device 10 using a railroad company's web page or a kiosk terminal installed at a station.

[0104] When the user registration unit 302 acquires a face image, it calculates features from the face image. The user registration unit 302 registers the user's biometric information (e.g., features calculated from the face image) together with a user ID that identifies the system user (person who has registered the biometric information) in a "user information database" (see FIG. 9).

[0105] The user registration unit 302 registers information (business information) required for user authentication processing in the user information database as necessary. For example, when the server device 10 processes an authentication request from a ticket barrier (gate device 20) installed in a station, the user registration unit 302 stores information such as the charge amount and biometric information in association with each other in the user information database.

[0106] 9 is an example, and other items may be stored in association with the biometric information (feature amount). For example, the user's name and face image may be registered in the user information database.

[0107] The authentication request processing unit 303 is a unit that processes an authentication request received from the gate device 20 .

[0108] The authentication request processing unit 303 manages the status of the authentication processing using an authentication status database (see FIG. 10). When the authentication request processing unit 303 receives an authentication request, it extracts a gate ID from the authentication request. The authentication request processing unit 303 adds a new entry to the authentication status database and stores the extracted gate ID. The authentication request processing unit 303 also sets the processing status of the added entry to "in process." For ease of understanding, in FIG. 10, the symbol for gate device 20 is used for the gate ID.

[0109] When information is registered in the authentication status database, the authentication request processing unit 303 sets the biometric information (feature amount) included in the authentication request as the target for matching, and performs matching processing (first biometric authentication) between the biometric information registered in the user information database.

[0110] More specifically, the authentication request processing unit 303 sets the feature amount extracted from the authentication request as a matching target, and executes 1:N matching with a plurality of feature amounts registered in the user information database.

[0111] The authentication request processing unit 303 calculates the similarity between the feature amount (feature vector) to be matched and each of the multiple feature amounts on the registration side.

[0112] If a feature quantity having a similarity equal to or greater than a predetermined value is not registered in the user information database, the authentication request processing unit 303 sets the authentication result to "authentication failure."

[0113] If a feature quantity having a similarity equal to or greater than a predetermined value is registered in the user information database, the authentication request processing unit 303 determines whether or not the user identified by the matching process is qualified to pass through the gate device 20.

[0114] For example, when processing an authentication request received from the gate device 20 when entering a station, the authentication request processing unit 303 judges whether the charge amount of the identified user is equal to or greater than the minimum fare. If the charge amount is equal to or less than the minimum fare, the authentication request processing unit 303 judges that the identified user is not qualified to pass through the gate device 20. If the charge amount is greater than the minimum fare, the authentication request processing unit 303 judges that the identified user is qualified to pass through the gate device 20.

[0115] For example, when processing an authentication request received from the gate device 20 when exiting a station, the authentication request processing unit 303 judges whether or not a boarding station is set for the identified user. If a boarding station is not set, the authentication request processing unit 303 judges that the identified user is not qualified to pass through the gate device 20. If a boarding station is set, the authentication request processing unit 303 calculates a fare according to the user's route (the route between the boarding station and the disembarking station). If the calculated fare exceeds the charge amount, the authentication request processing unit 303 judges that the user is not qualified to pass through the gate device 20. If the calculated fare is equal to or less than the charge amount, the authentication request processing unit 303 judges that the identified user is qualified to pass through the gate device 20.

[0116] If the identified user is not qualified to pass through the gate apparatus 20, the authentication request processing unit 303 sets the authentication result to "authentication failed."

[0117] If the identified user is qualified to pass through the gate device 20, the authentication request processing unit 303 sets the authentication result to "authentication successful".

[0118] The authentication request processing unit 303 transmits an authentication result (authentication successful, authentication failed) to the gate device 20. If the authentication is successful, the authentication request processing unit 303 transmits an affirmative response indicating the authentication success to the gate device 20. At that time, the authentication request processing unit 303 transmits an affirmative response including the user ID and biometric information of the user who is the subject of the authentication process to the gate device 20. Note that the biometric information transmitted to the gate device 20 may be biometric information registered in a user information database, or may be biometric information included in the authentication request received from the gate device 20.

[0119] If the authentication fails, the authentication request processing unit 303 transmits a negative response indicating the authentication failure to the gate device 20. When transmitting a negative response, the authentication request processing unit 303 may also notify the gate device 20 of the cause of the authentication failure. For example, the authentication request processing unit 303 may transmit to the gate device 20 the cause of the authentication failure, such as biometric information not being registered in the system, an insufficient charge amount, or a boarding station not being set.

[0120] When a response to an authentication request is transmitted to the gate device 20, the authentication request processing unit 303 sets "responded" to the corresponding entry in the authentication status database. When notifying the gate device 20 of successful authentication, the authentication request processing unit 303 sets the user ID of the person who was successfully authenticated (the user who was determined to have been successfully authenticated) in the user ID field of the corresponding entry.

[0121] The gate passage notification processing unit 304 is a means for processing the gate passage notification received from the gate device 20. The gate passage notification processing unit 304 extracts the gate ID and user ID from the received notification. The gate passage notification processing unit 304 searches the authentication status database using the gate ID and user ID as keys to identify a corresponding entry. The gate passage notification processing unit 304 confirms that the processing status of the identified entry is "responded".

[0122] Thereafter, the gate passage notification processing unit 304 reads out the user ID from the user ID field of the identified entry. The gate passage notification processing unit 304 searches the user information database using the read out user ID as a key to identify the corresponding entry.

[0123] The gate passage notification processing unit 304 executes a process associated with the user's passage through the gate for the identified entry.

[0124] For example, when processing a gate passage notification received from the gate device 20 when entering a station, the gate passage notification processing unit 304 sets the station where the gate device 20 is installed as the boarding station of the identified entry.

[0125] For example, when processing a gate passing notification received from the gate device 20 when exiting a station, the gate passing notification processing unit 304 calculates the fare of the user and subtracts the fare from the charge amount. The gate passing notification processing unit 304 also clears the setting value in the boarding station field.

[0126] The storage unit 305 stores various information necessary for the operation of the server device 10. In the storage unit 305, a user information database and an authentication status database are constructed.

[0127] FIG. 11 is a flowchart showing an example of the operation of the server device 10 according to the first embodiment.

[0128] The server device 10 receives an authentication request from the gate device 20 (step S201).

[0129] The server device 10 executes a matching process using the biometric information included in the authentication request and the biometric information registered in the user information database (step S202).

[0130] The server device 10 determines whether or not there is an entry whose similarity between pieces of biometric information is equal to or greater than a predetermined value (step S203).

[0131] If such an entry does not exist (step S203, No branch), the server device 10 sets the authentication result to authentication failure (step S204).

[0132] If such an entry exists (step S203, Yes branch), server device 10 judges whether or not the person to be authenticated is qualified to pass through gate device 20 (step S205).

[0133] If the person to be authenticated does not have the qualification to pass through the gate apparatus 20 (step S205, No branch), the server apparatus 10 sets the authentication result to authentication failure (step S204).

[0134] If the person to be authenticated is qualified to pass through the gate apparatus 20 (step S205, Yes branch), the server apparatus 10 sets the authentication result to successful authentication (step S206).

[0135] The server device 10 transmits the authentication result (authentication success, authentication failure) to the gate device 20 (step S207).

[0136] Note that a description of the operation of the server device 10 when the gate passage notification is received will be omitted.

[0137] Next, the operation of the authentication system according to the first embodiment will be described with reference to the drawings. Fig. 12 is a sequence diagram showing an example of the operation of the authentication system according to the first embodiment. It is assumed that the system users have been registered beforehand prior to the operation of Fig. 12.

[0138] Gate apparatus 20 detects an authenticated person (user, passenger) in an authentication area (step S01).

[0139] The gate apparatus 20 transmits an authentication request including the biometric information of the person to be authenticated to the server apparatus 10 (step S02).

[0140] The server device 10 executes the first biometric authentication and transmits the authentication result to the gate device 20 (steps S11 and S12). If the authentication is successful, the server device 10 transmits an affirmative response including the user ID and biometric information of the person who has been successfully authenticated to the gate device 20.

[0141] When a successful authentication is received, the gate apparatus 20 registers the user ID and the biometric information in a list of those who have been successfully authenticated (step S03).

[0142] When the user reaches the entrance of the gate device 20, the gate device 20 executes a second biometric authentication for the user using the successful authentication person list (step S04).

[0143] If the authentication is successful, the gate device 20 displays on the monitor 32 or 33 a message indicating that the user is permitted to pass (step S05). If the authentication is successful, the gate device 20 displays on the monitor 32 or 33 on the opposite side to the side on which the user is detected a message indicating that the user is denied passage.

[0144] When the user arrives immediately before the gate 36, the gate device 20 executes a third biometric authentication for the user using the successful authentication person list (step S06).

[0145] The gate device 20 uses the result of the third biometric authentication to control the opening and closing of the gate 36 (step S07).

[0146] When the user is permitted to pass through the gate, gate device 20 transmits a gate passage notification to server device 10 (step S08).

[0147] When the gate passing notification is received, the server device 10 updates the information of the gate passer (authentication successful person; the person to be authenticated who is determined to have been authenticated successfully) (step S13). Specifically, the server device 10 updates the entry in the user information database corresponding to the gate passer.

[0148] Next, specific operations of the gate device 20 assuming various movements of users (persons to be authenticated, users who are not the subject of authentication) will be described with reference to the drawings.

[0149] As shown in FIG. 13, a case will be considered in which a user 43 passes through an authentication area, arrives at the entrance of the gate device 20, and passes through the gate device 20 as is.

[0150] In this case, when the user 43 reaches the authentication area, biometric authentication (first biometric authentication) of the user 43 is performed, and the result is transmitted to the gate device 20. More precisely, the authentication result is transmitted to the gate device 20 before the user 43 reaches the entrance of the gate device 20.

[0151] If the first biometric authentication is successful, the user ID and biometric information of the person who has been successfully authenticated are registered in a list of people who have been successfully authenticated. That is, as a result of the first biometric authentication being successful, information (user ID, biometric information) of the user 43 who is qualified to pass through the gate device 20 is stored inside the gate device 20.

[0152] When the user 43 who has been authenticated in the authentication area reaches the entrance of the gate device 20, a second biometric authentication is performed. The second biometric authentication is performed using the biometric information of the user 43 who has reached the entrance and the biometric information stored inside the gate device 20. If the second biometric authentication is successful, the gate device 20 displays a message such as "Entry permitted" on the monitor 32.

[0153] Upon seeing this display, user 43 enters gate device 20. When user 43 reaches just before gate 36, third biometric authentication is performed. The third biometric authentication is performed using biometric information of user 43 who has reached just before gate 36 and biometric information stored inside gate device 20. If the third biometric authentication is successful, gate device 20 keeps gate 36 open and allows user 43 to pass through the gate.

[0154] Furthermore, when the gate device 20 permits the user 43 to pass through the gate, the gate device 20 transmits to the server device 10 a message indicating that the user 43 has passed through the gate device 20. The server device 10 stores the fact that the user 43 has passed through the gate device 20 (updates the user information database).

[0155] As shown in FIG. 14, a case will be considered in which a user 44 reaches the entrance of the gate device 20 without passing through the authentication area, and enters the inside of the gate device 20 directly.

[0156] In this case, since the user 44 has not passed through the authentication area, the first biometric authentication has not been performed on the user 44. In other words, the information of the user 44 (user ID, biometric information) is not registered in the list of successful authenticatees, and is not stored inside the gate device 20.

[0157] When the user 44 arrives at the entrance of the gate device 20, the second biometric authentication is performed. However, the biometric information of the user 44 is not registered in the list of successful authentication users, so the authentication fails. As a result, "Entry not permitted" is displayed on the monitor 32.

[0158] If the user 44 proceeds inside the gate device 20 despite this display, a third biometric authentication is performed in front of the gate 36. Since the biometric information of the user 44 is not registered in the list of successful authentications, the third biometric authentication also fails. Therefore, the gate device 20 closes the gate 36 and refuses the user 44 from passing through the gate.

[0159] As shown in FIG. 15, a case will be considered in which a user 45 passes through an authentication area, reaches the entrance of the gate device 20, and then turns back.

[0160] In this case, biometric authentication (first biometric authentication) of the user 45 is performed, and information about the user 45 (user ID, biometric information) is registered in a list of successfully authenticated users.

[0161] When the user 45 reaches the entrance of the gate device 20, the second biometric authentication is performed. Since the biometric information of the user 45 is registered in the list of successful authentication users, the second biometric authentication is successful.

[0162] If the user 45 turns back without proceeding inside the gate device 20, the information of the user 45 (the user ID and biometric information registered in the successful authentication list) will remain inside the gate device 20. However, when a predetermined period of time has passed since the information of the user 45 was registered in the successful authentication list, the entry of the user 45 will be deleted from the successful authentication list.

[0163] In this way, information on users who do not pass through the gate device 20 even after a predetermined period of time has passed is deleted from the list of successful authenticatees, so the size of the list does not become unnecessarily large. Since the size of the list of successful authenticatees is kept appropriate, there is no degradation in the processing speed of the second and third biometric authentications that use the list.

[0164] Furthermore, when the entry of the user 45 is deleted from the list of authenticated users, the server device 10 is notified of the deletion, and the series of authentication procedures by the server device 10 are also canceled.

[0165] As described above, in the first embodiment, three biometric authentications are performed. The server device 10 identifies a user (a user in the authentication area) walking toward the gate device 20 by biometric authentication, and determines whether the identified user is qualified to pass through the gate device 20. The gate device 20 internally stores biometric information of a user (a person who has been successfully authenticated) who has been successfully authenticated for the first time (the biometric information is recorded in a list of people who have been successfully authenticated). When the gate device 20 detects a user at the entrance, it performs biometric authentication of the user (second biometric authentication). At that time, the gate device 20 performs biometric authentication using the biometric information stored internally. Note that the list of people who have been successfully authenticated contains only a small number of entries. Therefore, the second biometric authentication by the gate device 20 ends immediately. When the second biometric authentication is successful, the gate device 20 notifies the user at the entrance that he or she may pass through the gate 360. The user who receives the notification can enter the gate device 20 without stopping in front of the gate device 20. Furthermore, if a user who has not undergone the first biometric authentication (a user whose qualification to pass through gate device 20 is unclear) enters from the side of gate device 20, the third biometric authentication for that user will fail. If the third biometric authentication fails, gate device 20 closes the gate and denies the user passage through the gate. In this way, users who have the right to pass through gate device 20 can pass through gate 36 with peace of mind, whereas users whose qualification to pass through gate device 20 is unclear cannot pass through gate 36.

[0166] Next, the hardware of each device constituting the authentication system will be described.

[0167] The gate device 20 includes a processor 311, a memory 312, and a communication interface 313. The components such as the processor 311 are connected by an internal bus or the like and are configured to be able to communicate with each other.

[0168] However, the configuration shown in Fig. 16 is not intended to limit the hardware configuration of the gate device 20. The gate device 20 may include hardware not shown. In addition, the number of processors 311 and the like included in the gate device 20 is not intended to be limited to the example shown in Fig. 16, and for example, the gate device 20 may include multiple processors 311.

[0169] The processor 311 is, for example, a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0170] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0171] The communication interface 313 is a circuit, a module, etc. that communicates with other devices. For example, the communication interface 313 includes a NIC (Network Interface Card), a bus controller, etc.

[0172] The functions of the gate device 20 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded in a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network, or updated using a storage medium storing the program. The processing modules may also be realized by a semiconductor chip.

[0173] The gate device 20 is equipped with a computer, and the functions of the gate device 20 can be realized by causing the computer to execute a program. The gate device 20 also executes a control method for the gate device 20 by the program.

[0174] Further, as shown in FIG. 3 etc., the gate device 20 includes a camera 31, monitors 32 and 33, detection sensors 34 and 35, a gate 36, etc.

[0175] The camera 31 is a camera device capable of acquiring a visible light image. Although the gate device 20 has been described as having one camera 31 in FIG. 3 and other figures, the gate device 20 may have multiple cameras 31. For example, multiple cameras 31 may be installed in the gate device 20 depending on the purpose. For example, a camera 31 for detecting a person to be authenticated, a camera 31 for second biometric authentication, and a camera 31 for third biometric authentication may be installed in the gate device 20.

[0176] Alternatively, instead of the camera 31 for detecting the person to be authenticated, the person to be authenticated may be detected by other means. For example, a human sensor or the like may be used to detect a person in an authentication area at a predetermined distance from the gate device 20. Alternatively, when a person is detected by the human sensor, the camera 31 may acquire image data and detect the person to be authenticated.

[0177] The monitors 32 and 33 are display devices such as liquid crystal monitors.

[0178] The detection sensors 34 and 35 are sensors that detect people. The detection sensors 34 and 35 are devices that detect the movement of a person or the like when the person or the like moves within a detection range. The detection sensors 34 and 35 detect a person or the like by using infrared rays or the like.

[0179] In the above embodiment, the detection sensors 34 and 35 are used to detect users near the entrance of the gate device 20 and users in front of the gate 36. However, these users may be detected by processing images obtained from the camera 31.

[0180] The gate 36 is a device that controls the passage of users. The type of the gate 36 is not particularly limited, and examples thereof include a flapper gate in which a flapper installed on one or both sides of the passage opens and closes, and a turnstile gate in which three bars rotate.

[0181] The server device 10 can be configured by an information processing device. As with the gate device 20, the server device 10 only needs to include a processor, a memory, a communication interface, and the like, and the configuration thereof will be clear to those skilled in the art, so detailed description thereof will be omitted.

[0182] [Variations] The configuration, operation, and the like of the authentication system described in the above embodiment are merely examples, and are not intended to limit the system configuration, and the like.

[0183] In the above embodiment, the gate device 20 has been described as a ticket gate installed at a station. However, it is needless to say that the intent is not to limit the gate device 20 to a ticket gate. The gate device 20 may be any device that is installed at an airport, an event venue, an office, etc. and controls the passage of users.

[0184] In the above embodiment, the monitor 32 that provides information to the user on the left side and the monitor 33 that provides information to the user on the right side are different devices. However, a device capable of displaying information on both sides may be used to provide information to both the users on the right side and the users on the left side.

[0185] In the above embodiment, it has been described that text (entry permitted, entry prohibited) is displayed on the monitors 32, 33, but instead of or in addition to text, symbols, icons, animations, etc. may be used to notify the user that entry to the gate device 20 is permitted or prohibited. Alternatively, the monitors 32, 33 may be flashed, turned off, or the like to notify the user that entry is permitted or prohibited by the display mode of the monitors 32, 33.

[0186] In the above embodiment, the case has been described where the server device 10 has a user information database and an authentication status database. However, these databases may be constructed in a database server different from the server device 10. In addition, the authentication system may include the various means (authentication request unit 203, etc.) described in the above embodiment.

[0187] In the above embodiment, a case has been described in which biometric information related to features generated from a face image is transmitted from the gate device 20 to the server device 10. However, the "face image" itself may be transmitted as biometric information from the gate device 20 to the server device 10. The server device 10 may generate features from the acquired face image and perform authentication processing (1:N matching).

[0188] In the above embodiment, it is assumed that the camera 31 is a monocular camera, but the camera 31 may be a depth camera (stereo camera) capable of measuring the depth direction. In this case, instead of threshold processing for the eye distance, the gate device 20 may use images obtained from the stereo camera to detect a person to be authenticated in an authentication area at a predetermined distance from the gate device 20. Specifically, the gate device 20 analyzes two images obtained from the stereo camera (analysis using parallax) and calculates the position of the user based on the gate device 20. If the calculated position is included in a predetermined location, the gate device 20 sets the user as a person to be authenticated.

[0189] The form of data transmission and reception between the gate device 20 and the server device 10 is not particularly limited, but the data transmitted and received between these devices may be encrypted. Since the face image and the feature amount calculated from the face image are personal information, it is desirable to transmit and receive encrypted data in order to appropriately protect the personal information.

[0190] In the above embodiment, it has been described that the gate device 20 transmits a gate passage notification to the server device 10 when the third biometric authentication is successful. However, the gate device 20 may transmit the gate passage notification to the server device 10 after confirming that the user has passed through the gate 36. Specifically, the gate device 20 may detect the passage through the gate 36 based on a detection signal from a detection sensor installed immediately behind the gate 36, and transmit the gate passage notification upon the detection.

[0191] The authentication result (authentication success) by the server device 10 may be shared by each gate device 20. For example, in FIG. 2, when the server device 10 processes an authentication request from the gate device 20-1 and the authentication is successful, the server device 10 may transmit a positive response including the biometric information and user ID of the authenticated person to the other gate devices 20-2 and 20-3. The other gate devices 20-2 and 20-3 record the biometric information and user ID received when the other gate device 20-1 transmits the authentication request in a list of authenticated people. The gate devices 20-2 and 20-3 can use such a list of authenticated people to perform the second and third biometric authentications, thereby allowing users who are qualified to pass through the gate device 20 through the authentication area but deviate from the normal route (straight route) to pass through the gate.

[0192] In the above embodiment, it has been described that a gate passage notification including a user ID is transmitted to the server device 10, but a gate passage notification including biometric information instead of the user ID may be transmitted to the server device 10. The server device 10 may identify the user who has passed through the gate by biometric authentication (matching process) using the acquired biometric information.

[0193] In the above embodiment, the gate device 20 performs two biometric authentications (second and third biometric authentications) as described above, but the gate device 20 may perform one biometric authentication. For example, the gate device 20 performs biometric authentication when a user reaches an entrance. If the authentication is successful, the gate device 20 may notify the user that the user is permitted to pass through the gate and may maintain the gate 36 in an open state.

[0194] Alternatively, the gate device 20 may control the monitors 32 and 33 depending on the result of the biometric authentication (first biometric authentication) by the server device 10. In this case, the authentication areas may be X1 to X3. Specifically, if the result of the first biometric authentication is "authentication successful", the gate device 20 notifies the user that he or she is permitted to pass through the gate ("Entry OK" is displayed on the monitor 32 or 33). After that, the gate device 20 may not execute the biometric authentication (second biometric authentication) near the entrance, but execute the biometric authentication (third biometric authentication) immediately before the gate 36. As a result, the user who confirms the display of "Entry OK" can safely enter the gate device 20, and the third biometric authentication can deny the passage of persons who are not qualified to pass through the gate device 20.

[0195] In the above embodiment, the case where the passage of users is controlled by the gate 36 has been described. However, the passage of users may be controlled by other means rather than by physical means. For example, when a user who is not authorized to pass through the gate device 20 enters the gate device 20, the passage of the user may be restricted by sound from a speaker, monitor display, lighting or blinking of an LED (Light Emitting Diode) or the like.

[0196] In the flow charts (flow charts, sequence diagrams) used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the figures can be changed to a degree that does not interfere with the content, such as executing each process in parallel.

[0197] The above-mentioned embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the configurations described above are necessary. In addition, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace a part of the configuration of an embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of an embodiment. Furthermore, it is possible to add, delete, or replace a part of the configuration of an embodiment with another configuration.

[0198] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to authentication systems installed in airports, train stations, etc.

[0199] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. [Appendix 1] A server device that performs a first biometric authentication using biometric information of each of a plurality of users; a gate device connected to the server device; Including, The gate device includes: an authentication request unit that, when a first user is detected in an authentication area at a predetermined distance from the device itself, requests the server device to perform the first biometric authentication on the detected first user, and registers biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; a first authentication unit that, when a second user is detected at a first position closer to the device than the authentication area, executes a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; a second authentication unit that, when a third user is detected at a second position within the device, executes a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication user list; a gate control unit that permits the third user to pass through a gate if the third biometric authentication is successful; Equipped with When the second biometric authentication is successful, the first authentication unit notifies the second user that he or she can pass through the gate. [Appendix 2] The system according to claim 1, further comprising a list management unit that deletes biometric information that has been registered in the successful authentication list for a predetermined period of time. [Appendix 3] The system described in Appendix 2, wherein the list management unit deletes the biometric information of the third user from the successful authentication list in response to the third user passing through the gate. [Appendix 4] The system according to any one of claims 1 to 3, further comprising an authenticatee detection unit that detects the first user in the authentication area. [Appendix 5] The system described in Appendix 4, wherein the authenticated person detection unit detects the first user based on the eye distance calculated from a facial image contained in image data obtained by photographing the authentication area. [Appendix 6] The system according to any one of claims 1 to 5, wherein the authentication request unit acquires biometric information and a user ID of the first user from the server device, and registers them in the successful authentication list. [Appendix 7] The system described in Appendix 6, wherein the gate control unit transmits a gate passage notification to the server device, the notification including the user ID of the third user who passed through the gate. [Appendix 8] A system described in any one of Appendix 1 to 7, wherein, when the second biometric authentication is successful, the first authentication unit notifies a fourth user on the opposite side to the side where the second user is detected that he or she cannot pass through the gate. [Appendix 9] The system according to any one of claims 1 to 8, wherein the biometric information is a facial image or a feature generated from the facial image. [Appendix 10] an authentication request unit that, when a first user is detected in an authentication area at a predetermined distance from the device itself, requests a server device that performs first biometric authentication using biometric information of each of a plurality of users to perform a first biometric authentication on the detected first user, and registers the biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; a first authentication unit that, when a second user is detected at a first position closer to the device than the authentication area, executes a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; a second authentication unit that, when a third user is detected at a second position within the device, executes a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication user list; a gate control unit that permits the third user to pass through a gate if the third biometric authentication is successful; Equipped with The gate device, wherein the first authentication unit notifies the second user that the second user can pass through the gate when the second biometric authentication is successful. [Appendix 11] In the gate device, When a first user is detected in an authentication area at a predetermined distance from the device, the device requests a server device that performs first biometric authentication on the detected first user using biometric information of each of a plurality of users; registering biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; when a second user is detected at a first position closer to the device than the authentication area, a second biometric authentication is performed using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; when a third user is detected at a second position within the device, a third biometric authentication is performed using biometric information of the third user detected at the second position and biometric information registered in the successful authentication list; permitting the third user to pass through the gate if the third biometric authentication is successful; The gate device control method further comprises notifying the second user that he or she may pass through the gate if the second biometric authentication is successful. [Appendix 12] The computer installed in the gate device When a first user is detected in an authentication area at a predetermined distance from the device, a process of requesting a server device that performs first biometric authentication on the detected first user using biometric information of each of a plurality of users; a process of registering biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; when a second user is detected at a first position closer to the device than the authentication area, a process of performing a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication person list; a process of performing a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication list when a third user is detected at a second position in the device; a process of permitting the third user to pass through a gate when the third biometric authentication is successful; a process of notifying the second user that the second user can pass through the gate if the second biometric authentication is successful; A computer-readable storage medium that stores a program for executing the above.

[0200] The disclosures of the above cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and amendments that a person skilled in the art can make in accordance with the entire disclosure, including the scope of the claims, and the technical ideas. [Explanation of symbols]

[0201] 10, 101 Server device 20, 20-1~20-3, 102 Gate device 31 Camera 32, 33 Monitor 34, 35 Detection sensor 36 Gate 41~45 users 111, 203 Authentication request section 112, 205 First Certification Section 113, 206 Second Certification Section 114, 207 Gate control section 201, 301 Communication control unit 202 Subject detection unit 204 List Management Department 208, 305 Storage section 302 User Registration Department 303 Authentication request processing unit 304 Gate passage notification processing unit 311 Processor 312 Memory 313 Communication Interface

Claims

1. a server device that performs a first biometric authentication using biometric information of each of a plurality of users; a gate device connected to the server device; Including, The gate device includes: an authentication request unit that, when a first user is detected in an authentication area at a predetermined distance from the device itself, requests the server device to perform the first biometric authentication on the detected first user, and registers biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; a first authentication unit that, when a second user is detected at a first position closer to the device than the authentication area, executes a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; a second authentication unit that, when a third user is detected at a second position within the device, executes a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication user list; a gate control unit that permits the third user to pass through a gate when the third biometric authentication is successful; Equipped with When the second biometric authentication is successful, the first authentication unit notifies the second user that he or she can pass through the gate.

2. The system according to claim 1 , further comprising a list management unit that deletes biometric information that has been registered in the successful authentication person list for a predetermined period of time.

3. 3. The system according to claim 2, wherein the list management unit deletes the biometric information of the third user from the list of successful authentication users in response to the third user passing through the gate.

4. The system according to claim 1 , further comprising an authenticatee detection unit that detects the first user in the authentication area.

5. The system according to claim 4 , wherein the authenticated person detection unit detects the first user based on an eye distance calculated from a facial image included in image data obtained by photographing the authentication area.

6. 6. The system according to claim 1, wherein the authentication request unit acquires biometric information and a user ID of the first user from the server device, and registers them in the list of successful authenticatees.

7. 7. The system according to claim 6, wherein the gate control unit transmits a gate passage notification including the user ID of the third user who has passed through the gate to the server device.

8. an authentication request unit that, when a first user is detected in an authentication area at a predetermined distance from the device itself, requests a server device that performs first biometric authentication using biometric information of each of a plurality of users to perform a first biometric authentication on the detected first user, and registers the biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; a first authentication unit that, when a second user is detected at a first position closer to the device than the authentication area, executes a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; a second authentication unit that, when a third user is detected at a second position within the device, executes a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication user list; a gate control unit that permits the third user to pass through a gate when the third biometric authentication is successful; Equipped with The gate device, wherein the first authentication unit notifies the second user that the second user can pass through the gate when the second biometric authentication is successful.

9. In the gate device, When a first user is detected in an authentication area at a predetermined distance from the device, the device requests a server device that performs first biometric authentication on the detected first user using biometric information of each of a plurality of users; registering biometric information of the first user who has succeeded in the first biometric authentication in a successful authentication list; when a second user is detected at a first position closer to the device than the authentication area, a second biometric authentication is performed using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list; when a third user is detected at a second position within the device, a third biometric authentication is performed using biometric information of the third user detected at the second position and biometric information registered in the successful authentication list; permitting the third user to pass through the gate if the third biometric authentication is successful; a gate device control method for notifying the second user that he or she can pass through the gate if the second biometric authentication is successful.

10. The computer installed in the gate device a process of, when a first user is detected in an authentication area at a predetermined distance from the device itself, requesting a server device that performs first biometric authentication on the detected first user using biometric information of each of a plurality of users; a process of registering biometric information of the first user who has succeeded in the first biometric authentication in a list of successful authentication users; a process of performing a second biometric authentication using biometric information of the second user detected at the first position and biometric information registered in the successful authentication list when a second user is detected at a first position closer to the device than the authentication area; a process of performing a third biometric authentication using biometric information of the third user detected at the second position and biometric information registered in the successful authentication person list when a third user is detected at a second position in the device; a process of permitting the third user to pass through a gate when the third biometric authentication is successful; a process of notifying the second user that the second user can pass through the gate if the second biometric authentication is successful; A program for executing.

Citation Information

Patent Citations

  • Automatic ticket gate system with face collating function, face collating and registering server, and automatic ticket gate with face collating function

    JP2005135059A

  • Authentication device and authentication method

    JP2010128938A

  • Face authentication system

    JP2015001790A

  • Passage permission device, passage permission method, and passage permission program

    JP2019079264A

  • Information processing device, information processing system, information processing method, and information processing program

    JP2020057191A

Cited By

  • Method and system for verifying user authenticity in an access control system

    US12694734B2