Gate device, biometric authentication control unit, system, gate device control method, and computer program

Abstract

To provide a gate device that improves convenience of a user using the gate device corresponding to bidirectional passage.SOLUTION: A gate device includes an authentication object person detection unit, and a monitor control unit. The authentication object person detection unit detects a first user at a predetermined position on one side as an authentication object person. The monitor control unit responds to a request for authentication of the detected authentication object person to a server device or reception of an authentication success from the server device, to cause a monitor to display that a second user on the other side cannot enter the self device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a gate device, a biometric authentication control unit, a system, a control method for a gate device, and a storage medium. [Background technology]

[0002] Services using facial recognition are becoming more widespread. For example, facial recognition is beginning to be applied to various procedures at airports (e.g., check-in, baggage drop-off, security checks, etc.). Development of facial recognition-compatible ticket gates is also underway.

[0003] Various technologies related to biometric authentication are being developed.

[0004] For example, Patent Document 1 describes that an automatic ticket gate system, an automatic ticket gate method, and a program are provided that enable vulnerable persons to use automatic ticket gates safely. The station service system in Patent Document 1 includes an image acquisition unit, a determination processing unit, a specification processing unit, and a setting processing unit. The image acquisition unit acquires captured images of users using the automatic ticket gates. The determination processing unit determines whether the captured images acquired by the image acquisition unit include an image of the vulnerable person. If the determination processing unit determines that the captured images include an image of the vulnerable person, the specification processing unit identifies a target passageway to be used, which is a ticket gate passageway that the vulnerable person intends to use. The setting processing unit permits use of the target passageway identified by the specification processing unit in a first direction, which is the direction in which the vulnerable person will pass, and prohibits use in a second direction, which is the opposite direction to the first direction.

[0005] Patent Document 2 describes a door authentication system that can improve convenience while ensuring security. The facial recognition locking / unlocking system of Patent Document 2 performs authentication processing to determine whether a person is a resident based on a facial image of the person captured by a camera, and controls the locking / unlocking of an entrance door installed at the entrance based on the authentication result using a locking / unlocking device. The property has a first area adjacent to the entrance and an outer photographed area outside the first area and included in the camera's photographing range. In this case, authentication processing is performed based on the facial image of the person captured by the camera in the outer photographed area, and if the authentication processing identifies the person in the outer photographed area as a resident, it is determined whether the resident has moved to the first area. If the resident has moved to the first area based on the determination, the entrance door is unlocked by the locking / unlocking device. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2020-091516 [Patent Document 2] Japanese Patent Application Publication No. 2017-218801 Summary of the Invention [Problem to be solved by the invention]

[0007] Problems can arise when biometric authentication is applied to gate devices used by many users, such as ticket gates installed at train stations. Specifically, ticket gates installed at train stations often allow users (passengers) to enter from both directions. If such ticket gates are equipped with facial recognition, authentication will begin on both sides when a person approaches from either side. Furthermore, if the authentication results on both sides are "authentication successful," the ticket gate will output a message indicating this, and users who see this message will enter the ticket gate. Alternatively, even if authentication has not yet begun, if the ticket gate indicates "entry permitted," users who approach the ticket gate will enter the gate, potentially obstructing the passage of users who have already been authenticated.

[0008] This problem cannot be solved by applying the technologies disclosed in Patent Documents 1 and 2. This is because Patent Document 1 is a document that targets vulnerable passers-by, while Patent Document 2 is not a document that targets ticket gates.

[0009] The main object of the present invention is to provide a gate device, a biometric authentication control unit, a system, a control method for a gate device, and a storage medium that contribute to improving convenience for users who use a gate device that supports two-way traffic. [Means for solving the problem]

[0010] According to a first aspect of the present invention, there is provided a gate device comprising: an authenticated user detection unit that detects a first user at a predetermined position on one side as an authenticatee; and a monitor control unit that, in response to requesting authentication of the detected authenticated user from a server device or receiving successful authentication from the server device, displays on a monitor that a second user on the other side is not allowed to enter the device.

[0011] According to a second aspect of the present invention, there is provided a biometric authentication control unit comprising: an authenticated person detection unit that detects a first user at a predetermined position on one side as an authenticated person; and a request unit that requests authentication of the detected authenticated person from a server device that performs biometric authentication, wherein the authenticated person detection unit transmits a biometric authentication start notification to a gate control unit via a relay unit in response to the biometric authentication request, and the relay unit controls a first monitor and a second monitor installed in the gate device.

[0012] According to a third aspect of the present invention, there is provided a system including a server device that performs biometric authentication and a gate device connected to the server device, wherein the gate device is equipped with an authenticated user detection unit that detects a first user at a predetermined position on one side as an authenticatee, and a monitor control unit that, in response to requesting authentication of the detected authenticated user from the server device or receiving a successful authentication from the server device, displays on a monitor that a second user on the other side is not allowed to enter the gate device.

[0013] According to a fourth aspect of the present invention, there is provided a method for controlling a gate device, in which a first user at a predetermined position on one side is detected as an authenticatee, and in response to requesting authentication of the detected authenticatee from a server device or receiving authentication success from the server device, a message is displayed on a monitor indicating that a second user on the other side is not allowed to enter the device.

[0014] According to a fifth aspect of the present invention, there is provided a computer-readable storage medium for storing a program for causing a computer mounted on a gate device to execute the following processes: detecting a first user at a predetermined position on one side as a person to be authenticated; and, in response to requesting a server device to authenticate the detected person to be authenticated or receiving a successful authentication from the server device, displaying on a monitor a message indicating that a second user on the other side is not allowed to enter the device. [Effects of the Invention]

[0015] According to each aspect of the present invention, a gate device, a biometric authentication control unit, a system, a gate device control method, and a storage medium are provided that contribute to improving convenience for users who use a gate device that supports two-way traffic. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram for explaining an overview of an embodiment. [Figure 2] 1 is a diagram illustrating an example of a schematic configuration of an authentication system according to a first embodiment. [Figure 3] 1 is a plan view showing an example of a schematic configuration of a gate apparatus according to a first embodiment. [Figure 4] 1 is a diagram illustrating an example of the configuration of a gate device according to a first embodiment. [Figure 5] FIG. 2 is a diagram for explaining the general operation of the authentication system according to the first embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a processing configuration of a biometric authentication control unit according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing an example of an authentication-subjected user information table according to the first embodiment. [Figure 8] FIG. 4 is a diagram illustrating an example of an authentication request according to the first embodiment. [Figure 9] FIG. 3 is a diagram showing an example of table information according to the first embodiment. [Figure 10] FIG. 3 is a diagram illustrating an example of a processing configuration of a relay unit according to the first embodiment. [Figure 11] FIG. 2 is a diagram illustrating an example of a processing configuration of a gate control unit according to the first embodiment. [Figure 12] FIG. 3 is a sequence diagram showing an example of an operation of the gate device according to the first embodiment. [Figure 13] FIG. 2 is a diagram illustrating an example of a processing configuration of a server device according to the first embodiment. [Figure 14]FIG. 2 is a diagram illustrating an example of a user information database according to the first embodiment. [Figure 15] FIG. 3 is a diagram illustrating an example of an authentication status database according to the first embodiment. [Figure 16] 6 is a flowchart showing an example of the operation of the server device according to the first embodiment. [Figure 17] FIG. 3 is a sequence diagram showing an example of the operation of the authentication system according to the first embodiment. [Figure 18] FIG. 2 is a diagram for explaining the operation of the gate device according to the first embodiment. [Figure 19] FIG. 2 is a diagram for explaining the operation of the gate device according to the first embodiment. [Figure 20] FIG. 2 is a diagram illustrating an example of the configuration of a gate device according to a first modified example of the first embodiment. [Figure 21] FIG. 10 is a diagram illustrating an example of the configuration of a gate device according to a second modification of the first embodiment. [Figure 22] FIG. 2 is a diagram illustrating an example of a hardware configuration of a biometric authentication control unit according to the present disclosure. [Figure 23] FIG. 10 is a diagram illustrating an example of a processing configuration of a gate device according to a modified example of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0017] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0018] A gate device 100 according to one embodiment includes an authenticated user detection unit 101 and a monitor control unit 102 (see FIG. 1). The authenticated user detection unit 101 detects a first user at a predetermined position on one side as an authenticatee. In response to requesting authentication of the detected authenticated user from the server device or receiving a successful authentication from the server device, the monitor control unit 102 displays on the monitor that a second user on the other side is not allowed to enter the device.

[0019] The gate device 100, like a ticket gate installed at a station, supports entry from both directions. When a user attempts to enter the gate device 100 from one side, the gate device 100 requests authentication from a server device that performs biometric authentication to confirm whether the user is authorized to pass through the gate device 100. Furthermore, upon requesting biometric authentication from the server device, the gate device 100 notifies the user on the other side that they are not permitted to enter the gate device 100. Users who receive such a notification will not enter the gate device 100. Furthermore, users on the side who have not requested authentication will not enter the gate device 100, and will not interfere with users whose authentication has already begun. In this way, the gate device 100 improves user convenience.

[0020] Specific embodiments will be described in more detail below with reference to the drawings.

[0021] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0022] [System Configuration] Fig. 2 is a diagram showing an example of a schematic configuration of the authentication system according to the first embodiment. Referring to Fig. 2, the authentication system includes a server device 10 and a plurality of gate devices 20-1 to 20-3.

[0023] In the following description, unless there is a particular reason to distinguish between the gate devices 20-1 to 20-3, they will simply be referred to as "gate device 20." Similarly, for other components, the reference numeral to the left of the hyphen will represent that component.

[0024] The server device 10 and the gate device 20 are configured to be able to communicate with each other via wired or wireless communication means. The server device 10 may be installed in the same building as the gate device 20, or may be installed on a network (cloud).

[0025] The server device 10 is a device that controls the entire authentication system. The server device 10 is a device that performs biometric authentication of a user who attempts to pass through the gate device 20. If the user has the qualifications (authority) to pass through the gate device 20, the server device 10 allows the user to pass through. If the user does not have the qualifications to pass through the gate device 20, the server device 10 denies the user passage.

[0026] The gate device 20 is a device installed in, for example, an airport or a station. The gate device 20 controls the passage of users. The gate device 20 is capable of passing through from both directions. In the first embodiment, the gate device 20 will be described as a ticket gate installed in a station. However, it is needless to say that the intention is not to limit the gate device 20 to a ticket gate installed in a station.

[0027] Fig. 3 is a diagram showing an example of a plan view of gate device 20 as viewed from above. As shown in Fig. 3, gate device 20 is equipped with two cameras 31 and 32. Camera 31 is installed so as to be able to capture an image of a user approaching gate device 20 from the right side. Camera 32 is installed so as to be able to capture an image of a user approaching gate device 20 from the left side.

[0028] The gate device 20 is equipped with two monitors 33 and 34. The monitor 33 is installed so that it can be seen by a user walking from the right side. The monitor 34 is installed so that it can be seen by a user walking from the left side. Note that the installation and positions of the devices (cameras 31 and 32, monitors 33 and 34) shown in FIG. 3 are merely examples. For example, the camera 31 and the monitor 33 may be installed one above the other, and the camera 32 and the monitor 34 may be installed one above the other. Installing them in this manner allows the user to directly face the monitors 33 and 34, making it easier to obtain an image suitable for biometric authentication.

[0029] The gate device 20 includes four detection sensors 41 to 44 for detecting a user who enters the device itself. Although four detection sensors 41 to 44 are shown in Fig. 3, it goes without saying that the number of detection sensors is not intended to be limited.

[0030] The gate device 20 includes two gates 51 and 52. The gate 51 controls the passage of users walking from the right side. The gate 52 controls the passage of users walking from the left side.

[0031] The gate device 20 includes a biometric authentication control unit 61, a relay unit 62, and a gate control unit 63 (see FIG. 4). The biometric authentication control unit 61, the relay unit 62, and the gate control unit 63 are connected by a bus standard such as USB (Universal Serial Bus) or PCI (Peripheral Component Interconnect).

[0032] The biometric authentication control unit 61 is a unit that can be added on to the gate device 20. The biometric authentication control unit 61 is configured to be able to communicate with the cameras 31 and 32. The biometric authentication control unit 61 is connected to the server device 10.

[0033] The relay unit 62 is connected between the biometric authentication control unit 61 and the gate control unit 63 and relays communication between these units. The relay unit 62 is connected to the monitors 33 and 34. The relay unit 62 controls the display of the monitors 33 and 34 based on information (control signals) transmitted and received between the biometric authentication control unit 61 and the gate control unit 63.

[0034] The gate control unit 63 is a module that controls the gates 51 and 52. The gate control unit 63 controls the opening and closing of these gates by transmitting control signals to the gates 51 and 52. The gate control unit 63 also uses detection signals from the detection sensors 41 to 44 for gate control.

[0035] [System operation overview] Next, an outline of the operation of the authentication system according to the first embodiment will be described with reference to the drawings. FIG. 5 is a diagram for explaining the outline of the operation of the authentication system according to the first embodiment. With reference to FIG. 5, the operation when a user approaches the gate device 20 from the right side will be described. The operation when a user approaches the gate device 20 from the left side will be omitted because it is only necessary to reverse the left and right in the following description. Also, in FIG. 5, devices and the like used when a user passes through from the left side, such as gate 52, are not shown.

[0036] The biometric authentication control unit 61 starts biometric authentication of the user when the user approaches within a predetermined distance from the gate device 20. For example, in the examples of FIGS. 3 and 5, authentication of the user starts when the user reaches the tracking areas set on the left and right sides of the gate device 20.

[0037] In other words, the state of the gate device 20 is the initial state when there is no user around (on either side of) the gate device 20. For example, as shown in Fig. 5, when a user is outside the tracking areas set on the left and right sides of the gate device 20 (for example, when the user is located at position X0 in Fig. 5), the state of the gate device 20 is the initial state.

[0038] In the initial state, the relay unit 62 displays "Entry OK" on each of the monitors 33 and 34.

[0039] When a user approaches the gate device 20, the biometric authentication control unit 61 detects the user at position X1. Then, the biometric authentication control unit 61 requests the server device 10 to perform biometric authentication of the detected user. Specifically, the biometric authentication control unit 61 transmits an "authentication request" including the user's biometric information to the server device 10.

[0040] Furthermore, the biometric authentication control unit 61 starts tracking the user (the person to be authenticated detected at position X1) at substantially the same timing as the transmission of the authentication request (start of authentication).

[0041] Furthermore, when the biometric authentication control unit 61 transmits the authentication request to the server device 10, it notifies the gate control unit 63 of the transmission. More specifically, the biometric authentication control unit 61 notifies the gate control unit 63 of the transmission of the authentication request, specifying the side (the right side in the example of FIG. 5 ) on which the person to be authenticated (the user who has reached the tracking area) is detected. In this case, the biometric authentication control unit 61 transmits a "right side biometric authentication start notification" to the relay unit 62. When biometric authentication is started on the left side, the biometric authentication control unit 61 transmits a "left side biometric authentication start notification" to the relay unit 62. The biometric authentication start notification is transmitted to the gate control unit 63 via the relay unit 62.

[0042] In this way, when the biometric authentication control unit 61 detects the person to be authenticated at position X1, it sends an authentication request to the server device 10 and starts tracking of the person to be authenticated at substantially the same time. Furthermore, the biometric authentication control unit 61 notifies the gate control unit 63 via the relay unit 62 that biometric authentication has started.

[0043] Upon receiving the biometric authentication start notification, the relay unit 62 clearly indicates on the monitor 33 on the side where the biometric authentication started (the right side in the example of FIG. 5) that the user is allowed to enter the gate device 20. For example, the relay unit 62 maintains the message "Entry Allowed" displayed on the monitor 33.

[0044] On the other hand, with respect to the monitor on the opposite side from the side where the authentication was initiated (monitor 34 in the example of FIG. 5), the relay unit 62 clearly indicates that the user is not permitted to enter the gate device 20. For example, the relay unit 62 displays "Entry not permitted" on the monitor 34.

[0045] Upon receiving the authentication request, the server device 10 identifies the user through a matching process (authentication process) using pre-registered biometric information. The server device 10 determines whether the identified user is qualified to pass through the gate device 20. For example, the server device 10 checks the pre-registered user's charge amount, etc., and determines whether the authenticated person is permitted to pass. Note that the server device 10 may query an external server or the like when determining whether the authenticated person is permitted to pass. Whether or not to query an external server or the like depends on the system specifications, design, etc., and is not within the scope of the present disclosure, so a description of the system configuration including the external server will be omitted.

[0046] The server device 10 transmits a response (authentication result) to the authentication request to the biometric authentication control unit 61, which is the sender of the request. Specifically, if the server device 10 determines that the user is "allowed to pass," it notifies the biometric authentication control unit 61 that the authentication was successful. If the server device 10 determines that the user is "not allowed to pass," it notifies the biometric authentication control unit 61 that the authentication was unsuccessful.

[0047] While the server device 10 is processing the authentication request, the person to be authenticated (the person photographed at position X1) moves toward the gate device 20. For example, when the person to be authenticated moves to position X2, the biometric authentication control unit 61 receives a response to the authentication request from the server device 10.

[0048] The biometric authentication control unit 61 continues to track the person to be authenticated even when the authentication result is received from the server device 10. Even when the biometric authentication control unit 61 receives the authentication result from the server device 10, it does not instruct the gate control unit 63 to open or close the gate 51 at that timing.

[0049] The user (person to be authenticated) approaches further toward gate device 20 and enters inside it (the person to be authenticated reaches position X3). Gate control unit 63 detects that the user has entered inside gate device 20 based on a detection signal from detection sensor 41 installed at the entrance of gate device 20.

[0050] When the gate control unit 63 detects a user, it notifies the biometric authentication control unit 61 of the detection. More specifically, the gate control unit 63 notifies the biometric authentication control unit 61 of the detection of the user while clearly indicating the side on which the user is detected. In the example of FIG. 5, the gate control unit 63 transmits a "right-side user detection notification" to the relay unit 62. The relay unit 62 transfers the received notification (user detection notification; right-side user detection notification or left-side user detection notification) to the biometric authentication control unit 61.

[0051] When the biometric authentication control unit 61 recognizes from this notification that the user has entered the gate device 20, it makes a final determination regarding tracking of the person to be authenticated. The biometric authentication control unit 61 makes a final determination regarding tracking at the time when it is determined that the user has entered the gate device 20 (position X3). If the biometric authentication control unit 61 is able to track the face of the same person between positions X1 and X3, it determines that "tracking is complete."

[0052] When the biometric authentication control unit 61 makes a final determination regarding tracking, if the authentication by the server device 10 is successful and tracking is completed, it determines that the user (person to be authenticated) can pass through the gate device 20 and notifies the gate control unit 63 of this fact.

[0053] More specifically, the biometric authentication control unit 61 clearly indicates the side on which passage is permitted and transmits a "passage permission notice" to the gate control unit 63. In the example of Fig. 5, the biometric authentication control unit 61 transmits a "right-hand passage permission notice" to the gate control unit 63 via the relay unit 62.

[0054] The person to be authenticated (user) proceeds further inside from the entrance of gate device 20. When the person to be authenticated proceeds to a predetermined position (position X4) of gate device 20, gate control unit 63 detects the person to be authenticated based on a detection signal from detection sensor 42 installed in the middle of gate device 20.

[0055] If the gate control unit 63 receives a "passage permission notice" at the time the user is detected, it maintains the gate 51 in an open state and allows the user to pass through the gate.

[0056] On the other hand, if the gate control unit 63 does not receive a "passage permission notice" at the time the user is detected, it closes the gate 51 to restrict the user's passage.

[0057] When the biometric authentication control unit 61 permits multiple users (persons to be authenticated) to pass through the gate device 20, it transmits a "passage permission notice" for each permitted person to the gate control unit 63. For example, when two users are permitted to pass, two pass permission notices are transmitted to the gate control unit 63 via the relay unit 62.

[0058] In this case, the gate control unit 63 allows the notified number of people to pass through. If more users than the number notified by the detection sensor 42 attempt to pass through, the gate control unit 63 closes the gate 51 to refuse passage.

[0059] Furthermore, when there is no one inside the gate device 20, the gate control unit 63 requests initialization from the biometric authentication control unit 61. Specifically, the gate control unit 63 transmits an "initialization request" to the biometric authentication control unit 61 via the relay unit 62. In the example of FIG. 5, when a user reaches position X5 and signals from the detection sensors 41 to 44 indicate that there is no one inside the gate device 20, the gate control unit 63 transmits the initialization request.

[0060] Upon receiving the initialization request, the relay unit 62 initializes the display on the monitors 33 and 34. Specifically, the relay unit 62 returns the content displayed on the monitors 33 and 34 to "entry permitted."

[0061] Upon receiving the initialization request, the biometric authentication control unit 61 prepares for new detection of the user (person to be authenticated) in the tracking areas set on both the left and right sides.

[0062] If the biometric authentication control unit 61 detects the next user before receiving the initialization request, it transmits a biometric authentication start notification to the relay unit 62 in the same manner as described above. That is, in a situation where users are approaching the gate device 20 one after another from one side, the users cannot enter the gate device 20 from the other side. In the example of Fig. 5, the "No Entry" message on the monitor 34 is not released.

[0063] Furthermore, when the biometric authentication control unit 61 detects a user in a tracking area on the opposite side from the side where the user to be authenticated was detected, the biometric authentication control unit 61 does not request biometric authentication of the user from the server device 10. The biometric authentication control unit 61 does not transmit an authentication request for the user on the opposite side to the server device 10.

[0064] The biometric information of a user may be, for example, data (features) calculated from physical features unique to an individual, such as a face or iris pattern. Alternatively, the biometric information of a user may be image data such as a face image or iris image. The biometric information of a user may be any information that includes the user's physical features. In the first embodiment, a description will be given using a person's face image or features generated from the face image as biometric information.

[0065] There are various methods for tracking a user. For example, in the present disclosure, tracking using a face image or tracking using a body shape image can be used. In the first embodiment, a case where a person to be authenticated is tracked using face tracking using a face image (face area) will be described.

[0066] The configuration shown in Fig. 2 etc. is an example and is not intended to limit the configuration of the system. For example, the authentication system may include at least one gate device 20. The gate devices 20 may be installed in the same location (for example, the same station) or in different locations.

[0067] Next, the biometric authentication control unit 61, the relay unit 62, the gate control unit 63, and the server device 10 included in the authentication system according to the first embodiment will be described in detail.

[0068] [Biometric authentication control unit] Fig. 6 is a diagram showing an example of a processing configuration (processing module) of the biometric authentication control unit 61 according to the first embodiment. Referring to Fig. 6, the biometric authentication control unit 61 includes a communication control unit 201, an authenticated person detection unit 202, an authentication request unit 203, an authenticated person tracking unit 204, a passage permission determination unit 205, a table management unit 206, and a storage unit 207.

[0069] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201.

[0070] Furthermore, the communication control unit 201 transmits and receives data to and from other devices (relay unit 62) via a bus such as a USB.

[0071] Authentication-subject detection unit 202 is a means for detecting an authentication-subject. Authentication-subject detection unit 202 detects, as an authentication-subject, a first user at a predetermined position on one side of gate device 20 out of the two entrances. More specifically, authentication-subject detection unit 202 detects, as an authentication-subject, a person at a position (predetermined position) a predetermined distance away from gate device 20. For example, authentication-subject detection unit 202 detects whether or not a person is present at a position (position X1 in FIG. 5) a predetermined distance away from gate device 20.

[0072] Authentication-subjected person detection unit 202 periodically or at predetermined timing acquires image data from cameras 31 and 32. Authentication-subjected person detection unit 202 attempts to extract a face image from each of the acquired image data.

[0073] Since existing technology can be used for the facial image extraction process by authentication-subjected person detection unit 202, detailed description will be omitted. For example, authentication-subjected person detection unit 202 may extract facial images (facial regions) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, authentication-subjected person detection unit 202 may extract facial images using a method such as template matching.

[0074] When a face image is extracted, authentication-subjected person detection unit 202 calculates the eye distance from the face image. Specifically, authentication-subjected person detection unit 202 extracts the left and right eyes from the face image and calculates the length (number of pixels) of the line connecting the extracted eyes.

[0075] Authentication-subjected person detection unit 202 performs threshold processing on the calculated eye-to-eye distance and determines whether or not the authentication-subject is present at the predetermined position (position X1) based on the result. Specifically, if the eye-to-eye distance is longer than the threshold, authentication-subjected person detection unit 202 determines that the authentication-subject is detected at the predetermined position. If the eye-to-eye distance is equal to or less than the threshold, authentication-subjected person detection unit 202 determines that the authentication-subject is not present at the predetermined position. In this way, authentication-subjected person detection unit 202 detects the authentication-subject based on the eye-to-eye distance calculated from the face image included in the image data captured at the predetermined position (position X1).

[0076] When an authentication-subject is detected at a predetermined position (position X1), authentication-subject detection unit 202 adds an entry to the authentication-subject information table. Authentication-subject detection unit 202 assigns an authentication-subject ID that identifies the authentication-subject, and stores the authentication-subject ID in a new entry. Authentication-subject detection unit 202 also stores the side that detected the authentication-subject (detection side) and the time when the authentication-subject was registered in the authentication-subject information table (the time when the new entry was added) in the authentication-subject information table.

[0077] Fig. 7 is a diagram showing an example of an authentication-subjected user information table according to the first embodiment. The authentication-subjected user information table is constructed in the memory of the biometric authentication control unit 61. As shown in the bottom row of Fig. 7, when the authentication-subjected user detection unit 202 detects a person at position X1 on the right side, it adds an entry to the authentication-subjected user information table and sets the detected person as the authentication-subjected user. Note that when the entry is added, nothing is set in the authentication status field, tracking ID field, and tracking status field.

[0078] The authentication status field is a field for managing the status of the biometric authentication of the person to be authenticated. The tracking ID field is a field for storing a tracking ID, which will be described later. The tracking status field is a field for managing the tracking status of the person to be authenticated. Note that in Figure 7, a case has been described in which "left" and "right" are set in the detection side field, but instead of left and right, settings such as inside the station (inside the fence) or outside the station (outside the fence) may also be used.

[0079] When registration of the authenticated person is completed, authenticated person detection unit 202 passes the authenticated person ID and the facial image at the time of detection of the authenticated person to authentication request unit 203 and authenticated person tracking unit 204. More precisely, authenticated person detection unit 202 outputs an "authentication request instruction" accompanied by the authenticated person ID and facial image to authentication request unit 203. Authenticated person detection unit 202 outputs a "tracking start instruction" accompanied by the authenticated person ID and facial image to authenticated person tracking unit 204.

[0080] Furthermore, when registration of the person to be authenticated is completed, the person to be authenticated detection unit 202 transmits a "biometric authentication start notification" to the relay unit 62. When the person to be authenticated is detected on the right side (when a facial image is detected from image data from camera 31), the person to be authenticated detection unit 202 transmits a right-side biometric authentication start notification to the relay unit 62. When the person to be authenticated is detected on the left side (when a facial image is detected from image data from camera 32), the person to be authenticated detection unit 202 transmits a left-side biometric authentication start notification to the relay unit 62.

[0081] Authentication request unit 203 is a means for requesting server device 10 to authenticate the person to be authenticated detected by person-to-be-authenticated detection unit 202. Upon receiving an authentication request instruction from person-to-be-authenticated detection unit 202, authentication request unit 203 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the acquired face image.

[0082] Since existing technology can be used for the process of generating feature amounts, detailed description thereof will be omitted. For example, the authentication request unit 203 extracts the eyes, nose, mouth, etc. from the face image as feature points. Then, the authentication request unit 203 calculates the position of each feature point and the distance between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the face image) consisting of multiple feature amounts.

[0083] The authentication request unit 203 generates an authentication request including the generated feature amount (biometric information), the authenticatee ID, and the gate ID, and transmits it to the server device 10 (see FIG. 8). The gate ID is identification information for identifying the gate device 20. The gate ID may be a MAC (Media Access Control) address or an IP (Internet Protocol) address of the gate device 20. Alternatively, the gate ID may be identification information (identification ID) unique to the system. By storing the identification ID as a master on the server device 10 side, it can be determined that the transmitted authentication request is from an authorized gate device 20.

[0084] When an authentication request is sent to server device 10, authentication request unit 203 sets "authenticating" in the authentication status field of the corresponding entry (entry with the same authenticated user ID) in the authenticated user information table (see the second entry from the bottom in Figure 7).

[0085] Authentication request unit 203 receives a response (including an authentication result) from server device 10 to the authentication request. Authentication request unit 203 extracts the authentication-subject ID from the received response. Authentication request unit 203 identifies the authentication-subject based on the extracted authentication-subject ID, and registers the authentication result in the corresponding entry in the authentication-subject information table (see the first and second entries from the top in FIG. 7).

[0086] Authentication-subjected person tracking unit 204 is a means for tracking the authentication-subjected person (user at position X1) detected by authentication-subjected person detection unit 202. When it receives a tracking start instruction from authentication-subjected person detection unit 202, authentication-subjected person tracking unit 204 starts tracking the person corresponding to the acquired face image. Authentication-subjected person tracking unit 204 assigns a "tracking ID" to the face image for which tracking has begun, and manages the face image being tracked.

[0087] Authentication-subject tracking unit 204 manages tracking of authentication-subjects using table information in which facial images of tracking targets are associated with tracking IDs, as shown in FIG. 9, for example.

[0088] When tracking of the authenticated person starts (when a tracking ID is assigned to the face image), the authenticated person tracking unit 204 stores the tracking ID in the tracking ID field of the corresponding authenticated person (the entry corresponding to the authenticated person ID acquired from the authenticated person detection unit 202). In addition, the authenticated person tracking unit 204 sets "Tracking" in the tracking status field of the corresponding authenticated person (see the third entry from the bottom in FIG. 7).

[0089] Authentication-subjected person tracking unit 204 acquires image data from a camera (camera 31 or 32 on the side that initiated authentication) periodically or at a predetermined timing. Authentication-subjected person tracking unit 204 uses the acquired image data to determine whether the authentication-subjected person has been tracked. Specifically, authentication-subjected person tracking unit 204 determines that tracking is successful if it can obtain, by translation, rotation, or scale, a facial image that is the same as a previous facial image (for example, a facial image at the start of tracking) from the acquired image data. If such a facial image is not obtained, authentication-subjected person tracking unit 204 determines that tracking is unsuccessful. Note that existing processing can be used for tracking processing using facial images, so further explanation will be omitted.

[0090] Authenticated user tracking unit 204 reflects the result of the tracking determination in the authenticated user information table. Specifically, authenticated user tracking unit 204 sets the tracking status of an entry corresponding to a tracking ID determined to be a tracking success among the tracking IDs of the tracking target to "tracking in progress." Conversely, authenticated user tracking unit 204 sets the tracking status of an entry corresponding to a tracking ID determined to be a tracking failure among the tracking IDs of the tracking target to "tracking failed" (see the third entry from the top in FIG. 7).

[0091] In this way, the authenticated person tracking unit 204 overwrites the tracking status of an authenticated person who has been successfully tracked with "tracking in progress," and sets the tracking status of an authenticated person who has not been successfully tracked to "tracking failed." If image data is acquired and a tracking determination is performed at the time when another user crosses in front of the authenticated person, "tracking failed" may be set in the authenticated person information table. In addition, "tracking failed" may also be set if the authenticated person leaves the gate device 20 and turns back. However, even if "tracking failed" has been set for an entry, if a subsequent tracking determination is successful, "tracking in progress" will be set.

[0092] The authenticated person tracking unit 204 acquires a "user detection notification" from the gate control unit 63 via the relay unit 62. The authenticated person tracking unit 204 receives a user detection notification (right-side user detection notification, left-side user detection notification) that clearly indicates the side on which the user was detected.

[0093] In response to this notification, authenticated person tracking unit 204 acquires image data from the camera (camera 31 or 32) on the side where the authenticated person was detected. Authenticated person tracking unit 204 performs a tracking determination using the acquired image data. That is, in response to the detection of an intruder by gate control unit 63, authenticated person tracking unit 204 performs a final determination (final tracking determination) regarding the tracking of the authenticated person.

[0094] When the final tracking determination is completed, authentication-subjected user tracking unit 204 registers the determination result in the authentication-subjected user information table. More specifically, when the final tracking determination is successful, authentication-subjected user tracking unit 204 sets the tracking status of the entry corresponding to the tracking ID for which the determination was successful to "tracking completed" (see the top entry in FIG. 7).

[0095] If the final tracking determination fails, authentication-subjected user tracking unit 204 does not perform any special processing. In the final tracking determination, authentication-subjected user tracking unit 204 does not set "tracking failed" for an authentication-subject whose tracking has failed.

[0096] In this way, when the authenticated person is successfully tracked between position X1 where the authenticated person was detected and position X3 where the authenticated person entered the gate device 20, the authenticated person tracking unit 204 sets "tracking completed" in the authenticated person information table.

[0097] When authentication-subjected person tracking unit 204 completes the final determination regarding tracking of the authentication-subjected person (last tracking determination), it notifies passage permission determination unit 205 of this fact.

[0098] The passage permission determination unit 205 is a means for determining whether or not the person to be authenticated (user) is permitted to pass through the gate device 20, and notifying the gate control unit 63 of the result. The passage permission determination unit 205 determines whether or not the person to be authenticated is permitted to pass through the gate device 20 based on the result of biometric authentication of the person to be authenticated by the server device 10 and the result of tracking determination of the person to be authenticated at the entrance of the gate device 20. The passage permission determination unit 205 notifies the gate control unit 63 of the determination result via the relay unit 62.

[0099] Passage permission determination unit 205 accesses the authentication-subject information table at the timing when authentication-subject tracking unit 204 completes the final tracking determination regarding the authentication-subject.

[0100] The pass permission determination unit 205 checks the authentication status field and the tracking status field of each entry included in the authenticated person information table. If there is an entry in which the setting value of the authentication status field is "authentication successful" and the setting value of the tracking status field is "tracking ended," the pass permission determination unit 205 allows the authenticated person to pass through the gate device 20. Specifically, if there is an entry that satisfies the above two conditions, the pass permission determination unit 205 notifies the gate control unit 63 that the user can pass through the gate device 20. The pass permission determination unit 205 transmits a "pass permission notification" to the gate device 20. If the authenticated person is detected on the right side (if "right" is set in the detection side field of the authenticated person information database), a right side pass permission notification is transmitted. If the authenticated person is detected on the left side (if "left" is set in the detection side field of the authenticated person information database), a left side pass permission notification is transmitted.

[0101] In the example of Fig. 7, the top entry satisfies the above two conditions, so the pass permission determination unit 205 transmits a "right-hand pass permission notice" to the relay unit 62. In this way, when a final determination regarding the tracking of the authenticated person is made in response to the detection of an entrant at the entrance of the gate device 20, the pass permission determination unit 205 determines whether or not the authenticated person is allowed to pass through the gate device 20. That is, the pass permission determination unit 205 determines whether or not the authenticated person is allowed to pass through the gate device 20 based on the result of the biometric authentication and the result of the final determination. When the result of the biometric authentication by the server device 10 is successful authentication and the result of the final determination of tracking is successful, the pass permission determination unit 205 transmits a pass permission notice to the relay unit 62 indicating that the authenticated person is allowed to pass through the gate device 20.

[0102] When the passage permission determination unit 205 permits the user (person to be authenticated) to pass through the gate, it deletes the entry that was the basis for that permission. In the example of Fig. 7, the passage permission determination unit 205 deletes the topmost entry.

[0103] In this way, passage permission determination unit 205 determines whether a user is permitted to pass through the gate based on the set values ​​in the authentication status field and the tracking status field of the authentication-subject information table. As described above, when authentication-subject detection unit 202 detects an authentication-subject at a predetermined position, it adds an entry to the authentication-subject information table. When authentication request unit 203 receives a biometric authentication result from server device 10, it sets the received biometric authentication result in the authentication status field of the added entry. Authentication-subject tracking unit 204 sets the tracking determination result in the tracking status field of the added entry.

[0104] The passage permission determination unit 205 may receive a "gate closed notice" from the gate device 20. When the passage permission determination unit 205 receives the notice, it continues to access the authenticated person information table for a predetermined period of time and checks whether an entry that satisfies the above two conditions appears (exists). If an entry that satisfies the above two conditions appears during the predetermined period of time, the passage permission determination unit 205 permits the authenticated person (user) to pass through the gate. Specifically, if an entry that satisfies the above two conditions appears, the passage permission determination unit 205 transmits a "passage permission notice" to the gate device 20.

[0105] For example, the above phenomenon may occur if there is a delay in reflecting the authentication result (authentication success) from server device 10 in the authentication-subject information table due to the network environment between gate device 20 and server device 10. Alternatively, the above phenomenon may occur if the authentication-subject tries to run through gate device 20.

[0106] If no entry that satisfies the above two conditions appears after a predetermined period of time has elapsed, the passage permission determination unit 205 notifies a station employee (a terminal used by the station employee) that a problem has occurred. Alternatively, the passage permission determination unit 205 may output a voice message or the like to the authenticated person urging them to go to the station employee.

[0107] Table management unit 206 is a means for managing the authentication-subjected user information table. Table management unit 206 accesses the authentication-subjected user information table periodically or at a predetermined timing, and deletes entries that are no longer needed.

[0108] Table management unit 206 checks the registration time field of each entry and deletes entries for which a predetermined period of time has passed since the entry was added to the authentication-subject information table. That is, table management unit 206 deletes entries that do not satisfy the above two conditions (authentication success, tracking completion) even after a predetermined period of time has passed since the entry was registered.

[0109] By such operation of the table management unit 206, even if a user detected as a person to be authenticated does not head toward the gate device 20 but moves elsewhere, the entry for such a person to be authenticated is deleted.

[0110] When an entry is deleted, table management unit 206 may notify server device 10 and authentication-subject tracking unit 204 of this fact. Table management unit 206 may notify server device 10 of the authentication-subject ID and cancel the authentication of the corresponding authentication-subject. Furthermore, table management unit 206 may notify authentication-subject tracking unit 204 of the tracking ID and instruct it to exclude the face image corresponding to the tracking ID from the targets of face tracking.

[0111] The storage unit 207 is a means for storing information necessary for the operation of the biometric authentication control unit 61 .

[0112] [Relay unit] 10 is a diagram showing an example of a processing configuration (processing module) of the relay unit 62 according to the first embodiment. Referring to FIG. 10, the relay unit 62 includes a communication control unit 301, a monitor control unit 302, and a storage unit 303.

[0113] The communication control unit 301 is a means for controlling communication with other devices (units). For example, the communication control unit 301 receives data from the biometric authentication control unit 61. The communication control unit 301 also transmits data to the biometric authentication control unit 61. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301.

[0114] The communication control unit 301 also functions as a means for transferring data acquired from other devices. Specifically, when the communication control unit 301 receives a biometric authentication start notification or a passage permission notification from the biometric authentication control unit 61, it transfers these notifications to the gate control unit 63. When the communication control unit 301 receives a user detection notification or an initialization request from the gate control unit 63, it transfers these messages to the biometric authentication control unit 61.

[0115] The monitor control unit 302 is a means for controlling the monitors 33 and 34 installed in the gate device 20. In response to a request to the server device 10 for authentication of the person to be authenticated detected by the biometric authentication control unit 61, the monitor control unit 302 displays on the monitor 33 or 34 a message indicating that the second user on the other side is not allowed to enter the gate device 20.

[0116] The monitor control unit 302 sets the initial display of the monitors 33 and 34 to "Entry permitted." When the monitor control unit 302 receives a biometric authentication start notification (right side biometric authentication start notification, left side biometric authentication start notification) from the biometric authentication control unit 61, it displays "Entry prohibited" on the monitor opposite to the side where authentication is started in accordance with the notification.

[0117] When the monitor control unit 302 receives the "initialization request" from the gate control unit 63, it initializes the displays on the monitors 33 and 34. The monitor control unit 302 displays "Entry OK" on the monitors 33 and 34.

[0118] In this way, in response to a request for authentication of the authenticatee being made to the server device 10, the monitor control unit 302 displays on a first monitor (monitor 33 in the above example) visible to the first user that the first user is permitted to enter the gate device 20. The monitor control unit 302 also displays on a second monitor (e.g., monitor 34) visible to the second user (the user on the left in the above example) that the second user is prohibited from entering the gate device 20. Furthermore, in response to an initialization request received when the inside of the gate device 20 becomes unmanned, the monitor control unit 302 displays on the left and right monitors 33, 34 that users on both sides (one side and the other side) are permitted to enter the gate device 20.

[0119] The storage unit 303 is a means for storing information necessary for the operation of the relay unit 62 .

[0120] [Gate control unit] 11 is a diagram showing an example of a processing configuration (processing module) of the gate control unit 63 according to the first embodiment. Referring to FIG. 11, the gate control unit 63 includes a communication control unit 401, an intruder detection unit 402, a gate control unit 403, and a storage unit 404.

[0121] The communication control unit 401 is a means for controlling communication with other devices (units). For example, the communication control unit 401 receives data from the relay unit 62. The communication control unit 401 also transmits data to the relay unit 62. The communication control unit 401 passes data received from other devices to other processing modules. The communication control unit 401 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 401.

[0122] The intruder detection unit 402 is a means for detecting an intruder into its own device (gate device 20). More specifically, the intruder detection unit 402 detects an intruder at the entrance on the side specified by the biometric authentication start notification. Specifically, the intruder detection unit 402 detects an intruder using a detection signal from the detection sensor 41 or the detection sensor 43. Upon detecting an intruder, the intruder detection unit 402 transmits a "user detection notification" to the relay unit 62.

[0123] When an intruder is detected using the detection signal from the detection sensor 41, the intruder detection unit 402 transmits a "right-side user detection notification." When an intruder is detected using the detection signal from the detection sensor 43, the intruder detection unit 402 transmits a "left-side user detection notification."

[0124] Furthermore, the entering person detection unit 402 detects a user who has reached the midpoint of the gate device 20 (position X4 in FIG. 5) using the detection signals from the detection sensors 42 and 44. When the entering person detection unit 402 detects a user at position X4, it notifies the gate control unit 403 of the detection of the user while clearly indicating the side (right side, left side) of the detection.

[0125] The gate control unit 403 is a means for controlling the gates 51 and 52 provided in the gate device 20. The gate control unit 403 controls the opening and closing of the gates 51 and 52 when a user reaches a predetermined position of the gate device 20 (position X4 in FIG. 5).

[0126] For example, if the gate control unit 403 has already received a "right-hand passage permission notification" from the biometric authentication control unit 61 at the time the user reaches position X4, the gate control unit 403 keeps the gate 51 open. On the other hand, if the gate control unit 403 has not received a "right-hand passage permission notification" from the biometric authentication control unit 61 at that time, the gate control unit 403 closes the gate 51.

[0127] When the gate 51 or 52 is closed, the gate control unit 403 notifies the biometric authentication control unit 61 of this. Specifically, the gate control unit 403 transmits a "gate closed notification" to the biometric authentication control unit 61. When the gate control unit 403 receives a "passage permission notification" within a predetermined period after transmitting the gate closed notification, the gate control unit 403 opens the closed gates 51 and 52.

[0128] The gate control unit 403 allows the passage of the same number of users as the number of times it has received the pass permission notice. For example, if the gate control unit 403 receives three pass permission notices, it allows the passage of three users (authenticated persons). However, the gate control unit 403 denies the passage of a fourth user.

[0129] After confirming that the same number of users have passed as the number of times that the pass permission notices have been received, the gate control unit 403 checks whether or not there are users inside the gate device 20. Specifically, if a detection signal is output from at least one of the detection sensors 41 to 44, the gate control unit 403 determines that "a user is present" inside the gate device 20.

[0130] When there is no user inside the gate device 20 , the gate control unit 403 transmits an “initialization request” to the relay unit 62 .

[0131] The gate control unit 403 notifies the server device 10 via the biometric authentication control unit 61 that the person to be authenticated has passed through gate 51 or 52. Specifically, when the gate control unit 403 detects the user at position X4 and receives a pass permission notice from the biometric authentication control unit 61, and permits the user to pass through the gate, the gate control unit 403 notifies the biometric authentication control unit 61 to that effect. The pass permission determination unit 205 of the biometric authentication control unit 61 transmits a "gate passage notice" to the server device 10, which includes the authenticated user ID and the gate ID of the gate device 20 that are written in the entry (entry in the authenticated user information table) that served as the basis for transmitting the pass permission notice. That is, the biometric authentication control unit 61 transmits a "gate passage notice" to the server device 10, which includes the authenticated user ID and gate ID of the authenticated person who passed through gate 51 or 52.

[0132] The storage unit 404 is a means for storing information necessary for the operation of the gate device 20.

[0133] FIG. 12 is a sequence diagram showing an example of the operation of the gate device 20 (biometric authentication control unit 61, relay unit 62, and gate control unit 63) according to the first embodiment.

[0134] The biometric authentication control unit 61 detects a user and, upon starting biometric authentication, transmits a "biometric authentication start notification" to the relay unit 62 (step S101).

[0135] The relay unit 62 controls the monitors 33 and 34 in response to receiving the biometric authentication start notification (step S102). The relay unit 62 displays "Entry prohibited" on the monitors 33 and 34 on the opposite side from the side where the user was detected. In this way, in response to the relay unit 62 receiving the biometric authentication start notification, the monitor 33 (first monitor) displays that the user (first user) can enter the gate device 20. The monitor 34 (second monitor) displays that the user on the other side (second user) is not allowed to enter the gate device 20.

[0136] When the gate control unit 63 detects that a user has entered the gate device 20 using the detection sensors 41 and 43, it transmits a user detection notification to the relay unit 62 (step S103).

[0137] When the user detection notification is received via the relay unit 62, the biometric authentication control unit 61 makes a final determination of tracking of the person to be authenticated (step S104).

[0138] If the person to be authenticated is permitted to pass through the gate device 20 based on the authentication result from the server device 10 and the result of the final tracking judgment, the biometric authentication control unit 61 transmits a permission to pass notification to the relay unit 62 (step S105).

[0139] The gate control unit 63 confirms the passage of a user who is permitted to pass through the gate device 20, and if there is no one inside the gate device 20, transmits an initialization request to the relay unit 62 (step S106).

[0140] In response to the initialization request, the relay unit 62 initializes the display contents of the monitors 33 and 34 (step S107). Specifically, the relay unit 62 displays "Entry OK" on the monitors 33 and 34.

[0141] [Server device] 13 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to FIG. 13, the server device 10 includes a communication control unit 501, a user registration unit 502, an authentication unit 503, a gate passage notification processing unit 504, and a storage unit 505.

[0142] The communication control unit 501 is a means for controlling communication with other devices. For example, the communication control unit 501 receives data (packets) from the biometric authentication control unit 61. The communication control unit 501 also transmits data to the biometric authentication control unit 61. The communication control unit 501 passes data received from other devices to other processing modules. The communication control unit 501 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 501.

[0143] The user registration unit 502 is a means for system-registering users who are allowed to pass through the gate device 20. The user registration unit 502 acquires biometric information (for example, a face image) of users who are allowed to pass through the gate device 20 using any means.

[0144] For example, a system user inputs biometric information and personal information (such as name and address) into the server device 10 using a railway company's web page or a kiosk terminal installed at a station.

[0145] When a facial image is acquired, the user registration unit 502 calculates features from the facial image. The user registration unit 502 registers the user's biometric information (for example, the features calculated from the facial image) together with a user ID that identifies the system user (the person whose biometric information is registered) in a "user information database" (see FIG. 14).

[0146] The user registration unit 502 registers information (business information) necessary for user authentication processing in the user information database as necessary. For example, when the server device 10 processes an authentication request from a ticket gate (gate device 20) installed in a station, the user registration unit 502 associates information such as the charge amount with biometric information and stores them in the user information database.

[0147] 14 is an example, and other items may be stored in association with biometric information (features). For example, the user's name and face image may be registered in the user information database.

[0148] The authentication unit 503 is a means for processing an authentication request received from the biometric authentication control unit 61 (gate device 20). When the authentication unit 503 receives an authentication request, it extracts the gate ID and the user ID to be authenticated from the authentication request. The authentication unit 503 adds a new entry to the authentication status database and stores the extracted gate ID and user ID (see FIG. 15). The authentication unit 503 also sets the processing status of the added entry to "in processing." For ease of understanding, in FIG. 15, the gate ID uses the symbol for the gate device 20.

[0149] When information is registered in the authentication status database, the authentication unit 503 sets the biometric information (feature amount) included in the authentication request as a target for matching, and performs matching processing with the biometric information registered in the user information database.

[0150] More specifically, the authentication unit 503 sets the feature extracted from the authentication request as the target for matching, and performs 1:N (N is a positive integer, the same applies below) matching with multiple feature registered in the user information database.

[0151] The authentication unit 503 calculates the similarity between the feature (feature vector) to be matched and each of the multiple feature values ​​on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0152] If the feature quantity having a similarity equal to or greater than a predetermined value is not registered in the user information database, the authentication unit 503 sets "authentication failed" as the authentication result.

[0153] If a feature quantity having a similarity equal to or greater than a predetermined value is registered in the user information database, the authentication unit 503 determines whether the user identified by the matching process is qualified to pass through the gate device 20.

[0154] For example, when processing an authentication request received from the gate device 20 for entering a station, the authentication unit 503 determines whether the charge amount of the identified user is equal to or greater than the minimum fare. If the charge amount is equal to or less than the minimum fare, the authentication unit 503 determines that the identified user is not eligible to pass through the gate device 20. If the charge amount is greater than the minimum fare, the authentication unit 503 determines that the identified user is eligible to pass through the gate device 20.

[0155] For example, when processing an authentication request received from the gate device 20 for exiting a station, the authentication unit 503 determines whether or not a boarding station is set for the identified user. If a boarding station is not set, the authentication unit 503 determines that the identified user is not qualified to pass through the gate device 20. If a boarding station is set, the authentication unit 503 calculates a fare according to the user's route (the route between the boarding station and the disembarking station). If the calculated fare exceeds the charge amount, the authentication unit 503 determines that the user is not qualified to pass through the gate device 20. If the calculated fare is equal to or less than the charge amount, the authentication unit 503 determines that the identified user is qualified to pass through the gate device 20.

[0156] If the identified user is not qualified to pass through the gate device 20, the authentication unit 503 sets the authentication result to "authentication failed."

[0157] If the identified user is authorized to pass through the gate device 20, the authentication unit 503 sets the authentication result to "authentication successful."

[0158] The authentication unit 503 transmits the authentication result (authentication success, authentication failure) to the biometric authentication control unit 61 (gate device 20). If the authentication is successful, the authentication unit 503 transmits an affirmative response indicating the authentication success to the biometric authentication control unit 61. At that time, the authentication unit 503 transmits the affirmative response including the authenticatee ID of the user who is the target of the authentication process to the biometric authentication control unit 61.

[0159] If the authentication fails, the authentication unit 503 transmits a negative response indicating the authentication failure to the biometric authentication control unit 61. When transmitting a negative response, the authentication unit 503 may also notify the biometric authentication control unit 61 of the cause of the authentication failure. For example, the authentication unit 503 may transmit to the biometric authentication control unit 61 causes related to the authentication failure, such as biometric information not being registered in the system, insufficient charge amount, or no boarding station being set. Furthermore, even if the authentication fails, the authentication unit 503 transmits to the biometric authentication control unit 61 a negative response including the authenticatee ID of the user who was the subject of the authentication process.

[0160] When a response to the authentication request is sent to the gate device 20, the authentication unit 503 sets "responded" to the corresponding entry in the authentication status database. Furthermore, when the authentication success is notified to the gate device 20, the authentication unit 503 sets the user ID of the authenticated person (the user determined to have been successfully authenticated) to the user ID of the corresponding entry.

[0161] The gate passage notification processing unit 504 is a means for processing the gate passage notification received from the gate device 20 (biometric authentication control unit 61). The gate passage notification processing unit 504 extracts the gate ID and the authenticated user ID from the received notification. The gate passage notification processing unit 504 searches the authentication status database using the gate ID and the authenticated user ID as keys, and identifies the corresponding entry.

[0162] The gate passage notification processing unit 504 reads the user ID from the user ID field of the identified entry. The gate passage notification processing unit 504 searches the user information database using the read user ID as a key to identify the corresponding entry.

[0163] The gate passage notification processing unit 504 executes processing for the identified entry in response to the user passing through the gate.

[0164] For example, when processing a gate passage notification received from a gate device 20 for entering a station, the gate passage notification processing unit 504 sets the station where the gate device 20 is installed as the boarding station of the identified entry.

[0165] For example, when processing a gate passage notification received from the gate device 20 for exiting a station, the gate passage notification processing unit 504 calculates the user's fare and deducts the fare from the charge amount. The gate passage notification processing unit 504 also clears the set value in the boarding station field.

[0166] The storage unit 505 stores various information necessary for the operation of the server device 10. In the storage unit 505, a user information database and an authentication status database are constructed.

[0167] FIG. 16 is a flowchart showing an example of the operation of the server device 10 according to the first embodiment.

[0168] The server device 10 receives an authentication request from the biometric authentication control unit 61 (step S201).

[0169] The server device 10 executes a matching process using the biometric information included in the authentication request and the biometric information registered in the user information database (step S202).

[0170] The server device 10 determines whether or not there is an entry in which the similarity between the biometric information is equal to or greater than a predetermined value (step S203).

[0171] If such an entry does not exist (step S203, No branch), the server device 10 sets the authentication result to authentication failure (step S204).

[0172] If such an entry exists (step S203, Yes branch), server device 10 determines whether the person to be authenticated is qualified to pass through gate device 20 (step S205).

[0173] If the person to be authenticated does not have the qualification to pass through the gate device 20 (step S205, No branch), the server device 10 sets the authentication result to authentication failure (step S204).

[0174] If the person to be authenticated is qualified to pass through the gate device 20 (step S205, Yes branch), the server device 10 sets the authentication result to successful authentication (step S206).

[0175] The server device 10 transmits the authentication result (authentication success, authentication failure) to the biometric authentication control unit 61 (step S207).

[0176] The description of the operation of the server device 10 when it receives the gate passage notification will be omitted.

[0177] Next, the operation of the authentication system according to the first embodiment will be described with reference to the drawings. Fig. 17 is a sequence diagram showing an example of the operation of the authentication system according to the first embodiment. It is assumed that system users have been registered in advance prior to the operation of Fig. 17.

[0178] Gate apparatus 20 detects a person to be authenticated who is located a predetermined distance away from the apparatus (step S01).

[0179] The gate device 20 acquires biometric information of the person to be authenticated, and transmits an authentication request including the biometric information to the server device 10 (step S02).

[0180] Furthermore, at substantially the same timing as the transmission of the authentication request, that is, at the same time that authentication of the person to be authenticated is requested to server device 10, gate device 20 starts tracking the person to be authenticated (step S03).

[0181] The server device 10 executes the authentication process and transmits the result to the gate device 20 (steps S11 and S12).

[0182] Gate apparatus 20 receives the authentication result and reflects the authentication result in the authentication-subject information table (reflecting authentication result; step S04).

[0183] When the person to be authenticated reaches the entrance of gate device 20, gate device 20 makes a final determination of the tracking of the person to be authenticated (step S05). Gate device 20 reflects the result of the final determination in the person to be authenticated information table.

[0184] When the person to be authenticated reaches a predetermined position of the gate device 20, the gate device 20 performs gate control (step S06). Specifically, the gate device 20 allows the person to be authenticated who has been set as having been successfully authenticated and tracked to pass through.

[0185] When the authentication subject is permitted to pass through, gate apparatus 20 transmits a gate passage notification to server apparatus 10 (step S07).

[0186] Upon receiving the gate passing notification, the server device 10 updates the information of the gate passer (authentication successful person; person to be authenticated who has been determined to have been authenticated successfully) (step S13). Specifically, the server device 10 updates the entry in the user information database corresponding to the gate passer.

[0187] Next, specific operations of the gate device 20 assuming various movements of users (persons to be authenticated, users who are not the object of authentication) will be described with reference to the drawings.

[0188] As shown in the upper part of Fig. 18, user 70 is set as the person to be authenticated, and user 71 is a user who is not the target of authentication. In the drawings including Fig. 18, the person to be authenticated is shown in gray, and the user who is not the target of authentication is shown in white. User 71 is not the person to be authenticated because he is not detected as the person to be authenticated at position X1. Therefore, there is no entry related to user 71 in the person to be authenticated information table.

[0189] A user 70 walks toward the gate device 20. A user 71 moves so as to enter the gate device 20 from the side of the user 70. In this case, the positional relationship between the two becomes as shown in the lower part of FIG. 18 over time.

[0190] Since the entry for user 71 is not registered in the authentication-subject information table, gate 51 closes when user 71 reaches position X4. Furthermore, even if a predetermined period of time has passed since gate 51 closed, the authentication result for user 71 is not registered in the authentication-subject information table, so gate 51 does not open.

[0191] Alternatively, it is also possible that a person to be authenticated may overtake another person to be authenticated who is walking in front of them. For example, as shown in the upper part of Fig. 19, consider a case where users 72 and 73 are walking toward gate device 20. In this case, biometric information of both users 72 and 73 is acquired at position X1 and tracking begins, so they are set as persons to be authenticated (people in gray).

[0192] A user 73 walking behind moves as shown by the dashed line in the upper part of Figure 19 and overtakes the user 72 in front. In this case, the relative positions of the two users change over time as shown in the lower part of Figure 19.

[0193] Entries for users 72 and 73 are registered in the authenticated person information table, and if the authentication process for user 73 (authentication process in server device 10) is successful, gate 51 remains open even when user 73 reaches position X4. Furthermore, gate 51 will not close even if user 72 reaches position X4 after user 73.

[0194] In this way, the biometric information of the user who is acquired at position X1 and set as the person to be authenticated is processed normally even if he or she does not arrive (enter) the gate device 20 in the set order. That is, even if the user does not arrive at the gate device 20 in the order registered as the person to be authenticated due to differences in walking speed of the person to be authenticated, the user can pass through the gate device 20. In this way, the authentication system according to the first embodiment allows irregular situations, thereby improving the system throughput.

[0195] <Modification 1 of the First Embodiment> In the above embodiment, the relay unit 62 is provided between the biometric authentication control unit 61 and the gate control unit 63, and the relay unit 62 controls the monitors 33 and 34. However, the gate control unit 63 may control the monitors 33 and 34.

[0196] For example, the gate device 20 may have a configuration as shown in Fig. 20. Referring to Fig. 20, the monitors 33 and 34 are connected to a gate control unit 63. The gate control unit 63 only needs to have the monitor control unit 302 provided in the relay unit 62.

[0197] When the monitor control unit 302 of the gate control unit 63 receives a biometric authentication start notification from the biometric authentication control unit 61 via the relay unit 62, it displays "Entry not permitted" on the monitor opposite to the side where authentication has started in accordance with the notification.

[0198] Furthermore, when the "initialization request" is transmitted, the monitor control unit 302 initializes the displays on the monitors 33 and 34. The monitor control unit 302 displays "Entry permitted" on the monitors 33 and 34.

[0199] In this manner, the gate control unit 63 may control the display on the monitors 33, 34.

[0200] <Modification 2 of the First Embodiment> In the above embodiment, the relay unit 62 is provided between the biometric authentication control unit 61 and the gate control unit 63, and the relay unit 62 controls the monitors 33 and 34. However, the gate device 20 does not necessarily have to include the relay unit 62.

[0201] For example, the gate device 20 may have a configuration as shown in Fig. 21. Referring to Fig. 21, the gate device 20 includes biometric authentication control units 61a and 61b. The biometric authentication control unit 61a is connected to the camera 31 and the monitor 33. The biometric authentication control unit 61a is a module that is responsible for biometric authentication of a user walking from the right side.

[0202] The biometric authentication control unit 61b is connected to the camera 32 and the monitor 34. The biometric authentication control unit 61b is a module that is responsible for biometric authentication of a user walking from the left side.

[0203] Each of the biometric authentication control units 61a and 61b is connected to a gate control unit 63 that controls the gates 51 and 52. Each of the biometric authentication control units 61a and 61b is also connected to the server device 10.

[0204] 21, the gate device 20 is in the initial state when there are no users on either side of the gate device 20. In this case, the biometric authentication control units 61a and 61b display "Entry Allowed" on the monitors 33 and 34, respectively.

[0205] When a user arrives in a tracking area set for the side in charge of biometric authentication, the biometric authentication control units 61a and 61b transmit an authentication request including biometric information (e.g., a facial image) of the user to the server device 10. After transmitting the authentication request to the server device 10, the biometric authentication control units 61a and 61b notify the gate control unit 63 of this. Specifically, the biometric authentication control units 61a and 61b transmit a "biometric authentication start notification" to the gate control unit 63.

[0206] The gate control unit 63 recognizes whether biometric authentication has started on the right side or the left side based on the sender address of the biometric authentication start notification, etc. The gate control unit 63 notifies the other biometric authentication control unit 61a, 61b, which has not yet started biometric authentication, of the start of biometric authentication.

[0207] The biometric authentication control units 61a and 61b that receive the notification from the gate control unit 63 display "Entry prohibited" on the monitors 33 and 34 connected to them. Furthermore, the biometric authentication control units 61a and 61b that receive the notification do not request biometric authentication of the user from the server device 10 even if the user enters the tracking area.

[0208] As described in the first embodiment, the biometric authentication control units 61a and 61b and the server device 10 perform biometric authentication of the person to be authenticated and perform tracking determination, etc. When the biometric authentication control units 61a and 61b permit the user to pass, they transmit a "passage permission notification" to the gate control unit 63. The gate control unit 63 confirms the passage of the notified number of people, and if there is no one inside the gate device 20, transmits an "initialization request" to the two biometric authentication control units 61a and 61b. Upon receiving the initialization request, the biometric authentication control units 61a and 61b initialize the displays on the monitors 33 and 34, respectively, and display "Pass Allowed."

[0209] <Modification 3 of the First Embodiment> In the above embodiment, the relay unit 62 controls the displays on the monitors 33 and 34 based on signals transmitted and received between the biometric authentication control unit 61 and the gate control unit 63. However, the monitors 33 and 34 may be controlled based on clear instructions from the gate control unit 63.

[0210] For example, when the gate control unit 63 receives a "biometric authentication start notification" from the biometric authentication control unit 61, it designates either the monitor 33 or 34 that should display "No entry" and sends a "monitor control instruction" to the relay unit 62.

[0211] Based on the received monitor control instruction, the relay unit 62 displays "No Entry" on the monitor that is instructed to do so, either the monitor 33 or the monitor 34.

[0212] Furthermore, when the inside of the gate device 20 becomes unmanned, the gate control unit 63 transmits a “monitor initialization instruction” to the relay unit 62 .

[0213] Based on the received monitor initialization instruction, the relay unit 62 sets the display on the monitors 33 and 34 to "passage permitted."

[0214] <Fourth Modification of the First Embodiment> In the second modification, a configuration including the biometric authentication control units 61a and 61b and the gate control unit 63 has been described with reference to Fig. 21. In this configuration, display control of the monitors 33 and 34 may be performed by communication between the two biometric authentication control units 61a and 61b. In this case, it is necessary that the biometric authentication control units 61a and 61b are connected to each other and set to be able to communicate with each other in the configuration of Fig. 21.

[0215] When the biometric authentication control units 61a and 61b transmit an authentication request to the server device 10, they notify the gate control unit 63 and the other biometric authentication control units 61a and 61b of the request. Specifically, the biometric authentication control units 61a and 61b transmit a "biometric authentication start notification" to the gate control unit 63 and the other biometric authentication control units 61a and 61b.

[0216] The biometric authentication control units 61a and 61b that have received the biometric authentication start notification display "Entry prohibited" on the monitors 33 and 34 connected to them. Furthermore, the biometric authentication control units 61a and 61b that have received the notification do not request the server device 10 to perform biometric authentication of the user even if the user enters the tracking area.

[0217] As described in the first embodiment, the biometric authentication control units 61a and 61b and the server device 10 perform biometric authentication of the person to be authenticated and perform tracking determination, etc. When the biometric authentication control units 61a and 61b permit the user to pass, they transmit a "passage permission notification" to the gate control unit 63. The gate control unit 63 confirms the passage of the notified number of people, and if there is no one inside the gate device 20, transmits an "initialization request" to the two biometric authentication control units 61a and 61b. Upon receiving the initialization request, the biometric authentication control units 61a and 61b initialize the displays on the monitors 33 and 34, respectively, and display "Pass Allowed."

[0218] As described above, in the first embodiment, when biometric authentication is initiated on one side of the gate device 20 that allows passage from both directions, the user is notified that biometric authentication is unavailable on the other side (that the user cannot enter the gate device 20). Furthermore, biometric authentication is initiated when a user is detected in a tracking area (buffer area) set in front of the gate device 20. The gate device 20 completes tracking in the tracking area (tracking is successful until the user enters the gate device) and allows the user to pass through the gate if the authentication result of the server device 10 is successful. As a result, the user knows the status of the gate device 20 that the user is about to enter, and can avoid the gate device 20 that displays "No Entry" and head toward another gate device 20. Furthermore, unnecessary authentication requests are not sent to the server device 10, thereby reducing the load on the server device 10.

[0219] Next, the hardware of each device constituting the authentication system will be described. Fig. 22 is a diagram showing an example of the hardware configuration of the biometric authentication control unit 61.

[0220] The biometric authentication control unit 61 includes a processor 311, a memory 312, and a communication interface 313. The components such as the processor 311 are connected by an internal bus or the like and are configured to be able to communicate with each other.

[0221] However, the configuration shown in Fig. 22 is not intended to limit the hardware configuration of the biometric authentication control unit 61. The biometric authentication control unit 61 may include hardware not shown. Furthermore, the number of processors 311 and the like included in the biometric authentication control unit 61 is not intended to be limited to the example shown in Fig. 22, and for example, the biometric authentication control unit 61 may include multiple processors 311.

[0222] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0223] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0224] The communication interface 313 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 313 includes a NIC (Network Interface Card), a bus controller, etc.

[0225] The functions of the biometric authentication control unit 61 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by a semiconductor chip.

[0226] The biometric authentication control unit 61 is equipped with a computer, and the functions of the biometric authentication control unit 61 can be realized by having the computer execute a program. The biometric authentication control unit 61 also executes a control method for the biometric authentication control unit 61 using the program. Similarly, the control method for the gate device 20 is executed by having the computer equipped in the gate device 20 execute a program.

[0227] The basic hardware configuration of the relay unit 62 and the gate control unit 63 can be the same as that of the biometric authentication control unit 61, so a description thereof will be omitted.

[0228] 4 and other figures, the gate device 20 includes cameras 31 and 32, monitors 33 and 34, detection sensors 41 to 44, and gates 51 and 52. Like the biometric authentication control unit 61, the gate device 20 also includes hardware such as a processor, a memory, and a communication interface, but illustrations and descriptions of these components will be omitted.

[0229] The cameras 31 and 32 are camera devices capable of acquiring visible light images. In Fig. 4, the gate device 20 is described as being equipped with one type of camera 31 and 32, but this is not intended to limit the installation of the cameras 31 and 32. For example, multiple cameras may be installed in the gate device 20 for different purposes. For example, the gate device 20 may be installed with a camera for detecting a person to be authenticated, a camera for tracking, and a camera for making a final determination of the tracking.

[0230] Alternatively, instead of using the cameras 31 and 32 to detect the person to be authenticated, the person to be authenticated may be detected by other means. For example, a human presence sensor or the like may be used to detect a person at a location a predetermined distance away from the gate device 20. Alternatively, when a person is detected by the human presence sensor, the camera 31 or the like may acquire image data, and the person to be authenticated may be detected.

[0231] The monitors 33 and 34 are display devices such as liquid crystal monitors.

[0232] The detection sensors 41 to 44 are sensors that detect people. For example, sensors configured with an optical transmitting device and an optical receiving device (so-called optical pass-through sensors) can be used for the detection sensors 41 to 44. For example, the optical transmitting device and the optical receiving device are installed facing each other (two devices are installed on the inner wall of the main body). The transmitting device constantly transmits light, and the receiving device receives the transmitted light. The gate control unit 63 determines that a person has been detected when the receiving device fails to receive light. Note that FIG. 3 and other figures illustrate only one of the two devices that make up the detection sensors 41 to 44.

[0233] In the above description, the gate device 20 is configured to include four detection sensors 41 to 44, but some of the sensors may be integrated. Specifically, the final tracking determination of the authenticated person and gate control may be performed using an integrated detection sensor (for example, the detection sensor 41 installed at the entrance).

[0234] Gates 51 and 52 are devices that control the passage of users. The type of gate 51 etc. is not particularly limited, and examples include a flapper gate that opens and closes with a flapper installed on one or both sides of the passage, and a turnstile gate with three rotating bars.

[0235] The functions of the biometric authentication control unit 61 and the like may be realized by a CPU or the like that controls the entire gate device 20. That is, the gate device 20 may have a configuration as shown in FIG. 23 that includes the modules described in the above embodiments. Note that the modules shown in FIG. 23 are given the same reference numerals as the modules described using the drawings such as FIG. 6. Furthermore, the processing and operation of each module can be the same as those of the corresponding module already described, and therefore description thereof will be omitted.

[0236] Alternatively, the functions of the gate device 20 may be realized by the processor 311 included in the biometric authentication control unit 61.

[0237] The server device 10 can be configured by an information processing device. The server device 10 only needs to include a processor, a memory, a communication interface, etc., similar to the biometric authentication control unit 61, and the configuration thereof will be clear to those skilled in the art, so detailed description thereof will be omitted.

[0238] [Variations] The configuration, operation, etc. of the authentication system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0239] In the above embodiment, the gate device 20 has been described as a ticket gate installed in a station. However, it is needless to say that the intent is not to limit the gate device 20 to a ticket gate. The gate device 20 may be any device that is installed in an airport, an event venue, an office, etc. and controls the passage of users.

[0240] In the above embodiment, the monitor 33 that provides information to the user on the right side and the monitor 34 that provides information to the user on the left side are described as different devices. However, a device capable of displaying on both sides may be used to provide information to both the users on the right and left sides. In other words, the relay unit 62 may use a single display device to provide information to users on both the left and right sides.

[0241] In the above embodiment, it has been described that text (entry permitted, entry prohibited) is displayed on the monitors 33, 34, but instead of or in addition to text, symbols, icons, animations, etc. may be used to notify the user whether entry to the gate device 20 is permitted or prohibited. Alternatively, the monitors 33, 34 may be flashed, turned off, or other display modes may be used to notify the user whether entry is permitted or prohibited.

[0242] In the above embodiment, the biometric authentication control unit 61 detects the user in the tracking area and tracks the user within the detection area. However, tracking does not have to be performed. The biometric authentication control unit 61 may request biometric authentication from the server device 10 when the user reaches position X1, and may also transmit a biometric authentication start notification to the relay unit 62.

[0243] The biometric authentication control unit 61 may transmit a biometric authentication start notification to the relay unit 62 in response to receiving an authentication result indicating successful authentication from the server device 10. In the example of FIG. 5, the biometric authentication start notification may be transmitted to the relay unit 62 when the user arrives at position X2. By shifting the timing of transmitting the biometric authentication start notification in this manner, it is possible to prevent the passage of the other side from being unnecessarily restricted when the authentication result is "failed." That is, when users approach the gate device 20 from both sides at similar times, the monitors 33 and 34 are controlled so that the user on the side whose authentication was successful is allowed to pass, and the monitors 33 and 34 on the other side are controlled so that they are not allowed to pass. In this way, in response to requesting authentication of the detected authenticated person from the server device 10 or receiving a successful authentication result from the server device 10, the monitors 33 and 34 may indicate that the user on the other side is not allowed to enter their own device.

[0244] When detecting a user from image data acquired from camera 31 capturing an image of a user on the right side and camera 32 capturing an image of a user on the left side, biometric authentication control unit 61 may set the user who is closer to gate device 20 as the person to be authenticated. More specifically, biometric authentication control unit 61 may detect a user by employing image data in which a user with a longer eye distance is captured.

[0245] The biometric authentication control unit 61 may count the number of users walking toward the gate device 20 and notify the relay unit 62 of the number of users. More specifically, after transmitting the biometric authentication start notification, the biometric authentication control unit 61 calculates the approximate number of users who can be authenticated. The approximate number of users can be obtained by inputting image data into a pre-prepared learning model. The relay unit 62 may display the obtained approximate number (the number of remaining biometric authentication users) on the monitor on the side that is set to be prohibited from entry. By taking such measures, users on the waiting side can know how long they will need to wait in situations such as when they cannot see the other side of the gate device 20.

[0246] In the above embodiment, the server device 10 has a user information database. However, the database may be constructed on a database server different from the server device 10. Furthermore, the authentication system may include the various means (authentication request unit 203, authenticatee tracking unit 204, etc.) described in the above embodiment. For example, the authentication process executed by the server device 10 may be executed by the gate device 20 (biometric authentication control unit 61). Some or all of the functions of the server device 10 may be realized by the gate device 20.

[0247] In the above embodiment, the biometric authentication control unit 61 transmits biometric information related to features generated from a facial image to the server device 10. However, the biometric authentication control unit 61 may transmit the "facial image" itself as biometric information to the server device 10. The server device 10 may generate features from the acquired facial image and perform authentication processing (1:N matching).

[0248] In the above embodiment, it is assumed that the cameras 31 and 32 are monocular cameras. However, the cameras 31 and 32 may be depth cameras (stereo cameras) capable of measuring the depth direction. In this case, the biometric authentication control unit 61 may detect a person to be authenticated who is located a predetermined distance away from the gate device 20 using images obtained from the stereo cameras, instead of performing threshold processing on the eye-to-eye distance. Specifically, the biometric authentication control unit 61 analyzes two images obtained from the stereo cameras (analysis using parallax) and calculates the position of the user relative to the gate device 20. If the calculated position is included in a predetermined location, the biometric authentication control unit 61 sets the user as a person to be authenticated.

[0249] The form of data transmission and reception between the biometric authentication control unit 61 and the server device 10 is not particularly limited, but the data transmitted and received between these devices may be encrypted. Facial images and feature values ​​calculated from the facial images are personal information, and in order to appropriately protect the personal information, it is desirable to transmit and receive encrypted data.

[0250] In the above embodiment, a case has been described in which tracking failures are permitted while the person to be authenticated moves from position X1 to position X3 in FIG. 5. However, the biometric authentication control unit 61 (gate device 20) may refuse passage through gates 51 and 52 of a person to whom tracking has been unsuccessful even once. In this case, the biometric authentication control unit 61 does not overwrite the tracking status field in the person to be authenticated information table, which has been set to "tracking failed," with "tracking in progress." In this way, the gate device 20 can achieve stricter control (management of pedestrians) by refusing passage through the gate of a person to whom tracking has been unsuccessful.

[0251] Alternatively, tracking of the movement of the person to be authenticated from position X1 to position X3 may not be performed. That is, the biometric authentication control unit 61 may store a facial image of the person to be authenticated at position X1, and set the tracking result to "tracking completed" if the facial image taken at position X3 and the facial image at position X1 are of the same person. In this way, the gate device 20 may omit tracking of the person to be authenticated from position X1 to position X3.

[0252] Alternatively, if tracking of an authenticated person fails multiple times, the entry for that authenticated person may be deleted from the authenticated person information table. The biometric authentication control unit 61 stores the number of tracking failures for each tracking target. If the number of tracking failures exceeds a predetermined threshold, the biometric authentication control unit 61 may delete the corresponding entry. In other words, a situation in which tracking of an authenticated person fails multiple times is generally not conceivable. In such a situation, it is assumed that the authenticated person is not heading toward the gate device 20 but toward another location, so it is desirable to quickly exclude such an authenticated person from being subject to gate control.

[0253] In the above embodiment, the biometric authentication control unit 61, the relay unit 62, and the gate control unit 63 are separate units. However, these units may be integrated. That is, the biometric authentication control unit 61, the relay unit 62, and the gate control unit 63 may be integrated with the gate device 20.

[0254] In the above embodiment, the case where information about the authenticated person is stored and managed using an authentication-subject information table has been described. However, information about the authenticated person may be stored and managed using a database (authentication-subject information database).

[0255] In the above embodiment, the biometric authentication control unit 61 transmits a biometric authentication start notification to the gate control unit 63 housed in the same gate device 20. Here, the biometric authentication control unit 61 may transmit the biometric authentication start notification to gate devices 20 other than the gate device 20 in which the biometric authentication control unit 61 is housed. For example, in the example of FIG. 2, the biometric authentication start notification may be transmitted from gate device 20-1 to gate devices 20-2 and 20-3. The gate devices 20 that receive the notification may grasp the status of the other gate devices 20 and provide information based on the grasped status. For example, consider a case where the right side of gate device 20-1 is passable and the left side is not passable, and the right side of gate device 20-2 is not passable and the left side is passable. In this case, gate device 20-2 grasps the status of gate device 20-1 (passable on the right side and not passable on the left side) and displays "Gate device 20-1 is passable" on the monitor on the side where its own passage is not permitted (the right side). Upon seeing this display, a user of the gate device 20-2 moves to the gate device 20-1 that is passable.

[0256] Alternatively, the gate device 20 may send an initialization request to another gate device 20. Based on the request, the gate device 20 may ascertain the status of the other gate device 20 (passage permitted in both directions). The gate device 20 may display a message on the monitor on the blocked side urging the user to head toward a gate device 20 that allows passage in both directions.

[0257] In the above embodiment, the case where the passage of users is controlled by the gates 51 and 52 has been described. However, the passage of users may be controlled by other means rather than by physical means. For example, when a user who is not authorized to pass through the gate device 20 enters the gate device 20, the passage of the user may be restricted by sound from a speaker, a monitor display, lighting or flashing of an LED (Light Emitting Diode), etc.

[0258] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0259] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0260] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to authentication systems installed in airports, train stations, etc.

[0261] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. [Appendix 1] an authentication subject detection unit that detects a first user at a predetermined position on one side as an authentication subject; a monitor control unit that, in response to requesting a server device to authenticate the detected person to be authenticated or receiving a successful authentication from the server device, displays on a monitor a message indicating that a second user on the other side cannot access the device; A gate device comprising: [Appendix 2] The gate device described in Appendix 1, wherein the monitor control unit, in response to requesting the server device to authenticate the detected authenticated person or receiving successful authentication from the server device, displays on a first monitor visible to the first user that the first user is allowed to enter the device, and displays on a second monitor visible to the second user that the second user is not allowed to enter the device. [Appendix 3] The gate device described in Appendix 2, wherein the monitor control unit displays on the first and second monitors that users on the one side and the other side can enter the device when the inside of the device is unmanned. [Appendix 4] a tracking unit that tracks the detected authenticatee; a determination unit that determines whether the person to be authenticated is allowed to pass through the device itself based on a result of biometric authentication of the person to be authenticated by the server device and a result of tracking determination of the person to be authenticated at an entrance of the device itself; 4. The gate device according to claim 1, further comprising: [Appendix 5] A gate device described in any one of Appendix 1 to 4, wherein the authentication subject detection unit detects the authentication subject based on the eye distance calculated from a facial image included in the image data taken at the specified position. [Appendix 6] 5. The gate device according to claim 4, wherein the tracking unit starts tracking the person to be authenticated at the same time that the server device is requested to authenticate the person to be authenticated. [Appendix 7] an authentication subject detection unit that detects a first user at a predetermined position on one side as an authentication subject; a request unit that requests authentication of the detected person to a server device that performs biometric authentication; Equipped with The authentication subject detection unit In response to the biometric authentication being requested, a biometric authentication start notification is sent to the gate control unit via the relay unit; The relay unit is a biometric authentication control unit that controls a first monitor and a second monitor installed in the gate device. [Appendix 8] The biometric authentication control unit of claim 7, wherein, in response to the relay unit receiving the biometric authentication start notification, the first monitor displays that the first user is allowed to enter the gate device, and the second monitor displays that a second user on the other side is not allowed to enter the gate device. [Appendix 9] a tracking unit that tracks the detected authenticatee; a determination unit that determines whether the person to be authenticated is allowed to pass through the gate device based on a result of biometric authentication of the person to be authenticated by the server device and a result of tracking determination of the person to be authenticated at the entrance of the gate device; Furthermore, the tracking unit makes a final determination regarding tracking of the authenticated person in response to receiving a user detection notification from the gate control unit indicating that a user has been detected at the entrance of the gate device; The biometric authentication control unit described in Appendix 8, wherein the judgment unit judges whether the person to be authenticated is allowed to pass through the gate device based on the result of the biometric authentication and the result of the final judgment, and notifies the gate control unit of the judgment result via the relay unit. [Appendix 10] 10. The biometric authentication control unit according to claim 9, wherein the determination unit transmits a notice of permission to pass to the gate control unit via the relay unit when it determines that the person to be authenticated is allowed to pass through the gate device. [Appendix 11] a server device that performs biometric authentication; a gate device connected to the server device; Including, The gate device an authentication subject detection unit that detects a first user at a predetermined position on one side as an authentication subject; a monitor control unit that, in response to requesting the server device to authenticate the detected person to be authenticated or receiving a notification of successful authentication from the server device, displays on a monitor that a second user on the other side is not allowed to enter the gate device; and A system comprising: [Appendix 12] In the gate device, Detecting a first user at a predetermined position on one side as an authenticatee; A control method for a gate device, which, in response to requesting authentication of the detected person to be authenticated from a server device or receiving successful authentication from the server device, displays on a monitor that a second user on the other side cannot enter the device. [Appendix 13] The computer installed in the gate device A process of detecting a first user at a predetermined position on one side as an authenticatee; a process of displaying on a monitor a message indicating that a second user on the other side cannot access the device itself in response to a request to the server device for authentication of the detected person to be authenticated or a notification of successful authentication from the server device; A computer-readable storage medium that stores a program for executing the above.

[0262] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0263] 10 Server device 20, 20-1 to 20-3, 100 gate device 31, 32 Camera 33, 34 Monitor 41~44 Detection sensors Gates 51 and 52 61, 61a, 61b Biometric control unit 62 Relay unit 63 Gate Control Unit 70~73 users 101, 202 Subject detection unit 102, 302 Monitor control unit 201, 301, 401, 501 Communication control unit 203 Authentication Request Section 204 Subject Tracking Unit 205 Traffic Permit Judgment Department 206 Table Management Department 207, 303, 404, 505 Storage section 311 processor 312 memory 313 Communication Interface 402 Intruder detection unit 403 Gate control section 502 User Registration Department 503 Authentication Department 504 Gate passage notification processing unit

Claims

1. a biometric information acquisition unit that acquires biometric information of a first user detected at a predetermined position on one side of the device; a biometric authentication request unit that requests a server device to perform biometric authentication using the acquired biometric information; a determination result acquisition unit that acquires a passability determination result based on the user information identified by the biometric authentication; a control unit that controls the user's entry into the device based on the acquired passability determination result; a monitor control unit that, when allowing the first user to enter the device, displays on a monitor that a second user on the other side of the device is not allowed to enter the device; Equipped with When a plurality of first users are permitted to pass, the control unit transmits a passage permission notice to the gate control unit a number of times corresponding to the number of permitted users; the gate control unit permits passage of a number of users according to the number of times the passage permission notice has been received, and closes the gate to refuse passage if more users than the number of users attempt to pass; Gate device.

2. 2. The gate device according to claim 1, wherein the monitor control unit, in response to requesting authentication of the detected first user from the server device or receiving successful authentication from the server device, displays on a first monitor visible to the first user that the first user is allowed to enter the device, and displays on a second monitor visible to the second user that the second user is not allowed to enter the device.

3. 3. The gate device according to claim 2, wherein the monitor control unit displays on the first and second monitors, when the inside of the device is unmanned, that users on the one side and the other side can enter the device.

4. a tracking unit that tracks the first user; a determination unit that determines whether the first user is allowed to pass through the device itself based on a result of the biometric authentication of the first user by the server device and a result of tracking determination of the first user at an entrance of the device itself; The gate device according to claim 1 , further comprising:

5. an authentication subject detection unit that detects an authentication subject based on an eye distance calculated from a face image included in the image data captured at the predetermined position; The gate device according to claim 1 , further comprising:

6. 5. The gate device according to claim 4, wherein the tracking unit starts tracking the first user at the same time that authentication of the first user is requested from the server device.

7. a biometric information acquisition unit that acquires biometric information of a first user detected at a predetermined position on one side of the gate device; a biometric authentication request unit that requests a server device to perform biometric authentication using the acquired biometric information; a determination result acquisition unit that acquires a passability determination result based on the user information identified by the biometric authentication; a control unit that controls the user's entry into the device based on the acquired passability determination result; Equipped with The biometric information acquisition unit In response to the biometric authentication being requested, a biometric authentication start notification is sent to the gate control unit via the relay unit; when allowing the first user to enter the gate device, the relay unit controls a first monitor installed on the one side of the gate device to display that the first user is permitted to enter the gate device, and a second monitor installed on the other side of the gate device to display that the first user is not permitted to enter the gate device; When a plurality of the first users are permitted to pass, the control unit transmits a passage permission notice to the gate control unit via the relay unit a number of times corresponding to the number of permitted users; the gate control unit permits passage of a number of users according to the number of times the passage permission notice has been received, and closes the gate to refuse passage if more users than the number of users attempt to pass; Biometric control unit.

8. a server device that performs biometric authentication; a gate device connected to the server device; Including, The gate device is a biometric information acquisition unit that acquires biometric information of a first user detected at a predetermined position on one side of the gate device; a biometric authentication request unit that requests biometric authentication using the acquired biometric information; a determination result acquisition unit that acquires a passability determination result based on the user information identified by the biometric authentication; a control unit that controls the user's entry into the device based on the acquired passability determination result; a monitor control unit that, when allowing the first user to enter the gate device, displays on a monitor a message indicating that a second user on the other side of the gate device is not allowed to enter the gate device; Equipped with When a plurality of first users are permitted to pass, the control unit transmits a passage permission notice to the gate control unit a number of times corresponding to the number of permitted users; the gate control unit permits passage of a number of users according to the number of times the passage permission notice has been received, and closes the gate to refuse passage if more users than the number of users attempt to pass; system.

9. In the gate device, acquiring biometric information of a first user detected at a predetermined position on one side of the device; requesting a server device for biometric authentication using the acquired biometric information; Obtain a passability determination result based on the user information identified by the biometric authentication, Controlling the user's entry into the device based on the acquired passability determination result; When the first user is allowed to enter the device, a message is displayed on a monitor indicating that a second user on the other side of the device is not allowed to enter the device; In the step of controlling, if a plurality of the first users are permitted to pass, a notice of permission to pass is transmitted to the gate control unit a number of times corresponding to the number of permitted users; the gate control unit permits passage of a number of users according to the number of times the passage permission notice has been received, and closes the gate to refuse passage if more users than the number of users attempt to pass; A method for controlling a gate device.

10. The computer installed in the gate device acquiring biometric information of a first user detected at a predetermined position on one side of the gate device; a process of requesting a server device for biometric authentication using the acquired biometric information; A process of acquiring a passability determination result based on user information identified by the biometric authentication; A process of controlling the user's entry into the device based on the acquired passability determination result; a process of displaying on a monitor, when the first user is allowed to enter the gate device, that a second user on the other side of the gate device is not allowed to enter the gate device; Execute In the control process, when a plurality of the first users are permitted to pass, a pass permission notice is sent to the gate control unit a number of times corresponding to the number of permitted users; causing the gate control unit to permit passage of a number of users corresponding to the number of times the passage permission notice has been received, and to close the gate and refuse passage if more users than the number of users attempt to pass; A computer program that stores a program.

Images