Ticket gate system, ticket gate method, and ticket gate program

Abstract

To ensure the liquidity of users.SOLUTION: A ticket examination system according to an embodiment includes: an acquisition unit for acquiring an image captured with a camera recording an aisle of a ticket gate; a face authentication unit that authenticates the face of a first user based on the captured image; and a control unit that tracks the first user based on the captured image and determines whether a second user has been detected when it is determined that the first user is being tracked.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] Embodiments of the present invention relate to a ticket gate system, a ticket gate method, and a ticket gate program.

Background Art

[0002] When a person enters or exits a ticket gate, the ticket gate or a server connected to the ticket gate determines whether to permit or deny entry / exit by face authentication as a measure against the transfer of discounts that can be used by specific persons.

[0003] When performing face authentication, there is a possibility of misrecognizing a face even when the user is not visible at all. Furthermore, there may be cases where the face of a user who has no intention of entering or exiting is detected. For example, there is a technology that captures the face of a user and performs face authentication triggered by a passerby crossing a certain boundary line.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When performing face authentication, there may be cases where the face of the second user cannot be captured by the camera because the second user is behind the first user. Alternatively, there may be cases where the user's face cannot be captured by the camera due to luggage or the like. On the other hand, the user has no means of knowing that their face is not being captured by the camera. Therefore, it is difficult to maintain an appropriate distance between users for face authentication.

[0006] This invention has been made paying attention to the above circumstances, and an object thereof is to provide a technology capable of ensuring the mobility of users by reducing the possibility of stopping users at the ticket gate when their faces cannot be captured.

Means for Solving the Problem

[0007] The ticket gate system according to the embodiment includes an acquisition unit that acquires a captured image captured by a camera that captures a passage of a ticket gate, a face authentication unit that authenticates the face of a first user based on the captured image, and a control device that tracks the first user based on the captured image and determines whether a second user has been detected when it is determined that the first user can be tracked.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0009] Hereinafter, a ticket gate system, a ticket gate method, and a ticket gate program will be described in detail with reference to the drawings. In the following embodiments, parts with the same number are assumed to perform the same operation, and redundant explanations will be omitted. For example, when there are a plurality of identical or similar elements, a common reference numeral may be used to describe each element without distinction, or a branch number may be used in addition to the common reference numeral to describe each element separately.

[0010] FIG. 1 is a conceptual diagram showing a configuration example of a ticket gate system 10 according to an embodiment. The ticket gate system 10 is a system for controlling entry and exit at ticket gates in transportation facilities such as railways or buses, for example. Needless to say, the ticket gate system 10 can also be applied to entry and exit at live venues and the like.

[0011] As shown in FIG. 1, the ticket gate system 10 includes a ticket gate 20, a camera 21, a media detection unit 22, a door 23, a central server 30, and the like.

[0012] The ticket gate 20 controls whether to permit passage for users (passengers) attempting to pass through the passage (enter or exit). One or more ticket gates 20 may be installed at ticket gates in stations or the like. And each of these ticket gates 20 forms a passage for users to pass through. Also, the ticket gate 20 can be connected to the central server 30 via a network or by wire, and transmits and receives various information to and from the central server 30.

[0013] The camera 21 is installed corresponding to the ticket gate 20. For example, the camera 21 is installed so as to secure a shooting range capable of shooting the faces of users passing through the passage. Therefore, the camera 21 may be installed on the ticket gate 20 or at a location separate from the ticket gate 20. Here, in the example shown in FIG. 1, an example where the camera 21 is installed at a location separate from the ticket gate 20 is shown.

[0014] The media detection unit 22 is installed, for example, on the ticket gate 20 that performs entry and exit processing using a medium (for example, an IC card ticket, a two-dimensional code, a barcode, etc.) held by the user. And the media detection unit 22 detects the user's medium and reads the information stored in the medium. For example, when the user presents an IC card ticket to the media detection unit 22, the media detection unit 22 can detect the IC card ticket and transmit and receive various information to and from the IC card ticket.

[0015] The door 23 is installed on the ticket gate 20 and physically blocks the passage of the user when passage is not permitted.

[0016] The central server 30 is connected to the ticket gate 20 either by wire or wirelessly. The central server 30 is installed in the station premises, the station management room, etc. Also, the central server 30 can perform various authentications such as face authentication based on various information received from the ticket gate 20.

[0017] [First Embodiment] (Configuration) Next, the configuration of the ticket gate 20 in the ticket gate system 10 according to the first embodiment will be described.

[0018] FIG. 2 is a block diagram showing a configuration example of the ticket gate 20 according to the first embodiment. As shown in FIG. 2, the ticket gate 20 includes a control device 201, a storage unit 202, a communication unit 203, a media authentication unit 204, a face authentication unit 205, an interface 206, a passage control unit 207, and a notification unit 208.

[0019] The control device 201 controls various operations in the ticket gate 20. The control device 201 has a processor that executes a program. For example, the control device 201 includes a processor, a memory, an interface, etc. The control device 201 executes various processes by the processor executing a program stored in the storage unit 202 or the memory in the control device 201.

[0020] For example, the control device 201 operates as an acquisition unit. The control device 201 acquires a captured image from the camera 21 through the interface 206 described later. Further, the control device 201 receives various information from the media detection unit 22 through the interface 206. Then, the control device 201 stores the acquired various information in the storage unit 202. Also, the control device 201 may transmit the acquired various information to the central server 30 through the communication unit 203 described later.

[0021] For example, the control device 201 operates as a detection unit. The control device 201 detects the face of the user from the captured image obtained from the camera 21. Here, the control device 201 is not limited to only detecting the face of the user, and it is also possible to detect the body and luggage of the user.

[0022] Furthermore, the control device 201 operates as an access control unit. The control device 201 controls the access control unit 207 to control the access of the user. When at least one of the medium authentication or the face authentication of the user is successful, the control device 201 permits the access (entry or exit) of the user. On the other hand, when either the medium authentication or the face authentication fails, the control device 201 controls the access control unit 207 to prevent the access of the user by setting the user as not allowed to pass.

[0023] The storage unit 202 is composed of a rewritable non-volatile memory such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 202 stores a face database. The face database is a database of face data pre-registered by the users who use the ticket gate 20. For example, the control device 201 operating as an acquisition unit acquires face data based on the face image captured by the camera 21 installed in the ticket vending machine, and stores it in the face database 2021 of the storage unit 202. Alternatively, the control device 201 operating as an acquisition unit may receive a face image of the user captured by the user's own mobile terminal or the like, acquire face data based on the acquired face image, and store it in the face database 2021.

[0024] The communication unit 203 is a communication interface including a communication module for performing wired or wireless transmission and reception of various data with the central server 30. The communication unit 203 transmits and receives various information with the central server 30. The communication module may be a general communication module as long as it can communicate with the central server 30.

[0025] The media authentication unit 204 receives from the control device 201 the information obtained by the media detection unit 22 from the media. Then, the media authentication unit 204 determines whether the media can be authenticated based on the received information. That is, the media authentication unit 204 determines whether to permit the user to pass through.

[0026] The face authentication unit 205 receives from the control device 201 face detection information indicating that the face of the user has been detected from the captured image captured by the camera 21. The face authentication unit 205 performs face authentication based on the face detection information and the face database. The face authentication is executed, for example, depending on whether the data corresponding to the data of the face of the user detected by the control device 201 exists in the face database 2021. The face authentication unit 205 may output the authentication result to the control device 201.

[0027] The interface 206 is an interface that enables the transmission and reception of various information between the camera 21 and the media detection unit 22 shown in FIG. 1. Here, the interface may include a communication interface. For example, it may be possible to wirelessly transmit and receive various information from the camera 21.

[0028] The camera 21 starts shooting when the ticket gate 20 is activated, that is, when it is possible to determine whether to let the user pass through. The control device 201 acquires the captured image and performs face detection of the user. Also, the control device 201 may store the captured image in the storage unit 202.

[0029] The media detection unit 22 is activated simultaneously when the ticket gate 20 is activated. When the media detection unit 22 can detect the media, it may light up in a color such as green or blue to notify the user that authentication is possible. On the other hand, when canceling the authentication of the media, it may turn off or light up in red to notify the user that authentication cannot be performed.

[0030] The access control unit 207 controls the access of users when passing through the passage beside the ticket gate 20 (entering or exiting). The access control unit 207 is driven to control the access of users according to the instructions of the control device 201. For example, the access control unit 207 has a drive mechanism for controlling the opening and closing of the door 23 and the door 23. When the access control unit 207 blocks the access of users (entering or exiting), it operates to close the door 23, and when it permits the access of users, it operates to open the door 23. Also, the access control unit 207 may be controlled by the control device 201.

[0031] The notification unit 208 includes a display, a speaker, a lamp, etc. The display displays various information to the user. Therefore, the display is provided at a position visible to the user who intends to pass through the ticket gate 20. For example, the display displays information indicating whether access is permitted based on the face authentication result for the user under the control of the control device 201. The speaker outputs sound at a volume that can be recognized by the user. The speaker outputs a voice such as an alert to the user for whom access is determined to be impossible under the control of the control device 201. The lamp may light up in blue or may not light up when the user's access is permitted. On the other hand, when the user's access is determined to be impossible, it may light up in red to notify the user that access is not possible.

[0032] FIG. 3 is a block diagram showing a configuration example of the central server 30 according to the first embodiment. As shown in FIG. 3, the central server 30 includes a control device 301, a storage unit 302, a communication unit 303, a media authentication unit 304, a face authentication unit 305, and a display unit 306.

[0033] The control device 301 controls various operations in the central server 30. The control device 301 has a processor that executes a program. For example, the control device 301 includes a processor, a memory, an interface, etc. The control device 301 executes various processes by the processor executing a program stored in the storage unit 302 or the memory in the control device 301.

[0034] For example, the control device 301 can execute the same operations as those described for the control device 201 of the ticket gate 20. For example, the control device 301 controls the passage of the user by transmitting information for controlling the passage control unit 207 to the ticket gate 20 through the communication unit 303 described later. When either the authentication of the medium or the face authentication of the user is successful, the control device 301 transmits information permitting the passage (entry or exit) of the user to the ticket gate 20. On the other hand, when either the medium authentication or the face authentication fails, the control device 301 transmits information indicating that the passage of the user is prohibited to the ticket gate 20. The control device 201 of the ticket gate 20 that has received the information controls the passage control unit 207 to block the passage of the user.

[0035] The storage unit 302 is composed of a rewritable non-volatile memory such as an HDD or an SSD. The storage unit 202 stores a face database 3021. The face database 3021 is a database of face data pre-registered by users who use the ticket gate 20. Here, the face database 3021 may store the same data as the face database 2021 stored in the storage unit 202 of the ticket gate 20. For example, the face data is acquired based on a face image captured by a camera installed in the ticket vending machine. Alternatively, it is acquired based on a face image of the user captured by a mobile terminal or the like held by the user.

[0036] The communication unit 303 is a communication interface including a communication module for transmitting and receiving various data to and from the ticket gate 20 by wire or wirelessly. The communication unit 303 transmits and receives various information to and from the ticket gate 20. For example, the communication unit 303 receives the captured data captured by the camera 21 disposed in the ticket gate 20. Then, the communication unit 303 may store the received captured data in the storage unit 302. Further, the communication unit 303 receives the information acquired by the medium detection unit 22 from the ticket gate 20. Then, the communication unit 303 outputs the information to the medium authentication unit 304 and may store it in the storage unit 302. The communication module may be a general communication module as long as it can communicate with the ticket gate 20.

[0037] The media authentication unit 304 acquires, under the control of the control device 301, the information obtained by the media detection unit 22 of the ticket gate 20 from the ticket gate 20. Then, the media authentication unit 304 determines whether the passage of the user may be permitted based on the acquired information. Further, the media authentication unit 304 transmits the determination result to the ticket gate 20 through the communication unit 303.

[0038] The face authentication unit 305 receives, from the control device 301, face detection information indicating that the face of the user has been detected from the captured image acquired from the communication unit 303. The face authentication unit 205 performs face authentication based on the face detection information and the face database 3031. The face authentication is executed, for example, depending on whether the data corresponding to the face data of the user detected by the control device 201 exists in the face database 2021. The face authentication unit 305 may output the authentication result to the control device 301. Then, the control device 301 may transmit the result to the ticket gate 20 through the communication unit 303.

[0039] The display unit 306 is a display device using, for example, liquid crystal, organic EL, etc., and displays sounds, characters, images, etc. under the control of the control device 301. That is, the display unit 306 can display various information to the administrator who manages the central server 30.

[0040] (Operation) FIG. 4 is a flowchart showing an example of the processing procedure in the ticket gate system 10 shown in FIG. 1. The operations of this flowchart are realized by the control device 201, the media authentication unit 204, and the face authentication unit 205 of the ticket gate 20 reading and executing the programs stored in the storage unit 202. Note that some of the operations of this flowchart may be realized by the control device 301 and the face authentication unit 305 of the central server 30 reading and executing the programs stored in the storage unit 302.

[0041] Each user has previously registered the user's face data associated with the ID of the medium using an application or the web, or the user's face data has been photographed by the ticket vending machine and is associated with the ID of the medium issued by the ticket vending machine. Then, the face data is transmitted to the ticket gate 20 and the central server, and is assumed to be registered in at least one of the face database 2021 in the storage unit 202 of the ticket gate 20 or the face database 3031 in the storage unit 302 of the central server 30.

[0042] In addition, the storage unit 202 of the ticket gate 20 or the storage unit 302 of the central server 30 may store the ID of the medium that can pass through the ticket gate 20.

[0043] First, when the control device 201 detects the face of the user (the first user) from the captured image captured by the camera, this flowchart starts. The control device 201 outputs face detection information indicating that it has detected the face of the user to the face authentication unit 205. Here, the control device 201 may detect not only the user but also the user's body and luggage. Note that this flowchart may start when the medium detection unit 22 detects the medium and the control device 201 receives the detection information.

[0044] The face authentication unit 205 authenticates the first user (step ST101). The face authentication unit 205 acquires the face data of the user based on the face detection information. Then, the face authentication unit 205 compares the acquired face data with the data stored in the face database 2021 of the storage unit 202. If the data corresponding to the face data exists in the face database 2021, the face authentication unit 205 authenticates the first user. The face authentication unit 205 may output face authentication information indicating that it has authenticated the first user to the control device 201. In the following description, on the other hand, if the data corresponding to the face data does not exist in the face database 2021, the face authentication unit 205 determines that the authentication of the first user has failed and may output face non-authentication information to the control device 201. In this case, the control device 201 may output an instruction to close the door 23 to the passage control unit 207 so as not to permit the passage of the first user.

[0045] When the medium detection unit 22 detects a medium, the control device 201 receives the medium information acquired by the medium detection unit 22 from the medium. Then, the control device 201 outputs the various types of information to the medium authentication unit 204. The medium authentication unit 204 authenticates the first user based on the medium information. Also, in this case, the control device 201 may acquire the captured image captured by the camera 21, and detect the face, body, luggage, etc. of the first user from the acquired captured image.

[0046] In the following description, for the sake of simplicity, the case where the face authentication unit 205 succeeds in authenticating the first user will be described.

[0047] The control device 201 tracks the first user (step ST102). The control device 201 tracks the face of the first user from the captured image captured by the camera 21, regarding the first user who can be acquired from the captured data captured by the camera 21 as the authenticated user. Also, at least one of the body or luggage of the first user may be included as the tracking target.

[0048] The control device 201 determines whether it is possible to track the first user (step ST103). The control device 201 determines whether it is possible to track the first user from the captured data. When it is determined that the face of the first user cannot be tracked, the process proceeds to step ST104. On the other hand, when it is determined that the face of the first user, which is the tracking target, can be tracked, the process proceeds to step ST106.

[0049] The control device 201 determines whether it has detected the face of the second user from the captured image (step ST104). The control device 201 determines whether it has detected the face of the second user, who is the next user, based on the captured image stored in the storage unit 202 or received from the camera 21. If it has detected the face of the second user, the control device 201 outputs face detection information indicating the detection to the face authentication unit 205. On the other hand, if it has not detected the face of the second user, the process returns to step ST104 again. That is, the control device 201 continues the determination described in step ST104 until it can detect the face of the second user.

[0050] The face authentication unit 205 starts the authentication of the second user (step ST105). The face authentication unit 205 acquires the face data of the second user based on the face authentication information. Then, similar to step ST101, the face authentication unit 205 compares the face data with the data stored in the face database 2021. If it is determined as a result of the comparison that there is data corresponding to the face data, the face authentication unit 205 will authenticate the second user. Although an example where the process ends is shown in FIG. 4, the process may return to step ST102 with the second user regarded as the first user.

[0051] The control device 201 determines whether it has detected a face other than the first user (step ST106). The control device 201 determines whether it has detected a face other than the first user from the captured data. For example, if it has detected the face of the second user behind the first user, the control device 201 outputs second detection information indicating the detection of the face of the second user to the face authentication unit 205. Then, the process proceeds to step ST105. On the other hand, if it cannot detect a face other than the first user, there may be a possibility that the face of the second user is in the blind spot caused by the first user (face, body, or luggage) being reflected in the captured image. In this case, the process proceeds to step ST107.

[0052] The control device 201 stops the authentication process (step ST107). When stopping the authentication process for the second user, the control device 201 may output a signal to close the door 23 to the access control unit 207 to close the door 23. Further, the control device 201 may output information indicating that the authentication process is stopped to the notification unit 208. The notification unit 208 may display information for indicating that the face of the user cannot be detected on the display of the notification unit 208. The notification unit 208 may cause the lamp of the notification unit 208 to light up or turn off in red or the like. Then, the process returns to step ST103. That is, the control device 201 determines whether the first user can be tracked.

[0053] In addition, when the process returns to step ST103 and a face other than the first user is detected in step ST106, the control device 201 resumes the authentication process. That is, the control device 201 may output a signal to open the door to the access control unit 207 and output information indicating that the authentication process has been resumed to the notification unit 208. The notification unit 208 may display that the face of the user has been detected on the display and may cause the color of the lamp to light up in blue or green or the like.

[0054] Also, in the example of the flowchart shown in FIG. 4, an example executed by the ticket gate 20 is shown, but the central server 30 may execute each step. In this case, the ticket gate 20 transmits the information acquired by the camera 21 and the medium detection unit 22 to the central server 30. Then, each unit of the central server 30 may execute the process shown in FIG. 4 and transmit the processing result to the ticket gate 20.

[0055] (Operational Effects of the First Embodiment) According to the embodiment described above, while the first user is being tracked, the authentication process is stopped unless the face of the second user is recognized, and the second user is notified that the authentication process is stopped. As a result, the second user can recognize that the face is not captured by the camera 21.

[0056] According to the notification, the second user will adjust the distance from the first user so that the face is reflected in the camera 21. As a result, the distance between the users becomes an appropriate distance, and the face of the second user can be detected and authenticated.

[0057] [Second Embodiment] (Configuration) The configuration according to the second embodiment is the same as the first embodiment described with reference to FIGS. 1 to 3, and thus the description thereof is omitted here.

[0058] (Operation) FIG. 5 is a flowchart showing an example of a processing procedure in the ticket gate system 10 shown in FIG. 1. The operation of this flowchart is realized by the control device 201, the medium authentication unit 204, and the face authentication unit 205 of the ticket gate 20 reading and executing the program stored in the storage unit 202. Note that a part of the operation of this flowchart may be realized by the control device 301 and the face authentication unit 305 of the central server 30 reading and executing the program stored in the storage unit 302.

[0059] The start timing, steps ST201 to ST205 in FIG. 5 are the same as the start timing, steps ST101 to ST105 described with reference to FIG. 4, and thus the descriptions thereof are omitted.

[0060] The control device 201 determines whether a body or luggage other than the first user is detected (step ST206). The control device 201 determines whether a body or luggage other than the first user is detected from the captured data. For example, if the face of the second user cannot be detected behind the first user but a body or luggage is detected, the control device 201 determines that the second user is present. In this case, the process proceeds to step ST207. On the other hand, if the body or luggage of the second user cannot be detected, the process returns to step ST203.

[0061] Step ST207 is the same as step ST207 described with reference to FIG. 4, and thus these descriptions are omitted.

[0062] The control device 201 determines whether or not the face of the second user has been detected (step ST208). The control device 201 determines whether or not the face of the second user has been detected from the captured data. For example, when the second user moves to a location where the face can be captured by the camera 21, the control device 201 outputs second detection information indicating that the face of the second user has been detected to the face authentication unit 205. Then, the process proceeds to step ST205. On the other hand, when the face of the second user cannot be detected, the process returns to step ST203. In this case, that is, the control device 201 determines whether or not the first user can be tracked while aborting the authentication process.

[0063] (Operation and Effect of the Second Embodiment) According to the embodiment described above, when the body or luggage of the second user is detected but the face cannot be detected, it is highly likely that the second user is in a blind spot where the camera 21 behind the first user cannot capture the image. Therefore, the authentication process is aborted, and the second user is notified that the authentication process has been aborted. As a result, the second user can recognize that the face is not captured by the camera 21.

[0064] In accordance with the notification, the second user adjusts the distance from the first user so that the face is captured by the camera 21. As a result, the distance between the users becomes an appropriate distance, and the face of the second user can be detected and authenticated.

[0065] Also, in the example of the flowchart shown in FIG. 5, an example executed by the ticket gate 20 is shown, but the central server 30 may execute each step. In this case, the ticket gate 20 transmits the information acquired by the camera 21 and the medium detection unit 22 to the central server 30. Then, each unit of the central server 30 may execute the process shown in FIG. 5 and transmit the processing result to the ticket gate 20.

[0066] [Other Embodiments] Note that the present invention is not limited to the above-described embodiments. For example, the first embodiment and the second embodiment may be combined. For example, instead of immediately aborting the authentication process when the face of the first person cannot be detected, the determination described in step ST206 may be performed. For example, when a body or luggage other than the first user cannot be detected, the process may return to step ST103.

[0067] In short, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the gist thereof at the implementation stage. Also, the respective embodiments may be combined and implemented as appropriate, and in that case, the combined effects can be obtained. Furthermore, the above-described embodiments include inventions at various stages, and various inventions can be extracted by appropriate combinations of a plurality of disclosed constituent elements.

Explanation of Reference Numerals

[0068] 10…Ticket gate system 20…Ticket gate machine 201…Control device 202…Storage unit 2021…Face database 203…Communication unit 204…Media authentication unit 205…Face authentication unit 206…Interface 207…Passage control unit 208…Notification unit 21…Camera 22…Media detection unit 23…Door 30…Central server 301…Control device 302…Storage unit 3021…Face database 303…Communication unit 304…Media authentication unit 305…Face authentication unit 306…Display unit

Claims

1. An acquisition unit that acquires a captured image captured by a camera that captures a passage of a ticket gate; A face authentication unit that authenticates the face of a first user based on the captured image; A control device that tracks the first user based on the captured image and determines whether a second user has been detected when it is determined that the first user can be tracked; A ticket gate system comprising:

2. Detecting the second user includes detecting the face of the second user. The ticket gate system according to claim 1.

3. When it is determined that the face of the second user cannot be detected, the control device aborts the authentication process of the second user. The ticket gate system according to claim 2.

4. When it is determined that the face of the second user has been detected, the face authentication unit performs face authentication of the second user. The ticket gate system according to claim 2.

5. Detecting the second user includes detecting at least one of the body or luggage of the second user. The ticket gate system according to any one of claims 1 to 4.

6. When at least one of the body or luggage of the user is detected, the control device aborts the authentication process of the second user. The ticket gate system according to claim 5.

7. The tracking includes detecting the face, body, and luggage of the first user. The ticket gate system according to any one of claims 1 to 6.

8. When it is determined that the tracking cannot be performed, the control device determines whether the face of the second user can be detected. The ticket gate system according to any one of claims 1 to 7.

9. Obtaining a captured image captured by a camera that captures a passage of a ticket gate; Authenticating the face of a first user based on the captured image; Tracking the first user based on the captured image; Determining whether a second user has been detected when it is determined that the first user can be tracked; A ticket gate method comprising:

10. A ticket gate program that causes a processor to function as each part of the ticket gate system according to any one of Claims 1 to 8.

Images