Gate device, traffic control method, and traffic control program

Abstract

To suppress determination on whether or not to permit passage of a passageway by means of personal authentication with a face image contrary to the intension of a user who wishes to use a medium.SOLUTION: A gate device includes an imaging unit, a medium information reading unit, a first determination unit, a second determination unit, an output unit, and a deciding unit. The first determination unit determines whether to permit a user to pass through a passageway by means of personal authentication with a face image imaged by the imaging unit. The second determination unit determines whether to permit the user to pass through the passageway by means of medium information read by the medium information reading unit from a medium. The output unit outputs a reminder about a failure to present the medium after the imaging unit images the face of the user entering the passageway. If the medium information reading unit has not read the medium information from the medium at a time point when the user arrives at an entry detection position set on the passageway, the deciding unit decides whether to permit the user to pass through the passageway based on a determination result obtained by the first determination unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for preventing a processing against the intention of a user from being performed when passing through a gate regardless of the type of the ticket.

Background Art

[0002] Conventionally, some automatic ticket gates installed at the ticket gates of stations are configured to determine whether a user can pass through the ticket gate passage based on either the ticket information recorded on the ticket medium (contactless IC ticket, optical reading ticket, magnetic ticket) held by the user or the personal authentication using a face image (see Patent Document 1). The automatic ticket gate described in this Patent Document 1 has a configuration for preventing the passage through the ticket gate passage from being performed by personal authentication using a face image against the intention of a user who wishes to use the ticket medium. <映

[0003] Specifically, the imaging of the user's face and the personal authentication using the captured face image are performed before reaching the position where the user can present the ticket medium held by the user to the automatic ticket gate (a position where the user can insert or hold it up). The automatic ticket gate described in Patent Document 1 determines whether the user has presented the ticket medium even when the personal authentication using the face image is successful. The automatic ticket gate is configured to determine whether the user can pass through the ticket gate passage based on the ticket information recorded on the ticket medium when the user presents the ticket medium.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] It should be noted that there is an unclear symbol "<映 " in the original text which is translated as "<映 " as it is not clear what it exactly represents. You may need to check and correct it if it is an incorrect symbol in the original.However, even when users wish to use a physical ticket, they sometimes forget to present their ticket at the automatic ticket gate and enter the ticket passage. In this case, the system may determine whether or not the user is allowed to pass through based on facial recognition. In particular, users who regularly use facial recognition were more likely to forget to present their physical ticket at the automatic ticket gate.

[0006] The objective of this invention is to provide a technology that prevents the determination of whether or not a user is allowed to pass through a passageway based on facial image authentication, against the will of the user who wishes to use the medium. [Means for solving the problem]

[0007] The gate device of this invention is configured as shown below to achieve the above objective.

[0008] This gate device comprises an imaging unit, a media information reading unit, a first determination unit, a second determination unit, an output unit, and a decision unit. The imaging unit captures the face of a user entering the passageway. The media information reading unit receives a medium presented by the user and reads the media information recorded on that medium. The first determination unit determines whether to allow the user to pass through the passageway based on the facial image captured by the imaging unit. The second determination unit determines whether to allow the user to pass through the passageway based on the media information read from the medium by the media information reading unit. The output unit outputs a reminder to the user to present their medium after the imaging unit has captured the face of a user entering the passageway. The decision unit determines whether to allow the user to pass through the passageway based on the determination result of the first determination unit, if the media information reading unit has not read media information from the medium when the user reaches the entry detection position set in the passageway.

[0009] In this configuration, when a user wishes to enter a passageway using a medium, it is possible to suppress the determination of whether or not they are allowed to pass through based on facial image authentication.

[0010] Furthermore, for example, the decision unit of this gate device, when a user reaches the entry detection position set in the passageway, will decide whether to allow the user to pass through the passageway based on the determination result from the second determination unit, if the media information reading unit has read media information from the media when the user reaches that position.

[0011] Furthermore, for example, when a user reaches an entry detection position set in the passageway, the decision unit of this gate device reads media information from the media using the media information reading unit, and if the second determination unit determines that passage through the passageway should not be permitted, it decides whether to permit the user to pass through the passageway based on the determination result of the first determination unit.

[0012] Furthermore, for example, if the first determination unit determines that passage through the passage is not permitted, the output unit of this gate device will output a warning that includes this determination result.

[0013] Furthermore, for example, if the first determination unit determines that passage through the passage is permitted, the output unit of this gate device will output a warning that includes this determination result.

[0014] Furthermore, for example, the output unit of this gate device displays a warning message on the display unit. [Effects of the Invention]

[0015] This invention prevents the determination of whether or not a user is allowed to pass through a passageway based on facial image authentication, against the will of the user who wishes to use the medium. [Brief explanation of the drawing]

[0016] [Figure 1] Figure 1 is an illustrative diagram of an automatic ticket gate according to Configuration Example 1. [Figure 2] Figure 2 is a block diagram showing the configuration of the automatic ticket gate in Configuration Example 1. [Figure 3] Figure 3 is a block diagram showing the configuration of the central server in Configuration Example 1. [Figure 4] Figure 4 shows the processing pattern in Configuration Example 1. [Figure 5]FIG. 5 is a diagram showing a processing pattern in Configuration Example 1. [Figure 6] FIG. 6 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. [Figure 7] FIG. 7 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. [Figure 8] FIG. 8 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. [Figure 9] FIG. 9 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. [Figure 10] FIG. 10 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. [Figure 11] FIG. 11 is a flowchart showing the process flow of the automatic ticket gate in the operation example. [Figure 12] FIG. 12 is a flowchart showing the process flow of the automatic ticket gate in the operation example. [Figure 13] FIG. 13 is an image diagram of the process of entering the automatic ticket gate in Modified Example 1. [Figure 14] FIG. 14(A) and FIG. 14(B) are image diagrams of the display unit of the automatic ticket gate in Modified Example 2.

Embodiments for Carrying Out the Invention

[0017] Hereinafter, embodiments for carrying out the present invention will be described with reference to several drawings.

[0018] <1. Application Example 1> First, an example to which the present invention is applied will be described using FIG. 1. Here, an example in which user 30 enters the station premises using a ticket medium 300, in this case a contactless IC ticket, will be used for the description. FIG. 1 is an image diagram of the automatic ticket gate 1 and the station operation system.

[0019] Each station in the railway network is equipped with an automatic ticket gate 1, ticket vending machines and fare adjustment machines (not shown in the diagram), and other station equipment. A center server 5 is also installed at the center. The automatic ticket gate 1 comprises a ticket processing unit 11, an imaging unit 12, a user detection unit 14, and a display unit 17.

[0020] The ticket processing unit 11 reads the information stored in the ticket medium 300 (contactless IC ticket) held by the user 30 when the user holds the ticket medium over it. The imaging unit 12 captures the face of the user using the automatic ticket gate 1. The user detection unit 14 detects the user passing through the ticket gate passage of the automatic ticket gate 1. The display unit 17 displays information on whether passage is permitted when using the automatic ticket gate 1, or information on whether the ticket information stored in the ticket medium is usable.

[0021] At each station, the station equipment such as automatic ticket gates 1 and ticket vending machines installed at that station are connected via a network such as a LAN. At least one unit of station equipment such as automatic ticket gates 1 and ticket vending machines is installed at each station. Furthermore, these station equipment units are connected to a central server 5 via a network 6 such as a dedicated line or public line. The configuration including these connected devices via network 6 constitutes the station system.

[0022] Automatic ticket gate 1 is installed at the ticket gate of a station, as is well known, and processes tickets for users entering the station premises and users exiting the station premises.

[0023] User 30 possesses a ticket medium 300 (contactless IC ticket). The ticket medium 300 stores ticket information. This ticket information may be for a commuter pass or a regular ticket for which a fare is incurred each time the train is used. In addition, the center server 5 stores ticket information linked to the ticket medium 300. As a result, User 30 can board the train using the ticket information registered in the ticket medium 300.

[0024] For example, if the ticket medium 300 is an SF card, the ticket information includes an identification number IDi that identifies the ticket medium 300, and entry / exit history information, which is a history of ticket gate processing using the ticket medium 300. In addition, the ticket medium 300 is charged with value used to settle fares for using railways, etc., and is registered, for example, as a remaining balance. This identification number IDi is a unique identification number that cannot be rewritten for the ticket medium 300. Note that this identification number IDi may also be a manufacturing number (IDm).

[0025] Furthermore, if the ticket medium 300 is a commuter pass, the ticket information (commuter pass information) includes an identification number IDi that identifies the ticket medium 300, a commuter pass ID that identifies the commuter pass, available section information indicating the section for which the ticket was issued for the ticket medium 300, validity period information indicating the validity period of the commuter pass, and entry / exit history information which is the history of ticket gate processing using this contactless IC ticket.

[0026] The automatic ticket gate 1 reads the ticket information on the ticket medium 300 to determine the expiration date and whether it is a commuter pass valid for travel within the valid section, or a regular ticket for which a fare is incurred each time the train is used.

[0027] Here, we will explain assuming that user 30's facial recognition information is stored in the central server 5 and that user 30 has authorized the ticket gate using facial recognition. However, in this instance, user 30 will use a ticket medium 300 to pass through.

[0028] User 30 approaches the automatic ticket gate 1. The imaging unit 12 captures a picture of user 30's face. As a result, the automatic ticket gate 1 generates a facial image to determine whether user 30 is eligible to enter. The automatic ticket gate 1 transmits this facial image to the central server 5. The central server 5 uses the facial image to determine whether authentication is possible (hereinafter referred to as the authentication result). The central server 5 transmits the authentication result to the automatic ticket gate 1.

[0029] In this case, the automatic ticket gate 1 will hold off on opening or closing the gate door according to the authentication result.

[0030] User 30 holds the ticket medium 300 over the ticket processing unit 11 of the automatic ticket gate 1. The ticket processing unit 11 reads the ticket information from the ticket medium 300. The automatic ticket gate 1 determines that the ticket information is valid. The user detection unit 14 of the automatic ticket gate 1 detects that user 30 has passed through the ticket gate passage.

[0031] As a result, the automatic ticket gate 1 determines that the user 30 is entering based on the ticket information of the ticket medium 300 that the user possesses.

[0032] Furthermore, after the imaging unit 12 captures the user's face 30, the display unit 17 displays a message indicating that "face recognition is OK" and a warning about whether or not to hold up the ticket medium 300. Specifically, if face recognition of the user 30 is successful, the display unit 17 displays a message such as, "If you are entering with the ticket medium 300, please hold up the ticket medium 300."

[0033] This configuration prevents the determination of whether or not a user 30 is allowed to pass through a passageway based on facial recognition, even if the user 30 forgets to present their ticket medium 300. In other words, it improves user convenience.

[0034] <2. Configuration Example 1> Figure 1 is an image diagram of the automatic ticket gate in Configuration Example 1. Figure 2 is a block diagram showing the configuration of the automatic ticket gate in Configuration Example 1. Figure 3 is a block diagram showing the configuration of the center server in Configuration Example 1. Figure 4 is a diagram showing the processing pattern in Configuration Example 1. Figure 5 is a diagram showing the processing pattern in Configuration Example 1. Figure 6 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 7 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 8 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 9 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 10 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1.

[0035] Based on the station system configuration shown in Figure 1 above, Figures 2 and 3 will be used to explain more specific configuration examples.

[0036] (Configuration of automatic ticket gate 1 and central server 5) First, Figure 2 shows the configuration of the automatic ticket gate 1. The automatic ticket gate 1 comprises a control unit 10, a ticket processing unit 11, an imaging unit 12, a determination unit 13, a user detection unit 14, a door opening / closing unit 15, an output unit 16, a display unit 17, a determination unit 18, and a communication unit 19. The automatic ticket gate 1 corresponds to the "gate device" in this invention. The ticket medium 300 shown below is, for example, an IC ticket. However, the ticket medium 300 is not limited to an IC ticket, but may also be a two-dimensional code, a magnetic card, etc.

[0037] The control unit 10 controls the operation of the automatic ticket gate 1 main unit.

[0038] As is well known, the ticket processing unit 11 is configured to read ticket information regardless of the type of ticket medium. Ticket mediums include, for example, contactless IC tickets and 2D codes. The ticket processing unit 11 is equipped with an IC reader / writer for reading ticket information stored in the ticket medium, and a camera for reading 2D codes, etc.

[0039] Furthermore, the ticket processing unit 11 is equipped with a wireless communication unit that performs short-range wireless communication with the IC chip on the ticket medium 300. This wireless communication unit repeatedly polls to request a response from a wireless communication terminal located within the wireless communication area. In this way, the ticket processing unit 11 detects an object approaching the wireless communication area based on whether or not it has received a response to the polling in the wireless communication processing unit.

[0040] The imaging unit 12 is a camera that captures images of users 30 approaching the automatic ticket gate 1. More specifically, it captures images of the user's face. This allows the imaging unit 12 to generate a facial image for use in facial recognition to pass through the automatic ticket gate 1. A detailed explanation of the structure will follow.

[0041] The determination unit 13 comprises a first determination unit 131 and a second determination unit 132. The first determination unit 131 performs identity authentication using the facial image captured by the imaging unit 12 and determines whether to permit the user 30 to pass through the ticket gate passage. The second determination unit 132 determines whether to permit the user 30 to pass through the ticket gate passage based on the ticket processing unit 11 read from the ticket medium 300 (corresponding to the medium information of the present invention). The ticket processing unit 11 corresponds to the "medium information reading unit" of the present invention. The determination is made whether the user 30 will pass through the automatic ticket gate 1 by facial recognition or by using the ticket medium. The detailed structure will be described later.

[0042] The user detection unit 14 uses multiple sensors arranged along the ticket gate passage to repeatedly detect the user's position within the passage at regular intervals, thereby tracking the user's movement within the passage.

[0043] The user detection unit 14 defines the entry detection position (a line for determining whether or not a ticket is being used) as shown below. This entry detection position is used to determine whether or not user 30 enters the automatic ticket gate 1 using facial recognition. When user 30 enters the automatic ticket gate 1 using facial recognition, they do not use a ticket medium. In this case, the user detection unit 14 detects whether or not user 30 has held up the ticket medium 300 before reaching the entry detection position. If user 30 has not held up the ticket medium 300 before reaching the entry detection position, the user detection unit 14 outputs the detection result to the determination unit 13 (first determination unit 131) to determine that passage is being made by facial recognition.

[0044] The door opening / closing unit 15 opens and closes the gate door located on the exit side of the ticket gate passage for the user 30 who has entered the ticket gate passage, according to the result of the determination of whether or not the user 30 is allowed to pass through the ticket gate passage.

[0045] After the imaging unit 12 captures the face of the user 30 entering the passageway, the output unit 16 outputs a warning message reminding the user to present their ticket medium 300. The output unit 16 also emits a warning sound when it determines that the user 30 entering the ticket gate passageway should not be permitted to pass through.

[0046] The display unit 17 is located on the exit side of the ticket gate passage for users entering the passage. When a user 30 passes through the automatic ticket gate 1 using facial recognition, the display unit 17 displays a facial image. When a user 30 passes through the automatic ticket gate 1 using a ticket medium, the display unit 17 displays the pass-through determination result. Further details will be described later.

[0047] When the user 30 reaches the entry detection position set in the ticket gate passage, the decision unit 18, if the ticket processing unit 11 has not read the media information from the ticket medium 300, decides whether to allow the user 30 to pass through the ticket gate passage based on the determination result from the first determination unit 131.

[0048] The communications unit 19 controls data communication between the station's ticket vending machines and the central server 5.

[0049] Next, Figure 3 will be used to explain the main components of the center server 5 and provide an overview of the processing flow. Figure 3 is a block diagram showing the configuration of the center server 5 in Configuration Example 1.

[0050] The center server 5 comprises a control unit 51, a storage unit 52, a face image determination unit 53, and a communication unit 54. The control unit 51 controls the operation of the center server 5 main body. The storage unit 52 stores face images captured of users, and determination images used to determine whether these face images belong to the user themselves.

[0051] The facial image determination unit 53 compares the facial image captured by the automatic ticket gate 1 with the determination image stored in the memory unit 52. This determination image is not limited to user 30, but includes facial images of multiple people registered when using facial recognition.

[0052] The face image determination unit 53 determines whether the user's face image can be authenticated by following the procedure below. First, the face image determination unit 53 compares the face image with multiple authentication images stored in the memory unit 52. More specifically, the face image determination unit 53 extracts the feature quantities of the user's face image, and determines that the user's face authentication is valid if the degree to which these feature quantities match is above a threshold. This threshold can be arbitrarily determined, for example, 85%.

[0053] Furthermore, if the user's 30 face image is not registered in the central server's storage unit 52, the face image determination unit 53 determines that the image is unregistered and that face authentication is NG.

[0054] The communication unit 54 controls communication with the automatic ticket gates 1 at each station via the network 6.

[0055] Using the above configuration, we will now explain the processing patterns of the automatic ticket gate 1 using Figures 4 and 5. First, Figure 4 shows a processing pattern in which a user 30's facial image is registered and the user has a ticket medium. In this case, the user 30 intends to enter the automatic ticket gate 1 using the ticket medium 300.

[0056] Figure 4(1) shows a pattern where facial recognition fails, but the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition fails. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reaches the entry detection position, and the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the second determination unit 132. In other words, the second determination unit 132 of the automatic ticket gate 1 determines that ticketing with the ticket medium is OK. The display unit 17 of the automatic ticket gate 1 displays that ticketing with the ticket medium is OK.

[0057] Figure 4(2) shows a pattern where facial recognition is successful, but the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is successful. As a result, the output unit 16 outputs a message to the display unit 17 instructing the user to "Facial recognition is successful. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reached the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays a message indicating that the ticket medium cannot be used for entry.

[0058] Figure 4(3) shows a pattern where facial recognition is not registered and the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition is not registered. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 determines that ticketing with the ticket medium is OK. The display unit 17 of the automatic ticket gate 1 displays that ticketing with the ticket medium is OK.

[0059] Figure 4(4) shows a pattern where facial recognition is not registered and the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is not registered. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the second determination unit 132. In other words, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays that the use of the ticket medium is rejected.

[0060] Figure 4(5) shows a pattern where facial recognition is invalid and the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition is invalid. As a result, the output unit 16 outputs a message to the display unit 17 instructing that "Facial recognition is invalid. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reaches the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate passage is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 approves the use of the ticket medium for ticketing. The display unit 17 of the automatic ticket gate 1 displays that it is OK to use the ticket medium for ticketing.

[0061] Figure 4(6) shows the case where facial recognition is invalid and the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is invalid. As a result, the output unit 16 outputs a message to the display unit 17 instructing that "Facial recognition is invalid. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reaches the entry detection position, and the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the second determination unit 132. In other words, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays a message indicating that the ticket medium cannot be used for entry.

[0062] Next, Figure 5 shows a processing pattern in which the user 30's facial image is registered and the user does not possess a ticket medium 300 (meaning that ticket gate entry is not intended). In this case, the user 30 intends to enter the automatic ticket gate 1 via facial recognition.

[0063] Figure 5(1) shows a pattern where facial recognition is successful. The first determination unit 131 determines that facial recognition is successful. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not perform the reading of the ticket medium. The first determination unit 131 of the automatic ticket gate 1 approves the ticketing by facial recognition. The display unit 17 of the automatic ticket gate 1 displays that the ticketing by facial recognition is successful. The center server 5 updates the ticket information associated with the facial image generated by the imaging unit 12 to the entry status.

[0064] Figure 5(2) shows a pattern where the facial image is not registered. The first determination unit 131 determines that the facial recognition is not registered. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not perform the reading of the ticket medium. The first determination unit 131 of the automatic ticket gate 1 rejects the ticketing by facial recognition. The display unit 17 of the automatic ticket gate 1 displays that passage is not permitted.

[0065] Figure 5(3) shows a pattern where the facial image is invalid. The first determination unit 131 determines that facial recognition is invalid. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not perform the reading of the ticket medium. The first determination unit 131 of the automatic ticket gate 1 rejects the ticketing by facial recognition. The display unit 17 of the automatic ticket gate 1 displays that facial recognition is invalid and passage is not permitted.

[0066] (Image of user 30 entering through an automatic ticket gate) Figures 6, 7, 8, 9, and 10 illustrate the process of user 30 entering the automatic ticket gate 1.

[0067] Figure 6 shows an example where user 30 enters the automatic ticket gate 1 using the ticket medium 300, even though user 30's facial recognition is NG or the user is not registered. Figure 6 shows the conditions shown in (1), (3), and (5) of Figure 4 above, and is an example where the ticket medium 300 is valid. The display unit 17 displays "Passing through using a ticket" and "Passing through OK".

[0068] Figure 7 shows an example where user 30 enters the automatic ticket gate 1 using the ticket medium 300, after facial recognition of user 30 has been successful. Figure 7 shows the state shown in Figure 4 (2) above, an example where the ticket medium 300 is invalid. The display unit 17 displays "The ticket is invalid" and "Entry is not permitted".

[0069] Figure 8 shows an example where user 30 enters the automatic ticket gate 1 using the ticket medium 300, with user 30's facial recognition being unregistered or invalid. Figure 8 is the state shown in (4) and (6) of Figure 4 above, and is an example where the ticket medium 300 is invalid. The display unit 17 displays "The ticket is invalid" and "Entry is not permitted."

[0070] Figure 9 shows an example where user 30 enters the automatic ticket gate 1 using facial recognition, with user 30's facial recognition enabled. Figure 9 shows the state described in Figure 5 (1) above. First, the display unit 17 displays "Passage is possible with facial recognition" and "If passing with a ticket, please hold up your ticket." Next, if user 30 does not hold up the ticket medium 300 before reaching the entry detection position, the display unit 17 displays a facial image and "Passage is OK with facial recognition."

[0071] Figure 10 shows an example where user 30 enters the automatic ticket gate 1 using facial recognition, even though user 30's facial recognition is unregistered or invalid. Figure 10 shows the state described in Figure 5(2) and (3) above. First, the display unit 17 displays "that facial recognition is invalid or unregistered" and "that the user should hold up their ticket if passing through with a ticket." Next, if user 30 does not hold up the ticket medium 300 before reaching the entry detection position, the display unit 17 displays "passage is not permitted."

[0072] <3. Example of operation> Figure 11 is a flowchart showing the process when user 30 enters the automatic ticket gate 1. Figure 11 outlines the process of user 30 entering using facial recognition and the ticket medium 300.

[0073] The imaging unit 12 acquires a facial image of the user 30. The automatic ticket gate 1 transmits this facial image to the central server 5 via the communication unit 19. The facial image determination unit 53 of the central server 5 determines whether this facial image is valid (S101).

[0074] If the face image determination unit 53 determines that the face image is valid (S101: Yes), it transmits this determination result to the automatic ticket gate 1. The first determination unit 131 determines that face authentication is OK. Next, the ticket processing unit 11 reads the ticket information from the ticket medium 300. The second determination unit 132 determines whether the ticket information is valid. The decision unit 18 determines whether the authentication method is a ticket or face authentication (S102).

[0075] If the second determination unit 132 determines that the ticket information is valid and that the user 30 has held the ticket medium 300 over the ticket processing unit 11 before reaching the entry detection position, the decision unit 18 determines whether or not passage through the ticket gate passage is permitted based on the second determination unit 132 (S102: Authentication by ticket medium 300). In this case, if authentication by ticket medium 300 is OK, the display unit 17 displays "OK for ticket gate use" (S103a).

[0076] If authentication using the ticket medium 300 fails, the system displays "Ticket gate NG" (S103b) and performs the process shown in step S109 below. That is, the process shown in (2) of Figure 4 is performed.

[0077] The door opening / closing section 15 of the automatic ticket gate 1 is opened, allowing the user 30 to pass through (S104).

[0078] If the system determines that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position, the decision unit 18 determines whether or not passage through the ticket gate passage is permitted by the second determination unit 132 (S102: facial recognition authentication). The display unit 17 displays "OK" for ticket gate authentication by facial recognition (S103c). After that, the automatic ticket gate 1 executes step S104.

[0079] If the face image determination unit 53 determines that the face image is invalid and unregistered (S101: No), it transmits this determination result to the automatic ticket gate 1. The ticket processing unit 11 determines whether the ticket medium 300 has been held up to the ticket processing unit 11 (S105). More specifically, it determines whether the ticket medium 300 has been held up to the ticket processing unit 11 before the user 30 reaches the entry detection position.

[0080] If the ticket processing unit 11 determines that the ticket medium 300 has been swiped (S105: Yes), the second determination unit 132 determines whether the ticket information is valid (S106).

[0081] If the second determination unit 132 determines that the ticket information is valid (S106: Yes), the display unit 17 displays "OK" for ticket gate entry (S107). The automatic ticket gate 1 then executes step S104.

[0082] If the second determination unit 132 determines that the ticket information is invalid (S106: No), the display unit 17 displays that passage is not permitted (S108). The door opening / closing unit 15 of the automatic ticket gate 1 closes the gate door (S109).

[0083] If the ticket processing unit 11 determines that the ticket medium 300 was not scanned (S105: No), the display unit 17 displays that facial recognition failed (S110). Subsequently, the automatic ticket gate 1 executes step S109.

[0084] Figure 12 is a flowchart showing the process after the automatic ticket gate 1 has determined whether to allow entry. Figure 12 is executed after the process shown in Figure 11, more specifically when the user 30 passes through the automatic ticket gate 1.

[0085] The determination unit 13 deletes the information entered via facial image and the information entered via train ticket medium according to the authentication result (S141). This allows for more accurate authentication processing for subsequent users.

[0086] As described above, the automatic ticket gate 1 can accurately perform the ticketing process even when the user 30 has both facial recognition and ticket media 300 as authentication methods. In other words, the user can use the automatic ticket gate 1 by the means they intend, improving convenience. To put it another way, it prevents the determination of whether or not a user can pass through the gate based on facial image authentication against the user's wishes to use ticket media.

[0087] Furthermore, the above configuration shows an example where the ticket medium 300 is a contactless IC ticket. However, it is not limited to contactless IC tickets; it may also be a 2D code, magnetic card, etc.

[0088] In the configuration described above, a facial image is displayed on the display unit 17 when facial recognition is performed. However, a configuration in which the facial image is not displayed is also acceptable from a privacy standpoint.

[0089] <4. Variation 1> Next, the automatic ticket gate according to Modification Example 1 will be explained with reference to the figure. Modification Example 1 differs from Configuration Example 1 in the processing when a passenger mistakenly holds the ticket medium 300 over the ticket processing unit 11, even though passage is possible through facial recognition. The other configurations are the same as those of the automatic ticket gate 1 in Configuration Example 1, and explanations of the same parts will be omitted.

[0090] As shown in Figure 13, user 30 is allowed to pass through facial recognition. However, user 30 mistakenly holds an invalid ticket medium 300 up to the ticket processing unit 11. As a result, the second determination unit 132 determines that the ticket medium 300 is invalid. However, the decision unit 18 determines that user 30 mistakenly held up the ticket medium 300 and allows passage based on facial recognition authenticated by the first determination unit 131.

[0091] In this case, the decision unit 18 may determine that user 30 mistakenly held up the ticket medium 300 based on user 30's facial recognition history, frequency and tendencies of using the ticket medium 300, etc. For example, it may be used as a criterion to determine if user 30 has been continuously using facial recognition but held up the ticket medium 300 only on this occasion.

[0092] With this configuration, authentication can be performed according to the user's intentions. In other words, if a user does not wish to use a physical ticket, their access to the passage can be determined by facial recognition. This improves user convenience.

[0093] <5. Modification 2> Next, the automatic ticket gate according to Modification Example 2 will be explained with reference to the figure. Modification Example 2 differs from Configuration Example 1 in the method of displaying the authentication result shown by the display unit 17. The other configurations are the same as those of the automatic ticket gate 1 in Configuration Example 1, and explanations of the same parts will be omitted.

[0094] The display unit 17 displays the expiration date of the facial image when facial recognition is performed. More specifically, as shown in Figure 14(A), the display unit 17 displays a message indicating that facial recognition is required for passage, as well as the expiration date of the facial image. By checking this expiration date, the user 30 can easily recognize the date the facial image was updated. Furthermore, the display unit 17 may display a message prompting the user to update their facial image.

[0095] Furthermore, as shown in Figure 14(B), the background color of the display unit 17 may be changed when the expiration date is approaching. More specifically, the background color may be orange if the expiration date is within one month, yellow if the expiration date is within three months, etc.

[0096] In the above configuration, the display unit 17 displays the expiration date. However, the output unit 16 may also be configured to output a warning sound. This warning sound may output the expiration date according to its pitch and volume.

[0097] In the above-described configuration, an automatic ticket gate located within a train station was used as an example. However, the configuration is not limited to automatic ticket gates. For example, the gate device of the present invention can be applied to devices that can use facial recognition and media-based authentication in combination, such as entrance and exit gates in theme parks or security gates in offices.

[0098] Furthermore, this invention is not limited to the above example, and in the implementation stage, the components can be modified and materialized without departing from the gist of the invention. In addition, various inventions can be formed by appropriately combining the multiple components disclosed in the above example. For example, some components may be deleted from all the components shown in the above example. Furthermore, components from different examples may be appropriately combined.

[0099] Furthermore, the correspondence between the configuration of this invention and the configuration described above can be described as follows: <Note> This gate device (1) comprises an imaging unit (12), a media information reading unit (11), a first determination unit (131), a second determination unit (132), an output unit (16), and a decision unit (18). The imaging unit (12) captures the face of a user entering the passageway. The media information reading unit (11) receives the media presented by the user and reads the media information recorded on that media. The first determination unit (131) determines whether to allow the user to pass through the passageway based on the face image captured by the imaging unit (12) for authentication. The second determination unit (132) determines whether to allow the user to pass through the passageway based on the media information read from the media by the media information reading unit (11). The output unit (16) outputs a reminder to the user to present their media after the imaging unit (12) has captured the face of a user entering the passageway. The decision unit (18) determines whether to allow the user to pass through the passage if the media information reading unit (11) has not read media information from the media when the user reaches the entry detection position set in the passage. This determination is made based on the determination result of the first determination unit (131). [Explanation of Symbols]

[0100] 1…Automatic ticket gate 5…Central Server 6…Network 10…Control Unit 11…Ticket Processing Unit 12…IMG Department 13…Judgment section 14…User detection unit 15... Door opening / closing mechanism 16…Output section 17…Display section 18…Decision Section 19… Communications Department 30…User 51... Control Unit 52...Storage section 53…Facial Image Recognition Unit 54... Communications Department 131...1st judgment section 132...Second judgment section 300...Train ticket media

Claims

1. An imaging unit that captures the faces of users entering the passageway, A media information reading unit that receives the media presented by the user and reads the media information recorded on that media, A first determination unit determines whether to permit the user to pass through the passage based on the facial image captured by the imaging unit, A second determination unit determines whether to permit the user to pass through the passage based on the media information read from the media by the media information reading unit, After the imaging unit captures the face of a user entering the passageway, the output unit outputs a reminder that the medium has been forgotten. The system includes a determination unit that, when the user reaches the entry detection position set in the passage, determines whether to allow the user to pass through the passage based on the determination result of the first determination unit, if the media information reading unit has not read media information from the media. The output unit is a gate device that outputs the warning, including the determination result, when the first determination unit determines that passage through the passage is permitted.

2. The gate device according to claim 1, wherein the determination unit determines whether to allow the user to pass through the passage based on the determination result of the second determination unit, if the media information reading unit has read media information from the media when the user reaches the entry detection position set in the passage.

3. The gate device according to claim 1, wherein the determination unit determines whether to allow the user to pass through the passage based on the determination result of the first determination unit when the user reaches the entry detection position set in the passage, the media information reading unit has read media information from the media, and the second determination unit has determined that passage through the passage should not be permitted.

4. The gate device according to any one of claims 1 to 3, wherein the output unit outputs the warning including the determination result when the first determination unit determines that passage through the passage is not permitted.

5. The gate device according to any one of claims 1 to 4, wherein the output unit causes the warning to be displayed on the display unit.

6. An imaging unit that captures the faces of users entering the passageway, A media information reading unit that receives the media presented by the user and reads the media information recorded on that media, A first determination step involves determining whether to permit a user to pass through a passageway based on the user's facial image captured by the imaging unit as the user enters the passageway, A second determination step involves determining whether to permit the user to pass through the passage based on the media information read from the media presented by the user in the media information reading unit, After the imaging unit captures the face of a user entering the passageway, an output step is performed to output a reminder that the medium has been forgotten. When the user reaches the entry detection position set in the passage, if the media information reading unit has not read media information from the media, the computer performs a decision step to determine whether to allow the user to pass through the passage based on the determination result of the first determination step. The traffic control method is a method in which, if the first determination step determines that passage through the passage is permitted, the first determination step determines that the warning including the determination result is output.

7. An imaging unit that captures the faces of users entering the passageway, A media information reading unit that receives the media presented by the user and reads the media information recorded on that media, A first determination step involves determining whether to permit a user to pass through a passageway based on the user's facial image captured by the imaging unit as the user enters the passageway, A second determination step involves determining whether to permit the user to pass through the passage based on the media information read from the media presented by the user in the media information reading unit, After the imaging unit captures the face of a user entering the passageway, an output step is performed to output a reminder that the medium has been forgotten. When the user reaches the entry detection position set in the passage, if the media information reading unit has not read media information from the media, the computer is instructed to perform a decision step to determine whether to allow the user to pass through the passage based on the determination result of the first determination step. The traffic control program is a traffic control program in which, if the first determination step determines that passage through the passage is permitted, it outputs the warning including the determination result.

Images