Information processing system, information processing method, and recording medium

Abstract

An information processing system comprising: an image acquisition means for acquiring at least one of a first image that includes at least part of a first lane through which a first object being authenticated heading from a first area to a second area passes, and a second image that includes at least part of a second lane through which a second object being authenticated heading from the second area to the first area passes; and an authentication means for performing at least one of authentication of the first object being authenticated using the first image and authentication of the second object being authenticated using the second image.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] As an example of this type of system, a technology has been proposed that uses wireless tags to realize a gateless bicycle parking lot management system in a bicycle parking lot with separate entrance and exit passages (see Patent Document 1).Other prior art documents related to this disclosure include Patent Documents 2 to 4.

[0003] JP 2013-020598 A JP 2021-095287 A JP 2022-053683 A JP 2022-164310 A

[0004] An object of this disclosure is to provide an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing system includes an image acquisition means for acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area, and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area, and an authentication means for performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0006] One aspect of the information processing method involves acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes as he travels from a first area to a second area, and a second image including at least a portion of a second lane through which a second subject to be authenticated passes as he travels from the second area to the first area, and performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0007] One aspect of the recording medium has a computer program recorded thereon to cause a computer to execute an information processing method for acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area, and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area, and performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0008] 1 is a diagram showing the configuration of an information processing system according to a first embodiment; FIG. 2 is a diagram showing an example of an authentication area; FIG. 3 is a flowchart showing the operation of an information processing device according to a first embodiment; FIG. 4 is a diagram showing an example of a sloped road; FIG. 5 is a diagram showing another example of a sloped road; FIG. 6 is a diagram showing another example of a sloped road; FIG. 7 is a diagram showing the configuration of a ticket gate system according to a second embodiment; FIG. 8 is a block diagram showing the configuration of an information processing device according to a second embodiment; FIG. 9 is a diagram for explaining target tracking processing; FIG. 10 is a diagram showing an example of an ID correspondence table; FIG. 11 is a diagram showing another example of an authentication area; FIG. 12 is a diagram showing another example of an authentication area.

[0009] First Embodiment A first embodiment relating to an information processing system, an information processing method, and a recording medium will be described with reference to Figures 1 to 3. Hereinafter, the first embodiment relating to an information processing system, an information processing method, and a recording medium will be described using an information processing system 1.

[0010] 1, an information processing system 1 includes an information processing device 10 and cameras CAM1 and CAM2. Cameras CAM1 and CAM2 will be described with reference to Fig. 2. In Fig. 2, a space (e.g., a passage) connecting the first area and the second area is provided between the first area and the second area.

[0011] The first area may be, for example, one of the inside and outside of a railway station. In this case, the second area may be the other of the inside and outside of a railway station. The first area may be, for example, one of the inside and outside of an amusement park. In this case, the second area may be the other of the inside and outside of an amusement park. The first area may be, for example, an area set to a first security level. In this case, the second area may be an area set to a second security level different from the first security level.

[0012] In the space, a first lane through which objects traveling from the first area to the second area pass, and a second lane through which objects traveling from the second area to the first area pass, are set. Note that a member, such as a fence, that physically blocks the passage of objects may be provided between the first and second lanes. Note that the term "object" is not limited to humans, but also includes animals such as dogs and snakes, and moving objects such as robots.

[0013] Camera CAM1 captures an image of at least a portion of the first lane. As a result, camera CAM1 generates a first image that includes at least a portion of the first lane. Camera CAM2 captures an image of at least a portion of the second lane. As a result, camera CAM2 generates a second image that includes at least a portion of the second lane. Note that, in addition to camera CAM1, information processing system 1 may also include another camera that captures an image of at least a portion of the first lane. In addition to camera CAM2, information processing system 1 may also include another camera that captures an image of at least a portion of the second lane. In other words, information processing system 1 may also include three or more cameras.

[0014] The first lane and the second lane do not have to be provided in the same space (e.g., an aisle). For example, the first lane may be provided in a first space connecting the first area and the second area, and the second lane may be provided in a second space different from the first space connecting the first area and the second area. A third lane may be provided in addition to the first lane and the second lane. That is, three or more lanes may be provided. The third lane may be provided in a space connecting the first area and a third area different from the second area, or in a space connecting the second area and a fourth area different from the first area.

[0015] 1 , the information processing device 10 has an image acquisition unit 11, an authentication unit 12, and an information database 13 (hereinafter referred to as "information DB 13" as appropriate). The information DB 13 stores, for example, information related to registrants who are registered as users of the information processing system 1. The information related to registrants includes information (for example, feature amounts) used in biometric authentication, which will be described later.

[0016] The image acquisition unit 11 of the information processing device 10 acquires a first image and a second image. The authentication unit 12 uses the first image to perform biometric authentication of a subject traveling along the first lane from the first area to the second area (in other words, the subject to be authenticated). The authentication unit 12 uses the second image to perform biometric authentication of a subject traveling along the second lane from the second area to the first area (in other words, the subject to be authenticated). Note that the biometric authentication may be at least one of face authentication and iris authentication.

[0017] For example, the authentication unit 12 may detect the face of a target included in the first image (in other words, captured in the first image). The authentication unit 12 may calculate a facial feature amount indicating the characteristics of the detected face. The authentication unit 12 may calculate a matching score from the calculated facial feature amount and a facial feature amount registered in the information DB 13 (corresponding to the above-mentioned "information used in biometric authentication"). The authentication unit 12 may determine (identify) whether the target included in the first image is a registered person by comparing the matching score with a predetermined threshold.

[0018] For example, the authentication unit 12 may detect the face of a target included in the second image (in other words, captured in the second image). The authentication unit 12 may calculate a facial feature amount indicating the characteristics of the detected face. The authentication unit 12 may calculate a matching score from the calculated facial feature amount and the facial feature amount registered in the information DB 13. The authentication unit 12 may determine (identify) whether the target included in the second image is a registered person by comparing the matching score with a predetermined threshold.

[0019] For example, the authentication unit 12 may detect the eyes of a target included in the first image (in other words, captured in the first image). The authentication unit 12 may calculate iris features indicating the characteristics of the irises of the detected eyes. The authentication unit 12 may calculate a matching score from the calculated iris features and iris features registered in the information DB 13 (corresponding to the above-mentioned "information used in biometric authentication"). The authentication unit 12 may determine (identify) whether the target included in the first image is a registered person by comparing the matching score with a predetermined threshold. Note that the authentication unit 12 may determine (identify) whether the target is a registered person using both facial features indicating the facial characteristics of a target included in the first image and iris features indicating the iris characteristics of the target's eyes. In other words, the authentication unit 12 may perform multimodal authentication.

[0020] For example, the authentication unit 12 may detect the eyes of a target included in the second image (in other words, reflected in the second image). The authentication unit 12 may calculate an iris feature amount indicating the characteristics of the iris of the detected eye. The authentication unit 12 may calculate a matching score from the calculated iris feature amount and the iris feature amount registered in the information DB 13. The authentication unit 12 may determine (identify) whether the target included in the second image is a registered person by comparing the matching score with a predetermined threshold. Note that the authentication unit 12 may determine (identify) whether the target is a registered person using both a facial feature amount indicating the facial characteristics of a target included in the second image and an iris feature amount indicating the iris characteristics of the target's eye. In other words, the authentication unit 12 may perform multimodal authentication.

[0021] The authentication unit 12 may perform biometric authentication on a subject traveling along the first lane from the first area to the second area (i.e., the subject to be authenticated) while the subject is passing through the first lane. Similarly, the authentication unit 12 may perform biometric authentication on a subject traveling along the second lane from the second area to the first area (i.e., the subject to be authenticated) while the subject is passing through the second lane. That is, the authentication unit 12 may perform walk-through biometric authentication. Therefore, the first lane and the second lane may be referred to as authentication areas. Note that the length of the first lane along the traveling direction of the subject passing through the first lane may be set so that the time required for the subject to pass through the first lane is sufficiently longer than the time required for biometric authentication. Similarly, the length of the second lane along the traveling direction of the subject passing through the second lane may be set so that the time required for the subject to pass through the second lane is sufficiently longer than the time required for biometric authentication.

[0022] The operation of the information processing device 10 will be described with reference to the flowchart of Fig. 3. In Fig. 3, the image acquisition unit 11 acquires a first image and a second image (step S101). The authentication unit 12 performs biometric authentication using the first image and biometric authentication using the second image (step S102).

[0023] The information processing system 1 may include one of the cameras CAM1 and CAM2 and the information processing device 10. That is, the information processing system 1 may only perform biometric authentication of a subject passing through one of the first lane and the second lane. That is, the image acquisition unit 11 may acquire only one of the first image and the second image. The authentication unit 12 may only perform biometric authentication using the first image or biometric authentication using the second image. In this case, biometric authentication of a subject passing through the other of the first lane and the second lane may be performed by another information processing system (not shown).

[0024] Therefore, the image acquisition unit 11 may acquire at least one of a first image and a second image, and the authentication unit 12 may perform at least one of biometric authentication using the first image and biometric authentication using the second image.

[0025] In the above-mentioned information processing system 1, it can be said that an information processing method is performed in which at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area, and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area, is acquired, and at least one of authentication of the first subject to be authenticated using the first image and authentication of the second subject to be authenticated using the second image is performed.

[0026] The authentication device 1 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium has recorded thereon a computer program for causing the computer to execute an information processing method for acquiring at least one of a first image including at least a part of a first lane through which a first subject to be authenticated passing from a first area to a second area and a second image including at least a part of a second lane through which a second subject to be authenticated passing from the second area to the first area, and for authenticating the first subject to be authenticated using the first image or the second subject to be authenticated using the second image.

[0027] (Technical Effect) If a first lane and a second lane are not defined in a space (e.g., a passageway) connecting the first and second areas, objects traveling from the first area to the second area and objects traveling from the second area to the first area will pass through the space in a disorderly manner. In this case, within the imaging range of a camera (e.g., at least one of cameras CAM1 and CAM2), there will be objects whose front faces face the camera and objects whose back faces face the camera. In addition, because multiple objects pass through the space in a disorderly manner, it is possible that one object will be relatively frequently in the shadow of another object as viewed by the camera. As a result, the multiple images captured by the camera may include images that are not suitable for use in biometric authentication. This may result in an object that has not been biometrically authenticated by the information processing system 1 entering the first or second area. Furthermore, it may take a relatively long time to perform biometric authentication on an object.

[0028] In contrast, when a first lane and a second lane are set in the above space, it is expected that multiple objects passing through the first lane will travel in the same direction, and similarly, it is expected that multiple objects passing through the second lane will travel in the same direction. Therefore, camera CAM1 can be positioned in advance so that camera CAM1 can capture an image of the front of an object passing through the first lane. Similarly, camera CAM2 can be positioned in advance so that camera CAM2 can capture an image of the front of an object passing through the second lane.

[0029] Therefore, for example, the authentication unit 12 can relatively efficiently detect the face or eyes of the target (i.e., the target to be authenticated) from each of the image captured by the camera CAM1 (i.e., the first image) and the image captured by the camera CAM2 (i.e., the second image). As a result, the time required for biometric authentication of one target can be shortened. In addition, it is possible to prevent targets who have not undergone biometric authentication by the information processing system 1 from entering the first area or the second area.

[0030] 2 may include a sloped path that slopes from one side of the first area or the second area to the other side of the first area or the second area. Here, the sloped path is not limited to a slope, but also includes structures that enable movement of an object between two points with a difference in elevation, such as stairs, escalators, and belt conveyors.

[0031] For example, the first lane may include a slope that descends from the first area side toward the second area side. The camera CAM1 may capture an image of the slope as at least a portion of the first lane. For example, the camera CAM1 may capture an image of the slope to generate an image (e.g., a first image) that includes an object passing through the slope. For example, the camera CAM1 may capture an image of the slope to generate an image (e.g., a first image) that includes an object before entering the slope. For example, the camera CAM1 may capture an image of the slope to generate an image (e.g., a first image) that includes an object after passing through the slope.

[0032] Similarly, the second lane may include a slope that descends from the second area side toward the first area side. Camera CAM2 may capture an image of the slope as at least a portion of the second lane. For example, camera CAM2 may capture an image of the slope to generate an image (e.g., the second image) that includes an object passing through the slope. For example, camera CAM2 may capture an image of the slope to generate an image (e.g., the second image) that includes an object before entering the slope. For example, camera CAM2 may capture an image of the slope to generate an image (e.g., the second image) that includes an object after passing through the slope.

[0033] Due to the slope of the road, it is expected that the difference in height between the head position of one target and the head position of another target immediately before the one target will be relatively large. Therefore, it is possible to prevent the head of one target from being overshadowed by another target in an image (e.g., at least one of the first image and the second image). In addition, it is expected that the faces of multiple targets will each be included in a single image, which is expected to improve the efficiency of biometric authentication.

[0034] In this case, the sloped road may include an escalator E1 shown in Figure 4. The camera C1 may be positioned so as to capture an image of the escalator E1. The escalator E1 can regulate the direction of travel of an object by its operation. This can prevent an object from traveling in the wrong direction in a lane (e.g., at least one of the first lane and the second lane) (in other words, a wrong-way runner).

[0035] When the escalator E1 is included in the first lane, the camera C1 corresponds to an example of the camera CAM1. When the escalator E1 is included in the second lane, the camera C1 corresponds to an example of the camera CAM2. The arrow in Fig. 4 indicates the direction of travel of the escalator E1.

[0036] For example, the first lane may include a slope that rises from the first area toward the second area. Camera CAM1 may capture an image of a predetermined range that includes the end of the slope as at least a portion of the first lane. Similarly, the second lane may include a slope that rises from the second area toward the first area. Camera CAM2 may capture an image of a predetermined range that includes the end of the slope as at least a portion of the second lane.

[0037] A subject climbing a slope often turns his / her face toward the front of the slope to check the path near the end of the slope. Therefore, if a camera (for example, at least one of cameras CAM1 and CAM2) is positioned so as to capture an image of a predetermined range including the end of the slope, it can be expected that the camera will capture an appropriate image of the face of the subject (in other words, the subject to be authenticated).

[0038] In this case, the sloped road may include the escalator E2 shown in Figure 5. The camera C2 may be positioned so as to capture an image of a predetermined range including the end of the escalator E2. The escalator E2 can restrict the direction of travel of an object by its operation. This can prevent an object from traveling in the wrong direction in a lane (e.g., at least one of the first lane and the second lane) (in other words, a wrong-way runner).

[0039] When the escalator E2 is included in the first lane, the camera C2 corresponds to an example of the camera CAM 1. When the escalator E2 is included in the second lane, the camera C2 corresponds to an example of the camera CAM 2. The arrow in Fig. 5 indicates the direction of travel of the escalator E2.

[0040] For example, the first lane may include a first slope that descends from the first area toward the second area and a second slope that ascends from the first area toward the second area. In this case, as shown in FIG. 6 , the first lane may include an escalator E1 as the first slope and an escalator E2 as the second slope. In this case, a camera C1, which is an example of the camera CAM1, may capture an image of the escalator E1. A camera C2, which is another example of the camera CAM1, may capture an image of a predetermined range including the end of the escalator E2.

[0041] For example, the second lane may include a third slope that descends from the second area toward the first area and a fourth slope that ascends from the second area toward the first area. In this case, as shown in FIG. 6 , the second lane may include an escalator E1 as the third slope and an escalator E2 as the fourth slope. In this case, camera C1, which is an example of camera CAM2, may capture an image of escalator E1. Camera C2, which is another example of camera CAM2, may capture an image of a predetermined range including the end of escalator E2.

[0042] Note that a display for digital signage, for example, may be placed near at least one of the cameras C1 and C2. With this configuration, the face of a target passing through the first or second lane can be directed toward the camera C1 or C2.

[0043] Second Embodiment A second embodiment relating to an information processing system, an information processing method, and a recording medium will be described with reference to Figures 7 to 10. Hereinafter, the second embodiment relating to an information processing system, an information processing method, and a recording medium will be described using a ticket gate system 2. Here, the ticket gate system 2 corresponds to an example of an information processing system. Note that, with regard to the second embodiment, descriptions that overlap with the description of the first embodiment described above will be omitted as appropriate.

[0044] (Outline of Ticket Gating System) An outline of the ticket gate system 2 according to the second embodiment will be described with reference to Fig. 7. In Fig. 7, the ticket gate system 2 includes an information processing device 20, a station server 41, and cameras CAM1 and CAM2 installed at railway station A, and an information processing device 20a, a station server 42, and cameras CAM1a and CAM2a installed at railway station B, a center server 50, and a face information database 60 (hereinafter referred to as "face information DB60" as appropriate). Note that cameras CAM1a and CAM2a at station B correspond to cameras CAM1 and CAM2 at station A, respectively. The information processing devices 20 and 20a correspond to the information processing device 10 according to the first embodiment described above.

[0045] Note that in addition to the information processing device 20, other information processing devices may be installed at station A. That is, multiple information processing devices may be installed at station A. Similarly, in addition to the information processing device 20a, other information processing devices may be installed at station B. That is, multiple information processing devices may be installed at station B.

[0046] At station A, the information processing device 20 and the station server 41 may be connected via a narrow area network such as a local area network (LAN). Similarly, at station B, the information processing device 20a and the station server 42 may be connected via a narrow area network. The station servers 41 and 42, the center server 50, and the face information DB 60 are connected via a wide area network NW such as the Internet.

[0047] The ticket gate area of ​​Station A has a first lane and a second lane as shown in Figure 2. The first area shown in Figure 2 may be either inside or outside the premises of Station A. The second area shown in Figure 2 may be the other of inside or outside the premises of Station A. However, in the following explanation, it is assumed that the first area is outside the premises of Station A and the second area is inside the premises of Station A. In this case, an object entering the premises of Station A from outside the premises of Station A will pass through the first lane. An object leaving the premises of Station A from inside the premises of Station A will pass through the second lane.

[0048] Camera CAM1 captures an image of at least a portion of the first lane, thereby generating a first image including at least a portion of the first lane. Camera CAM2 captures an image of at least a portion of the second lane, thereby generating a second image including at least a portion of the second lane.

[0049] The information processing device 20 may perform facial recognition based on the image captured by camera CAM1 (i.e., the first image) and identify a target entering station A. The information processing device 20 associates identification information indicating a registered person corresponding to the target identified by facial recognition with information indicating that the target has entered station A, and transmits the associated information to the station server 41. The information processing device 20 may perform facial recognition based on the image captured by camera CAM2 (i.e., the second image) and identify a target exiting station A. The information processing device 20 associates identification information indicating a registered person corresponding to the target identified by facial recognition with information indicating that the target has exited station A, and transmits the associated information to the station server 41.

[0050] A registrant is an individual registered in the face information DB 60 as a user of the ticket gate system 2. Information relating to each of a plurality of registrants is registered in the face information DB 60. In the face information DB 60, the information relating to a registrant may include, for example, identification information for identifying the registrant and face information used in face authentication (e.g., facial feature quantities indicating the facial characteristics of the registrant). In addition to the identification information and face information, the information relating to a registrant may also include terminal information (e.g., a telephone number, an email address, etc.) relating to a terminal device (e.g., a smartphone) owned by the registrant.

[0051] The station server 41 transmits the information transmitted from the information processing device 20 (i.e., identification information indicating the registered person corresponding to the target identified by facial recognition, and information indicating that the target has entered Station A or information indicating that the target has exited Station A) to the center server 50 at a predetermined communication cycle.

[0052] The ticket gate area of ​​Station B is provided with a first lane and a second lane as shown in FIG. 2. The first area shown in FIG. 2 may be either inside or outside the station premises. The second area shown in FIG. 2 may be the other of inside or outside the station premises. However, in the following description, it is assumed that the first area is outside the station premises of Station B, and the second area is inside the station premises of Station B. In this case, an object entering the station premises of Station B from outside the station premises will pass through the first lane. An object leaving the station premises of Station B from inside the station premises will pass through the second lane.

[0053] Camera CAM1a captures an image of at least a portion of the first lane, thereby generating a third image including at least a portion of the first lane. Camera CAM2a captures an image of at least a portion of the second lane, thereby generating a fourth image including at least a portion of the second lane.

[0054] The information processing device 20a may perform facial recognition based on the image captured by the camera CAM1a (i.e., the third image) and identify a target entering station B. The information processing device 20a associates identification information indicating a registered person corresponding to the target identified by facial recognition with information indicating that the target has entered station B, and transmits the associated information to the station server 42. The information processing device 20a may perform facial recognition based on the image captured by the camera CAM2a (i.e., the fourth image) and identify a target exiting station B. The information processing device 20a associates identification information indicating a registered person corresponding to the target identified by facial recognition with information indicating that the target has exited station B, and transmits the associated information to the station server 42.

[0055] The station server 42 transmits the information transmitted from the information processing device 20a (i.e., identification information indicating the registered person corresponding to the target identified by facial recognition, and information indicating that the target has entered Station B or information indicating that the target has exited Station B) to the center server 50 at a predetermined communication period.

[0056] The center server 50 may calculate the railway fare for each registrant based on information (e.g., identification information indicating the registrant identified by facial recognition and information indicating entry and exit from a station) transmitted from each of the multiple station servers including the station servers 41 and 42. The center server 50 may pay the railway fare for each registrant using payment information related to each registrant.

[0057] (Configuration of Information Processing Device) In Fig. 8, the information processing device 20 includes a calculation device 21, a storage device 22, and a communication device 23. The authentication device 20 may further include an input device 24 and an output device 25. The authentication device 20 may include a face information database 26 (hereinafter referred to as "face information DB 26" as appropriate). Note that the authentication device 20 does not necessarily include at least one of the input device 24 and the output device 25. In the authentication device 20, the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, and the face information DB 26 may be connected via a data bus 27.

[0058] The face information DB 26 may store the same information as that stored in the face information DB 60. The face information DB 26 may be updated at a predetermined interval so that the information stored in the face information DB 26 is the same as that stored in the face information DB 60.

[0059] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0060] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0061] The communication device 23 may be capable of communicating with devices external to the authentication device 20. The communication device 23 may perform wired communication or wireless communication.

[0062] The input device 24 is a device capable of accepting information input to the authentication device 20 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the authentication device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the authentication device 20, such as a USB (Universal Serial Bus) memory. Note that when information is input to the authentication device 20 via the communication device 23 (in other words, when the authentication device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0063] The output device 25 is a device capable of outputting information to the outside of the authentication device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium that is detachable from the authentication device 20, such as a USB memory. Note that when the authentication device 20 outputs information via the communication device 23, the communication device 23 may function as an output device.

[0064] The calculation device 21 may have an image acquisition unit 211, a tracking unit 212, a face authentication unit 213, a judgment unit 214, and an alarm unit 215 as logically realized functional blocks or as physically realized processing circuits.

[0065] At least one of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the notification unit 215 may be realized in a format in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the notification unit 215 are functional blocks, at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the notification unit 215 may be realized by the calculation device 21 executing a predetermined computer program.

[0066] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) provided in the authentication device 20. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the authentication device 20 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0067] The "image acquisition unit 211," "face authentication unit 213," and "face information DB 26" are components corresponding to the "image acquisition unit 11," "authentication unit 12," and "information DB 13" in the first embodiment described above, respectively.

[0068] The information processing device 20a may have the same configuration as the information processing device 20. Therefore, a description of the information processing device 20a will be omitted. The operation of the information processing device 20 will be described below, but the information processing device 20a may also perform the same operation as the information processing device 20.

[0069] (Operation of Information Processing Device) As described above, the information processing device 20 performs face authentication of an object passing through the first lane set at Station A based on the image captured by camera CAM1 (i.e., the first image). The information processing device 20 performs face authentication of an object passing through the second lane set at Station A based on the image captured by camera CAM2 (i.e., the second image).

[0070] The information processing device 20 may perform facial authentication on a target passing through the first lane while the target passes through the first lane from outside the station A premises (corresponding to the first area in FIG. 2 ) to inside the station A premises (corresponding to the second area in FIG. 2 ). The information processing device 20 may perform facial authentication on a target passing through the second lane while the target passes through the second lane from inside the station A premises to outside the station A premises. In other words, the information processing device 20 may be a device capable of performing walk-through facial authentication. Note that if no device capable of physically obstructing the passage of users is installed in the ticket gate area of ​​station A, the facial authentication method performed by the information processing device 20 may be referred to as gateless facial authentication.

[0071] The image acquisition unit 211 acquires an image (i.e., a first image) captured by the camera CAM1 and including at least a part of the first lane set at Station A. The image acquisition unit 211 acquires an image (i.e., a second image) captured by the camera CAM2 and including at least a part of the second lane set at Station A.

[0072] The cameras CAM1 and CAM2 may be connected to the information processing device 20 via a cable such as a USB cable. The cameras CAM1 and CAM2 may communicate with the information processing device 20 via wireless communication such as Bluetooth (registered trademark). In these cases, the image acquisition unit 211 may acquire images directly from the cameras CAM1 and CAM2. The cameras CAM1 and CAM2 may transmit the captured images to the station server 41. In this case, the image acquisition unit 211 may acquire the images captured by the cameras CAM1 and CAM2 from the station server 41.

[0073] The tracking unit 212 performs tracking processing of one or more objects passing through at least one of the first lane and the second lane, using the images (e.g., at least one of the first image and the second image) acquired by the image acquisition unit 211. Furthermore, the face authentication unit 213 performs face authentication processing of one or more people passing through at least one of the first lane and the second lane, using the images acquired by the image acquisition unit 211.

[0074] As a specific example of the tracking process performed by the tracking unit 212, a case where the tracking unit 212 performs tracking process on a target P1 passing through the first lane (see FIG. 2) will be described with reference to Fig. 9. Also, as a specific example of the face authentication process performed by the face authentication unit 213, a case where the face authentication unit 213 performs face authentication process on the target P1 will be described.

[0075] 9 are images including object P1 (in other words, images in which object P1 is captured). Image IMG1 is an image generated by camera CAM1 capturing an image of the first lane at time t1. Image IMG2 is an image generated by camera CAM1 capturing an image of the first lane at time t2, which is later than time t1. Image IMG3 is an image generated by camera CAM1 capturing an image of the first lane at time t3, which is later than time t2.

[0076] Each of images IMG1, IMG2, and IMG3 may be an image corresponding to one frame of a video. In this case, image IMG2 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG1. In other words, image IMG2 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG1. Similarly, image IMG3 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG2. In other words, image IMG3 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG2.

[0077] The tracking unit 212 detects the head of the target P1 included in the image IMG1 from the image IMG1. Note that the method for detecting a person's head from an image is an existing technique, so a detailed description thereof will be omitted. Based on the detected head of the target P1, the tracking unit 212 sets an area including the head of the target P1 as a tracking area TA1.

[0078] When the tracking unit 212 sets the tracking area TA1, it sets a tracking ID, which is identification information for identifying the target P1 related to the tracking area TA1, to the target P1. The tracking unit 212 calculates the position of the target P1 (for example, the position of the feet of the target P1) based on the tracking area TA1. Note that since existing technology can be applied to a method for calculating the position of a subject included in an image from the image, a detailed description thereof will be omitted. The tracking unit 212 associates the tracking ID with the position of the target P1 and registers them in an ID correspondence table 221 stored in the storage device 22.

[0079] When the tracking area TA1 is set, the tracking unit 212 determines whether or not the face of the target P1 is captured in the tracking area TA1. In other words, the tracking unit 212 performs face detection on the tracking area TA1. When it is determined that the face of the target P1 is captured in the tracking area TA1, the tracking unit 212 generates a face image including the face area of ​​the target P1. The tracking unit 212 associates the generated face image with the tracking ID related to the target P1 and transmits it to the face authentication unit 213. Note that when it is determined that the face of the target P1 is not captured in the tracking area TA1, the tracking unit 212 does not need to generate a face image.

[0080] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. For example, the face authentication unit 213 may calculate a face feature amount indicating features related to the face of the target P1 from the face image. The face authentication unit 213 may calculate a matching score from the calculated face feature amount and face information (e.g., face feature amount) of one registrant registered in the face information DB 26.

[0081] If the calculated matching score is greater than a predetermined threshold, the face authentication unit 213 determines that face authentication has been successful. In this case, one registrant corresponding to the target (here, target P1) indicated by the face image transmitted from the tracking unit 212 is identified from among the multiple registrants registered in the face information DB 26. On the other hand, if the calculated matching score is less than the predetermined threshold, the face authentication unit 213 determines that face authentication has failed. In this case, it is highly likely that the person corresponding to the target (here, target P1) indicated by the face image transmitted from the tracking unit 212 is not registered in the face information DB 26. Note that if the calculated matching score and the predetermined threshold are "equal," either case may be included.

[0082] If the facial authentication is successful, the facial authentication unit 213 associates an authentication ID indicating a registrant registered in the facial information DB 26 that corresponds to the target (target P1 in this case) indicated by the facial image transmitted from the tracking unit 212 with the tracking ID associated with the facial image, and registers the associated ID in the ID correspondence table 221. In addition to the authentication ID, the facial authentication unit 213 may register an authentication time, which is the time when the facial authentication process was performed, in the ID correspondence table 221. If the facial authentication is unsuccessful, the facial authentication unit 213 may associate information indicating that there is no corresponding person (for example, "N / A (Not Applicable)") with the tracking ID associated with the facial image transmitted from the tracking unit 212, and register the associated information in the ID correspondence table 221. Note that the "authentication ID" corresponds to an example of the above-mentioned "identification information for identifying one registrant."

[0083] The ID correspondence table 221 will be further described with reference to FIG. 10 . As shown in FIG. 10 , in the ID correspondence table 221, a tracking ID, a tracking position (e.g., the position of the feet of the target P1), an authentication ID, and an authentication time may be associated with one another. In the ID correspondence table 221, when a tracking ID is associated with a specific authentication ID, this indicates that a registrant corresponding to the person for whom the tracking ID is set is registered in the face information DB 26. When a tracking ID is associated with the character string "N / A," this indicates that a person corresponding to the person for whom the tracking ID is set is not registered in the face information DB 26. When a tracking ID is not associated with an authentication ID (i.e., when the authentication ID field is blank), this indicates that face authentication processing has never been performed.

[0084] The tracking unit 212 may use the image IMG2 and the image IMG1 to identify the object P1 included in the image IMG2. Identifying the object P1 included in the image IMG2 is synonymous with associating the object P1 included in the image IMG1 with the object P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method related to image correspondence can be applied to identify the object P1 included in the image IMG2. Note that various existing methods can be applied to both the matching method and the optical flow method, and therefore detailed description thereof will be omitted.

[0085] When target P1 included in image IMG2 is identified, the tracking unit 212 detects the head of target P1. Based on the detected head of target P1, the tracking unit 212 sets an area including the head of target P1 as tracking area TA2. Since target P1 included in image IMG1 and target P1 included in image IMG2 are the same target, the tracking ID of target P1 related to tracking area TA2 is the same as the tracking ID of target P1 related to tracking area TA1. The tracking unit 212 calculates the position of target P1 based on tracking area TA2.

[0086] The tracking unit 212 associates the position of the target P1 with the tracking ID associated with the target P1 and registers it in the ID correspondence table 221. In this case, since the position of the target P1 calculated based on the tracking area TA1 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of the target P1 calculated based on the tracking area TA2 in the ID correspondence table 221, thereby updating the position of the target P1.

[0087] When the tracking area TA2 is set, the tracking unit 212 determines whether the face of the target P1 is captured in the tracking area TA2. In other words, the tracking unit 212 performs face detection on the tracking area TA2. When it is determined that the face of the target P1 is captured in the tracking area TA2, the tracking unit 212 generates a face image including the face area of ​​the target P1. The tracking unit 212 associates the generated face image with the tracking ID associated with the target P1 and transmits the associated face image to the face authentication unit 213. Note that, when it is determined that the face of the target P1 is not captured in the tracking area TA2, the tracking unit 212 does not need to generate a face image. Note that, even when it is determined that the face of the target P1 is captured in the tracking area TA2, when the tracking ID associated with the target P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., when face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0088] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 associates an authentication ID indicating a registrant registered in the face information DB 26 who corresponds to the target (here, target P1) indicated by the face image transmitted from the tracking unit 212 with the tracking ID linked to the face image, and registers the ID in the ID correspondence table 221. In addition to the authentication ID, the face authentication unit 213 may register an authentication time, which is the time when the face authentication processing was performed, in the ID correspondence table 221. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may associate information indicating that there is no corresponding person (e.g., “N / A”) with the tracking ID linked to the face image transmitted from the tracking unit 212, and register the information in the ID correspondence table 221.

[0089] The tracking unit 212 may use the images IMG3 and IMG2 to identify the target P1 included in the image IMG3. When the target P1 included in the image IMG3 is identified, the tracking unit 212 detects the head of the target P1. Based on the detected head of the target P1, the tracking unit 212 sets an area including the head of the target P1 as a tracking area TA3. Because the target P1 included in the image IMG2 and the target P1 included in the image IMG3 are the same target, the tracking ID of the target P1 related to the tracking area TA3 is the same as the tracking ID of the target P1 related to the tracking area TA2. The tracking unit 212 calculates the position of the target P1 based on the tracking area TA3.

[0090] The tracking unit 212 associates the position of the target P1 with the tracking ID associated with the target P1 and registers it in the ID correspondence table 221. In this case, since the position of the target P1 calculated based on the tracking area TA2 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of the target P1 calculated based on the tracking area TA3 in the ID correspondence table 221, thereby updating the position of the target P1.

[0091] When the tracking area TA3 is set, the tracking unit 212 determines whether the face of the target P1 is captured in the tracking area TA3. In other words, the tracking unit 212 performs face detection on the tracking area TA3. If it is determined that the face of the target P1 is captured in the tracking area TA3, the tracking unit 212 generates a face image including the face area of ​​the target P1. The tracking unit 212 associates the generated face image with the tracking ID associated with the target P1 and transmits the associated face image to the face authentication unit 213. Note that if it is determined that the face of the target P1 is not captured in the tracking area TA3, the tracking unit 212 does not need to generate a face image. Note that even if it is determined that the face of the target P1 is captured in the tracking area TA3, if the tracking ID associated with the target P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., if face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0092] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 associates an authentication ID indicating a registrant registered in the face information DB 26 who corresponds to the target (here, target P1) indicated by the face image transmitted from the tracking unit 212 with the tracking ID linked to the face image, and registers the ID in the ID correspondence table 221. In addition to the authentication ID, the face authentication unit 213 may register an authentication time, which is the time when the face authentication processing was performed, in the ID correspondence table 221. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may associate information indicating that there is no corresponding person (e.g., “N / A”) with the tracking ID linked to the face image transmitted from the tracking unit 212, and register the information in the ID correspondence table 221.

[0093] However, it may become difficult for the tracking unit 212 to continue tracking the target P1, for example, because the head of the target P1 is hidden behind another person. When tracking of the target P1 is interrupted, the tracking unit 212 may perform the following process. After tracking of the target P1 is interrupted, the tracking unit 212 may determine whether a new person has been detected from an image acquired by the image acquisition unit 211 (for example, an image captured by the camera CAM1). A "new person" means a person for whom a tracking ID has not been set.

[0094] When a new person is detected, the tracking unit 212 may determine whether the target P1 and the new person are the same target by comparing the feature amount of the tracking area related to the target P1 (e.g., at least one of the tracking areas TA1, TA2, and TA3) with the feature amount of the tracking area related to the new person. If it is determined that the target P1 and the new person are the same target, the tracking unit 212 may assign a tracking ID related to the target P1 to the new person. As a result, the tracking unit 212 can track the target P1 again. Note that the feature amount may be a feature amount related to the target's head, a feature amount related to the target's upper body, or a feature amount related to the target's entire body. In other words, the tracking area (e.g., at least one of the tracking areas TA1, TA2, and TA3) may include the target's head, the target's upper body, or the target's entire body. Note that the feature amount may be obtained, for example, using Person Re-Identification technology.

[0095] The tracking unit 212 and the face authentication unit 213 may repeat the above-described process until the object P1 passes through the first lane. The tracking unit 212 and the face authentication unit 213 may perform the same process as the above-described process for all objects passing through the first lane. The tracking unit 212 and the face authentication unit 213 may perform the same process as the above-described process for all objects passing through the second lane.

[0096] The determination unit 214 determines which targets have been successfully facially authenticated (in other words, which targets have been identified) among multiple targets passing through the first lane or the second lane, based on the ID correspondence table 221. When a tracking ID is associated with a specific authentication ID in the ID correspondence table 221, the determination unit 214 may determine that the target associated with the tracking ID is a target whose facial authentication has been successful.

[0097] Note that the determination unit 214 may determine that an object passing through the first lane has entered Station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is closer to the station premises (e.g., the second area in FIG. 2 ) than the first predetermined position in the first lane. The determination unit 214 may determine that an object passing through the second lane has exited Station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is closer to the station premises (e.g., the first area in FIG. 2 ) than the second predetermined position in the second lane.

[0098] The notification unit 215 may link the authentication ID of the subject whose face authentication was successful (in other words, the authentication ID of the registered person corresponding to the subject) with information indicating that the subject has entered or exited Station A, and transmit the information to the center server 50.

[0099] (Technical Effect) In the ticket gate system 2 according to the second embodiment, a lane through which objects entering the station pass (e.g., the first lane in FIG. 2 ) and a lane through which objects exiting the station pass (e.g., the second lane in FIG. 2 ) are set in the ticket gate area of ​​a railway station (e.g., at least one of Station A and Station B). Therefore, it is expected that multiple objects passing through the first lane will travel in the same direction, and similarly, it is expected that multiple objects passing through the second lane will travel in the same direction. Therefore, camera CAM1 can be positioned in advance so that camera CAM1 can capture an image of the front of an object passing through the first lane. Similarly, camera CAM2 can be positioned in advance so that camera CAM2 can capture an image of the front of an object passing through the second lane.

[0100] As a result, for example, the tracking unit 212 can relatively efficiently detect the face of the subject (in other words, the subject to be authenticated) from each of the images captured by camera CAM1 (i.e., the first image) and the images captured by camera CAM2 (i.e., the second image).

[0101] (First Modification) For example, in the ticket gate area of ​​Station A, in addition to cameras CAM1 and CAM2, an overhead camera that captures planar images of the ticket gate area from above may be installed. The image acquisition unit 211 of the information processing device 20 may acquire the images captured by the overhead camera. For example, the determination unit 214 may detect the number of objects passing through the first lane and the number of objects passing through the second lane based on the images captured by the overhead camera.

[0102] The determination unit 214 may determine whether the number of targets passing through the first lane is equal to the number of tracking IDs linked to positions in the first lane in the ID correspondence table 221 (in other words, the number of targets for which face recognition is performed using images captured by the camera CAM1). If it is determined that the number of targets passing through the first lane is different from the number of tracking IDs linked to positions in the first lane in the ID correspondence table 221, the notification unit 215 may issue a warning to a station attendant at Station A, for example, via a terminal device used by the station attendant.

[0103] The determination unit 214 may determine whether the number of targets passing through the second lane is equal to the number of tracking IDs linked to positions in the second lane in the ID correspondence table 221 (in other words, the number of targets for which face recognition is performed using images captured by the camera CAM2) If it is determined that the number of targets passing through the second lane is different from the number of tracking IDs linked to positions in the second lane in the ID correspondence table 221, the notification unit 215 may issue a warning to a station attendant at Station A, for example, via a terminal device used by the station attendant.

[0104] With this configuration, it is possible to detect, for example, an object entering or exiting station A while hiding behind another person.

[0105] (Second Modification) For example, in the ticket gate area of ​​Station A, in addition to cameras CAM1 and CAM2, an upper camera may be installed that captures planar images of the ticket gate area from above. The resolution of the upper camera may be lower than that of cameras CAM1 and CAM2. The image acquisition unit 211 of the information processing device 20 may acquire images captured by the upper camera. For example, the determination unit 214 may determine whether or not there is an object traveling in the opposite direction to the first lane's traveling direction (in other words, a wrong-way runner) by performing predetermined image processing on multiple temporally consecutive images captured by the upper camera. If it is determined that there is an object traveling in the opposite direction to the first lane's traveling direction, the notification unit 215 may issue a warning to station staff at Station A, for example, via a terminal device used by the station staff.

[0106] For example, the determination unit 214 may determine whether or not there is an object traveling in the second lane in the opposite direction to the traveling direction of the object (in other words, a wrong-way runner) by performing predetermined image processing on multiple temporally consecutive images captured by the upper camera. If it is determined that there is an object traveling in the second lane in the opposite direction to the traveling direction of the object, the notification unit 215 may issue a warning to station staff at Station A, for example, via a terminal device used by the station staff.

[0107] (Third Modification) For example, in the ticket gate area of ​​Station A, in addition to the first and second lanes, areas Ar1 and Ar2 may be set as shown in Fig. 11. Note that the upper side of Fig. 11 is the inside of Station A, and the lower side of Fig. 11 is the outside of Station A.

[0108] A first wrong-way runner camera may be installed in the ticket gate area of ​​Station A to capture images of targets passing through area Ar1 from inside the station toward outside the station (see dashed arrow a1). A second wrong-way runner camera may be installed in the ticket gate area of ​​Station A to capture images of targets passing through area Ar2 from outside the station toward inside the station (see dashed arrow a2).

[0109] The tracking unit 212 and the face authentication unit 213 of the information processing device 20 may perform the above-mentioned tracking process and face authentication process using an image captured by the first wrong-way runner camera. The determination unit 214 may determine that an object passing through area Ar1 has exited from Station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is, for example, closer to the first lane than the end of area Ar1 on the first lane side.

[0110] The tracking unit 212 and the face authentication unit 213 of the information processing device 20 may perform the above-mentioned tracking process and face authentication process using an image captured by the second wrong-way runner camera. The determination unit 214 may determine that a target passing through area Ar2 has entered station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is, for example, closer to the second lane than the end of area Ar2 on the second lane side.

[0111] (Fourth Modification) For example, in the ticket gate area of ​​Station A, areas Ar3 and Ar4 may be set instead of the first and second lanes, as shown in Fig. 12. Note that the upper side of Fig. 12 is the inside of Station A, and the lower side of Fig. 12 is the outside of Station A. In the ticket gate area of ​​Station A, a first camera (e.g., camera CAM1) may be installed to capture an image of an object passing through area Ar3 from the outside of Station A toward the inside of Station A (see dashed arrow a3). In the ticket gate area of ​​Station A, a second camera (e.g., camera CAM2) may be installed to capture an image of an object passing through area Ar4 from the inside of Station A toward the outside of Station A (see dashed arrow a4).

[0112] The tracking unit 212 and the face authentication unit 213 of the information processing device 20 may perform the above-mentioned tracking process and face authentication process using the image captured by the first camera. The determination unit 214 may determine that an object passing through area Ar3 has entered station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is, for example, closer to area Ar4 than the end of area Ar3 on the area Ar4 side.

[0113] The tracking unit 212 and the face authentication unit 213 of the information processing device 20 may perform the above-mentioned tracking process and face authentication process using an image captured by the second camera. The determination unit 214 may determine that an object passing through area Ar4 has exited from station A when the tracking position linked to the tracking ID in the ID correspondence table 221 is, for example, closer to area Ar3 than the end of area Ar4 on the area Ar3 side.

[0114] (Fifth Modification) Facial information (e.g., facial feature amounts) related to a suspicious target may be registered in a facial information database (e.g., facial information DBs 60 and 26). The determination unit 214 may determine whether an authentication ID registered in the ID correspondence table 221 is an authentication ID related to a suspicious target. If it is determined that the authentication ID registered in the ID correspondence table 221 is an authentication ID related to a suspicious target, the notification unit 215 may issue a warning to a station attendant, for example, via a terminal device used by the station attendant at Station A.

[0115] (Sixth Variant) In the ticket gate system 2, when pre-charged electronic money can be used to pay railway fares, the balance of the electronic money in the face information database (e.g., face information DB 60 and 26) may be linked to identification information (e.g., authentication ID) relating to each of multiple registered users.

[0116] For example, the determination unit 214 of the information processing device 20 may determine whether the balance of electronic money linked to the identification information of a registered user corresponding to a target exiting from Station A is less than the train fare (e.g., fare) to be paid. If it is determined that the balance of electronic money is less than the train fare to be paid, the notification unit 215 may notify, for example, a terminal device (e.g., a smartphone) carried by the target, that the balance is insufficient. In this case, the notification unit 215 may issue a warning to a station attendant at Station A via a terminal device used by the station attendant.

[0117] (Seventh Modification) For example, in the ticket gate area of ​​Station A, a first foot camera for capturing images of the feet of a subject passing through the first lane may be installed near the end of the first lane on the side inside the station A (e.g., the second area in FIG. 2 ). A second foot camera for capturing images of the feet of a subject passing through the second lane may be installed near the end of the second lane on the side outside the station A (e.g., the first area in FIG. 2 ).

[0118] The determination unit 214 may detect the shoes of a target passing through the first lane from the image captured by the first foot camera. The determination unit 214 may determine whether the direction in which the toes of the detected shoes are pointing is the same as the traveling direction set for the first lane. If the direction in which the toes of the detected shoes are pointing is opposite to the traveling direction set for the first lane, the determination unit 214 may determine that the target is a wrong-way runner.

[0119] The determination unit 214 may detect the shoes of a target passing through the second lane from the image captured by the second foot camera. The determination unit 214 may determine whether the direction in which the toes of the detected shoes are pointing is the same as the traveling direction set for the second lane. If the direction in which the toes of the detected shoes are pointing is opposite to the traveling direction set for the second lane, the determination unit 214 may determine that the target is a wrong-way runner.

[0120] (Eighth Modification) For example, the ID correspondence table 221 may include a history of the tracking position of each target. The determination unit 214 may determine the traveling direction of each target based on the history of the tracking position. In this case, if the first step of a target is taken from the inside of Station A (e.g., the second area in FIG. 2 ) of the first lane, the determination unit 214 may determine that the traveling direction of the target is opposite to the traveling direction set for the first lane. If the first step of a target is taken from the outside of Station A (e.g., the first area in FIG. 2 ) of the second lane, the determination unit 214 may determine that the traveling direction of the target is opposite to the traveling direction set for the second lane. Alternatively, the determination unit 214 may determine the traveling direction of the target from the first and second steps of the target.

[0121] The determination unit 214 may determine that an object passing through the first lane is running in a direction opposite to the direction of travel set for the first lane, and may determine that an object passing through the second lane is running in a direction opposite to the direction of travel set for the second lane, as a wrong-way runner.

[0122] (Ninth Modification) In the aspects of detecting or determining a wrong-way runner in a ticket gate area of ​​a railway station (the second, seventh, and eighth modifications described above), for example, the determination unit 214 may determine the trajectory of the wrong-way runner based on the position of the wrong-way runner calculated by the tracking unit 212. The determination unit 214 may determine the reason why the wrong-way runner is running in the wrong direction based on the determined trajectory of the wrong-way runner.

[0123] For example, if the trajectory of the wrong-way runner shows relatively large fluctuations in the width direction of the lane (e.g., at least one of the first lane and the second lane), the determination unit 214 may determine that the wrong-way runner is driving the wrong way due to poor health. In this case, the notification unit 215 may notify station staff at Station A that a person is in poor health, for example, via a terminal device used by the station staff.

[0124] For example, if the trajectory of the wrong-way runner shows relatively little fluctuation in the width direction of the lane (e.g., at least one of the first lane and the second lane), the determination unit 214 may determine that the wrong-way runner is intentionally driving in the wrong direction. In this case, the determination unit 214 may determine that the wrong-way runner has entered or exited Station A. As a result, a railway fare may be charged to the wrong-way runner.

[0125] (Tenth Variant) For example, as shown in FIG. 2, if the first lane and the second lane are adjacent to each other and there is no member, such as a fence, between the first lane and the second lane that physically obstructs the passage of an object, for example, an object passing through the first lane may move to the second lane to overtake another object ahead.

[0126] For example, if the tracking position linked to the tracking ID in the ID correspondence table 221 changes from a position in the first lane to a position in the second lane, the judgment unit 214 may determine that the object associated with the tracking ID (in other words, the object to be authenticated) has moved from the first lane to the second lane.

[0127] In this case, the notification unit 215 may notify, for example, a terminal device (e.g., a smartphone) carried by the target with a message such as "Please return to lane 1." Alternatively, the notification unit 215 may notify, for example, a station attendant via a terminal device used by the station attendant, information for identifying the target (e.g., an image including the target) and information indicating that the target has moved from lane 1 to lane 2. With this configuration, for example, it can be expected that a target that has moved from lane 1 to lane 2 will return to lane 1.

[0128] Furthermore, if the target does not return to the first lane despite receiving the above notification, the information processing device 20 may change the target from a target to be authenticated passing through the first lane to a target to be authenticated passing through the second lane.

[0129] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0130] (Supplementary Note 1) An information processing system comprising: an image acquisition means for acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area, and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area; and an authentication means for performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0131] (Supplementary Note 2) The information processing system described in Supplementary Note 1, wherein at least one of the first lane and the second lane includes a sloped road, and the image acquisition means acquires at least one of the first image including the first authenticated object passing through the sloped road, or the first authenticated object before entering the sloped road or after passing through the sloped road, and the second image including the second authenticated object passing through the sloped road, or the second authenticated object before entering the sloped road or after passing through the sloped road.

[0132] (Supplementary Note 3) The information processing system according to Supplementary Note 2, wherein the sloped path includes an escalator.

[0133] (Supplementary Note 4) The information processing system according to Supplementary Note 2 or 3, further comprising an imaging unit that images the sloped road as at least a part of the first lane or at least a part of the second lane.

[0134] (Supplementary Note 5) The information processing system described in any one of Supplementary Notes 1 to 4 is provided with an alarm means for issuing a warning when the number of people passing through the first lane differs from the number of people to be authenticated in the authentication performed by the authentication means using the first image, and / or when the number of people passing through the second lane differs from the number of people to be authenticated in the authentication performed by the authentication means using the second image.

[0135] (Supplementary Note 6) The information processing system according to any one of Supplementary Notes 1 to 5, further comprising a wrong-way runner detection unit configured to detect a wrong-way runner based on at least one of the first image and the second image.

[0136] (Supplementary Note 7) The information processing system according to any one of Supplementary Notes 1 to 6, wherein the first area is one of inside and outside a railway station, and the second area is the other of the inside and outside of the railway station.

[0137] (Supplementary Note 8) An information processing method comprising: acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area; and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area; and performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0138] (Supplementary Note 9) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the method comprising: acquiring at least one of a first image including at least a portion of a first lane through which a first subject to be authenticated passes heading from a first area to a second area; and a second image including at least a portion of a second lane through which a second subject to be authenticated passes heading from the second area to the first area; and performing at least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image.

[0139] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0140] REFERENCE SIGNS LIST 1 Information processing system 2 Ticket gate system 10, 20, 20a Information processing device 11, 211 Image acquisition unit 12 Authentication unit 13 Information DB 26, 60 Face information DB 212 Tracking unit 213 Face authentication unit 214 Determination unit 215 Notification unit

Claims

1. an image acquisition means for acquiring at least one of a first image including at least a portion of a first lane through which a first target to be authenticated passes from a first area to a second area, and a second image including at least a portion of a second lane through which a second target to be authenticated passes from the second area to the first area; an authentication means for performing at least one of authentication of the first target using the first image and authentication of the second target using the second image; An information processing system comprising:

2. At least one of the first lane and the second lane includes a slope, The image acquisition means acquires at least one of the first image including the first object to be authenticated passing through the sloped road, or the first object to be authenticated before entering the sloped road or after passing through the sloped road, and the second image including the second object to be authenticated passing through the sloped road, or the second object to be authenticated before entering the sloped road or after passing through the sloped road. The information processing system according to claim 1 .

3. The ramp includes an escalator. The information processing system according to claim 2 .

4. An imaging means for imaging the sloped road is provided as at least a part of the first lane or at least a part of the second lane.

4. The information processing system according to claim 2 or 3.

5. The device is provided with a notification means for issuing a warning when the number of people passing through the first lane differs from the number of people to be authenticated in the authentication performed by the authentication means using the first image, and when the number of people passing through the second lane differs from the number of people to be authenticated in the authentication performed by the authentication means using the second image. The information processing system according to claim 1 .

6. a wrong-way runner detection means for detecting a wrong-way runner based on at least one of the first image and the second image; The information processing system according to claim 1 .

7. the first area is one of inside and outside a railway station; The second area is the other of the inside and outside of the railway station. The information processing system according to claim 1 .

8. acquiring at least one of a first image including at least a part of a first lane through which a first target to be authenticated travels from a first area to a second area, and a second image including at least a part of a second lane through which a second target to be authenticated travels from the second area to the first area; At least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image is performed. Information processing methods.

9. On the computer, acquiring at least one of a first image including at least a part of a first lane through which a first target to be authenticated travels from a first area to a second area, and a second image including at least a part of a second lane through which a second target to be authenticated travels from the second area to the first area; At least one of authenticating the first subject to be authenticated using the first image and authenticating the second subject to be authenticated using the second image is performed. A recording medium on which a computer program for executing an information processing method is recorded.