Information processing device, information processing method, and recording medium

Abstract

This information processing device comprises: an image acquisition means for acquiring an image including a face authentication region through which a person to be authenticated passes; a face authentication means for performing face authentication of the person to be authenticated on the basis of the image; and a determination means for acquiring age information related to the age associated with a registrant corresponding to the person to be authenticated, the age information being specified by the face authentication means performing face authentication, and the determination means determining whether the person to be authenticated is a child.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] As an example of this type of device, a device has been proposed that performs facial recognition of people who are within an authentication range based on an image captured of the authentication range around a ticket gate installed at a railway station, and controls the opening and closing of the ticket gate door based on the result of the facial recognition (see Patent Document 1).Other prior art documents related to this disclosure include Patent Documents 2 to 4.

[0003] Japanese Patent Application Publication No. 2021-149257 Japanese Patent Application Publication No. 2022-010919 International Publication No. 2021 / 065488 International Publication No. 2020 / 203744

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing device includes an image acquisition means for acquiring an image including a facial authentication area through which a person to be authenticated passes, a facial authentication means for performing facial authentication of the person to be authenticated based on the image, and a determination means for acquiring age information relating to the age associated with a registered person corresponding to the person to be authenticated, which is identified by the facial authentication means performing the facial authentication, and determining whether the person to be authenticated is a child or not.

[0006] One aspect of the information processing method involves acquiring an image including a facial recognition area through which the person to be authenticated passes, performing facial recognition of the person to be authenticated based on the image, acquiring age information relating to the age associated with the registered person corresponding to the person to be authenticated, as determined by the facial recognition, and determining whether the person to be authenticated is a child.

[0007] One aspect of the recording medium has a computer program recorded on it that causes a computer to execute an information processing method that acquires an image including a facial authentication area through which a person to be authenticated passes, performs facial authentication of the person to be authenticated based on the image, acquires age information related to the age associated with the registered person corresponding to the person to be authenticated that is identified by the facial authentication, and determines whether the person to be authenticated is a child.

[0008] FIG. 1 is a diagram showing an overview of a ticket gate system according to a first embodiment. FIG. 2 is a diagram showing an example of a face authentication area. FIG. 3 is a diagram showing an example of a face information database. FIG. 4 is a flowchart showing the operation of an information processing device according to the first embodiment. FIG. 5 is a block diagram showing the configuration of an information processing device according to a first modified example and a second modified example of the first embodiment. FIG. 6 is a block diagram showing the configuration of an information processing device according to a third modified example of the first embodiment. FIG. 7 is a diagram showing an overview of a ticket gate system according to a second embodiment. FIG. 8 is a block diagram showing the configuration of an information processing device according to the second embodiment. FIG. 9 is a diagram for explaining person tracking processing. FIG. 10 is a diagram showing an example of an ID correspondence table.

[0009] <First embodiment> A first embodiment relating to an information processing device, an information processing method, and a recording medium will be described with reference to Figures 1 to 4. Hereinafter, the first embodiment relating to an information processing device, an information processing method, and a recording medium will be described using an information processing device 10 provided in a ticket gate system 1.

[0010] (Outline of the ticket gate system) An outline of the ticket gate system 1 according to the first embodiment will be described with reference to Fig. 1. In Fig. 1, the ticket gate system 1 includes an information processing device 10 and a center server 50. The ticket gate system 1 includes a camera CAM1 installed at railway station A and a camera CAM2 installed at railway station B. The information processing device 10, the center server 50, and the cameras CAM1 and CAM2 are connected via a network NW. Note that railway stations will hereinafter be referred to as "stations" where appropriate.

[0011] Note that in addition to camera CAM1, other cameras may be installed at station A. That is, two or more cameras may be installed at station A. Similarly, in addition to camera CAM2, other cameras may be installed at station B. That is, two or more cameras may be installed at station B. Note that network NW may be a wide area network such as the Internet.

[0012] The information processing device 10 may perform face recognition based on images captured by camera CAM1, and identify persons entering station A and persons exiting station A. The information processing device 10 may perform face recognition based on images captured by camera CAM2, and identify persons entering station B and persons exiting station B.

[0013] For example, suppose that person P corresponding to registrant R enters station A. Then, person P travels by train to station B. Then, person P exits from station B.

[0014] When person P enters station A, the information processing device 10 may perform facial authentication based on an image captured by camera CAM1 and identify person P as registrant R. The information processing device 10 may link identification information indicating registrant R with information indicating entry into station A and transmit the linked information to the center server 50. The center server 50 may register that registrant R has entered station A. At least one of the information processing device 10 and the center server 50 may transmit information indicating entry into station A to a terminal device (e.g., a smartphone) carried by person P, who is registrant R.

[0015] When person P exits from station B, the information processing device 10 may perform facial recognition based on an image captured by camera CAM2 and identify person P as registrant R. The information processing device 10 may link identification information indicating registrant R with information indicating that person P exited from station B and transmit the linked information to the center server 50. The center server 50 may register that registrant R exited from station B. At least one of the information processing device 10 and the center server 50 may transmit information indicating that person P exited from station B to a terminal device carried by person P, who is registrant R.

[0016] As a result, the center server 50 may register that registrant R entered station A and exited station B. The center server 50 may calculate the railway fare (e.g., fare) from station A to station B. The center server 50 may pay the calculated railway fare using payment information related to registrant R. The center server 50 may transmit information indicating the railway fare to a terminal device carried by person P, who is registrant R. The payment information may be, for example, at least one of credit card information, debit card information, prepaid card information, IC (Integrated Circuit) card information, and account information.

[0017] As described above, the information processing device 10 is a device that detects the entry and exit of a person, instead of a ticket gate device (e.g., an automatic ticket gate) that detects the entry and exit of a person using at least one of a magnetic ticket, an IC ticket, and a mobile ticket.

[0018] 1, an information processing device 10 includes an image acquisition unit 11, a face authentication unit 12, a determination unit 13, and a face information database 14 (hereinafter referred to as "face information DB 14" as appropriate). The image acquisition unit 11 acquires images captured by cameras CAM1 and CAM2.

[0019] Here, the ticket gate area of ​​a station (for example, at least one of Station A and Station B) will be described with reference to FIG. 2. In FIG. 2, the dashed line indicates the boundary between the inside and outside of the station premises. In FIG. 2, the area above the dashed line corresponds to the inside of the station premises. In FIG. 2, the area below the dashed line corresponds to the outside of the station premises. Note that the dashed line is shown merely for convenience of explanation. Lines corresponding to the dashed lines in FIG. 2 do not need to be drawn in the ticket gate area of ​​an actual station. Note that a gate device having a member (for example, a flap) that opens and closes depending on the results of facial authentication may be located at the position corresponding to the dashed line.

[0020] In Fig. 2 , facial recognition areas Ar1 and Ar2 may be set near the dashed line (i.e., the boundary between the inside and outside of the station). The facial recognition areas Ar1 and Ar2 are virtual areas. A person entering the station (e.g., person P1 in Fig. 2 ) passes through the facial recognition area Ar1 from outside the station toward the inside of the station and crosses the dashed line to enter the station. A person leaving the station (e.g., person P2 in Fig. 2 ) passes through the facial recognition area Ar2 from inside the station toward the outside of the station and crosses the dashed line to exit the station.

[0021] 2 are merely examples and are not intended to be limiting. The face recognition area (e.g., at least one of the face recognition areas Ar1 and Ar2) may be set appropriately in consideration of at least one of the structure of the station building, the passage rules, and the number of passengers getting on and off.

[0022] Camera CAM1 may capture an image of a face recognition area set in the ticket gate area of ​​Station A (i.e., a face recognition area corresponding to at least one of face recognition areas Ar1 and Ar2 in FIG. 2 ). Note that if another camera is installed in addition to camera CAM1 in the ticket gate area of ​​Station A, camera CAM1 may capture an image of at least a part of the face recognition area.

[0023] The image acquisition unit 11 acquires an image captured by the camera CAM1, the image including at least a part of the face recognition area set in the ticket gate area of ​​Station A. The image captured by the camera CAM1 may be provided with, for example, time information (e.g., a timestamp) indicating the time of capture and location information indicating the location of the camera CAM1. The image captured by the camera CAM1 may be provided with information for identifying the ticket gate area of ​​Station A instead of or in addition to the location information indicating the location of the camera CAM1.

[0024] Camera CAM2 may capture an image of a face recognition area set in the ticket gate area of ​​Station B (i.e., a face recognition area corresponding to at least one of face recognition areas Ar1 and Ar2 in FIG. 2). Note that if another camera is installed in addition to camera CAM2 in the ticket gate area of ​​Station B, camera CAM2 may capture an image of at least a part of the face recognition area.

[0025] The image acquisition unit 11 acquires an image captured by the camera CAM2, the image including at least a part of the face recognition area set in the ticket gate area of ​​Station B. The image captured by the camera CAM2 may be provided with, for example, time information (e.g., a timestamp) indicating the time of capture and location information indicating the location of the camera CAM2. The image captured by the camera CAM2 may be provided with information for identifying the ticket gate area of ​​Station B instead of or in addition to the location information indicating the location of the camera CAM2.

[0026] A station (for example, at least one of Station A and Station B) may have two or more ticket gate areas. In this case, two or more cameras may be installed in the station to capture images of the face recognition areas of the two or more ticket gate areas, respectively.

[0027] The face authentication unit 12 of the information processing device 10 performs face authentication based on the image acquired by the image acquisition unit 11. Note that various existing methods such as a two-dimensional (2D) authentication method and a three-dimensional (3D) authentication method can be applied to face authentication. An example of processing related to face authentication will be described below.

[0028] The face authentication unit 12 may detect the face of a person (hereinafter referred to as the "person to be authenticated") included in the image. The face authentication unit 12 may calculate facial feature amounts indicating the characteristics of the detected face. The face authentication unit 12 may identify a registered person corresponding to the person to be authenticated using the calculated facial feature amounts and the face information DB 14.

[0029] Here, the face information DB 14 will be described with reference to Figure 3. The face information DB 14 stores information related to persons who wish to use the ticket gate system 1. Among those who wish to use the ticket gate system 1, those whose information is registered in the face information DB 14 correspond to the "registrants" described above. The face information DB 14 stores an authentication ID as identification information for identifying each of the multiple registrants. Information on each of the multiple registrants is linked to the authentication ID and registered in the face information DB 14. The authentication ID may be an example of the "identification information indicating the registrant R" described above.

[0030] As shown in FIG. 3 , facial information, age information, and terminal information for one registrant may be linked to an authentication ID and registered in the facial information DB 14. As shown in FIG. 3 , facial information, payment information, and terminal information for one registrant may be linked to an authentication ID and registered in the facial information DB 26. The facial information may be, for example, information (e.g., a file name) for identifying a feature quantity indicating the facial characteristics of the one registrant. Alternatively, the facial information may be, for example, information (e.g., a file name) for identifying a facial image including the face of the one registrant. The age information may be information indicating the date of birth of the one registrant. Alternatively, the age information may be information indicating the current age of the one registrant. The terminal information may be information (e.g., at least one of a telephone number and an email address) for identifying a terminal device (e.g., a smartphone) owned by the one registrant.

[0031] A facial image including the face of a registrant may be generated, for example, by capturing an image of the registrant's face with a camera at the time of registration. The facial image may be acquired, for example, from a recording medium showing the face of the registrant. The "recording medium showing the face of the registrant" may be at least one of a recording medium on which a facial image including the face of the registrant is printed and a recording medium having an electronic component (e.g., an IC chip) that stores a facial image including the face of the registrant. Examples of such recording media include a My Number card and a driver's license.

[0032] The face authentication unit 12 may calculate a matching score from the calculated facial feature amount (i.e., facial feature amount related to the face of the person to be authenticated) and facial feature amount based on facial information of one registrant registered in the face information DB 14. If the calculated matching score is greater than a predetermined threshold, the face authentication unit 12 may determine that the one registrant is the registrant corresponding to the person to be authenticated. If the calculated matching score is less than the predetermined threshold, the face authentication unit 12 may calculate a matching score from the calculated facial feature amount and facial feature amount based on facial information of another registrant registered in the face information DB 14. Note that if the calculated matching score is "equal" to the predetermined threshold, it may be treated as including either case.

[0033] The determination unit 13 of the information processing device 10 acquires age information linked to the registered person corresponding to the person to be authenticated, which is identified by the facial authentication unit 12 performing facial authentication. The determination unit 13 determines whether the person to be authenticated is a child based on the acquired age information. Here, "child" refers to a person to whom a "child's fare" for railway fares (e.g., fares) applies. "Child" may include, for example, a person under the age of 12 and a 12-year-old person who has not yet entered junior high school. For example, if the current date is before April 1, the determination unit 13 may determine that a 12-year-old person is a 12-year-old person who has not yet entered junior high school.

[0034] When the age information indicates the date of birth of the registrant corresponding to the person to be authenticated, the determination unit 13 may calculate the current age of the person to be authenticated from the date of birth indicated by the age information and the current date.The determination unit 13 may determine whether the person to be authenticated is a child based on the calculated age.When the age information indicates the current age of the registrant, the determination unit 13 may determine whether the person to be authenticated is a child based on the age indicated by the age information.

[0035] When the determination unit 13 determines that the person to be authenticated is a child, the information processing device 10 may link the authentication ID of the registrant corresponding to the person to be authenticated, information indicating that the person to be authenticated is a child, and information indicating that the person to be authenticated has entered or exited the station, and transmit the linked information to the center server 50. The center server 50 may register that the registrant associated with the authentication ID transmitted from the information processing device 10 is a child.

[0036] If the determination unit 13 determines that the person to be authenticated is not a child (i.e., the person to be authenticated is an adult), the information processing device 10 may link the authentication ID of the registrant corresponding to the person to be authenticated with information indicating that the person to be authenticated has entered or exited a station, and transmit the linked information to the center server 50. The center server 50 may register that the registrant associated with the authentication ID transmitted from the information processing device 10 is an adult. Note that the center server 50 does not need to register that the registrant is an adult. In this case, the center server 50 may simply treat the registrant who is not registered as a child as an adult.

[0037] The information processing device 10 does not have to transmit information indicating that the person to be authenticated is an adult to the center server 50. The information processing device 10 may transmit information indicating that the person to be authenticated is an adult to the center server 50. The term "adult" refers to a person to whom a "child's fare" for railway fares (e.g., fares) applies. The term "adult" may include a person aged 13 or older, and a person who has turned 12 after entering junior high school. For example, if the current date is April 1 or later, the determination unit 13 may determine that a 12-year-old person is a person who has turned 12 after entering junior high school.

[0038] Next, the operation of the information processing device 10 will be described with reference to the flowchart of Fig. 4. In Fig. 4, the image acquisition unit 11 of the information processing device 10 acquires an image (i.e., an image including a face recognition area) captured by a camera (e.g., at least one of cameras CAM1 and CAM2) (step S101).

[0039] The face authentication unit 12 performs face authentication based on the image acquired in the process of step S101 (step S102). The determination unit 13 acquires age information linked to the registrant corresponding to the person to be authenticated (i.e., the person included in the image acquired in the process of step S101) identified in the process of step S102 (step S103).

[0040] The determination unit 13 determines whether the age of the person to be authenticated corresponds to that of a child based on the age information acquired in the process of step S103 (step S104). If it is determined in the process of step S104 that the age corresponds to that of a child (step S104: Yes), the determination unit 12 determines that the person to be authenticated is a child (step S105). On the other hand, if it is determined in the process of step S104 that the age does not correspond to that of a child (step S104: No), the determination unit 12 determines that the person to be authenticated is an adult (step S106).

[0041] In this way, the information processing device 10 performs an information processing method in which an image including a facial recognition area through which the person to be authenticated passes is acquired, facial recognition of the person to be authenticated is performed based on the image, age information relating to the age linked to the registered person corresponding to the person to be authenticated, identified through the facial recognition, is acquired, and the person to be authenticated is determined to be a child or not.

[0042] The information processing device 10 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium stores a computer program for causing a computer to execute an information processing method that acquires an image including a facial authentication area through which a person to be authenticated passes, performs facial authentication of the person to be authenticated based on the image, acquires age information related to the age associated with a registered person corresponding to the person to be authenticated that is identified by the facial authentication, and determines whether the person to be authenticated is a child.

[0043] (Technical Effect) Railway fare categories include "adult" and "child." It is necessary to apply an appropriate fare to each person using the railway. For example, a technology has been proposed that estimates a person's age from a facial image showing the person's face. However, it is extremely difficult to accurately determine a person's age from a facial image showing the person's face.

[0044] In contrast, in the face information DB 14 included in the information processing device 10, age information is linked to the authentication ID of a registrant. Therefore, in the information processing device 10, once the face authentication unit 12 identifies a registrant corresponding to the person to be authenticated (i.e., a person included in the image acquired by the image acquisition unit 11), the age of the person to be authenticated can be accurately identified based on the age information linked to the authentication ID of the identified registrant. Therefore, the information processing device 10 can accurately determine whether the person to be authenticated is a child. Therefore, the information processing device 10 can apply appropriate fares to people using trains.

[0045] In addition to "adult" and "child," the railway fare categories may include, for example, at least one of "toddler" and "infant."

[0046] (First Modification) A first modification of the first embodiment will be described with reference to Fig. 5. In the first modification, the ticket gate system 1 may include an information processing device 10a instead of the information processing device 10. In Fig. 5, the information processing device 10a includes an image acquisition unit 11, a face authentication unit 12, a determination unit 13, a face information DB 14, and an output unit 15.

[0047] In the face information DB 14, time information indicating the date when information about one registrant (for example, at least one of face information, age information, and terminal information) was registered or updated may be linked to the authentication ID of one registrant. In this case, it can be said that the authentication ID, face information, age information, terminal information, and time information are linked to one another for one registrant.

[0048] If the determination unit 13 determines that the person to be authenticated is a child, the output unit 15 may acquire time information linked to the authentication ID of the registrant corresponding to the person to be authenticated. The output unit 15 may calculate the difference between the date indicated by the acquired time information and the current date. The output unit 15 may determine whether the calculated difference is longer than a predetermined period (e.g., six months, one year, etc.).

[0049] If it is determined that the calculated difference is longer than the predetermined period, the output unit 15 may output a notification prompting the user to update the face information linked to the authentication ID of the registrant corresponding to the user. In this case, the output unit 15 may transmit the notification to at least one of a terminal device owned by the user determined to be a child and a terminal device owned by the guardian of the user, based on terminal information linked to the authentication ID of the registrant corresponding to the user. Note that if it is determined that the calculated difference is shorter than the predetermined period, the output unit 15 does not need to output the notification. Note that if the calculated difference and the predetermined period are "equal," either case may be included.

[0050] (Technical Effect) The faces of people of an age at which children's train fares apply often change in a relatively short period of time as they grow up. If the facial information of people of an age at which children's train fares apply, registered in the face information DB 14, is not updated after registration, it may become difficult to identify the person through face recognition if a certain amount of time has passed since registration (i.e., face recognition may fail).

[0051] In contrast, in the information processing device 10a, when the determination unit 13 determines that the person to be authenticated is a child and the difference between the date indicated by the time information and the current date is longer than a predetermined period, the output unit 15 outputs a notification urging the user to update their facial information. If the facial information related to the person to be authenticated determined to be a child is updated in response to the notification output from the output unit 15, the person to be authenticated can be identified by facial recognition even if their face has changed due to growth.

[0052] (Second Modification) A second modification of the first embodiment will be described with reference to Fig. 5. In the second modification, the ticket gate system 1 may include an information processing device 10a instead of the information processing device 10. In Fig. 5, the information processing device 10a includes an image acquisition unit 11, a face authentication unit 12, a determination unit 13, a face information DB 14, and an output unit 15.

[0053] When the facial authentication unit 12 performs facial authentication and identifies a registered person corresponding to the person to be authenticated (for example, when the matching score related to the facial authentication is greater than a predetermined threshold), and the determination unit 13 determines that the person to be authenticated is a child, the output unit 15 may acquire the matching score related to the facial authentication performed by the facial authentication unit 12 for the person to be authenticated. The output unit 15 may determine whether the acquired matching score is lower than a predetermined value. Note that the predetermined value is, for example, a value higher than a predetermined threshold related to the facial authentication.

[0054] If the matching score is determined to be lower than a predetermined value, the output unit 15 may output a notification prompting the user to update the face information linked to the authentication ID of the registrant corresponding to the user. In this case, the output unit 15 may transmit the notification to at least one of a terminal device owned by the user determined to be a child and a terminal device owned by the guardian of the user, based on terminal information linked to the authentication ID of the registrant corresponding to the user. Note that if the matching score is determined to be higher than the predetermined value, the output unit 15 does not need to output the notification. Note that if the matching score and the predetermined value are "equal," either case may be included.

[0055] (Technical Effect) The faces of people of an age at which children's train fares apply often change in a relatively short period of time as they grow up. If the facial information of people of an age at which children's train fares apply, registered in the face information DB 14, is not updated after registration, it may become difficult to identify the person through face recognition if a certain amount of time has passed since registration (i.e., face recognition may fail).

[0056] If there is a difference between the facial information registered in the facial information DB 14 and the actual face of a person of an age to which the child's rate applies (i.e., the face of the person contained in the image acquired by the image acquisition unit 11), the matching score for facial recognition will decrease.

[0057] In view of these circumstances, in the information processing device 10a, when the facial authentication unit 12 performs facial authentication to identify a registered person corresponding to a person to be authenticated, and when the determination unit 13 determines that the person to be authenticated is a child and the matching score related to the facial authentication is lower than a predetermined value, the output unit 15 outputs a notification urging the user to update the facial information. If the facial information related to the person to be authenticated determined to be a child is updated in response to the notification output from the output unit 15, the person to be authenticated can be identified by facial authentication even if the person's face has changed due to growth.

[0058] The aspect according to the second modification may be combined with the aspect according to the first modification described above. In this case, when it is determined that the matching score is lower than a predetermined value and it is determined that the difference between the date indicated by the time information linked to the authentication ID of the registrant corresponding to the user to be authenticated and the current date is longer than a predetermined period, the output unit 15 may output a notification prompting an update of the face information linked to the authentication ID of the registrant corresponding to the user to be authenticated.

[0059] (Third Modification) A third modification of the first embodiment will be described with reference to Fig. 6. In the third modification, the ticket gate system 1 may include an information processing device 10b instead of the information processing device 10. In Fig. 6, the information processing device 10a includes an image acquisition unit 11, a face authentication unit 12, a determination unit 13, a face information DB 14, an output unit 15, and a registration unit 16. Note that the information processing device 10b does not necessarily include the output unit 15.

[0060] The registration unit 16 may register information about a new registrant in the face information DB 14. The registration unit 16 may change (in other words, update) information about a registrant that is already registered in the face information DB 14.

[0061] The following is a specific description of the method by which the registration unit 16 acquires a facial image including the face of a registered user. Here, it is assumed that a person who wishes to use the ticket gate system 1 (hereinafter referred to as the "user") performs an input operation using a terminal device (e.g., a smartphone) that the person possesses. The registration unit 16 acquires, for example, a facial image from the terminal device. If the information processing device 10b has an input device such as a touch panel, the user may perform the input operation using the input device. The input operation may be performed by a representative of the user (e.g., a guardian) instead of or in addition to the user.

[0062] The registration unit 16 may acquire, from the terminal device, a facial image including the face of the applicant, captured by a camera included in the terminal device. The registration unit 16 may register the acquired facial image as facial information of the applicant (i.e., a new registrant) in the facial information DB 14, linking it to the authentication ID related to the applicant. Alternatively, the registration unit 16 may calculate facial feature amounts from the acquired facial image. The registration unit 16 may register the calculated facial feature amounts as facial information of the applicant (i.e., a new registrant) in the facial information DB 14, linking it to the authentication ID related to the applicant.

[0063] The prospective user may use a terminal device to acquire a facial image including the prospective user's face from a recording medium showing the prospective user's face. For example, the prospective user may acquire the facial image by capturing a facial image including the prospective user's face printed on the recording medium with a camera included in the terminal device. For example, the prospective user may acquire the facial image by reading a facial image including the prospective user's face stored in an electronic component (e.g., an IC chip) included in the recording medium using a reading function (e.g., an IC card reader application) included in the terminal device. Examples of such recording media include a My Number card and a driver's license.

[0064] The registration unit 16 may acquire, from the terminal device, a facial image acquired by the terminal device from a recording medium. The registration unit 16 may register the acquired facial image in the facial information DB 14 as facial information of the user applicant (i.e., a new registrant) in association with the authentication ID related to the user applicant. Alternatively, the registration unit 16 may calculate facial feature amounts from the acquired facial image. The registration unit 16 may register the calculated facial feature amounts in the facial information DB 14 as facial information of the user applicant (i.e., a new registrant) in association with the authentication ID related to the user applicant.

[0065] A facial image acquired by a terminal device from a recording medium may be provided with acquisition route information indicating that the image was acquired from the recording medium. The registration unit 16 may determine whether the acquired facial image was acquired from a recording medium based on the acquisition route information.

[0066] When the registration unit 16 acquires a facial image acquired by the terminal device from a recording medium as the facial image, the registration unit 16 may request a facial image including the current face (i.e., actual face) of the applicant from the applicant. Note that the facial image including the current face of the applicant may be captured by a camera included in the terminal device carried by the applicant. Note that the registration unit 16 may request a facial image including the current face (i.e., actual face) of the applicant only when, for example, the current age of the applicant based on the applicant's date of birth falls within the age range for which a child's fare for railway fares applies.

[0067] When the registration unit 16 acquires a facial image including the current face of the applicant, for example, the registration unit 16 may determine the degree of match between the face of the applicant shown in the facial image acquired by the terminal device from the recording medium and the current face of the applicant. Note that various existing methods can be applied to the method of determining the degree of match, and an example is a method of calculating a matching score as in the face authentication performed by the face authentication unit 12 (in this case, the matching score corresponds to an example of an index indicating the degree of match).

[0068] The registration unit 16 may determine whether the degree of match is less than a predetermined level. If it is determined that the degree of match is less than a predetermined level, the registration unit 16 may acquire a facial image including the current face of the applicant as a facial image to be registered as facial information in the facial information DB 14, instead of the facial image acquired by the terminal device from the recording medium (in other words, discard the facial image acquired by the terminal device from the recording medium). Alternatively, in this case, the registration unit 16 may register facial feature amounts calculated from the facial image including the current face of the applicant as facial information in the facial information DB 14.

[0069] If it is determined that the degree of match is greater than a predetermined degree, the registration unit 16 may acquire the facial image acquired by the terminal device from the recording medium as a facial image to be registered as facial information in the facial information DB 14. Alternatively, in this case, the registration unit 16 may register facial feature amounts calculated from the facial image acquired by the terminal device from the recording medium as facial information in the facial information DB 14. In this case, the registration unit 16 may acquire both the facial image acquired by the terminal device from the recording medium and a facial image including the current face of the user as facial images to be registered as facial information in the facial information DB 14. If the degree of match and the predetermined degree are "equal," either case may be included.

[0070] (Technical Effect) The faces of people of an age where a child's fare applies to railway fares often change in a relatively short period of time as they grow up. When a facial image including the face of a person of an age where a child's fare applies, who is the above-mentioned user, is acquired from the above-mentioned recording medium, there is a possibility that the face of the person shown in the recording medium and the current face of the person have changed to such an extent that they cannot be determined to be the same person in, for example, facial recognition.

[0071] As described above, when the degree of match between the face of the applicant in the facial image acquired by the terminal device from the recording medium and the current face of the applicant is less than a predetermined degree, the registration unit 16 may acquire a facial image including the current face of the applicant, instead of the facial image acquired by the terminal device from the recording medium, as the facial image to be registered as facial information in the facial information DB 14. Alternatively, in this case, the registration unit 16 may register facial feature amounts calculated from the facial image including the current face of the applicant as facial information in the facial information DB 14. With this configuration, facial information of a person of an age to which a child's rate applies, whose face is likely to change in a relatively short period of time during the growth process, can be appropriately registered in the facial information DB 14.

[0072] Second Embodiment A second embodiment relating to an information processing device, an information processing method, and a recording medium will be described with reference to Figures 7 to 10. Below, the second embodiment relating to an information processing device, an information processing method, and a recording medium will be described using an information processing device 20 provided in a ticket gate system 2. Note that, for the second embodiment, descriptions that overlap with the description of the first embodiment described above will be omitted as appropriate.

[0073] (Outline of Ticket Gating System) An outline of the ticket gate system 2 according to the second embodiment will be described with reference to FIG. 7 . In FIG. 7 , the ticket gate system 2 includes an information processing device 20, a station server 41, and a camera CAM1 installed at station A, and an information processing device 20a, a station server 42, and a camera CAM2 installed at station B, a center server 50, a counter server 60, and a face information database 70 (hereinafter referred to as "face information DB 70" as appropriate). Note that, in addition to the information processing device 20, other information processing devices may be installed at station A. That is, multiple information processing devices may be installed at station A. Similarly, in addition to the information processing device 20a, other information processing devices may be installed at station B. That is, multiple information processing devices may be installed at station B.

[0074] At station A, the information processing device 20 and the station server 41 may be connected via a narrow area network such as a local area network (LAN). Similarly, at station B, the information processing device 20a and the station server 42 may be connected via a narrow area network. The station servers 41 and 42, the center server 50, the counter server 60, and the face information DB 70 are connected via a network NW.

[0075] The information processing device 20 may perform facial recognition based on images captured by the camera CAM1, and identify persons entering station A and persons exiting station A. The information processing device 20 associates identification information (e.g., an authentication ID) indicating a registered person corresponding to the person identified by facial recognition with information indicating that the person has entered station A or information indicating that the person has exited station A, and transmits the associated information to the station server 41. The station server 41 transmits the information transmitted from the information processing device 20 (i.e., the identification information indicating the registered person corresponding to the person identified by facial recognition, and the information indicating that the person has entered station A or information indicating that the person has exited station A) to the center server 50 at a predetermined communication cycle.

[0076] The information processing device 20a may perform facial recognition based on images captured by the camera CAM2, and identify persons entering station B and persons exiting station B. The information processing device 20a associates identification information (e.g., an authentication ID) indicating a registered person corresponding to the person identified by facial recognition with information indicating that the person has entered station B or information indicating that the person has exited station B, and transmits the associated information to the station server 42. The station server 42 transmits the information transmitted from the information processing device 20a (i.e., the identification information indicating the registered person corresponding to the person identified by facial recognition, and the information indicating that the person has entered station B or information indicating that the person has exited station B) to the center server 50 at a predetermined communication cycle.

[0077] The counter server 60 is, for example, a device that performs a pre-registration process that a person who wishes to use the ticket gate system 2 (hereinafter referred to as an "applicant") must perform before using the ticket gate system 2. In addition to the pre-registration process, the counter server 60 may also perform, for example, an information change process that changes the registration information of a person who is already using the ticket gate system 2.

[0078] The prospective user may perform the pre-registration process by accessing the counter server 60 using a terminal device (e.g., a smartphone) that the user owns. In the pre-registration process, the prospective user may enter, for example, their name, date of birth, telephone number, email address, payment information, and a facial image.

[0079] The window server 60 may link, from the information input by the prospective user in the pre-registration process, for example, the name, date of birth, telephone number, email address, and payment information to identification information (for example, an authentication ID) related to the prospective user (i.e., a new registrant), and transmit the linked information to the center server 50. The window server 60 may link, from the information input by the prospective user in the pre-registration process, for example, the date of birth, telephone number, email address, and facial image to identification information (for example, an authentication ID) related to the prospective user (i.e., a new registrant), and newly register the linked information in the face information DB 70.

[0080] The identification information of the applicant (i.e., new registrant) sent from the window server 60 to the center server 50 may be the same as the identification information of the applicant (i.e., new registrant) that the window server 60 newly registers in the face information DB 70. The identification information of the applicant (i.e., new registrant) sent from the window server 60 to the center server 50 may be different from the identification information of the applicant (i.e., new registrant) that the window server 60 newly registers in the face information DB 70. In this case, information for identifying the correspondence between the two may be generated.

[0081] The face information DB 70 may have the same configuration as the face information DB 14 shown in Fig. 3. "Date of birth" corresponds to an example of "age information" shown in Fig. 3. "Telephone number" and "Email address" correspond to an example of "terminal information" shown in Fig. 3. "Facial image" corresponds to an example of "face information" shown in Fig. 3.

[0082] In addition, in the pre-registration process, the person wishing to use the service may use a terminal device they own to read a photo ID such as a My Number card or driver's license, which may automatically input, for example, their name, date of birth, telephone number, email address, and facial image.

[0083] The center server 50 may calculate the railway fare for each registrant based on information (e.g., identification information indicating the registrant identified by facial recognition and information indicating entry and exit from a station) transmitted from each of the multiple station servers including the station servers 41 and 42. The center server 50 may pay the railway fare for each registrant using payment information related to each registrant.

[0084] (Configuration of Information Processing Device) In FIG. 8 , the information processing device 20 includes a calculation device 21, a storage device 22, and a communication device 23. The authentication device 20 may further include an input device 24 and an output device 25. The authentication device 20 may include a face information database 26 (hereinafter, appropriately referred to as "face information DB 26"). Note that the authentication device 20 does not need to include at least one of the input device 24 and the output device 25. In the authentication device 20, the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, and the face information DB 26 may be connected via a data bus 27. Note that the face information DB 26 may store the same information as that registered in the face information DB 70. The face information DB 26 may be updated at a predetermined interval so that the information registered in the face information DB 26 is the same as the information registered in the face information DB 70.

[0085] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0086] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0087] The communication device 23 may be capable of communicating with devices external to the authentication device 20. The communication device 23 may perform wired communication or wireless communication.

[0088] The input device 24 is a device capable of accepting information input to the authentication device 20 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the authentication device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the authentication device 20, such as a USB (Universal Serial Bus) memory. Note that when information is input to the authentication device 20 via the communication device 23 (in other words, when the authentication device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0089] The output device 25 is a device capable of outputting information to the outside of the authentication device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium that is detachable from the authentication device 20, such as a USB memory. Note that when the authentication device 20 outputs information via the communication device 23, the communication device 23 may function as an output device.

[0090] The calculation device 21 may have an image acquisition unit 211, a tracking unit 212, a face authentication unit 213, a judgment unit 214, and an output unit 215 as logically realized functional blocks or as physically realized processing circuits.

[0091] At least one of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the output unit 215 may be realized in a format in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the output unit 215 are functional blocks, at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, the determination unit 214, and the output unit 215 may be realized by the calculation device 21 executing a predetermined computer program.

[0092] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) provided in the authentication device 20. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the authentication device 20 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0093] The "image acquisition unit 211," "face authentication unit 213," "determination unit 214," and "face information DB 26" are components corresponding to the "image acquisition unit 11," "face authentication unit 12," "determination unit 13," and "face information DB 14" in the first embodiment described above, respectively. The "output unit 215" is a component corresponding to the "output unit 15" in at least one of the first and second modified examples of the first embodiment described above.

[0094] The information processing device 20a may have the same configuration as the information processing device 20. Therefore, a description of the information processing device 20a will be omitted. The operation of the information processing device 20 will be described below, but the information processing device 20a may also perform the same operation as the information processing device 20.

[0095] (Operation of Information Processing Device) The information processing device 20 performs face authentication of the person to be authenticated (for example, at least one of the persons P1 and P2 in FIG. 2 ) based on an image captured by the camera CAM1. For example, it is assumed that face authentication areas Ar1 and Ar2 shown in FIG. 2 are set in the ticket gate area of ​​Station A. The information processing device 20 may perform face authentication of person P1 as the person to be authenticated while person P1 passes through face authentication area Ar1 from outside the station toward the station. The information processing device 20 may perform face authentication of person P2 as the person to be authenticated while person P2 passes through face authentication area Ar2 from inside the station toward the suburbs.

[0096] In other words, the information processing device 20 is a device capable of performing walk-through facial recognition. If no device capable of physically obstructing the passage of users is installed in the ticket gate area of ​​Station A, the facial recognition method performed by the information processing device 20 may be referred to as gateless facial recognition.

[0097] The image acquisition unit 211 acquires an image captured by the camera CAM1, the image including at least a part of a face authentication area set in the ticket gate area of ​​Station A (for example, at least one of the face authentication areas Ar1 and Ar2 shown in FIG. 2 ). The camera CAM1 may be connected to the information processing device 20 via a cable such as a USB cable. The camera CAM1 may communicate with the information processing device 20 via wireless communication such as Bluetooth (registered trademark). In these cases, the image acquisition unit 211 may acquire the image directly from the camera CAM1. The camera CAM1 may transmit the captured image to the station server 41. In this case, the image acquisition unit 211 may acquire the image captured by the camera CAM1 from the station server 41.

[0098] The tracking unit 212 performs tracking processing of one or more people passing through a face authentication area (for example, at least one of face authentication areas Ar1 and Ar2) using an image acquired by the image acquisition unit 211 (for example, an image captured by the camera CAM1). Furthermore, the face authentication unit 213 performs face authentication processing of one or more people passing through a face authentication area (for example, at least one of face authentication areas Ar1 and Ar2) using an image acquired by the image acquisition unit 211.

[0099] As a specific example of the tracking process performed by the tracking unit 212, a case where the tracking unit 212 performs tracking process on a person P1 (see FIG. 2) passing through the face authentication area Ar1 will be described with reference to Fig. 9. Also, as a specific example of the face authentication process performed by the face authentication unit 213, a case where the face authentication unit 213 performs face authentication process on the person P1 will be described.

[0100] 9 are images including person P1 (in other words, images in which person P1 is captured). Image IMG1 is an image generated by camera CAM1 capturing an image of face recognition area Ar1 at time t1. Image IMG2 is an image generated by camera CAM1 capturing an image of face recognition area Ar1 at time t2, which is later than time t1. Image IMG3 is an image generated by camera CAM1 capturing an image of face recognition area Ar1 at time t3, which is later than time t2.

[0101] Each of images IMG1, IMG2, and IMG3 may be an image corresponding to one frame of a video. In this case, image IMG2 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG1. In other words, image IMG2 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG1. Similarly, image IMG3 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG2. In other words, image IMG3 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG2.

[0102] The tracking unit 212 detects the head of person P1 included in image IMG1 from image IMG1. Note that the method for detecting a person's head from an image is an existing technique, so a detailed description thereof will be omitted. Based on the detected head of person P1, the tracking unit 212 sets an area including the head of person P1 as a tracking area TA1.

[0103] When the tracking unit 212 sets the tracking area TA1, it sets a tracking ID, which is identification information for identifying the person P1 related to the tracking area TA1, to the person P1. The tracking unit 212 calculates the position of the person P1 (for example, the position of the feet of the person P1) based on the tracking area TA1. Note that since existing technology can be applied to a method for calculating the position of a subject included in an image from the image, a detailed description thereof will be omitted. The tracking unit 212 associates the tracking ID with the position of the person P1 and registers them in an ID correspondence table 221 stored in the storage device 22.

[0104] When the tracking area TA1 is set, the tracking unit 212 determines whether or not the face of person P1 is captured in the tracking area TA1. In other words, the tracking unit 212 performs face detection on the tracking area TA1. When it is determined that the face of person P1 is captured in the tracking area TA1, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits it to the face authentication unit 213. Note that when it is determined that the face of person P1 is not captured in the tracking area TA1, the tracking unit 212 does not need to generate a face image.

[0105] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. For example, the face authentication unit 213 may calculate a face feature amount indicating features related to the face of the person P1 from the face image. The face authentication unit 213 may calculate a matching score from the calculated face feature amount and a face feature amount based on the face information of one registrant registered in the face information DB 26.

[0106] If the calculated matching score is greater than a predetermined threshold, the face authentication unit 213 determines that face authentication has been successful. In this case, one registrant corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 is identified from among the multiple registrants registered in the face information DB 26. On the other hand, if the calculated matching score is less than the predetermined threshold, the face authentication unit 213 determines that face authentication has failed. In this case, it is highly likely that the person corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 is not registered in the face information DB 26. Note that if the calculated matching score and the predetermined threshold are "equal," either case may be included.

[0107] If the facial authentication is successful, the facial authentication unit 213 associates an authentication ID indicating a registrant registered in the facial information DB 26 that corresponds to the person (person P1 in this case) indicated by the facial image transmitted from the tracking unit 212 with the tracking ID associated with the facial image, and registers the associated ID in the ID correspondence table 221. In addition to the authentication ID, the facial authentication unit 213 may register an authentication time, which is the time when the facial authentication process was performed, in the ID correspondence table 221. If the facial authentication is unsuccessful, the facial authentication unit 213 may associate information indicating that there is no corresponding person (for example, "N / A (Not Applicable)") with the tracking ID associated with the facial image transmitted from the tracking unit 212, and register the associated information in the ID correspondence table 221.

[0108] The ID correspondence table 221 will be further described with reference to FIG. 10 . As shown in FIG. 10 , in the ID correspondence table 221, a tracking ID, a tracking position (e.g., the position of the feet of person P1), an authentication ID, and an authentication time may be associated with one another. In the ID correspondence table 221, when a tracking ID is associated with a specific authentication ID, this indicates that a registrant corresponding to the person for whom the tracking ID is set is registered in the face information DB 26. When a tracking ID is associated with the character string "N / A", this indicates that a person corresponding to the person for whom the tracking ID is set is not registered in the face information DB 26. When a tracking ID is not associated with an authentication ID (i.e., when the authentication ID field is blank), this indicates that face authentication processing has never been performed.

[0109] The tracking unit 212 may use the image IMG2 and the image IMG1 to identify the person P1 included in the image IMG2. Identifying the person P1 included in the image IMG2 is synonymous with associating the person P1 included in the image IMG1 with the person P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method related to association between images can be applied to identifying the person P1 included in the image IMG2. Note that various existing methods can be applied to both the matching method and the optical flow method, and therefore detailed description thereof will be omitted.

[0110] When person P1 included in image IMG2 is identified, the tracking unit 212 detects the head of person P1. Based on the detected head of person P1, the tracking unit 212 sets an area including the head of person P1 as tracking area TA2. Since person P1 included in image IMG1 and person P1 included in image IMG2 are the same person, the tracking ID of person P1 related to tracking area TA2 is the same as the tracking ID of person P1 related to tracking area TA1. The tracking unit 212 calculates the position of person P1 based on tracking area TA2.

[0111] The tracking unit 212 associates the position of the person P1 with the tracking ID associated with the person P1 and registers it in the ID correspondence table 221. In this case, since the position of the person P1 calculated based on the tracking area TA1 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of the person P1 calculated based on the tracking area TA2 in the ID correspondence table 221, thereby updating the position of the person P1.

[0112] When the tracking area TA2 is set, the tracking unit 212 determines whether the face of person P1 is captured in the tracking area TA2. In other words, the tracking unit 212 performs face detection on the tracking area TA2. When it is determined that the face of person P1 is captured in the tracking area TA2, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits the associated face image to the face authentication unit 213. Note that, when it is determined that the face of person P1 is not captured in the tracking area TA2, the tracking unit 212 does not need to generate a face image. Note that, even when it is determined that the face of person P1 is captured in the tracking area TA2, when the tracking ID related to person P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., when face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0113] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 associates an authentication ID indicating a registrant registered in the face information DB 26 corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 with the tracking ID linked to the face image and registers the ID in the ID correspondence table 221. In addition to the authentication ID, the face authentication unit 213 may register an authentication time, which is the time when the face authentication processing was performed, in the ID correspondence table 221. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may associate information indicating that there is no corresponding person (e.g., “N / A”) with the tracking ID linked to the face image transmitted from the tracking unit 212 and register the information in the ID correspondence table 221.

[0114] The tracking unit 212 may use the images IMG3 and IMG2 to identify the person P1 included in the image IMG3. When the person P1 included in the image IMG3 is identified, the tracking unit 212 detects the head of the person P1. Based on the detected head of the person P1, the tracking unit 212 sets an area including the head of the person P1 as a tracking area TA3. Because the person P1 included in the image IMG2 and the person P1 included in the image IMG3 are the same person, the tracking ID of the person P1 related to the tracking area TA3 is the same as the tracking ID of the person P1 related to the tracking area TA2. The tracking unit 212 calculates the position of the person P1 based on the tracking area TA3.

[0115] The tracking unit 212 associates the position of the person P1 with the tracking ID associated with the person P1 and registers it in the ID correspondence table 221. In this case, since the position of the person P1 calculated based on the tracking area TA2 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of the person P1 calculated based on the tracking area TA3 in the ID correspondence table 221, thereby updating the position of the person P1.

[0116] When the tracking area TA3 is set, the tracking unit 212 determines whether the face of person P1 is captured in the tracking area TA3. In other words, the tracking unit 212 performs face detection on the tracking area TA3. When it is determined that the face of person P1 is captured in the tracking area TA3, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits the associated face image to the face authentication unit 213. Note that, when it is determined that the face of person P1 is not captured in the tracking area TA3, the tracking unit 212 does not need to generate a face image. Note that, even when it is determined that the face of person P1 is captured in the tracking area TA3, when the tracking ID related to person P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., when face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0117] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 associates an authentication ID indicating a registrant registered in the face information DB 26 corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 with the tracking ID linked to the face image and registers the ID in the ID correspondence table 221. In addition to the authentication ID, the face authentication unit 213 may register an authentication time, which is the time when the face authentication processing was performed, in the ID correspondence table 221. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may associate information indicating that there is no corresponding person (e.g., “N / A”) with the tracking ID linked to the face image transmitted from the tracking unit 212 and register the information in the ID correspondence table 221.

[0118] However, it may be difficult for the tracking unit 212 to continue tracking the person P1, for example, because the head of the person P1 is hidden behind another person. When tracking of the person P1 is interrupted, the tracking unit 212 may perform the following process. After tracking of the person P1 is interrupted, the tracking unit 212 may determine whether a new person has been detected from an image acquired by the image acquisition unit 211 (for example, an image captured by the camera CAM1). A "new person" means a person for whom a tracking ID has not been set.

[0119] When a new person is detected, the tracking unit 212 may compare the feature amount of the tracking area related to person P1 (e.g., at least one of tracking areas TA1, TA2, and TA3) with the feature amount of the tracking area related to the new person to determine whether person P1 and the new person are the same person. If it is determined that person P1 and the new person are the same person, the tracking unit 212 may assign a tracking ID related to person P1 to the new person. As a result, the tracking unit 212 can track person P1 again. Note that the feature amount may be a feature amount related to the person's head, a feature amount related to the person's upper body, or a feature amount related to the person's entire body. In other words, the tracking area (e.g., at least one of tracking areas TA1, TA2, and TA3) may include the person's head, a feature amount related to the person's upper body, or a feature amount related to the person's entire body. Note that the feature amount may be obtained, for example, by person re-identification technology.

[0120] The tracking unit 212 and the face authentication unit 213 may repeat the above-described process until the person P1 passes through the face authentication area Ar1. The tracking unit 212 and the face authentication unit 213 may perform the above-described process for all people who pass through the face authentication area Ar1.

[0121] The determination unit 214 acquires age information linked to a registered person corresponding to the person to be authenticated (e.g., person P1) identified by face authentication performed by the face authentication unit 213, based on the ID correspondence table 221 and the face information DB 26. The determination unit 214 determines whether the person to be authenticated is a child based on the acquired age information.

[0122] When the age information indicates the date of birth of the registrant corresponding to the person to be authenticated, the determination unit 214 may calculate the current age of the person to be authenticated from the date of birth indicated by the age information and the current date. The determination unit 214 may determine whether the person to be authenticated is a child based on the calculated age. When the age information indicates the current age of the registrant, the determination unit 214 may determine whether the person to be authenticated is a child based on the age indicated by the age information.

[0123] If the determination unit 214 determines that the person to be authenticated is a child, the information processing device 20 may link the authentication ID of the registrant corresponding to the person to be authenticated, information indicating that the person to be authenticated is a child, and information indicating that the person to be authenticated has entered or exited station A to the center server 50 via the communication device 23. The center server 50 may register that the registrant associated with the authentication ID transmitted from the information processing device 20 is a child.

[0124] If the determination unit 214 determines that the person to be authenticated is not a child (i.e., the person to be authenticated is an adult), the information processing device 20 may link the authentication ID of the registrant corresponding to the person to be authenticated with information indicating that the person to be authenticated has entered or exited station A to the center server 50 via the communication device 23. The center server 50 may register that the registrant associated with the authentication ID transmitted from the information processing device 20 is an adult. Note that the center server 50 does not need to register that the registrant is an adult. In this case, the center server 50 may simply treat the registrant who is not registered as a child as an adult.

[0125] The information processing device 20 does not have to transmit information indicating that the person to be authenticated is an adult to the center server 50. The information processing device 20 may transmit information indicating that the person to be authenticated is an adult to the center server 50.

[0126] In the face information DB 26 (and the face information DB 70), time information indicating the date when information about a registrant (for example, at least one of face information, age information, and terminal information) was registered or updated may be linked to the authentication ID of the registrant. In this case, it can be said that the authentication ID, face information, age information, terminal information, and time information are linked to one another for one registrant.

[0127] If the determination unit 214 determines that the person to be authenticated is a child, the output unit 215 may acquire time information linked to the authentication ID of the registrant corresponding to the person to be authenticated from the face information DB 26. The output unit 215 may calculate the difference between the date indicated by the acquired time information and the current date. The output unit 215 may determine whether the calculated difference is longer than a predetermined period (e.g., six months, one year, etc.).

[0128] If it is determined that the calculated difference is longer than the predetermined period, the output unit 215 may output a notification prompting the user to update the face information linked to the authentication ID of the registrant corresponding to the user. In this case, the output unit 215 may transmit the notification via the communication device 23 to at least one of a terminal device owned by the user determined to be a child and a terminal device owned by the guardian of the user, based on the terminal information linked to the authentication ID of the registrant corresponding to the user. Note that if it is determined that the calculated difference is shorter than the predetermined period, the output unit 215 does not need to output the notification. Note that if the calculated difference and the predetermined period are "equal," either case may be included.

[0129] When the facial authentication unit 213 performs facial authentication and identifies a registered person corresponding to the person to be authenticated (for example, when the matching score related to the facial authentication is greater than a predetermined threshold), and the determination unit 214 determines that the person to be authenticated is a child, the output unit 215 may acquire the matching score related to the facial authentication performed by the facial authentication unit 213 for the person to be authenticated. The output unit 215 may determine whether the acquired matching score is lower than a predetermined value. Note that the predetermined value is, for example, a value higher than a predetermined threshold related to the facial authentication.

[0130] If the matching score is determined to be lower than a predetermined value, the output unit 215 may output a notification prompting the user to update the face information linked to the authentication ID of the registrant corresponding to the user. In this case, the output unit 215 may transmit the notification via the communication device 23 to at least one of a terminal device owned by the user determined to be a child and a terminal device owned by the guardian of the user, based on the terminal information linked to the authentication ID of the registrant corresponding to the user. Note that if the matching score is determined to be higher than the predetermined value, the output unit 215 does not need to output the notification. Note that if the matching score and the predetermined value are "equal," either case may be included.

[0131] (Operation of the counter server) As described above, the counter server 60 performs a pre-registration process. As described above, in the pre-registration process, the prospective user may use a terminal device that the user owns to read a photo ID such as a My Number card or a driver's license, thereby automatically inputting, for example, the user's name, date of birth, telephone number, email address, and facial image.

[0132] In the pre-registration process, if a facial image or the like is automatically input by the prospective user reading an identification card using a terminal device, the facial image may be provided with acquisition route information indicating that it was read from the identification card. Based on the acquisition route information, the window server 60 may determine whether the facial image input in the pre-registration process is a facial image read from the identification card.

[0133] If it is determined that the facial image input in the pre-registration process is a facial image read from an identification card, the counter server 60 may request a facial image including the current face of the applicant (i.e., the actual face) from the applicant. The facial image including the current face of the applicant may be captured by a camera included in a terminal device carried by the applicant. The counter server 60 may request a facial image including the current face of the applicant (i.e., the actual face) only if the current age of the applicant based on the date of birth input in the pre-registration process falls within the age range for which a child's fare for railway fares applies.

[0134] When the liaison server 60 acquires a facial image including the current face of the applicant, for example, the liaison server 60 may determine the degree of match between the face of the applicant shown in the facial image read from the identification card and the current face of the applicant. Note that various existing methods can be applied to the method of determining the degree of match, and an example is a method of calculating a matching score as in the face authentication performed by the face authentication unit 213 (in this case, the matching score corresponds to an example of an index indicating the degree of match).

[0135] The liaison server 60 may determine whether the degree of match is less than a predetermined level. If it is determined that the degree of match is less than a predetermined level, the liaison server 60 may acquire a facial image including the current face of the applicant as a facial image to be registered as facial information in the facial information DB 70, instead of the facial image read from the identification card (in other words, discard the facial image read from the identification card). Alternatively, in this case, the liaison server 60 may register facial feature amounts calculated from the facial image including the current face of the applicant as facial information in the facial information DB 70.

[0136] If it is determined that the degree of match is greater than a predetermined degree, the liaison server 60 may acquire the facial image read from the identification card as a facial image to be registered as facial information in the facial information DB 70. Alternatively, in this case, the liaison server 60 may register facial feature amounts calculated from the facial image read from the identification card as facial information in the facial information DB 70. In this case, the liaison server 60 may acquire both the facial image read from the identification card and a facial image including the current face of the user as facial images to be registered as facial information in the facial information DB 70. If the degree of match and the predetermined degree are "equal," they may be treated as including either case.

[0137] (Technical Effect) As with the ticket gate system 1 including the information processing device 10 according to the first embodiment described above, the ticket gate system 2 can accurately determine whether or not the person to be authenticated is a child. Therefore, the ticket gate system 2 can apply an appropriate fare to a person using a train. In addition, if the facial information related to the person to be authenticated who has been determined to be a child is updated in response to the notification output from the output unit 215, the person to be authenticated can be identified by facial recognition even if the person's face has changed due to growth.

[0138] As described above, in the pre-registration process, if the degree of match between the face of the applicant indicated by the facial image read from the identification card and the current face of the applicant is less than a predetermined degree, the liaison server 60 may acquire a facial image including the current face of the applicant instead of the facial image read from the identification card as the facial image to be registered as facial information in the facial information DB 70. Alternatively, in this case, the liaison server 60 may register facial feature amounts calculated from the facial image including the current face of the applicant as facial information in the facial information DB 70. With this configuration, facial information of a person of an age to which a child's rate applies, whose face is likely to change in a relatively short period of time as they grow, can be appropriately registered in the facial information DB 70.

[0139] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0140] (Supplementary Note 1) An information processing device comprising: an image acquisition means for acquiring an image including a facial recognition area through which a person to be authenticated passes; a facial recognition means for performing facial recognition of the person to be authenticated based on the image; and a determination means for acquiring age information relating to an age associated with a registered person corresponding to the person to be authenticated, identified by the facial recognition means performing the facial recognition, and determining whether the person to be authenticated is a child or not.

[0141] (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the age information indicates the date of birth of the person to be authenticated, and the determination means determines whether the person to be authenticated is a child based on the date of birth of the person to be authenticated and the current date.

[0142] (Supplementary Note 3) The age information is linked to time information indicating the date on which the age information was registered, and the information processing device is equipped with an output means for outputting a notification prompting an update of face information related to a face linked to the registered person corresponding to the person to be authenticated when the determination means determines that the person to be authenticated is a child and the difference between the date indicated by the time information and the current date is longer than a predetermined period. The information processing device described in Supplementary Note 1 or 2.

[0143] (Supplementary Note 4) The information processing device according to any one of Supplementary Notes 1 to 3, further comprising: an output means for outputting a notification prompting an update of face information relating to a face linked to the registered person corresponding to the person to be authenticated when the facial authentication means performs the facial authentication to identify a registered person corresponding to the person to be authenticated, and when the determination means determines that the person to be authenticated is a child, and when the score related to the facial authentication is lower than a predetermined value.

[0144] (Supplementary Note 5) The information processing device described in any one of Supplementary Notes 1 to 4, wherein the facial authentication means performs the facial authentication based on first facial information, which is facial information regarding the face of the person to be authenticated obtained from the image, and second facial information, which is linked to the registrant and is facial information regarding the face of the registrant, and the second facial information is generated based on a recording medium showing the face of the registrant.

[0145] (Supplementary Note 6) The information processing device according to any one of Supplementary Notes 1 to 5, further comprising: a registration means for registering registrant information relating to a registrant; the registration means registering a facial image including the face of the registrant as part of the registrant information; the registration means acquiring the facial image from a recording medium showing the face of the registrant; and when the degree of match between the face shown in the recording medium and the face shown in a captured image capturing the current face of the registrant is less than a predetermined degree, the registration means acquires the facial image from the captured image instead of the recording medium.

[0146] (Supplementary Note 7) An information processing method comprising: acquiring an image including a facial recognition area through which a person to be authenticated passes; performing facial recognition of the person to be authenticated based on the image; acquiring age information relating to the age associated with a registered person corresponding to the person to be authenticated, identified by the facial recognition; and determining whether the person to be authenticated is a child.

[0147] (Supplementary Note 8) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, which includes acquiring an image including a facial recognition area through which a person to be authenticated passes, performing facial recognition of the person to be authenticated based on the image, and acquiring age information relating to the age associated with the registered person corresponding to the person to be authenticated, identified by the facial recognition, and determining whether the person to be authenticated is a child.

[0148] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0149] 1, 2 Ticket gate system 10, 10a, 10b, 20, 20a Information processing device 11, 211 Image acquisition unit 12, 213 Face authentication unit 13, 214 Determination unit 14, 26, 70 Face information database 15, 215 Output unit 16 Registration unit 212 Tracking unit

Claims

1. an image acquisition means for acquiring an image including a face recognition area through which a person to be authenticated passes; a face authentication means for performing face authentication of the person to be authenticated based on the image; a determination means for obtaining age information relating to an age associated with a registered person corresponding to the person to be authenticated, the age information being identified by the face authentication means performing the face authentication, and determining whether the person to be authenticated is a child; Equipped with the age information is linked to time information indicating the date on which the age information was registered, and an output means for outputting a notification prompting an update of face information related to a face linked to the registered person corresponding to the person to be authenticated when the determination means determines that the person to be authenticated is a child and when the difference between the date indicated by the time information and the current date is longer than a predetermined period. Information processing device.

2. the age information indicates the date of birth of the person to be authenticated, The determination means determines whether the person to be authenticated is a child based on the birth date of the person to be authenticated and the current date. The information processing device according to claim 1 .

3. and an output means for outputting a notification prompting an update of face information relating to a face linked to the registrant corresponding to the person to be authenticated when the face authentication means performs the face authentication and the determination means determines that the person to be authenticated is a child and the score related to the face authentication is lower than a predetermined value. The information processing device according to claim 1 .

4. the face authentication means performs the face authentication based on first face information, which is face information on the face of the person to be authenticated acquired from the image, and second face information, which is linked to the registrant and is face information on the face of the registrant; The second face information is generated based on a recording medium showing the face of the registrant. The information processing device according to claim 1 .

5. The information processing device includes a registration means for registering registrant information relating to a registrant, the registration means registers a facial image including a face of the registrant as part of the registrant information; The registration means acquires the face image from a recording medium showing the face of the registrant, When the degree of coincidence between the face shown in the recording medium and the face shown in a captured image of the current face of the registrant is smaller than a predetermined degree, the registration means acquires the face image from the captured image instead of the recording medium. The information processing device according to claim 1 .

6. Acquire an image including a facial recognition area through which the person to be authenticated passes, performing face authentication of the person to be authenticated based on the image; acquiring age information associated with a registered person corresponding to the person to be authenticated, the age information being identified by performing the facial authentication, and determining whether the person to be authenticated is a child; the age information is linked to time information indicating the date on which the age information was registered, If the person to be authenticated is determined to be a child and the difference between the date indicated by the time information and the current date is longer than a predetermined period, a notification is output prompting the user to update face information related to the face associated with the registered person corresponding to the person to be authenticated. Information processing methods.

7. A recording medium having a computer program recorded thereon for causing a computer to execute an information processing method, which involves acquiring an image including a facial authentication area through which a person to be authenticated passes, performing facial authentication of the person to be authenticated based on the image, acquiring age information relating to the age associated with a registered person corresponding to the person to be authenticated identified by the facial authentication, and determining whether the person to be authenticated is a child, the age information being linked to time information indicating the date on which the age information was registered, and if it is determined that the person to be authenticated is a child and the difference between the date indicated by the time information and the current date is longer than a predetermined period, outputting a notification urging the user to update the facial information relating to the face associated with the registered person corresponding to the person to be authenticated.