Computer device, server device, and face authentication system

Abstract

A computer device, a server device, and a face authentication system capable of reducing the time required for face authentication, the computer device performing face authentication using a plurality of face information registered in a storage with respect to a photographed face image of a user, including: a determination unit that determines face information used for face authentication from among the plurality of face information in accordance with position estimation information and a prescribed condition, the position estimation information being position estimation information of a user corresponding to the plurality of face information respectively, registered in the storage corresponding to the plurality of face information respectively; and an authentication unit that performs face authentication using the determined face information with respect to the photographed face image of the user.

Description

Technical Field

[0001] At least one embodiment of the present invention relates to a computer device, a server device, and a facial authentication system. Background Technology

[0002] Systems that use facial recognition to authenticate people's faces (facial recognition systems) are used, for example, in determining entry permits for amusement parks and other facilities, including attractions. In facial recognition, facial features are detected from the captured image of a person's face and compared with pre-registered facial information (see, for example, Patent Document 1). Furthermore, in recent years, there have been instances where deep learning, an artificial intelligence technique, is used for facial recognition.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: JP Patent No. 6684009.

[0006] In the facial recognition system described above, the process of comparing facial information with all pre-registered facial data is time-consuming, which is problematic. The more facial data that is pre-registered, the longer the facial recognition process will take. Summary of the Invention

[0007] The purpose of at least one embodiment of the present invention is to provide a computer device, a server device, and a facial recognition system to address the shortcomings of related technologies.

[0008] According to a non-limiting viewpoint, a computer device according to one embodiment of the present invention performs facial authentication using multiple facial information registered in a storage unit for a captured image of a user's face. The device includes: a determining unit that determines facial information for facial authentication from the multiple facial information based on location estimation information and predetermined conditions, wherein the location estimation information is location estimation information of a user corresponding to each of the multiple facial information items, and is registered in the storage unit corresponding to each of the multiple facial information items; and an authentication unit that performs facial authentication using the determined facial information for the captured image of a user's face.

[0009] According to a non-limiting viewpoint, one embodiment of the server device of the present invention is connected to a terminal device having a camera unit via a communication network. For a user's facial image captured by the terminal device, it performs facial authentication of the user using multiple facial information registered in a storage unit. The device includes: a determining unit that determines facial information for facial authentication from multiple facial information based on location estimation information and predetermined conditions, wherein the location estimation information is location estimation information of the user corresponding to each of the multiple facial information pieces, and is registered in a storage unit corresponding to each of the multiple facial information pieces; and an authentication unit that performs facial authentication using the determined facial information for the captured user's facial image.

[0010] According to a non-limiting viewpoint, one embodiment of the facial authentication system of the present invention includes: a terminal device having a camera unit; and a server device connected to the terminal device via a communication network. The facial authentication system performs facial authentication on a user's facial image captured by the terminal device using multiple facial information registered in a storage unit. The system further includes: a determining unit that determines facial information for facial authentication from the multiple facial information based on location estimation information and predetermined conditions, wherein the location estimation information is location estimation information of the user corresponding to each of the multiple facial information pieces, and is registered in the storage unit corresponding to each of the multiple facial information pieces; and an authentication unit that performs facial authentication on the captured user's facial image using the determined facial information.

[0011] The various embodiments of this application address one or more deficiencies. Attached Figure Description

[0012] Figure 1 This is a block diagram illustrating an example of the configuration of a face authentication system corresponding to at least one embodiment of the present invention.

[0013] Figure 2 This is a functional block diagram illustrating the configuration of a server device corresponding to at least one embodiment of the present invention.

[0014] Figure 3 This is a flowchart illustrating an example of face authentication processing corresponding to at least one embodiment of the present invention.

[0015] Figure 4 This is a block diagram illustrating an example of the configuration of a face authentication system corresponding to at least one embodiment of the present invention.

[0016] Figure 5 This is a flowchart illustrating an example of the operation of a terminal device when performing facial authentication processing, corresponding to at least one embodiment of the present invention.

[0017] Figure 6 This is a functional block diagram illustrating the configuration of a server device corresponding to at least one embodiment of the present invention.

[0018] Figure 7 This is a flowchart illustrating an example of face authentication processing corresponding to at least one embodiment of the present invention.

[0019] Figure 8 This is a block diagram illustrating an example of the configuration of a face authentication system corresponding to at least one embodiment of the present invention.

[0020] Figure 9 This is a functional block diagram illustrating the configuration of a server device corresponding to at least one embodiment of the present invention.

[0021] Figure 10 This is a diagram illustrating an example of registration data corresponding to at least one embodiment of the present invention.

[0022] Figure 11 This is a diagram illustrating an example of the time-required data corresponding to at least one embodiment of the present invention.

[0023] Figure 12 This is a functional block diagram illustrating the configuration of a terminal device corresponding to at least one embodiment of the present invention.

[0024] Figure 13 This is a flowchart illustrating an example of face authentication processing corresponding to at least one embodiment of the present invention.

[0025] Figure 14 This is a flowchart illustrating an example of face registration processing corresponding to at least one embodiment of the present invention.

[0026] Figure 15 This is a block diagram illustrating an example of the configuration of a face authentication system corresponding to at least one embodiment of the present invention.

[0027] Figure 16 This is a functional block diagram illustrating the configuration of a terminal device corresponding to at least one embodiment of the present invention.

[0028] Figure 17 This is a flowchart illustrating an example of the operation of a terminal device when performing facial authentication processing, corresponding to at least one embodiment of the present invention.

[0029] Figure 18 This is a flowchart illustrating an example of the operation of a terminal device when performing face registration processing, corresponding to at least one embodiment of the present invention.

[0030] Figure 19This is a block diagram illustrating an example of the configuration of a face authentication system corresponding to at least one embodiment of the present invention.

[0031] Figure 20 This is a functional block diagram illustrating the configuration of a server device corresponding to at least one embodiment of the present invention.

[0032] Figure 21 This is a diagram illustrating an example of registration data corresponding to at least one embodiment of the present invention.

[0033] Figure 22 This is a diagram illustrating an example of the time-required data corresponding to at least one embodiment of the present invention.

[0034] Figure 23 This is a functional block diagram illustrating the configuration of a terminal device corresponding to at least one embodiment of the present invention.

[0035] Figure 24 This is a flowchart illustrating an example of face authentication processing corresponding to at least one embodiment of the present invention.

[0036] Figure 25 This is a flowchart illustrating an example of face registration processing corresponding to at least one embodiment of the present invention.

[0037] Explanation of reference numerals in the attached figures

[0038] 10 server devices

[0039] 11. Determining the Department

[0040] 12 Certification Department

[0041] 13 Registration and Update Department

[0042] 14 Acquisition Department

[0043] 15. Game Progress Control Department

[0044] 20, 201~20N terminal devices

[0045] 100 facial recognition system Detailed Implementation

[0046] The following description, with reference to the accompanying drawings, illustrates examples of embodiments of the present invention. Furthermore, the various constituent elements in the examples of each embodiment described below can be appropriately combined without causing contradictions. Additionally, there are cases where descriptions already given as examples of one embodiment are omitted in other embodiments. Furthermore, there are cases where actions or processes unrelated to the characteristic parts of each embodiment are omitted. Moreover, the order of various processes constituting the various flows described below can differ without causing contradictions in the processing content.

[0047] [First Implementation Method]

[0048] Figure 1 This is a block diagram illustrating an example of the configuration of a facial authentication system 100 according to an embodiment of the present invention. Figure 1 As shown, the facial recognition system 100 includes a server device 10 and multiple terminal devices 20, 201 to 20N (N is any integer). The server device 10 and the multiple terminal devices 20, 201 to 20N are connected to a communication network 15 such as the Internet. However, the configuration of the facial recognition system 100 is not limited to this; for example, it may have multiple server devices or it may not have any server devices.

[0049] The facial recognition system 100 has various functions for performing facial recognition using registered facial information on a user's facial image captured by any of the terminal devices 20, 201-20N. The facial recognition system 100 of this embodiment is applicable, for example, to amusement park rides and other similar facilities, and to parade-type game activities. In amusement park facilities, facial recognition is used, for example, to determine whether a user can enter the facility or use (ride) any of the rides within the facility. Furthermore, in parade-type game activities, facial recognition is used, for example, to determine whether a user (player) can pass (reach) a checkpoint. Parade-type game activities are, for example, activities that allow users to pass (parade) through all the checkpoints set up within a game area in a real-world space.

[0050] Facial recognition refers to using a user's facial image to verify (personally confirm) the user's legitimacy. In other words, facial recognition determines whether the user whose facial image is being captured is the registered user. For example, in amusement park rides, if the facial information obtained from the captured image matches any of the registered facial information, the user is considered a legitimate entrant and allowed entry.

[0051] The server device 10 is managed by the game system administrator and has various functions to provide information about the progress of facial recognition to the terminal devices 20, 201-20N. For example, the server device 10 provides the result of facial recognition. In this embodiment, the server device 10 is configured as an information processing device such as a WWW server to provide information about facial recognition, and has one or more storage media (storage units) for storing various types of information. Furthermore, the server device 10 also has a control unit such as a CPU. Since the above configuration is a general configuration, detailed descriptions are omitted. The storage unit may be built into the server device 10 or may be a separate storage device such as a database device.

[0052] Figure 2 This is a functional block diagram illustrating the configuration of server device 10A, which is an example of the configuration of server device 10. Server device 10A has at least a determination unit 11 and an authentication unit 12, which execute software (face authentication processing program) stored in the storage unit for performing face authentication by the control unit. In addition, the face authentication program also includes control data for face authentication processing.

[0053] The determining unit (determining function) 11 determines the facial information used for facial authentication from among multiple facial information registered in the storage unit based on location estimation information and prescribed conditions. "Location estimation information" is information used to estimate the current location of the user for each of the multiple facial information registered in the storage unit. The location estimation information is registered in the storage unit of the server device 10A, corresponding to each of the multiple facial information entries.

[0054] As location estimation information, this includes information such as the location (capture location) and time (capture time) at which the user's facial image was captured. For example, in any of terminal devices 20, 201 to 20N, the capture time and location (terminal device location) when a facial image was captured for facial authentication are registered as location estimation information. For example, the latest information on capturing the user's facial image is registered as location estimation information. In addition, location estimation information may include, for example, the type of ticket held by the user in amusement park rides. Furthermore, location estimation information may include, in parade-type game activities, information on the checkpoints passed through.

[0055] As a prescribed condition, for example, facial information of a user who is presumed not to exist at the shooting location at the time the facial image for facial authentication is captured is excluded from the aforementioned facial authentication objects. In this example case, the determining unit 11 determines the remaining facial information from the multiple facial information registered in the storage unit after excluding the facial information for which the prescribed condition is met as the facial information used for facial authentication.

[0056] For example, let's describe the case where user A1's facial image is captured by terminal device 20, and user A1's facial authentication is performed thereafter. The location where user A1's image was captured is the location of terminal device 20. Here, user B1, different from user A1, has facial information and location estimation information registered in the storage unit. User B1's location estimation information includes the capture time 10 minutes prior to the current time and the capture location, which is the location of terminal device 201. That is, it is determined that user B1's facial image was captured by terminal device 201 10 minutes prior for facial authentication, etc. Since it is estimated that it would take user B1 30 minutes to move from terminal device 201 to terminal device 20, it is estimated that user B1 did not exist (could not move to) terminal device 20 at the time user A1's facial image was captured. Therefore, user B1's facial information is excluded from the facial information used for user A1's facial authentication. In this case, the estimated time required for the user to move between each terminal device 20, 201 to 20N (the estimated time) can be pre-registered in the storage unit of the server device 10A.

[0057] The authentication unit (authentication function) 12 performs facial authentication using determined facial information from a user's facial image captured by terminal devices 20, 201-20N. For example, the authentication unit 12 obtains facial information from the captured user's facial image and performs facial authentication by comparing it with the determined facial information. "Facial information" refers to information about the facial image, including feature values ​​such as the positions of feature points (eyes, nose, mouth, etc.) and the distances between feature points, as well as the feature vector of the facial image. Facial information is obtained, for example, from the facial image.

[0058] Next, terminal devices 20, 201-20N will be described. Terminal devices 20, 201-20N are installed in different locations, for example. Terminal devices 20, 201-20N are terminal devices that have a camera unit and are capable of performing facial authentication from users. Terminal devices 20, 201-20N are, for example, personal computers with a camera unit.

[0059] Each terminal device 20, 201-20N includes a camera, an operating device (operation unit), a storage medium (storage unit), a control unit (such as a CPU), a display unit, and a communication control unit. Since the above configuration is general, detailed descriptions are omitted. The terminal devices 20, 201-20N store software (face authentication acceptance program) for handling facial authentication in their storage units. By executing the above program, the terminal devices 20, 201-20N, for example, capture an image of the user's face and send the captured facial image and other information, along with the facial authentication request, to the server device 10. Furthermore, the terminal devices 20, 201-20N receive the facial authentication result (authentication result) from the server device 10A and display it on the display unit.

[0060] Next, the operation of a face authentication system 100A, which includes a server device 10A and multiple terminal devices 20, 201 to 20N, as an example of the structure of the face authentication system 100, will be described.

[0061] Figure 3 This is a flowchart illustrating an example of the face authentication process performed by the face authentication system 100A. In the face authentication process of this embodiment, the following steps are performed: determining the facial information used for face authentication and then performing face authentication. Furthermore, in... Figure 3 This section primarily focuses on the processing of facial information identification and comparison; other processing steps are sometimes omitted. The following explanation uses the example of server device 10A and terminal device 20 performing facial authentication processing.

[0062] The facial authentication process in this embodiment is performed, for example, when a facial authentication request is received from any of the terminal devices 20, 201 to 20N.

[0063] Terminal device 20 sends information for facial authentication, such as the captured facial image, along with the facial authentication request to server device 10A.

[0064] Server device 10A performs a determination process (step S10). In the determination process, based on location estimation information and predetermined conditions, the facial information used for facial authentication is determined from multiple facial information registered in the storage unit. As in the example above, the facial information remaining after excluding facial information that meets the predetermined conditions is determined as the facial information used for facial authentication.

[0065] Next, the server device 10A performs authentication processing (step S11). In this authentication process, facial authentication is performed on the facial image received from the terminal device 20 using the determined facial information. As in the example above, facial information is obtained from the captured user's facial image and compared with the determined facial information. During the comparison, if the facial information in the captured user's facial image matches any of the determined facial information, the server device 10A determines that the user of the received facial image is a legitimate user whose facial information is registered in the storage unit. Furthermore, in the authentication process, the server device 10A sends the authentication result, for example, to the terminal device 20. Since the facial information comparison process is a general configuration, detailed explanation is omitted.

[0066] Afterwards, server device 10A ends the face authentication process. Meanwhile, terminal device 20 outputs (displays on the display unit) an image based on the received authentication result (step S30). Afterwards, terminal device 20 ends the face authentication process. Furthermore, the same process as terminal device 20 is performed in the other terminal devices 201 to 20N.

[0067] As described above, in one aspect of the first embodiment, since the server device 10A has a determination unit 11 and an authentication unit 12, the facial information used for facial authentication is determined according to predetermined conditions, etc. Therefore, since facial authentication is not performed using all the commonly registered facial information, the time required for facial authentication is reduced.

[0068] Furthermore, in the example of the first embodiment described above, the server device 10A performs facial authentication, but it is not particularly limited to this. For example, Figure 4 As shown, a face authentication system including multiple terminal devices 50, 501 to 50N may also be configured as follows: instead of server device 10A, terminal devices 50, 501 to 50N each have at least a determination unit 11 and an authentication unit 12.

[0069] Terminal devices 50, 501-50N are the same as those described above, such as personal computers with camera units. Each terminal device 50, 501-50N includes a camera unit, an operation unit (operation unit), a storage medium (storage unit), a control unit composed of a CPU, a display unit, and a communication control unit. Furthermore, the above configuration is a general configuration, therefore detailed descriptions are omitted.

[0070] The terminal devices 50, 501 to 50N store software for performing facial authentication (facial authentication processing program) and software for accepting facial authentication (facial authentication acceptance program) in their storage units. That is, the terminal devices 50, 501 to 50N perform facial authentication upon receiving a request from the user to accept facial authentication.

[0071] The terminal devices 50, 501-50N store information identical to the facial information and location estimation information managed by the data registration server device 40. The data registration server device 40 is connected to the terminal devices 50, 501-50N, for example, via a communication network, and registers and updates the users' facial information and location estimation information in its own storage. Furthermore, whenever the data registration server device 40 updates the users' facial information and location estimation information in its own storage, it sends update information to the terminal devices 50, 501-50N. However, the data registration server device 40 does not perform facial authentication.

[0072] Figure 5 This shows that the terminal device 50 is performing... Figure 3 The flowchart illustrates an example of the operation of the terminal device 50 during facial authentication processing. For example, when accepting the execution of facial authentication, the terminal device 50 captures an image of the user's face.

[0073] In the face authentication process, the terminal device 50 performs a determination process (step S50). In the determination process, based on location estimation information and predetermined conditions, the face information used for face authentication is determined from multiple face information entries registered in the storage unit. Next, the terminal device 50 performs an authentication process (step S51). In the authentication process, face authentication is performed using the determined face information on the captured face image. Additionally, in the authentication process, the terminal device 50 displays the authentication result on a display unit, for example. Afterward, the terminal device 50 ends the face authentication process.

[0074] Alternatively, a data registration server device 40 may not be required. In this case, a shared storage unit is set up, and each terminal device 50, 501-50N can refer to, for example, the facial information and location estimation information in the shared storage unit. Furthermore, in Figure 4 The example shown is illustrated for multiple terminal devices 50, 501 to 50N, but embodiments of the present invention can also be applied to a single terminal device.

[0075] Furthermore, in the examples of the above embodiments, multiple facial information entries are registered in the storage unit of the server device; however, the registration of facial information only requires that the terminal device accepts the request. Specifically, the terminal device captures an image of the user's face and sends the image along with a facial registration request to the server device. The server device then generates facial information from the facial image based on the facial registration request and registers it in its storage unit.

[0076] In the examples of the above-described embodiments, one example of the prescribed condition is the exclusion of facial information of users presumed to be absent from the shooting location at the time the facial image for facial authentication was captured, but this is not a limitation. Any condition that can be determined using location estimation information can be applied as a prescribed condition. Alternatively, for example, a prescribed condition could be the inclusion of facial information of users presumed to be present at the shooting location at the time the facial image for facial authentication was captured as an object of facial authentication.

[0077] [Second Implementation]

[0078] In this embodiment, a face authentication system 100B, which is an example of a face authentication system 100, will be described. The face authentication system 100B includes a server device 10B and a plurality of terminal devices 20, 201 to 20N. Figure 6 This is a block diagram showing the configuration of a server device 10B, which is an example of a server device 10. In this embodiment, the server device 10B has at least a determination unit 11B and an authentication unit 12.

[0079] The determining unit 11B determines the facial information used for facial authentication from multiple facial information entries registered in the storage unit based on the location estimation information and prescribed conditions. The location estimation information is registered in the storage unit of the server device 10B, corresponding to each of the multiple facial information entries. The location estimation information may include, for example, information about the location (capture location) and time (capture time) at which the user's facial image was captured. For example, in any of the terminal devices 20, 201-20N, the capture time and capture location (terminal device location) when a facial image was captured for facial authentication are registered as location estimation information. For example, the latest information on capturing the user's facial image is registered as location estimation information. In addition, location estimation information may include, for example, information about the type of ticket held by the user in an amusement park ride.

[0080] The conditions specified in this embodiment are conditions under which facial information of a user who is not present at the shooting location at the time the facial image for facial authentication is captured is excluded from the objects of facial authentication. Therefore, the determination unit 11B determines the remaining facial information after excluding the facial information that meets the specified conditions from the multiple facial information registered in the storage unit as the facial information used for facial authentication.

[0081] For example, let's describe the case where user A1's face is captured by terminal device 20, and facial authentication of user A1 is performed accordingly. The location where user A1's face was captured is the location of terminal device 20. User B1 has facial information and location estimation information registered in the storage unit. User B1's location estimation information includes the capture time 10 minutes ago compared to the current time and the capture location as the location of terminal device 201. That is, it is determined that user B1's face was captured by terminal device 201 10 minutes ago for facial authentication, etc. The estimated time required for user B1 to move from terminal device 201 to terminal device 20 is 30 minutes, therefore it is estimated that at the time user A1's face was captured, user B1 did not exist (could not move to) terminal device 20. Therefore, user B1's facial information is excluded from the facial information used for user A1's facial authentication. The estimated time required for the user to move between each terminal device 20, 201 to 20N (the required time) can be pre-registered in the storage unit of server device 10B, for example. Additionally, the shooting time and location of user A1 are sent from terminal device 20 to server device 10B. Furthermore, the shooting location only requires the identification information of the terminal device that took the photo.

[0082] Alternatively, in the case of a touring game activity, information such as the checkpoints passed, game completion, and game exit (exit) information can be used as location estimation information. For example, in a touring game activity, the case of facial authentication for user A1 described above will be explained. For instance, user B2's location estimation information includes game completion information. In this case, user B2, having already completed the game, does not need to move to any checkpoints; therefore, at the moment user A1's facial image is captured, it is presumed that user B2 does not exist on the terminal device 20. Therefore, user B2's facial information is excluded from the facial information used for user A1's facial authentication.

[0083] Next, the authentication unit (authentication function) 12 performs facial authentication using the determined facial information from the user's facial image captured by the terminal devices 20, 201 to 20N. For example, the authentication unit 12 obtains facial information from the captured user's facial image and compares it with the determined facial information to perform facial authentication.

[0084] Next, the operation of the 100B facial recognition system will be explained.

[0085] Figure 7 This is a flowchart illustrating an example of the face authentication process performed by the face authentication system 100B. In the face authentication process of this embodiment, the following steps are performed: determining the facial information used for face authentication and then performing face authentication. Furthermore, in... Figure 7 This section primarily focuses on the processing of facial information determination and comparison; other processing steps are sometimes omitted. The following explanation uses the example of server device 10B and terminal device 20 performing facial authentication processing. Additionally, regarding the example shown... Figure 5 The flowchart illustrating the actions of a terminal device performing facial authentication is omitted for the purpose of avoiding repetitive explanation.

[0086] The facial authentication process in this embodiment is performed, for example, when a facial authentication request is received from any of the terminal devices 20, 201 to 20N.

[0087] Terminal device 20 may send information for facial authentication, such as the captured facial image, the time and location of the captured image, along with the authentication requirements, to server device 10B.

[0088] Server device 10B performs a determination process (step S10-B). In this process, based on location estimation information and predetermined conditions, the facial information used for facial authentication is determined from multiple facial information entries registered in the storage unit. As described above, the facial information remaining after excluding facial information that meets the predetermined conditions is determined as the facial information used for facial authentication. Server device 10B excludes facial information of users presumed to be absent from the facial authentication pool based on location estimation information, etc., from the list of targets for facial authentication.

[0089] Next, the server device 10B performs authentication processing (step S11). In this authentication process, facial authentication is performed using the determined facial information on the facial image received from the terminal device 20. Additionally, during the authentication process, the server device 10B sends, for example, the authentication result to the terminal device 20.

[0090] Afterwards, server device 10B ends the face authentication process. Meanwhile, terminal device 20 outputs (displays on the display unit) an image based on the received authentication result (step S30). Afterwards, terminal device 20 ends the face authentication process. Furthermore, the same process as terminal device 20 is performed on the other terminal devices 201 to 20N.

[0091] As described above, in one aspect of the second embodiment, the server device 10B is configured to have a determination unit 11B and an authentication unit 12, thus determining the facial information used for facial authentication based on predetermined conditions, etc. Therefore, facial authentication is not performed using all the commonly registered facial information, thereby reducing the time required for facial authentication.

[0092] [Third Implementation Method]

[0093] Figure 8 This is a block diagram illustrating the configuration of a face authentication system 100C, which is an example of the configuration of a face authentication system 100. In this embodiment, the face authentication system 100C is configured in an amusement park (amusement park ride) 300 in the real space. The face authentication system 100C includes a server device 10C and multiple terminal devices 20C, 201C to 205C. The server device 10C and the multiple terminal devices 20C, 201C to 205C are connected to a communication network 15 such as the Internet.

[0094] Amusement Park 300 is equipped with multiple amusement rides 80C to 84C, including a Ferris wheel and a roller coaster. The facilities (areas) of Amusement Park 300 are surrounded by fences. Users can enter the facilities through the gate G, which serves as the entrance and exit. In Amusement Park 300, facial recognition system 100C is used to determine whether a user can enter the facilities and use (ride) the various amusement rides 80C to 84C.

[0095] The usage conditions for rides 80C-84C vary depending on the type of ticket purchased. For example, there are tickets that only allow entry to the facility on the day of use, tickets that allow multiple uses of all rides 80C-84C on the day of use, and tickets that allow multiple uses of specific rides 80C-82C on the day of use. Regardless of the ticket type, users are free to enter and exit the facility on the day of use.

[0096] Users can purchase tickets, for example, at ticket machines (not shown) located near Gate G outside the facility. Alternatively, users can purchase tickets in advance via the website.

[0097] After purchasing a ticket, users need to pre-register their facial information for facial recognition (facial registration). This registration is handled by the terminal device 20C located at gate G. Ticket type registration is also performed during facial registration. After registration is complete, the user is permitted entry through gate G. Additionally, the terminal device 20C can also perform facial recognition for users re-entering the facility. If entry is granted via facial recognition, the user is allowed to re-enter through gate G (re-entry).

[0098] Once users enter the facility, they can ride the designated attractions after being granted permission through facial recognition. Terminal devices 201C to 205C are located near each attraction's 80C to 84C. Terminal devices 201C to 205C process facial recognition.

[0099] Figure 9 This is a block diagram showing the configuration of a server device 10C, which is an example of a server device 10. In this embodiment, the server device 10C includes at least a determination unit 11C, an authentication unit 12C, a registration and update unit 13C, and an acquisition unit 14C.

[0100] The determining unit 11C determines the facial information used for facial authentication from a plurality of facial information registered in the storage unit based on location estimation information and predetermined conditions. Specifically, the determining unit 11C determines the facial information used for facial authentication from the remaining facial information after excluding facial information that meets the predetermined conditions from the plurality of facial information registered in the storage unit. The location estimation information in this embodiment includes Figure 10 The registration data shown corresponds to multiple facial information entries. Figure 10 This is a diagram illustrating an example of the registration data used for facial recognition. The registration data is stored in the storage unit of the server device 10C.

[0101] The registration data consists of fields such as user ID, name, facial information, ticket type, first shooting time, and first shooting location. Each record contains information for one user. The ticket type, first shooting location, and first shooting time in the registration data are equivalent to location estimation information. For example, the registration data may contain information for thousands of users.

[0102] User identification information is registered in the User ID field. The text data of the user's name is registered in the Name field. Facial information (numerical values) obtained from the user's facial image is registered in the Facial Information field. Facial information is information about the facial image, such as the positions of feature points (eyes, nose, mouth, etc.) and the distances between feature points, as well as the feature vector of the facial image.

[0103] The type of ticket purchased by the user (identification information) is registered in the ticket type field. Additionally, in Figure 10 For clarity, descriptions of the ticket types are provided for the sake of explanation. The location and time of the last captured user's facial image are registered in the fields for "First Capture Time" and "First Capture Location". In this embodiment, the location and time of the last captured facial image are registered as "First Capture Time" and "First Capture Location" through either facial registration or facial authentication. The identification information of the terminal device that captured the facial image is registered in the field for "First Capture Location". For example, in the case of a user (user ID 0005), it is ultimately determined that the facial image was captured by terminal device 20C at 10:00 AM for facial registration or facial authentication.

[0104] Next, the prescribed conditions will be explained. The prescribed conditions for this embodiment include the following conditions (1) and (2).

[0105] Condition (1): When the location and time of the facial image of the object being facially authenticated are the second shooting location and the second shooting time, the user who took the facial image at the first shooting time and the first shooting location cannot move to the second shooting location by the second shooting time.

[0106] Condition (2): is a type of ticket that is presumed to not exist at the location where the face image of the object being used for face authentication was taken.

[0107] The determining unit 11C determines the remaining face information from the multiple face information registered in the storage unit after excluding face information that meets at least one of the above conditions (1) and (2).

[0108] Regarding the movement of condition (1), refer to Figure 11The required time data is as shown. Required time data is the estimated time needed for a user to move between two locations. The required time data is stored in the storage unit of server device 10C. The required time data consists of fields such as Device ID-1, Device ID-2, and Required Time. The Device ID-1 and Device ID-2 fields represent the two locations. The identification information of any one of the terminal devices 20C, 201C to 205C is set in the Device ID-1 and Device ID-2 fields. The required time between the two locations for Device ID-1 and Device ID-2 is set in the Required Time field. Furthermore, the required time is the time needed for a one-way trip between the two locations. Additionally, in amusement park 300, the user's movement is only on foot. Therefore, the estimated required time for walking is set in the Required Time field. For example, the required time is set to the time necessary regardless of how fast the movement is. When users can travel between two locations by boat, light rail, car, etc., they can also set the estimated time required when using boat, light rail, car, etc. in the required time field.

[0109] Next, regarding condition (2), condition (2) is met when the ticket only allows entry into the facility and can be used multiple times for specific rides 80C to 82C. For example, users with tickets only allowing entry into the facility generally do not move to the terminal devices 201C to 205C located at rides 80C to 84C. This is because these users cannot ride rides 80C to 84C. Similarly, users with tickets that can be used multiple times for specific rides 80C to 82C generally do not move to the terminal devices 204C and 205C located at rides 83C and 84C. This is because these users cannot ride rides 83C and 84C.

[0110] For example, regarding the photo of user A1 taken by terminal device 205C at 11:00 (refer to...) Figure 8 Following the facial image of user A1, the following explanation will be given regarding facial authentication for user A1. In this case, the second shooting location is terminal device 205C, and the second shooting time is 11:00.

[0111] Figure 10 The user ID shown in the registration data is 0001. The first shooting time was 10:20 AM, and the first shooting location was terminal device 20C. For example... Figure 11As shown, the time required to move from terminal device 20C to terminal device 205C is 5 minutes. Therefore, it is determined that the user with user ID 0001, who was in terminal device 20C at 10:20, can move to terminal device 205C at 11:00. Therefore, condition (1) is not met. However, the user with user ID 0001 has a ticket type registered as a ticket that only allows entry into the facility. Therefore, condition (2) is met. Therefore, the determination unit 11C excludes the facial information of user ID 0001 from the facial authentication objects of user A1. For example, the determination unit 11C can simply add user ID 0001 as exclusion information to the storage unit.

[0112] Next, for example, user ID 0002 registered the data. The first shooting time was 10:59, and the first shooting location was terminal device 201C. The time required to move from terminal device 201C to terminal device 205C is 15 minutes. Therefore, it is determined that user ID 0002, who was in terminal device 201C at 10:59, cannot move to terminal device 205C at 11:00. Therefore, condition (1) is met. Therefore, the determination unit 11C excludes the facial information of user ID 0002 from the facial authentication object zho of user A1. For example, the determination unit 11C only needs to add user ID 0002 as exclusion information to the storage unit. In addition, the ticket type of user ID 0002 is set to be a ticket that can be used multiple times for all amusement projects 80C to 84C. Therefore, condition (2) is not met.

[0113] Furthermore, for example, the user with registered user ID 0005, whose first photo capture time is 10:00 AM and whose first photo capture location is terminal device 20C. The time required to move from terminal device 20C to terminal device 205C is 5 minutes. Therefore, it is determined that the user with user ID 0005, who was located at terminal device 20C at 10:00 AM, can move to terminal device 205C at 11:00 AM. Therefore, condition (1) is not met. In addition, the ticket type of the user with user ID 0005 is set to a ticket that can be used multiple times for all amusement park rides 80C to 84C. Therefore, condition (2) is also not met. Therefore, the determination unit 11C uses the facial information of user ID 0005 as the object of facial authentication for user A1 (not set as excluded information).

[0114] As described above, the determination unit 11C refers to the presumed information of each location in the registration data (ticket type, first shooting time, and first shooting location) and determines the validity of conditions (1) and (2). Then, the remaining facial information after excluding the facial information of the user ID set as exclusion information from the multiple facial information in the registration data is determined as the facial information used for facial authentication.

[0115] Next, the authentication unit 12C performs facial authentication in the terminal devices 20C, 201C to 205C using the facial information determined by the determination unit 11C on the user's facial image captured for facial authentication purposes. That is, the authentication unit 12C determines whether the user who has registered their facial information is the same person who has been authenticated by the captured facial image, thereby determining whether they can enter the facility and use (ride) the amusement rides.

[0116] If the user's facial image captured for facial recognition is authenticated in terminal device 20C, entry to the facility is permitted. If the user's facial image captured for facial recognition is authenticated in terminal devices 201C to 205C, use (ride) of the amusement ride is permitted.

[0117] The authentication unit 12C obtains facial information from the captured user's facial image from the acquisition unit 14C and compares it with the facial information determined by the determination unit 11C to perform facial authentication. The terminal devices 20C, 201C to 205C send facial authentication information, such as the user's facial image, the time of capture of the facial image (second capture time), and the capture location (second capture location), along with the facial authentication request, to the server device 10C.

[0118] Next, the registration update unit (registration update function) 13C registers the facial information of the user's face image captured for face registration as new registration data on the terminal device 20C. Specifically, the registration update unit 13C registers a record portion of the user ID, name, facial information, ticket type, first shooting time, and first shooting location in the registration data. The terminal device 20C sends the face registration information, including the user's name, face image, the shooting time (first shooting time), and shooting location (first shooting location), along with the face registration request, to the server device 10C. The registration update unit 13C, referring to the face registration information received from the terminal device 20C, registers a new record portion in the registration data. In addition, the registration update unit 13C obtains the facial information of the face image received from the terminal device 20C from the acquisition unit 14C. Furthermore, the registration update unit 13C generates a new user ID for the new registration.

[0119] Furthermore, when a captured user's facial image is authenticated in facial recognition, the registration update unit 13C updates the location estimation information (first capture time and first capture location) of the user's registration data for that facial image to the information of the time the facial image was captured. For example, in the facial recognition of user A1 in the above example, the facial image of user A1, which is authenticated as being captured by the terminal device 205C at 11:00, is compared with the information of the time the facial image was captured. Figure 10 The following example illustrates a case where the facial information of user ID 0006 matches the registration data. In this case, server device 10C has already received the facial authentication information, including user A1's facial image, the time the facial image was captured (11:00), and the capture location (terminal device 205C), along with the facial authentication request, from terminal device 205C. Registration update unit 13C updates the first capture time and first capture location of user ID 0006 to the capture time (11:00) and capture location (terminal device 205C) received from terminal device 205C.

[0120] Next, the acquisition unit 14C acquires (extracts) facial information from the facial image during facial authentication and facial registration. The acquisition unit 14C acquires facial information using a learned model obtained through machine learning of the facial image. The learned model may be, for example, a neural network. The facial image is input into the neural network. Furthermore, the neural network outputs the facial information from the input facial image. The input facial image can be a facial image captured by the terminal devices 20C, 201C to 205C, or a facial image that has undergone various processing such as filtering. Even after various processing, the facial image still corresponds to the facial image captured by the terminal devices 20C, 201C to 205C.

[0121] The learned model (neural network) in this embodiment is generated by pre-inputting multiple facial images (learning data) and performing machine learning (e.g., deep learning). Alternatively, the learned model (neural network) can also be learned (additional learning) using facial images of the individuals who will be registered and authenticated at the amusement park 300 as input. Furthermore, facial information can also be acquired without using a learned model.

[0122] Figure 12 This is a block diagram showing the configuration of terminal device 20C, which is an example of terminal device 20. In this embodiment, terminal device 20C has at least a registration acceptance unit 21C and a face authentication acceptance unit 22C. In addition, terminal devices 201C to 205C have the same configuration as terminal device 20C, but do not have a registration acceptance unit 21C.

[0123] The registration acceptance unit 21C initiates facial registration for the user. The user can select facial registration simply by operating the operation panel of the terminal device 20C. The registration acceptance unit 21C causes the camera unit to capture an image of the user's face. Additionally, the registration acceptance unit 21C allows the user to operate the operation panel and input their name and ticket type. Afterwards, the registration acceptance unit 21C sends facial registration information, including the user's name, facial image, ticket type, the time (first capture time), and the capture location (first capture location), along with the facial registration request, to the server device 10C. Upon receiving confirmation of completion of facial registration from the server device 10C, the terminal device 20C displays a message indicating that access to the facility is permitted.

[0124] The face authentication receiving unit 22C accepts the execution of face authentication from the user. The user can select to execute face authentication simply by operating the operation unit of the terminal device 20C. The face authentication receiving unit 22C causes the imaging unit to capture an image of the user's face. Then, the face authentication receiving unit 22C sends the user's face image, the time of capture (second capture time), the capture position (second capture position), and other face authentication information, along with the face authentication request, to the server device 10C. The second capture position is the identification information of the terminal device 20C. Upon receiving the authentication result from the server device 10C, the terminal device 20C displays a message indicating that access to the facility is permitted. Furthermore, in terminal devices 201C to 205C, upon receiving the authentication result from the server device 10C, a message indicates that access to amusement rides 80C to 84C is permitted.

[0125] Next, the operation of the 100C facial recognition system will be explained.

[0126] Figure 13 This is a flowchart illustrating an example of facial authentication processing performed by system 100C. In the facial authentication processing of this embodiment, the following steps are performed: facial authentication is performed by determining the facial information used for facial authentication. Furthermore, in... Figure 13 This section primarily focuses on the processing of facial information identification and comparison; other processing steps are partially omitted. The following explanation uses the authentication process performed by server device 10C and terminal device 20C as an example.

[0127] The facial authentication process in this embodiment is performed, for example, when a facial authentication request is received from any of the terminal devices 20C, 201C to 205C.

[0128] The terminal device 20C sends the user's facial image, the second shooting time of the facial image, the second shooting position (identification information of the terminal device 20C), and other information used for facial authentication, together with the facial authentication request, to the server device 10C.

[0129] Server device 10C performs a determination process (step S10-C). In the determination process, based on location estimation information (ticket type, first shooting time, and first shooting location) and predetermined conditions (condition (1), condition (2)), the facial information used for facial authentication is determined from multiple facial information registered in the storage unit. As described above, the facial information remaining after excluding facial information that meets the predetermined conditions is determined as the facial information used for facial authentication.

[0130] Next, the server device 10C performs authentication processing (step S11-C). In this authentication process, facial authentication is performed using the determined facial information on the facial image received from the terminal device 20C. That is, facial information from the captured facial image is acquired, and it is determined whether the acquired facial information matches the determined facial information. Furthermore, in the authentication process, the server device 10C sends the authentication result, such as whether entry is permitted, to the terminal device 20C. Additionally, the server device 10C sends the authentication result, such as whether use (ride) of the amusement ride is permitted, to the terminal devices 201C to 205C.

[0131] On the other hand, the terminal device 20C outputs (displays on the display unit) an image based on the received authentication result, etc. (step S30-C). Afterwards, the terminal device 20C ends the face authentication process. Furthermore, the same processing as terminal device 20C is performed in the other terminal devices 201C to 205C.

[0132] Subsequently, the server device 10C performs an update process (step S12-C). In this update process, the location estimation information (first shooting time and first shooting position) corresponding to the facial information (registration data) consistent with the facial image received from the terminal device 20C is updated to the information of the time the facial image was captured, received from the terminal device 20C. Specifically, the shooting time and shooting position, which are the second shooting time and second shooting position received from the terminal device 20C, are registered as the first shooting position and first shooting position of the aforementioned registration data. Furthermore, in the authentication process, if it is determined that the facial information in the captured facial image does not match any of the determined facial information, the location estimation information is not updated in the update process. Afterward, the server device 10C ends the facial authentication process.

[0133] Figure 14This is a flowchart illustrating an example of face registration processing performed by system 100C. In the face registration processing of this embodiment, processing is performed to register facial information used for performing face authentication. Furthermore, in... Figure 14 The explanation mainly focuses on the processing of registered facial information; other processing methods are partially omitted.

[0134] The face registration process in this embodiment is performed, for example, when a face registration request is received from the terminal device 20C.

[0135] The terminal device 20C sends information for face registration, such as the user's name, facial image, ticket type, the time of facial image capture (first capture time), and the capture location (first capture location), along with the face registration request, to the server device 10C.

[0136] Server device 10C performs registration processing (step S20-C). During registration processing, a record portion containing the user ID, name, facial information, ticket type, first shooting time, and first shooting location is newly registered in the registration data. Additionally, during registration processing, server device 10C sends a notification of the end of facial registration to terminal device 20C. Afterwards, server device 10C ends facial registration processing. Meanwhile, terminal device 20C outputs (displayed on the display unit) an image based on the received end notification (step S40-C). Afterwards, terminal device 20C ends facial registration processing.

[0137] As described above, in one aspect of the third embodiment, the server device 10C is configured with a determination unit 11C, an authentication unit 12C, a registration update unit 13C, and an acquisition unit 14C. Therefore, it determines the facial information used for facial authentication based on predetermined conditions. Thus, it does not use all the commonly registered facial information for facial authentication, thereby reducing the time required for facial authentication.

[0138] Furthermore, in the example of the above implementation, the server device 10C performs facial authentication, but it is not particularly limited to this. For example, such as Figure 15 As shown, a face authentication system comprising multiple terminal devices 50C, 501C to 505C can also be configured as follows: Figure 16 As shown, the alternative server device 10C, and the terminal devices 50C, 501C to 505C, each have at least one determination unit 11C', authentication unit 12C', registration / update unit 13C', and acquisition unit 14C' identical to those of the determination unit 11C, authentication unit 12C, registration / update unit 13C, and acquisition unit 14C. Furthermore, Figure 16 This is a functional block diagram of terminal device 50C.

[0139] Terminal devices 50C, 501C to 505C are the same as those described above, namely, personal computers with a camera unit. Each terminal device 50C, 501C to 505C has a camera unit, an operation device (operation unit), a storage medium (storage unit), a control unit composed of a CPU, a display unit, a communication control unit, etc.

[0140] Furthermore, terminal devices 50C, 501C to 505C, like the aforementioned terminal devices 20C, 201C to 205C, are also installed in amusement park 300. Terminal devices 50C and 20C also have a registration unit 21C' and a facial recognition unit 22C'. Additionally, terminal devices 501C to 505C and 201C to 205C also have a facial recognition unit 22C'.

[0141] The storage units of terminal devices 50C, 501C to 505C store software for performing facial authentication (facial authentication processing program), software for accepting facial authentication (facial authentication acceptance program), and software for accepting facial registration (facial registration acceptance program). That is, terminal devices 50C, 501C to 505C execute facial registration and facial authentication from the user's acceptance of facial registration and facial authentication.

[0142] The storage units of terminal devices 50C, 501C to 505C contain registration data identical to the master registration data managed by the data registration server device 40C. The data registration server device 40C, for example, is connected to terminal devices 50C, 501C to 505C via a communication network to register and update the master registration data in its own storage unit. The master registration data is identical to the master registration data managed by the data registration server device 40C. Figure 10 The registration data shown is the same. Whenever the main registration data in the storage unit is updated, the data registration server device 40C sends update information to the terminal devices 50C, 501C to 505C. Additionally, the storage units of the terminal devices 50C, 501C to 505C also store time-sensitive data. Furthermore, the data registration server device 40 does not perform facial recognition.

[0143] When processing a face registration, the registration update unit 13C' sends the face registration information to the data registration server device 40C. The data registration server device 40C updates the registration data based on the received face registration information. Additionally, if the registration update unit 13C' is authenticated during face verification, it sends the capture time and location of the face image to the data registration server device 40C. The data registration server device 40C sets the received capture time and location as the first capture time and location for the registration data.

[0144] Figure 17 This indicates that the operation is performed on terminal device 50C. Figure 13 The flowchart illustrates an example of the operation of the terminal device 50C during face authentication processing. For example, when face authentication is requested, the terminal device 50C captures an image of the user's face. Then, in addition to the face image, the terminal device 50C acquires face authentication information such as the second capture time and the second capture position (recognition information of the terminal device 50C) of the face image.

[0145] In the face authentication process, the terminal device 50C performs a determination process (step S50-C). In the determination process, the face information used for face authentication is determined from multiple face information registered in the storage unit based on the location estimation information (ticket type, first shooting time and first shooting location) and the prescribed conditions (condition (1) and condition (2)).

[0146] Next, the terminal device 50C performs authentication processing (step S51-C). In this authentication process, facial authentication is performed using the determined facial information from the facial image captured by the terminal device 50C. Additionally, the terminal device 50C displays the authentication result indicating whether entry is permitted. Furthermore, terminal devices 501C to 505C display the authentication result indicating whether use (ride) of the amusement ride is permitted.

[0147] Afterwards, terminal device 50C performs an update process (step S52-C). In this update process, the location estimation information (first shooting time and first shooting position) corresponding to the facial information (master registration data) consistent with the captured facial image is updated to the information of the time the facial image was captured. Specifically, terminal device 50C sends the user ID consistent with the captured facial image, along with the shooting time and position (second shooting time and second shooting position) of the captured facial image, to data registration server device 40. Afterwards, terminal device 50C ends the facial authentication process. Meanwhile, data registration server device 40 updates the master registration data based on the received information and sends the update information to terminal devices 50C, 501C to 505C.

[0148] Figure 18 This indicates that the operation is performed on terminal device 50C. Figure 14 The flowchart illustrates an example of the operation of the terminal device 50C during face registration processing. For example, when accepting the execution of face registration, the terminal device 50C captures an image of the user's face. Then, in addition to the face image, the terminal device 50C acquires face registration information such as the first time the face image was captured and the first capture location (identification information of the terminal device 50C).

[0149] In the face registration process, the terminal device 50C performs the registration process (step S60-C). During the registration process, a record portion containing the user ID, name, facial information, ticket type, first shooting time, and first shooting location is newly registered in the main registration data. Specifically, the terminal device 50C sends the captured facial image, the first shooting time, and the first shooting location, etc., for face registration to the data registration server device 40C. The data registration server 40C generates a new user ID and updates the main registration data based on the received face registration information. Additionally, during the registration process, the terminal device 50C outputs (displayed on the display unit) an image based on the termination notification received from the data registration server device 40C. Afterwards, the terminal device 50C terminates the face registration process.

[0150] Furthermore, in the examples of the above embodiments, the execution of facial registration is handled by only one terminal device, but it is not particularly limited to this. For example, it could also be configured so that facial registration is handled by all terminal devices.

[0151] In the neural network of the above-described embodiment, a face image is input and face information is output, but this is not particularly limited to this. For example, the neural network can also perform face authentication. In this case, face information obtained from a captured image of the user's face is input into the neural network, and an authentication result is output.

[0152] The number of server devices and terminal devices in the above-described embodiments is not particularly limited. Any number can be used.

[0153] In the above-described implementation example, facial information and location estimation information (ticket type, etc.) are registered as registration data in the same storage unit. However, facial information and location estimation information can be registered in different storage units as long as they correspond. For example, there is a configuration where the user ID is registered in a first storage unit corresponding to the facial information, and the user ID is registered in a second storage unit corresponding to the location estimation information. In this case, the facial information and location estimation information correspond via the user ID.

[0154] [Fourth Implementation Method]

[0155] Figure 19 This is a block diagram illustrating the configuration of a face authentication system 100D, which is an example of the configuration of a face authentication system 100. In this embodiment, the face authentication system 100D is configured in a region 400 in real space. The face authentication system 100D includes a server device 10D and multiple terminal devices 20D, 201D to 205D. The server device 10D and the multiple terminal devices 20D, 201D to 205D are connected to a communication network 15 such as the Internet.

[0156] In this embodiment, a roving game activity is conducted in a specific area 400 in real space. In this roving game activity, area 400 serves as the game venue. Area 400 is, for example, a defined region such as a town or city. A starting point 90D and multiple checkpoints 91D to 95D are configured in area 400. Participants (users) complete the game by passing through all checkpoints 91D to 95D once, starting from the starting point 90D, within a time limit. Users must initially pass through the starting point 90D, but there is no set order for passing through the other checkpoints 91D to 95D. Users can pass through checkpoints 91D to 95D in any order. In this embodiment, facial recognition is used for passing checkpoints 91D to 95D, except for the starting point 90D. Furthermore, in this embodiment, for example, 100 participants conduct the game activity. Additionally, users can also quit the game midway through.

[0157] Furthermore, the game venue is not limited to the aforementioned region 400; it can be any defined area of ​​real space. For example, the entire world could be used as the game venue. Additionally, facilities such as amusement park rides and shopping malls could also be used as game venues. Moreover, in this embodiment, users can move using public transportation such as buses and light rail, in addition to walking.

[0158] The game activity will be held on the specified date and time (start time: 10:00 AM). Before starting, users need to pre-register their facial information for facial authentication (facial registration). Facial registration is handled by terminal device 20D, which is located near the starting point 90D. When a user registers their face via terminal device 20D, their passage through starting point 90D is also registered. That is, if a user registers their face via terminal device 20D, facial authentication at starting point 90D is not required. Therefore, after registering their face via terminal device 20D, users can move towards checkpoints 91D to 95D.

[0159] Alternatively, users can complete facial registration in advance using their own terminal devices such as smartphones. Users who have pre-registered their faces need to undergo facial authentication at checkpoint 90D on terminal device 20D before the start time. After being authenticated, the user can move to checkpoints 91D to 95D. That is, facial registration and facial authentication are performed on terminal device 20D.

[0160] Terminal devices 201D to 205D are installed near each checkpoint 91D to 95D. Terminal devices 201D to 205D, like terminal device 20D, handle facial authentication at the checkpoint. A user who is authenticated during facial authentication is considered to have passed the checkpoint where the terminal device handling the facial authentication is located.

[0161] In addition, terminal devices 20D, 201D to 205D also perform facial authentication for users to exit the game. Users authenticated during the exit facial authentication process register their exit. That is, in this embodiment's example of facial authentication, there are both checkpoint-passing facial authentication and exit facial authentication. Users can simply operate the operation unit of terminal devices 20D, 201D to 205D to select whether to perform checkpoint-passing facial authentication or exit facial authentication.

[0162] Figure 20 This is a block diagram showing the configuration of a server device 10D, which is an example of a server device 10. In this embodiment, the server device 10D includes at least a determination unit 11D, an authentication unit 12D, a registration update unit 13D, an acquisition unit 14D, and a game progress control unit 15D.

[0163] The determining unit 11D determines the facial information used for facial authentication from a plurality of facial information registered in the storage unit based on location estimation information and predetermined conditions. Specifically, the determining unit 11D determines the facial information remaining after excluding facial information that meets the predetermined conditions from the plurality of facial information registered in the storage unit as the facial information used for facial authentication. The location estimation information in this embodiment includes Figure 21 The registration data shown corresponds to multiple facial information entries. Figure 21 This is a diagram illustrating an example of the registration data used for facial recognition. The registration data is stored in the storage section of the server device 10D.

[0164] The registration data consists of fields such as user ID, name, facial information, progress, first shooting time, and first shooting location. Each record contains information for one user. The progress, first shooting location, and first shooting time in the registration data are equivalent to location estimation information.

[0165] The User ID field records the user's identification information. The Name field records the text data of the user's name. The Face Information field records the facial information (numerical values) obtained from the user's face image. Facial information is information about the face image, such as the position of feature points of the eyes, nose, mouth, etc., the distance between feature points, and the feature vector of the face image.

[0166] The progress field records the user's game activity progress. This progress includes information such as passed checkpoints (including the starting point), game completion, and exit identification. The identification information for passed checkpoints uses the identification information of terminal devices 20D, 201D to 205D. The fields for first shooting time and first shooting position record the location and time of the last captured user's face image. In this embodiment, the location and time of the last captured face image are recorded for either face registration or face authentication. The field for first shooting position sets the identification information of the terminal device that captured the face image. For example, in the case of user (user ID 0005), the last face image was captured by terminal device 20D at 9:45 for face registration (or face authentication). Furthermore, in the progress of user ID 0005, only the identification information of terminal device 20D is recorded. Therefore, user (user ID 0005) is in a state where no checkpoints 91D to 95D have been passed except for the starting point 90D.

[0167] Next, the specified conditions will be explained. The specified conditions for the example of this embodiment include the following conditions (1) and (2).

[0168] Condition (1): When the location and time of the facial image of the object being facially authenticated are the second shooting location and the second shooting time, the user who took the facial image at the first shooting time and the first shooting location cannot move to the second shooting location by the second shooting time.

[0169] Condition (2): is the progress of a game activity that is presumed to not exist at the location where the face image of the object being used for face authentication was taken.

[0170] The determining unit 11D determines the remaining face information for face authentication from the multiple face information registered in the storage unit after excluding face information for which at least one of the above conditions (1) and (2) is met.

[0171] Regarding the movement in condition (1), refer to Figure 22The required time data is as shown. Required time data is the estimated time needed for a user to move between two locations. Required time data is stored in the storage unit of server device 10D. Required time data consists of fields such as Device ID-1, Device ID-2, and Required Time. The Device ID-1 and Device ID-2 fields represent the two locations. The identification information of any one of the terminal devices 20D, 201D to 205D is set in the Device ID-1 and Device ID-2 fields. The required time is set in the Required Time field for the two locations, including Device ID-1 and Device ID-2. Furthermore, the required time is the time needed for a one-way trip between the two locations. In addition to walking, users in the game area can also move using public transportation. Therefore, the required time is set in the Required Time field based on the use of walking and public transportation. For example, the required time is set regardless of how fast the movement is.

[0172] Next, regarding condition (2), this condition is met if the user has exited or completed the game during the registration process. This is because users who have exited or completed the game are presumed not to have exited at starting point 90D or checkpoints 91D to 95D. Additionally, this condition is also met if, during the registration process, the user's identification information is registered at the same location (terminal device) where the facial image of the user being authenticated was captured. This is because the user is presumed not to return to checkpoints already passed.

[0173] For example, regarding the photo of user A1 taken by terminal device 201D at 12:00 (refer to...) Figure 19 The following describes the case where user A1's facial authentication is performed based on the facial image of the user. In this case, the second shooting location is terminal device 201D, and the second shooting time is 12:00.

[0174] The user with user ID 0001 registered the data. The first shooting time was 10:40, and the first shooting location was terminal device 205D. The time required to move from terminal device 201D to terminal device 205D is 15 minutes. Therefore, it is determined that the user with user ID 0001, who was in terminal device 205D at 10:40, can move to terminal device 201D at 12:00. Therefore, condition (1) is not met. However, in the progress of the user with user ID 0001, the registration is exited. Therefore, condition (2) is met. Therefore, the determination unit 11D excludes the facial information of user ID 0001 from the facial authentication objects of user A1. For example, the determination unit 11D can simply add user ID 0001 as exclusion information to the storage unit.

[0175] Next, for example, the user with registered data, User ID 0003, had their first photo taken at 11:45 AM, and their first photo taken at terminal device 204D. The time required to move from terminal device 204D to terminal device 201D is 30 minutes. Therefore, it is determined that the user with User ID 0003, who was at terminal device 204D at 11:40 AM, cannot move to terminal device 201D at 12:00 PM. Therefore, condition (1) is met. Therefore, the determination unit 11C excludes the facial information of user ID 0003 from the facial authentication objects of user A1. The determination unit 11D can simply add user ID 0003 as exclusion information to the storage unit, for example. Furthermore, in the progress of the user with User ID 0003, the identification information of terminal devices 204D and 205D is registered. That is, the user with User ID 0003 has already passed checkpoints 94D and 95D. Therefore, condition (2) is not met.

[0176] Additionally, for example, the user with registered user ID 0005 had their first photo taken at 9:45 AM, and their first photo taken at terminal device 20D. The time required to move from terminal device 20D to terminal device 201D is 30 minutes. Therefore, it is determined that the user with user ID 0005, who was at terminal device 20D at 9:45 AM, was able to move to terminal device 201D at 12:00 PM. Therefore, condition (1) is not met. Furthermore, only the identification information of terminal device 20D is registered in the user's progress. Therefore, condition (2) is also not met. Therefore, the determination unit 11D uses the facial information of user ID 0005 as the object of facial authentication for user A1 (not set as excluded information).

[0177] As described above, the determination unit 11D refers to the estimated information of each location in the registration data (progress, first shooting time, and first shooting position) and determines the validity of conditions (1) and (2). Then, the remaining face information after excluding the face information of the user ID set as exclusion information from the multiple face information in the registration data is determined as the face information used for face authentication.

[0178] Next, the authentication unit 12D performs facial authentication using the facial information determined by the determination unit 11D on the user's facial image captured in the terminal devices 20D, 201D to 205D for facial authentication purposes. That is, the authentication unit 12D determines whether the user whose facial image was captured is the user whose facial information is registered, thereby determining whether the checkpoint can be passed and whether the user can exit.

[0179] The authentication unit 12D acquires facial information from the captured user's face image from the acquisition unit 14D and compares it with the facial information determined by the determination unit 11D to perform facial authentication. The terminal devices 20D, 201D to 205D send facial authentication information, such as the user's face image, the time of capture of the face image (second capture time), and the capture location (second capture location), along with the facial authentication request, to the server device 10D.

[0180] Next, the registration update unit 13D registers the facial information of the user's face image captured in the terminal device 20D for face registration in the registration data. Specifically, the registration update unit 13D registers a record portion of the user ID, name, facial information, progress, first shooting time, and first shooting location in the registration data. The terminal device 20D sends the face registration information, including the user's name, face image, the shooting time (first shooting time), and shooting location (first shooting location), along with the face registration request, to the server device 10D. The registration update unit 13D, referring to the face registration information received from the terminal device 20D, registers a record portion of the record portion in the registration data. The identification information of the terminal device 20D, which sets the starting point 90D in the progress, is also included. In addition, the registration update unit 13D obtains the facial information of the face image received from the terminal device 20D from the acquisition unit 14D. Furthermore, the registration update unit 13D generates a new user ID for the new registration.

[0181] Furthermore, when a captured user's facial image is authenticated in facial recognition, the registration update unit 13D updates the location estimation information (first capture time and first capture location) of the user's registration data for that facial image to the information of the time the facial image was captured. For example, in the facial recognition of user A1 in the above example, the facial image of user A1 that was authenticated as being captured by the terminal device 201D at 12:00 is compared with the information of the time when the facial image was captured. Figure 21 The following example illustrates a case where the facial information of user ID 0007 matches the registration data. In this case, server device 10D receives facial authentication information, including user A1's facial image, the time the facial image was captured (12:00), and the capture location (terminal device 201D), along with the facial authentication request, from terminal device 201D. Registration update unit 13D updates the first capture time and first capture location of user ID 0007 to the capture time (12:00) and capture location (terminal device 201D) received from terminal device 201D.

[0182] Next, the acquisition unit 14D acquires (extracts) facial information from the facial image during facial authentication and facial registration. The acquisition unit 14D acquires facial information using a learned model obtained through machine learning of the facial image. The learned model, for example, uses a neural network. The facial image is input into the neural network. Furthermore, the neural network outputs the facial information of the input facial image. The input facial image can be a facial image captured by the terminal devices 20D, 201D to 205D, or a facial image that has undergone various processing such as filtering. Even if the facial image has undergone various processing, it still matches the facial image captured by the terminal devices 20D, 201D to 205D.

[0183] In this embodiment, the learned model (neural network) is generated by pre-inputting multiple facial images (learning data) and performing machine learning (e.g., deep learning). Alternatively, the learned model (neural network) can also be learned by inputting facial images of objects that are used for facial registration and facial authentication in game activities (additional learning). Furthermore, facial information can also be acquired using a configuration that does not use a learned model.

[0184] Next, the game progress control unit 15D controls the progress of the game activity. For example, based on the results of facial authentication at checkpoints, the game progress control unit 15D updates the progress (registration data progress) of each user at starting point 90D and checkpoints 91D to 95D. Specifically, the game progress control unit 15D adds the identification information of the terminal device that captured the facial image to the progress (registration data) of the user whose facial image has been authenticated. Furthermore, for example, based on the results of facial authentication exit, the game progress control unit 15D adds exit identification information to the progress of each user's registration data.

[0185] Furthermore, when the user has passed all starting points 90D and checkpoints 91D to 95D, the game progress control unit 15D adds game completion identification information to the user's registered data progress. The game progress control unit 15D only needs to determine whether the game has been completed based on the progress settings in the registered data.

[0186] Figure 23 This is a block diagram showing the configuration of a terminal device 20D, which is an example of a terminal device 20. In this embodiment, the terminal device 20D has at least a registration acceptance unit 21D and a facial authentication unit 22D. Terminal devices 201D to 205D have the same configuration as terminal device 20D, but do not have the registration acceptance unit 21D.

[0187] The registration acceptance unit 21D initiates face registration upon receiving a request from the user. The user can select face registration by operating the operation unit of the terminal device 20D. The registration acceptance unit 21D causes the camera unit to capture an image of the user's face. Additionally, the registration acceptance unit 21D allows the user to operate the operation unit and input their name. Afterwards, the registration acceptance unit 21D sends face registration information, including the user's name, face image, the time of capture (first capture time), and the capture location (first capture location), along with the face registration request, to the server device 10D. Upon receiving confirmation of face registration completion from the server device 10D, the terminal device 20D displays a message indicating that face registration is complete.

[0188] The face authentication receiving unit 22D accepts face authentication requests from users. As described above, it accepts both successful and failed face authentication requests. Users can select the desired face authentication request simply by operating the operation unit of the terminal device 20D. In the case of successful face authentication, the face authentication receiving unit 22D causes the camera to capture an image of the user's face. Then, the face authentication receiving unit 22D sends the user's face image, the capture time (second capture time), and the capture position (second capture position), along with the successful face authentication request, to the server device 10D. The second capture position is the identification information of the terminal device 20D. Upon receiving the face image authentication result from the server device 10D, the terminal device 20D displays the successful authentication (allow) checkpoint completion.

[0189] In the case of exiting facial authentication, the facial authentication receiving unit 22D causes the imaging unit to capture an image of the user's face. Then, the facial authentication receiving unit 22D sends the user's facial image, the time the facial image was captured (second capture time), the capture location (second capture location), and other facial authentication information, along with the exit facial authentication request, to the server device 10D. Upon receiving the result of facial image authentication from the server device 10D, the terminal device 20D displays a message indicating that exit is permitted.

[0190] Next, the operation of the 100D facial recognition system will be explained.

[0191] Figure 24 This is a flowchart illustrating an example of facial authentication processing performed by system 100D. In the facial authentication processing of this embodiment, the following process is performed: facial authentication is performed by determining the facial information used for facial authentication. Furthermore, in... Figure 24This section primarily focuses on the processing of facial information identification and comparison; other processing steps are sometimes omitted. The following explanation uses the authentication process performed by server device 10D and terminal device 20D as an example.

[0192] The facial authentication process in this embodiment is performed, for example, when any one of a facial authentication request to pass a checkpoint and a facial authentication request to exit is received from any one of the terminal devices 20D, 201D to 205D.

[0193] The terminal device 20D sends the user's facial image, the second shooting time of the facial image, the second shooting position (the recognition information of the terminal device 20D), and other information used for facial authentication, together with the facial authentication requirements, to the server device 10D.

[0194] Server device 10D performs a determination process (step S10-D). In the determination process, based on location estimation information (progress, first shooting time, and first shooting position) and predetermined conditions (condition (1), condition (2)), the facial information used for facial authentication is determined from multiple facial information registered in the storage unit. As described above, the facial information remaining after excluding facial information that meets the predetermined conditions is determined as the facial information used for facial authentication.

[0195] Next, the server device 10D performs authentication processing (steps S11-D). In this authentication processing, facial authentication is performed using the determined facial information on the facial image received from the terminal device 20D. That is, facial information from the captured facial image is acquired, and it is determined whether the acquired facial information matches the determined facial information.

[0196] Subsequently, the server device 10D executes update process A (step S12-D). In update process A, the location estimation information (first shooting time and first shooting position) corresponding to the facial information (registration data) that matches the facial image received from the terminal device 20D is updated to the information of the shooting time of the facial image received from the terminal device 20D. Specifically, the shooting time and shooting position, which are the second shooting time and second shooting position received from the terminal device 20D, are registered as the first shooting time and first shooting position of the aforementioned registration data. Furthermore, in the authentication process, if it is determined that the facial information of the captured facial image does not match any of the determined facial information, the location estimation information is not updated in update process A.

[0197] Next, the server device 10D executes update process B (step S13-D), in which the progress (registration data) of the game activity is updated. Specifically, the progress corresponding to the facial information (registration data) that matches the facial image received from the terminal device 20D is updated. In the case of passing the facial authentication requirement at a checkpoint, the recognition information of the terminal device 20D is added to the progress of the registration data. In addition, if the conditions for passing the game are met, the server device 10D adds the recognition information for passing the game to the progress of the registration data. In addition, in the case of exit authentication requirement, the exit recognition information is added to the progress of the registration data. Furthermore, in the authentication process, if it is determined that the facial information in the captured facial image does not match any of the determined facial information, the progress of the registration data is not updated in update process B.

[0198] Additionally, in update process B, server device 10D sends the authentication result to terminal device 20D. Furthermore, server device 10D also sends, for example, the progress status of the game activity to terminal device 20D. Afterwards, server device 10D completes the facial authentication process.

[0199] On the other hand, the terminal device 20D outputs (displays on the display unit) an image based on the received authentication result, etc. (step S30-D). After that, the terminal device 20D ends the face authentication process. In addition, the same process as terminal device 20D is performed in other terminal devices 201D to 205D.

[0200] Figure 25 This is a flowchart illustrating an example of face registration processing performed by system 100D. In the face registration processing of this embodiment, processing is performed to register facial information used for performing face authentication. Furthermore, in... Figure 25 The explanation mainly focuses on the processing of registered facial information; other processing methods are partially omitted.

[0201] The face registration process in this embodiment is performed, for example, when the server device 10D receives a face registration request from the terminal device 20D.

[0202] The terminal device 20D sends information for face registration, such as the user's name, face image, the time of capture of the face image (first capture time), and the capture location (first capture location), along with the face registration request, to the server device 10D.

[0203] Server device 10D performs registration processing (step S20-D). During registration processing, a record portion including user ID, name, facial information, progress, first shooting time, and first shooting location is newly registered in the registration data. During progress, the identification information of terminal device 20D is set. That is, by performing facial registration on terminal device 20D, the passage of starting point 90D is also registered. Additionally, during registration processing, server device 10D sends a notification of the end of facial registration to terminal device 20D. Afterwards, server device 10D ends the facial registration processing. Meanwhile, terminal device 20D outputs (displayed on the display unit) an image based on the received end notification, etc. (step S40-D). Afterwards, terminal device 20D ends the facial registration processing.

[0204] As described above, in one aspect of the fourth embodiment, the server device 10D is configured with a determination unit 11D, an authentication unit 12D, a registration update unit 13D, an acquisition unit 14D, and a game progress control unit 15D. Therefore, it determines the facial information used for facial authentication based on predetermined conditions. Thus, it does not use all the commonly registered facial information for facial authentication, thereby reducing the time required for facial authentication.

[0205] Furthermore, in the example of the above-described embodiment, the server device 10D performs facial authentication, but it is not particularly limited to this. As in the third embodiment described above... Figure 15 As illustrated in the examples, facial authentication can also be performed by the terminal device.

[0206] In the examples of the above embodiments, the execution of facial registration is handled by only one terminal device, but it is not particularly limited to this. For example, it could also be configured so that facial registration is handled by all terminal devices.

[0207] The neural network described in the above-described embodiments takes a face image as input and outputs face information, but is not particularly limited thereto. For example, the neural network can also perform face authentication. In this case, face information obtained from a captured image of the user's face is input into the neural network, and an authentication result is output.

[0208] The number of server devices and terminal devices in the above-described embodiments is not particularly limited. Any number can be used. For example, two server devices can be used: one for controlling the progress of game activities and another for performing facial authentication.

[0209] In the example of the above implementation, facial information and location estimation information (progress, etc.) are registered as registration data in the same storage unit. However, as long as the facial information and location estimation information correspond, they can also be registered in different storage units.

[0210] In the examples of the above embodiments, facial authentication has been described, but it is not limited to facial authentication. The embodiments of the present invention can be applied to biometric authentication that uses a person's physical characteristics for identity verification, such as fingerprint authentication and iris authentication.

[0211] [Postscript]

[0212] The above description of the embodiments is presented in a manner that enables at least those skilled in the art to carry out the invention described below. [1]

[0214] A facial authentication program enables a computer device to perform facial authentication on a captured image of a user's face using multiple pieces of facial information registered in a storage unit, the function including:

[0215] The function determines the facial information used for facial authentication from among the plurality of facial information based on location estimation information and specified conditions, wherein the location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0216] The authentication function uses the determined facial information to perform facial authentication on the captured image of the user's face. [2]

[0218] According to the face authentication procedure described in [1], the specified condition is as follows: facial information of a user who is presumed not to exist at the shooting location at the time the face image for face authentication is captured is excluded from the face authentication object.

[0219] The determination function implements the following function: determining the remaining face information after excluding the face information that meets the specified conditions from the plurality of face information as the face information used for face authentication. [3]

[0221] According to the facial authentication procedure described in [2], the location estimation information includes information on the first shooting location and the first shooting time as the location and time at which the user's facial image was captured.

[0222] The specified conditions include: when the location and time of capturing the facial image of the person to be authenticated are the second shooting location and the second shooting time, the user who captured the facial image at the first shooting time and at the first shooting location cannot move to the second shooting location by the second shooting time.

[0223] The determination function implements the following functions: obtaining the second shooting position and the second shooting time, and determining the facial information that does not meet the specified conditions among the multiple facial information as the facial information used for facial authentication. [4]

[0225] The face authentication procedure according to any one of [1] to [3], wherein the authentication function implements the following function: using a learned model, inputting a captured image of the user's face, and comparing it with the determined face information, wherein the learned model is obtained by using machine learning of the face image. [5]

[0227] According to the face authentication procedure described in [4], the machine learning uses deep learning. [6]

[0229] According to any one of [1] to [5], the face authentication procedure further enables the computer device to:

[0230] The registration update function updates the location estimation information corresponding to the facial information of the captured user's face to the information of the time when the face image was captured, provided that the captured user's face image is authenticated in the face authentication process. [7]

[0232] A server device having installed the face authentication program described in any one of [1] to [6]. [8]

[0234] A terminal device program enables a terminal device with a camera unit to perform the following:

[0235] A function to capture the user's face; and

[0236] A message sending function that sends information about a captured image of a user’s face to a server device [7] connected via a communication network. [9]

[0238] A terminal device having a camera unit and equipped with a facial authentication program as described in any one of [1] to [6].

[10]

[0240] A facial authentication procedure involves a server connected to a terminal device equipped with a camera unit via a communication network performing facial authentication on a user's facial image captured by the terminal device, using multiple facial information entries registered in a storage unit.

[0241] Enable the server device to achieve:

[0242] The function determines the facial information used for facial authentication from among the plurality of facial information based on location estimation information and specified conditions, wherein the location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0243] The authentication function uses the determined facial information to perform facial authentication on the captured image of the user's face.

[11]

[0245] According to the face authentication procedure described in

[10] , the specified condition is as follows: facial information of a user who is presumed not to exist at the shooting location at the time the face image for face authentication is captured is excluded from the face authentication object.

[0246] The determination function implements the following function: determining the remaining face information after excluding the face information that meets the specified conditions from the plurality of face information as the face information used for face authentication.

[12]

[0248] According to the facial authentication procedure described in

[11] , the location estimation information includes information on the first shooting location and the first shooting time as the location and time at which the user's facial image was captured.

[0249] The specified conditions include: when the location and time of capturing the facial image of the person to be authenticated are the second shooting location and the second shooting time, the user who captured the facial image at the first shooting time and at the first shooting location cannot move to the second shooting location by the second shooting time.

[0250] The determination function implements the following functions: obtaining the second shooting position and the second shooting time, and determining the facial information that does not meet the specified conditions among the multiple facial information as the facial information used for facial authentication.

[13]

[0252] The face authentication procedure according to any one of

[10] to

[12] , wherein the authentication function implements the following function: using a learned model, inputting a captured image of the user's face, and comparing it with the determined face information, wherein the learned model is obtained by using machine learning of the face image.

[14]

[0254] According to the face authentication procedure described in

[13] , the machine learning uses deep learning.

[15]

[0256] According to any one of

[10] to

[14] , the face authentication procedure further includes the server device implementing:

[0257] The registration update function updates the location estimation information corresponding to the facial information of the captured user's face to the information of the time when the face image was captured, provided that the captured user's face image is authenticated in the face authentication process.

[16]

[0259] A facial authentication system includes: a terminal device having a camera; and a server device connected to the terminal device via a communication network. The system performs facial authentication on a user's facial image captured by the terminal device using multiple facial information entries registered in a storage unit, including:

[0260] The determining unit determines the facial information used for facial authentication from the plurality of facial information based on location estimation information and specified conditions, wherein the location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0261] The authentication unit uses the determined facial information to perform facial authentication on the captured image of the user's face.

[17]

[0263] According to the face authentication system described in

[16] , wherein,

[0264] The specified conditions are as follows: facial information of users who are presumed not to exist at the shooting location at the time the facial image was captured during the facial authentication process will be excluded from the facial authentication pool.

[0265] The determining unit will exclude the facial information that meets the specified conditions from the plurality of facial information and determine the remaining facial information as the facial information used for facial authentication.

[18]

[0267] According to the face authentication system described in

[17] , wherein,

[0268] The location estimation information includes information about the first shooting location and the first shooting time, which serves as the location and time at which the user's facial image was captured.

[0269] The specified conditions include: when the location and time of capturing the facial image of the person to be authenticated are the second shooting location and the second shooting time, the user who captured the facial image at the first shooting time and at the first shooting location cannot move to the second shooting location by the second shooting time.

[0270] The determining unit acquires the second shooting position and the second shooting time, and determines the facial information among the plurality of facial information that does not meet the specified conditions as the facial information used for facial authentication.

[19]

[0272] According to any one of

[16] to

[18] , the face authentication system wherein,

[0273] The authentication unit uses a learned model to compare the captured image of the user's face with the determined facial information, wherein the learned model is obtained by using machine learning on the facial image.

[20]

[0275] According to the face authentication system described in

[19] , the machine learning uses deep learning. [twenty one]

[0277] The facial authentication system according to any one of

[16] to

[20] further includes:

[0278] The registration and update unit, when the captured user's facial image is authenticated in the facial authentication, updates the location estimation information corresponding to the facial information corresponding to the facial image to the information of the time when the facial image was captured. [twenty two]

[0280] A terminal device performs facial authentication using multiple facial information entries registered in a storage unit on a captured image of a user's face, comprising:

[0281] The determining unit determines the facial information used for facial authentication from the plurality of facial information based on location estimation information and specified conditions, wherein the location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0282] The authentication unit uses the determined facial information to perform facial authentication on the captured image of the user's face. [twenty three]

[0284] A facial authentication method enables a computer device to perform facial authentication on a captured image of a user's face using multiple pieces of facial information registered in a storage unit, wherein the method includes:

[0285] The process involves determining the facial information used for facial authentication from among the plurality of facial information based on location estimation information and specified conditions. The location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0286] The authentication process involves using the determined facial information to perform facial authentication on the captured image of the user's face. [twenty four]

[0288] A facial authentication method is executed by a facial authentication system, which includes: a terminal device having a camera; and a server device connected to the terminal device via a communication network. The facial authentication system performs facial authentication on a user's facial image captured by the terminal device using multiple facial information entries registered in a storage unit. The facial authentication method includes:

[0289] The process involves determining the facial information used for facial authentication from among the plurality of facial information based on location estimation information and specified conditions. The location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, and is registered in the storage unit corresponding to each of the plurality of facial information.

[0290] The authentication process involves using the determined facial information to perform facial authentication on the captured image of the user's face.

[0291] According to one embodiment of the invention, it is useful in reducing the time required for facial authentication.

Claims

1. A server device connected via a communication network to terminal devices having cameras located at different positions, wherein, for a user's facial image captured by any of the terminal devices, facial authentication of the user is performed using multiple facial information registered in a storage unit located within the server device or in a storage unit located in a separate storage unit, wherein... include: The determining unit determines the facial information used for facial authentication from the plurality of facial information based on location estimation information and predetermined conditions. The location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, including a first shooting position (the position of the terminal device capturing the user's facial image) and a first shooting time (the time when the user's facial image was captured), and is registered in the storage unit corresponding to each of the plurality of facial information. The predetermined conditions include the following: if the location of the terminal device capturing the facial image of the object of facial authentication and the time when the facial image of the object of facial authentication is captured are a second shooting position and a second shooting time, the facial information of the user who is presumed to have captured a facial image at the first shooting time and at the first shooting position but cannot move to the second shooting position by the second shooting time is excluded from the objects of facial authentication. The authentication unit compares the captured image of the user's face with the determined facial information. If the user's face image matches any of the determined facial information, the user is determined to be authenticated. The determining unit obtains the second shooting position and the second shooting time from the terminal device that captures the facial image of the object to be the face authentication. Based on the first shooting position, the first shooting time, the second shooting position, the second shooting time, and the data of the time required for the user to move between the positions of the terminal device registered in the storage unit, it determines the facial information that meets the predetermined conditions. The facial information other than the facial information that meets the predetermined conditions among the plurality of facial information is determined as the facial information used for the face authentication.

2. A facial recognition system comprising: a terminal device having a camera unit disposed at different locations; and a server device connected to the terminal device via a communication network; wherein the server device performs facial recognition of a user based on a facial image captured by any of the terminal devices, using multiple facial information registered in a storage unit located within the server device or in a storage unit located in a separate storage unit from the server device, wherein... The server device includes: The determining unit determines the facial information used for facial authentication from the plurality of facial information based on location estimation information and predetermined conditions. The location estimation information is the location estimation information of the user corresponding to each of the plurality of facial information, including a first shooting position (the position of the terminal device capturing the user's facial image) and a first shooting time (the time when the user's facial image was captured), and is registered in the storage unit corresponding to each of the plurality of facial information. The predetermined conditions include the following: if the location of the terminal device capturing the facial image of the object of facial authentication and the time when the facial image of the object of facial authentication is captured are a second shooting position and a second shooting time, the facial information of the user who is presumed to have captured a facial image at the first shooting time and at the first shooting position but cannot move to the second shooting position by the second shooting time is excluded from the objects of facial authentication. The authentication unit compares the captured image of the user's face with the determined facial information. If the user's face image matches any of the determined facial information, the user is determined to be authenticated. The determining unit obtains the second shooting position and the second shooting time from the terminal device that captures the facial image of the object to be the face authentication. Based on the first shooting position, the first shooting time, the second shooting position, the second shooting time, and the data of the time required for the user to move between the positions of the terminal device registered in the storage unit, it determines the facial information that meets the predetermined conditions. The facial information other than the facial information that meets the predetermined conditions among the plurality of facial information is determined as the facial information used for the face authentication.

Images