Face authentication server, face authentication system, face authentication method, and face authentication program

Abstract

To allow for preventing double registration of face information of a user for use in face authentication.SOLUTION: A face authentication server 2 acquires face information of a user as first face information for collation from a user terminal 3, and executes first collation processing of collating the first face information for collation with a plurality of pieces of registered face information stored in a storage device 13 to calculate collation scores indicating similarity between the first face information for collation and the registered face information. If a collation score equal to or higher than a prescribed threshold is calculated in the first collation processing, the server causes the user terminal 3 to display a registering operation screen 66 for prompting the user to execute an operation of registering the face information of the user, wherein the registering operation screen 66 includes alert information showing that the face information of the user has been registered, and when the operation of registering the face information of the user is executed on the registering operation screen 66, the face information of the user is stored in the storage device as the registered face information.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present disclosure relates to a face authentication server, a face authentication system, a face authentication method, and a face authentication program that register information regarding a user's face image as face information for face authentication.

Background Art

[0002] In recent years, services using face authentication technology (hereinafter referred to as face authentication services) have become widespread in order to manage access to facilities and perform payment procedures for goods and services. In face authentication technology, face matching is performed by comparing face information of a user (i.e., the person to be authenticated) obtained as an authentication target with information regarding a face image registered in advance (hereinafter referred to as a registered image). Thereby, it is possible to determine whether the user is a legitimate registrant.

[0003] Regarding information regarding a user's registered image, for example, a telework management system is known in which a plurality of types of feature amounts with different face orientations and the like for the same person are prepared in order to increase the recognition rate of the same person (see Patent Document 1).

[0004] In addition, a plurality of face images are extracted from an image captured by one camera, any one of the plurality of face images is selected as a reference face image, and the similarity between the reference face image and the plurality of face images is obtained and collated for each of the plurality of face images. An information processing apparatus is known that registers, in a face identification dictionary for identifying a face image of a person of the reference face image, a face image having a plurality of predetermined similarities among the collation results (see Patent Document 2).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] By the way, with the spread of face recognition services, there are an increasing number of cases where users register their face images as described above without going through a third party such as an administrator of the face recognition system. In addition, there are cases where a user registers their face image in association with information other than information such as a name that can easily identify themselves (i.e., the individual user), for example, the user's nickname.

[0007] In such cases, the user may unintentionally re-register information regarding their face image (i.e., a face image similar to the registered image) even when information regarding their face image has already been registered for the same face recognition service (e.g., the same shopping site). Such duplicate registration of information regarding similar face images contributes little to improving the recognition rate of the same person, while on the other hand, it may complicate the management of information regarding the registered image and hinder the smooth processing of face recognition.

[0008] However, the prior arts described in Patent Documents 1 and 2 do not take any particular consideration for preventing such duplicate registration of face information for user face recognition.

[0009] Therefore, a main object of the present disclosure is to provide a face recognition server, a face recognition system, a face recognition method, and a face recognition program that can easily prevent duplicate registration of user face information used for face recognition.

Means for Solving the Problems

[0010] The face recognition server of the present disclosure is a face recognition server that registers information regarding a user's face image as face information for face recognition, and includes a processor that executes a face registration process for registering the user's face information, a storage device that stores information regarding face images of a plurality of different persons registered in the past as registered face information, and a communication device for communicating with a user terminal used by the user. In the face registration process, the processor acquires the user's face information from the user terminal as first face information for verification, and executes a first verification process of verifying the first face information for verification with a plurality of the registered face information, thereby calculating a verification score indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When the registration operation of the user's face information is executed on the registration operation screen, the user's face information is stored in the storage device as the registered face information.

[0011] The face recognition system of the present disclosure is a face recognition system that registers information regarding a user's face image as face information for face recognition, and includes a user terminal used by the user, a face recognition server that executes a face registration process for registering the user's face information, a storage device that stores information regarding face images of a plurality of different persons registered in the past as registered face information, and a communication device for communicating with the user terminal used by the user. In the face registration process, the face recognition server acquires the user's face information from the user terminal as first face information for verification, and executes a first verification process of verifying the first face information for verification with a plurality of the registered face information, thereby calculating a verification score indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold value is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When a registration operation of the user's face information is executed on the registration operation screen, the user's face information is stored in the storage device as the registered face information.

[0012] The face recognition method of the present disclosure is a face recognition method by a face recognition server that registers information regarding a user's face image as face information for face recognition. The face information of the user is acquired from the user terminal used by the user as first face information for verification, and a first verification process of verifying the first face information for verification with a plurality of registered face information, which is information regarding face images of a plurality of different persons, is executed, thereby calculating a verification score indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold value is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When a registration operation of the user's face information is executed on the registration operation screen, the user's face information is stored in a storage device as the registered face information.

[0013] The face authentication program of the present disclosure is a face authentication program that causes a computer to execute information processing for registering information related to a user's face image as face information for face authentication. The information processing includes obtaining the user's face information from a user terminal used by the user as first face information for verification, and performing a first verification process of verifying the first face information for verification with a plurality of registered face information, which is information related to face images of a plurality of different persons, to calculate respective verification scores indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold value is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When a registration operation of the user's face information is executed on the registration operation screen, a procedure for storing the user's face information in a storage device as the registered face information is included in the configuration.

Effect of the Invention

[0014] According to the present disclosure, it is possible to easily prevent double registration of the user's face information used for face authentication.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Mode for Carrying Out the Invention

[0016] A first invention made to solve the above problems is a face authentication server that registers information related to a user's face image as face information for face authentication, and includes a processor that executes a face registration process for registering the user's face information, a storage device that stores information related to face images of a plurality of different persons registered in the past as registered face information, and a communication device for communicating with a user terminal used by the user. In the face registration process, the processor acquires the user's face information from the user terminal as first face information for verification, and executes a first verification process of verifying the first face information for verification with the plurality of registered face information, thereby calculating a verification score indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When the registration operation of the user's face information is executed on the registration operation screen, the user's face information is stored in the storage device as the registered face information.

[0017] According to this, when the verification score between the user's face information and the past registered face information is equal to or higher than a predetermined threshold (that is, the user's face is similar to the face of a person whose face has already been registered), the user is made to execute a registration operation of the face information (that is, the user is made to judge whether or not face information needs to be registered). Therefore, it is possible to easily prevent double registration of the user's face information used for face authentication.

[0018] Further, in the second invention, when the registration operation of the user's face information is executed on the registration operation screen, the processor causes the user terminal to display a reshooting screen for causing the user to reshoot the face image. When the reshooting of the user's face image is executed, information regarding the reshot face image of the user is acquired from the user terminal as second face information for verification, and a second verification process of verifying the second face information for verification with a plurality of pieces of the registered face information is executed, thereby calculating a second verification score indicating the similarity of the face information. When a verification score equal to or higher than the threshold value is not calculated in the second verification process, information regarding the reshot face image of the user is stored in the storage device as the registered face information.

[0019] According to this, by using the information regarding the reshot face image of the user as the registered face information through the re-verification process, it is possible to reduce the similarity between the information regarding the face image of the newly registered user and the existing registered face information (i.e., the information regarding the face images of other persons similar to the user), so that the accuracy of the user face authentication process using the registered face information can be improved.

[0020] Further, in the third invention, when the registration operation of the user's face information is executed on the registration operation screen, the processor adds a flag indicating that there is other similar face information to the face information of the user newly stored in the storage device as the registered face information and the registered face information stored in the storage device and having a verification score equal to or higher than the threshold value in the first verification process.

[0021] According to this, even when there is registered face information regarding the face images of other persons similar to the user's face image, the registered face information regarding the user's face image and the registered face information regarding the face images of other persons can be easily identified by the flag indicating that there is other similar face information.

[0022] Further, in the fourth invention, the processor is configured to add the flag only to the registered face information for which the highest matching score has been calculated among the registered face information for which a matching score equal to or higher than the threshold value has been calculated in the first matching process.

[0023] According to this, a predetermined flag can be appropriately added to the registered face information regarding the face images of other persons similar to the user's face image.

[0024] Further, in the fifth invention, the processor executes the face authentication process of the user, and in the face authentication process, by comparing information regarding the face image of the user generated by photographing with the registered face information stored in the storage device, a matching score indicating the similarity of the face information is calculated. When the face authentication process is not normally performed because a matching score equal to or higher than the threshold value is calculated for a plurality of pieces of the registered face information in the calculation of the matching score, it is determined whether or not the flag is added to the registered face information for which the matching score equal to or higher than the threshold value has been calculated. When it is determined that the flag is added to the registered face information, the configuration is such that the threshold value regarding the registered face information to which the flag is added is corrected to be increased.

[0025] According to this, even when there is registered face information regarding the face images of other persons similar to the user's face image, the accuracy of the user's face authentication process using the registered face information can be improved by increasing the threshold value of the matching process regarding the registered face information.

[0026] Further, in the sixth invention, when it is determined that the flag is added to the registered face information, the processor acquires the difference between the matching score regarding the registered face information and the threshold value, and in the correction of the threshold value, a value larger than the difference is added to the threshold value.

[0027] According to this, it becomes possible to appropriately correct the threshold value of the matching process, and as a result, the accuracy of the user's face authentication process using the registered face information can be improved.

[0028] Also, in the seventh invention, when a matching score equal to or higher than a predetermined threshold is calculated in the first matching process, the processor causes the user terminal to display an update operation screen for causing the user to perform an update operation on the face information of the user. When an update operation on the face information of the user is performed on the update operation screen, the user terminal is caused to display an input operation screen for causing the user to input information for identifying the user. When the information for identifying the user input from the input operation screen matches the information for identifying the user associated with the registered face information corresponding to the matching score equal to or higher than the predetermined threshold, the face information of the user is stored in the storage device as the registered face information.

[0029] According to this, when the user desires to update his / her face information after understanding that his / her face information has already been registered, it is possible to appropriately respond to the request of the user.

[0030] Also, the eighth invention is a face authentication system for registering information regarding a face image of a user as face information for face authentication, including a user terminal used by the user, a face authentication server that executes a face registration process for registering the face information of the user, a storage device that stores information regarding face images of a plurality of different persons registered in the past as registered face information, and a communication device for communicating with the user terminal used by the user. The face authentication server, in the face registration process, acquires the face information of the user from the user terminal as first face information for matching, and calculates a matching score indicating the degree of similarity of the face information by executing a first matching process of matching the first face information for matching with a plurality of the registered face information. When a matching score equal to or higher than a predetermined threshold is calculated in the first matching process, the user terminal is caused to display a registration operation screen for causing the user to perform a registration operation on the face information of the user. The registration operation screen includes alert information indicating that the face information of the user has already been registered. When a registration operation on the face information of the user is performed on the registration operation screen, the face information of the user is stored in the storage device as the registered face information.

[0031] According to this, when the matching score between the user's face information and the past registered face information is equal to or higher than a predetermined threshold value, in order to cause the user to execute a registration operation of the face information, it is possible to easily prevent double registration of the user's face information used for face authentication.

[0032] Further, a ninth invention is a face authentication method by a face authentication server that registers information related to a user's face image as face information for face authentication. The method includes obtaining the user's face information from a user terminal used by the user as first face information for verification, and performing a first verification process of verifying the first face information for verification with a plurality of registered face information that is information related to face images of a plurality of different persons, thereby calculating a matching score indicating the similarity of the face information. When a matching score equal to or higher than a predetermined threshold value is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When a registration operation of the user's face information is executed on the registration operation screen, the user's face information is stored in a storage device as the registered face information.

[0033] According to this, when the matching score between the user's face information and the past registered face information is equal to or higher than a predetermined threshold value, in order to cause the user to execute a registration operation of the face information, it is possible to easily prevent double registration of the user's face information used for face authentication.

[0034] Further, a tenth invention is a face authentication program that causes a computer to execute information processing for registering information related to a user's face image as face information for face authentication. The information processing includes acquiring the user's face information from a user terminal used by the user as first face information for verification, and performing a first verification process of verifying the first face information for verification with a plurality of registered face information, which is information related to face images of a plurality of different persons, to calculate respective verification scores indicating the similarity of the face information. When a verification score equal to or higher than a predetermined threshold is calculated in the first verification process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal. The registration operation screen includes alert information indicating that the user's face information has already been registered. When a registration operation of the user's face information is executed on the registration operation screen, a procedure for storing the user's face information in a storage device as the registered face information is included in the configuration.

[0035] According to this, when the verification score between the user's face information and the past registered face information is equal to or higher than a predetermined threshold, the user is caused to execute a registration operation of the face information, so that it is possible to easily prevent double registration of the user's face information used for face authentication.

[0036] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0037] (First Embodiment) FIG. 1 is an overall configuration diagram of a face authentication system 1 according to a first embodiment of the present disclosure. FIG. 2 is a functional block diagram of the face authentication server 2 shown in FIG. 1. FIG. 3 is an explanatory diagram showing an example of the registered user DB 31 shown in FIG. 2. FIG. 4 is an explanatory diagram showing an example of the verification threshold DB 32 shown in FIG. 2. FIG. 5 is a functional block diagram of the user terminal 3 shown in FIG. 1.

[0038] As shown in FIG. 1, the face authentication system 1 includes a face authentication server 2 operated by an operator who provides a face authentication service. Further, the face authentication system 1 may include a plurality of user terminals 3 each used by a plurality of users who are authentication subjects of the face authentication service.

[0039] The face authentication server 2 and each user terminal 3 can communicate with each other via a known communication network 5 such as the Internet. However, the face authentication server 2 and each user terminal 3 may transmit and receive necessary information and data to and from each other via other information processing apparatuses (i.e., indirectly) not shown in the drawings.

[0040] The face authentication server 2 is composed of a computer for executing processes necessary to provide a face authentication service. The face authentication server 2 can execute information processing (hereinafter referred to as face registration processing) for registering face information of a user (i.e., information regarding a face image) used for face authentication in a database. Further, the face authentication server 2 can execute information processing (hereinafter referred to as face authentication processing) for authenticating a face image of a user to be authenticated based on the face information of a plurality of persons (i.e., a plurality of users who have registered face information) registered in the database.

[0041] As shown in FIG. 2, the face authentication server 2 includes a communication unit 11 (an example of a communication device), a control unit 12 (an example of a processor), and a storage unit 13 (an example of a storage device).

[0042] The communication unit 11 performs wireless communication or wired communication with other devices (here, the user terminal 3, etc.) via the communication network 5 in accordance with a known communication protocol.

[0043] In the control unit 12, the image acquisition unit 21 acquires a captured image including the face of the user from the user terminal 3 when the user registers his / her own face information in the face registration process. Further, the image acquisition unit 21 can acquire a captured image including the face of the user from the user terminal 3 when the user performs his / her own face authentication in the face authentication process.

[0044] The face detection unit 22 detects the face of a person from the captured image acquired from the user terminal 3, and extracts the region of the detected face, thereby acquiring the face image of the user.

[0045] The feature quantity generation unit 23 acquires the face feature quantity of the user by detecting face feature points from the acquired face image of the user.

[0046] In the face registration process, the face registration unit 24 can store the acquired face feature quantity of the user (an example of face information for verification) in the storage unit 13 together with the corresponding face image and the related information of the user (that is, register it in the registered user DB 31).

[0047] Although details will be described later, the face registration unit 24 can determine the possibility of duplicate registration of the user's face information (that is, whether the user's face is similar to the face of a registered person) in the face registration process. As a result, when the face registration unit 24 determines that there is a possibility of duplicate registration of the face information, it can let the user to be registered judge whether to register the face information, and execute the registration only when the user requests registration. Also, when the face registration unit 24 determines that there is such a possibility of duplicate registration, it can add a predetermined flag to the information of the user to be registered and the face information of a person similar thereto.

[0048] As shown in FIG. 3, the registered user DB 31 is a database including the face information and related information of a plurality of registered users (that is, a plurality of persons). The face information of each user includes the face image of the user and the face feature quantity obtained from the face image. However, in the face authentication system 1, either the face image or the face feature quantity may be used as the face information of each user. The related information of each user includes a user ID (identifier), the registration date and time in the registered user DB 31, information on the registration site (for example, URL), and the user's name, gender, date of birth, age, nickname, and telephone number. The information on the registration site includes information on the site that triggered the user to register the face information. In other words, it includes information on the site where the user wishes to use the face authentication service (for example, a shopping site).

[0049] However, in the registered user DB 31, information that can easily identify an individual user (here, the user's name and phone number) may be omitted. For example, each user's face information may be associated only with information that cannot identify the individual user (information of the registration site and nickname).

[0050] In the face authentication process, the face authentication unit 25 determines whether the user is a legitimate registrant by comparing the face information of the user to be authenticated with the face information of the person stored in the storage unit 13 (i.e., registered in the registered user DB 31).

[0051] Although details will be described later, the face authentication unit 25 can correct the collation threshold used in the collation process of face information (here, face feature amounts) in the face authentication process. In particular, the face authentication unit 25 can correct the collation threshold based on the result of the collation process of face information in the face registration process.

[0052] The GUI control unit 26 causes various GUI (Graphical User Interface) screens to be transmitted to the user terminal 3, thereby displaying those GUI screens on the display of the user terminal 3. Also, the GUI control unit 26 can acquire input information based on the user's input operations on each GUI screen. Furthermore, the GUI control unit 26 can control the display of the GUI screen based on the input information of the user.

[0053] The storage unit 13 stores a collation threshold DB 32. As shown in FIG. 4, the collation threshold DB 32 is a database including information on the collation threshold for the collation score calculated in the collation of face information for each user (i.e., registered person) registered in the registered user DB 31. The collation score indicates the similarity of the two pieces of face information to be collated. Also, the collation threshold is used to determine whether the face information to be collated is similar to each other.

[0054] For example, in face authentication processing, when the matching score between the face information of the user to be matched and the face information of a person already registered in the registered user DB 31 is equal to or higher than the matching threshold set for that person, it is determined that the face information of the user to be matched is similar to the face information of the registered person (or the face images of both are similar to each other). On the other hand, in face authentication processing, when the matching score is less than the matching threshold, it is determined that the face information of both does not resemble each other.

[0055] The computer constituting the face authentication server 2 may include known hardware such as one or more processors (CPU, MPU, etc.), memory, display, input device, network interface, and storage.

[0056] The communication unit 11 may include a communication device equipped with an antenna, communication circuit, etc.

[0057] At least a part of the functions of each of the units 21 to 26 in the control unit 12 can be realized by one or more processors executing a predetermined control program. Also, the control unit 12 can comprehensively control the operation of the face authentication server 2.

[0058] The storage unit 13 includes a storage device such as a storage for storing data and information necessary for the processing of the face authentication server 2. Note that the storage unit 13 does not necessarily have to be provided integrally with the face authentication server 2, and may be an external storage device connected to the face authentication server 2 via a network or the like.

[0059] In FIG. 1, for convenience of explanation, only one face authentication server 2 is shown. However, in the face authentication system 1, at least a part of the functions of the above-described face authentication server 2 may be realized by a plurality of computers cooperating with each other.

[0060] The user terminal 3 includes an information device having a communication function such as a smartphone, a tablet terminal, or a notebook PC carried by the user. However, as the user terminal 3, an information terminal (for example, a kiosk terminal) installed in a store or a public facility may be used.

[0061] As shown in FIG. 5, the user terminal 3 includes a communication unit 41, a photographing unit 42, an operation unit 43, a display unit 44, a control unit 45, and a storage unit 46.

[0062] The communication unit 41 has the same configuration as the above-described communication unit 11, and performs wireless communication or wired communication with other devices (here, the face authentication server 2 etc.) via the communication network 5 according to a known communication protocol. The photographing unit 42 includes a camera equipped with known hardware, and can acquire (generate) a photographed image including the user's face by photographing with the camera.

[0063] The operation unit 43 includes known input devices such as a touch panel display and input buttons that enable input operations by the user of the user terminal 3.

[0064] The display unit 44 includes a known display device such as a liquid crystal display. However, the touch panel display used as an input device may function as a display device.

[0065] The control unit 45 includes one or more processors, and by the processor executing a predetermined control program, it can execute processes related to the face authentication service used by the user (for example, processes for registering the user's face information and processes for performing the user's face authentication). Also, the control unit 45 can comprehensively control the operation of the user terminal 3.

[0066] The storage unit 46 includes a storage device such as a storage for storing data and information necessary for the processing of the user terminal 3. The storage unit 46 stores a face authentication application 51 as one of the control programs for the user terminal 3 to execute processing related to the face authentication service. The face authentication application 51 is installed in the user terminal 3 in advance.

[0067] In addition, the storage unit 46 stores user information 52 used when using the face authentication service. The user information 52 may include information about the user who uses the user terminal 3 (for example, the user's name, gender, age, nickname, and phone number), and a captured image including the user's face generated by the capturing unit 42 (that is, the capturing by the camera). At least a part of the information included in the user information 52 can be used as information for identifying the user.

[0068] However, in the user information 52, similar to the above-described registered user DB 31, information that can easily identify an individual user may be omitted. Also, the user information 52 does not necessarily need to be permanently stored in the storage unit 46, and may be temporary information input by the user on, for example, a GUI screen.

[0069] A service provider that provides an arbitrary service can, by partnering with a service provider that provides a face authentication service, allow a customer to use the face authentication system 1 when providing a predetermined service to the customer. That is, the users of the face authentication system 1 include customers of such service providers. The services provided to the users include, for example, sales of goods and tickets, use of various facilities including transportation facilities, medical examinations and treatments at hospitals, guarantee or provision of credit related to credit sales, etc., and services related to permission to log in to a specific website. The face authentication system 1 may include an information processing device that is managed by such a service provider and that collaborates with the face authentication server 2 to execute necessary processing.

[0070] Next, the face registration process executed in the face authentication system 1 according to the first embodiment will be described.

[0071] FIG. 6 is a flowchart showing the flow of face registration processing in the face authentication system 1. FIG. 7 is a sequence diagram showing an example of the operations of the face authentication server 2 and the user terminal 3 in the face registration processing. FIG. 8 is an explanatory diagram showing an example of a screen displayed on the user terminal 3 in the face registration processing.

[0072] Note that in FIGS. 6 and 7, except for step ST109, the same reference numerals (ST101 to ST108) are assigned to the corresponding processes. However, in FIG. 7, it shows the case where a matching score equal to or higher than the matching threshold is detected in step ST103 of FIG. 6 (Yes in ST103), and the case where the user executes a registration operation in step ST106 (Yes in ST106).

[0073] The user can register his / her face information in the face authentication system 1 according to the guidance of the face authentication application 51 executed on the user terminal 3.

[0074] As shown in FIGS. 6 and 7, first, the user takes a picture of his / her face with the camera provided in the user terminal 3 (ST101).

[0075] In step ST101, on the display of the user terminal 3, as shown in, for example, FIG. 8(A), a face capture screen 61 is displayed as a GUI screen for prompting the user to capture his / her face. On the face capture screen 61, the user captures his / her face within the capture area 62 and presses the capture button 63, thereby causing the user's face to be captured. Further, on the face capture screen 61, when the user presses the face image registration button 64, a face registration request including the user's face image is transmitted to the face authentication server 2.

[0076] When the face authentication server 2 receives the face registration request, it executes a matching process (an example of the first matching process) (ST102). In this matching process, information about the user's face image received from the user terminal 3 (an example of the first face information for matching) is respectively matched with the face information of a plurality of persons registered in the registered user DB 31 (an example of registered face information). In the present embodiment, the face authentication server 2 matches the face feature amount obtained from the user's face image with the face feature amounts of a plurality of persons registered in the registered user DB 31.

[0077] Also, in step ST102, the face authentication server 2 calculates a matching score indicating the degree of similarity between the user's face information and the face information of each registered person by a known method. In the present embodiment, the larger the value of the matching score, the higher the degree of similarity (that is, the higher the possibility that the user and the registered person are the same person).

[0078] Next, the face authentication server 2 compares the matching score calculated in step ST102 with the matching threshold value set for the corresponding person (see FIG. 4), and determines whether the calculated matching score is equal to or greater than the matching threshold value for each person (ST103). Therefore, when a matching score equal to or greater than the matching threshold value is calculated for any person, the face authentication server 2 extracts the relevant information of the person from the registered user DB 31 (see FIG. 3) (ST104).

[0079] Thereafter, the face authentication server 2 transmits a display command for the registration operation screen to the user terminal 3 in order to cause the user to execute the registration operation of the user's face information (that is, to cause the user to determine whether face information needs to be registered). This display command for the registration operation screen may include the relevant information of the person to be matched extracted in step ST104.

[0080] When the user terminal 3 receives the display instruction for the registration operation screen, a registration operation screen 66 is displayed on the display of the user terminal 3 as shown in, for example, FIG. 8(B) (ST105). The registration operation screen 66 includes alert information indicating the possibility of duplicate registration (i.e., the user's face information has already been registered) regarding the user's face image (or face information). On the registration operation screen 66, as alert information, a message prompting the user's attention, such as "Duplicate registration detected" and "Haven't you already registered a face image?", is displayed. Further, the alert information may include at least a part of the related information of the person to be collated extracted in step ST104 (for example, a message such as "Have you never registered face information with the nickname ○○?") so that the user can easily recall duplicate registration. In the present embodiment, the registration operation screen 66 is configured to be smaller in size than the face capture screen 61 and is pop-up displayed so as to overlap the face capture screen 61. Further, the registration operation screen 66 may be displayed instead of the face capture screen 61.

[0081] On the registration operation screen 66, when the user presses the image registration button 67 (that is, the user executes a registration operation for face information) (ST106, but Yes in ST106 in FIG. 6), the user terminal 3 sends a registration command to the face authentication server 2 in order to register the face information of the user in the registered user DB 31. Note that, on the registration operation screen 66, when the user presses the cancel button 68 (No in ST106 shown in FIG. 6), the face registration process ends without registering the user's face information. For example, the user can press the cancel button 68 when recalling that they have registered their own face information in the past.

[0082] When the face authentication server 2 receives the registration command, it registers the face information of the user to be registered in the registered user DB 31 (ST107). At this time, even if the face information of a person similar to the face information of the newly registered user is already registered, the face information of the user is registered (forced registration) after the user's own judgment (that is, the execution of the registration operation in step ST106). Subsequently, the face authentication server 2 transmits a display command for the registration completion screen to the user terminal 3 in order to notify the user of the completion of the registration of the user's face information.

[0083] When the user terminal 3 receives the display command for the registration completion screen, it displays the registration completion screen 71 on the display as shown in, for example, FIG. 8(C) (ST108). On the registration completion screen 71, when the user presses the OK button 69, the face registration process ends.

[0084] On the other hand, when the face authentication server 2 does not calculate a matching score equal to or higher than the matching threshold in the matching process (No in step ST103 shown in FIG. 6), since there is no (or little) possibility of duplicate registration, it registers the user's face information in the registered user DB 31 (normal registration) (ST109). Thereby, the face registration process ends.

[0085] Note that the face authentication server 2 may be configured to perform only the face registration process (that is, function as a face registration server). In that case, the registered face information obtained by the face registration process (that is, the information registered in the registered user DB 31) is used by another information processing device capable of executing the face authentication process.

[0086] In the above example of the face registration process, even if the face information of a person similar to the face information of the user (here, the face image or face feature amount) is already registered in the registered user DB 31, if the user executes a registration operation, the face information of that user can be forcibly registered as it is.

[0087] However, as shown below, when face information similar to the user's face information has already been registered, the face authentication server 2 may be configured to request the user to re-take a picture of the face.

[0088] As described above, in the face authentication system 1, when the matching score between the face information of the user to be registered and the face information of any person in the registered user DB 31 (that is, the registered face information registered in the past) is equal to or higher than the matching threshold, the user is made to execute a registration operation of the face information (that is, the user is made to determine whether or not to register the face information). As a result, in the face authentication system 1, it is possible to easily prevent duplicate registration of the face information of the user used for face authentication.

[0089] FIG. 9 is a flowchart showing a modified example of the flow of the face registration process shown in FIG. 6. FIG. 10 is a sequence diagram showing a modified example of an example of the operations of the face authentication server 2 and the user terminal 3 shown in FIG. 7. FIG. 11 is an explanatory diagram showing a display example of a screen displayed on the user terminal 3 in the face registration process according to the modified example. Note that FIG. 10 shows the case where all the matching scores calculated in step ST106c are less than the matching threshold.

[0090] In the modified example shown in FIGS. 9 and 10, after the user executes a registration operation of face information in step ST106, re-picture taking (ST106a), second matching processing (ST106b), and determination of the calculated matching score (ST106c) are executed.

[0091] More specifically, when the face authentication server 2 receives a registration command for the user's face information after step ST106, the face authentication server 2 transmits a re-picture taking request to the user terminal 3 (see FIG. 10).

[0092] When the user terminal 3 receives the re - shooting request, for example, as shown in FIG. 11, in order to let the user re - shoot the face, it displays a re - shooting screen 81 on the display (ST108). On the re - shooting screen 81, a message for prompting the user to re - shoot is displayed, such as "Please re - shoot your face." In this embodiment, the re - shooting screen 81 is configured to be smaller in size than the face - shooting screen 61 and is pop - up displayed so as to overlap the face - shooting screen 61, similar to the above - mentioned registration operation screen 66.

[0093] In response to the message on the re - shooting screen 81, the user can execute re - shooting of the user's face on the face - shooting screen 61 (see FIG. 8(A)) in the same manner as in step ST101 (ST106a). Further, when the user presses the face image registration button 64, the user's face image generated by re - shooting is transmitted to the face authentication server 2.

[0094] When the face authentication server 2 receives the re - shot user's face image, it executes a second matching process (an example of the second matching process) based on the re - shot face image in the same manner as the matching process in step ST102 (ST106b). In this matching process, information about the re - shot user's face image (an example of the second face information for matching) is respectively matched with the face information of a plurality of persons registered in the registered user DB31 (an example of the registered face information).

[0095] The face authentication server 2 compares the matching score calculated in step ST106b with the matching threshold set for each person to be matched (see FIG. 4) to determine whether the calculated matching score is equal to or greater than the matching threshold for each. Therefore, when the face authentication server 2 does not calculate a matching score equal to or greater than the matching threshold in the matching process for each person (ST106c), it registers the face information of the target user in the registered user DB31 (ST107).

[0096] On the other hand, when a matching score equal to or higher than the matching threshold is calculated in any of the matching processes for each person in step ST106c (Yes in step ST106c shown in FIG. 9), the face authentication server 2 can request the user to re-take a photo in step ST106a again.

[0097] According to such a modification of the face registration process, by using the information on the re-taken face image of the user as registered face information through the matching process again, it is possible to reduce the similarity between the face information of the newly registered user and the face information of the existing person. As a result, the accuracy of the user's face authentication process can be improved.

[0098] (Second Embodiment) Next, with reference to FIGS. 12 to 16, the face authentication system 1 according to the second embodiment of the present disclosure will be described. Regarding the face authentication system 1 according to the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals and detailed description thereof will be omitted. Also, regarding the face authentication system 1 according to the second embodiment, matters not particularly mentioned below are the same as those in the first embodiment.

[0099] FIG. 12 is a flowchart showing the flow of the face registration process in the face authentication system 1 according to the second embodiment. FIG. 13 is a sequence diagram showing an example of the operations of the face authentication server 2 and the user terminal 3 in the face registration process. FIG. 14 is an explanatory diagram showing an example of the registered user database.

[0100] In addition, in FIGS. 12 and 13, except for step ST210, the same reference numerals (ST201 to ST209) are assigned to the corresponding processes. However, in FIG. 13, a case is shown where a matching score equal to or higher than the matching threshold is detected in step ST203 of FIG. 12 and the user executes a registration operation in step ST206.

[0101] As shown in FIGS. 12 and 13, in the face registration process according to the second embodiment, steps ST201 to 206 similar to steps ST101 to ST106 shown in FIGS. 6 and 7 are executed respectively.

[0102] Subsequently, when the face authentication server 2 receives a registration command from the user terminal 3, it adds a flag (hereinafter referred to as a multi-match flag) indicating that there is other similar face information to the target of the matching process in step ST202 (ST207). More specifically, the multi-match flag is added to the face information of the user to be registered (i.e., newly stored in the storage unit 13) and the face information of the person for whom a score equal to or higher than the matching threshold is calculated in step ST203. In the present embodiment, the multi-match flag is set to "1" (i.e., ON) when there is other similar face information, and set to "0" (i.e., OFF) when there is no other similar face information.

[0103] For example, in step ST203, a case where it is determined that the matching score is equal to or higher than the matching threshold for the face information of person AAA (i.e., the person with user ID "AAA") in the registered user DB 31 will be described. In this case, as shown in FIG. 14, the multi-match flag of person AAA in the registered user DB 31 is set to "1" (i.e., changed from "0" to "1").

[0104] Thereafter, the face authentication server 2 registers the face information of the user to be registered in the registered user DB 31 in the same manner as in step ST107 shown in FIGS. 6 and 7 (ST208). At this time, the multi-match flag of the user face information newly registered in the registered user DB 31 is set to "1" in the same manner as person AAA shown in FIG. 14.

[0105] In step ST203, when it is determined that the matching scores for the face information of multiple persons in the registered user DB31 are equal to or higher than the matching threshold, the multi-match flags for those multiple persons are set to "1". However, when it is determined that the matching scores for the face information of multiple persons are equal to or higher than the matching threshold, the multi-match flag may be added only to the face information of the person for whom the highest matching score is calculated among the face information of those multiple persons. Thereby, the multi-match flag can be appropriately added to the face information of a person (that is, it is possible to prevent the multi-match flag from being excessively added).

[0106] Thereafter, in the face registration process according to the second embodiment, steps ST209 and ST210, which are the same as steps ST108 and ST109 shown in FIGS. 6 and 7, are respectively executed.

[0107] Next, the face authentication process executed by the face authentication system 1 according to the second embodiment will be described.

[0108] FIG. 15 is a flowchart showing the flow of the face authentication process in the face authentication system 1 according to the second embodiment. FIG. 16 is a sequence diagram showing an example of the operations of the face authentication server 2 and the user terminal 3 in the face authentication process.

[0109] In FIGS. 15 and 16, the same reference numerals (ST301 to ST308) are assigned to the corresponding processes. However, in FIG. 16, the case where the matching fails in step ST303 of FIG. 15, the multi-match flag exists in step ST304, and the final matching is successful in step ST307 is shown.

[0110] As described above, a user who has registered their own face information can use the face authentication service provided by the face authentication system 1 according to the guidance of the face authentication application 51 executed on the user terminal 3.

[0111] As shown in FIGS. 15 and 16, first, the user captures an image of his / her own face using the camera provided in the user terminal 3 (ST301).

[0112] In step ST301, for example, a screen similar to the above-described face capture screen 61 (see FIG. 8(A)) is displayed, and on this screen, the user can execute face capture. Therefore, by performing an operation for requesting face authentication, a face authentication request including the user's face image is transmitted to the face authentication server 2.

[0113] When the face authentication server 2 receives the face registration request, it executes a collation process (ST302). In this collation process, information regarding the user's face image received from the user terminal 3 is collated with the face information of a plurality of persons registered in the registered user DB 31, respectively. In the present embodiment, the face authentication server 2 performs collation using face feature amounts in the same manner as the above-described face registration process.

[0114] Next, the face authentication server 2 determines whether or not the collation process has failed. For example, when there are a plurality of pieces of face information of persons whose collation scores calculated in step ST302 are equal to or higher than the collation threshold value in the registered user DB 31, the face authentication server 2 determines that the collation process has failed (that is, the face authentication process has not been normally performed) (ST303). When the collation process has failed (Yes in ST303 in FIG. 15), the face authentication server 2 further determines whether or not a multi-match flag is added to the face information of the person for whom the collation process has failed (ST304).

[0115] Therefore, when a multi-match flag is added to the face information of a person (Yes in ST304 in FIG. 15), the face authentication server 2 corrects the collation score regarding that person (ST305). For example, the face authentication server 2 can correct it so as to increase the collation threshold value by adding a predetermined value to the current collation threshold value (see FIG. 4) set for the target person.

[0116] After that, the face authentication server 2 executes re-verification processing using the corrected verification threshold (ST306). At this time, the same verification processing as in step ST302 is executed again. Therefore, when there are not multiple pieces of face information of persons with a verification score equal to or higher than the verification threshold in the registered user DB31 for the verification score calculated in step ST306, the face authentication server 2 determines that the re-verification processing has succeeded (ST307, although it is Yes in ST307 in FIG. 15). Subsequently, the face authentication server 2 transmits a display command for the face authentication completion screen to the user terminal 3 in order to notify the user of the completion of the user's face authentication.

[0117] When the user terminal 3 receives the display command for the face authentication completion screen, it displays a face authentication completion screen indicating that the face authentication has been successfully completed on the display for the user (ST308). By the user confirming this face authentication completion screen, the face authentication process ends.

[0118] As another method, when the re-verification processing in step ST307 fails (No in ST307 in FIG. 15), it is also possible to return to step ST305 and re-correct the verification score. In this case, the face authentication server 2 can increment the verification score by repeating the correction of the verification score in step ST305.

[0119] As described above, according to the face authentication system 1 according to the second embodiment, even when there is face information of another person similar to the face image of the user to be registered in the registered user DB31, the face information of the user and the face information of other persons can be easily identified by the multi-match flag indicating that there is other similar face information. Also, in the face verification process, when the multi-match flag is added to the face information of the person to be verified, the verification score of the person is corrected, so it is possible to avoid the failure of the verification process caused by the existence of multiple pieces of face information of persons with a verification score equal to or higher than the verification threshold.

[0120] (Third Embodiment) Next, with reference to FIGS. 17 to 19, the face recognition system 1 according to the third embodiment of the present disclosure will be described. Regarding the face recognition system 1 according to the third embodiment, the same components as those in the first or second embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted. Also, regarding the face recognition system 1 according to the third embodiment, matters not particularly mentioned below are the same as those in the first or second embodiment.

[0121] FIG. 17 is a flowchart showing the flow of face registration processing in the face recognition system 1 according to the third embodiment. FIG. 18 is a sequence diagram showing an example of the operations of the face recognition server 2 and the user terminal 3 in the face registration processing. FIG. 19 is an explanatory diagram showing an example of the registered user database. FIG. 20 is an explanatory diagram showing an example of the collation score database.

[0122] As shown in FIGS. 17 and 18, in the face registration processing according to the third embodiment, steps ST401 to 406 similar to steps ST201 to ST206 shown in FIGS. 12 and 13 are executed.

[0123] Subsequently, when the face recognition server 2 receives a registration command from the user terminal 3, it calculates the difference (or the absolute value of the difference) between the collation score calculated for the face information of the person to be collated in step ST402 and the corresponding collation threshold, and adds a value larger than the difference to the collation threshold to register the corrected value of the collation threshold in the registered user DB 31 (ST407).

[0124] For example, for the face information of person AAA for whom a collation score equal to or higher than the collation threshold is calculated in step ST402, the case where it is determined in step ST407 that the difference between the collation score and the collation threshold is 59 will be described. In this case, as shown in FIG. 19, the corrected value of the collation threshold for person AAA in the registered user DB 31 is 60 obtained by adding 1 to the difference of 59. When the face collation process is executed, the collation threshold is corrected by adding the corrected value to the current collation threshold (see FIG. 4).

[0125] After that, similar to steps ST208 shown in FIGS. 12 and 13, the face authentication server 2 registers the face information of the user to be registered in the registered user DB 31 (ST408).

[0126] After that, in the face registration process according to the third embodiment, steps ST409 and ST410, which are similar to steps ST209 and ST210 shown in FIGS. 12 and 13 respectively, are executed respectively.

[0127] Next, the face authentication process executed in the face authentication system 1 according to the third embodiment will be described.

[0128] In the face registration process according to the third embodiment, steps substantially similar to steps ST301 to ST308 shown in FIGS. 15 and 16 are executed. However, in the face registration process according to the third embodiment, the correction of the matching score in step ST305 is based on the difference between the matching score calculated in step ST407 (see FIGS. 17 and 18) and the matching threshold (more precisely, a value larger than that difference (see the corrected value of the matching threshold for person AAA in FIG. 19) is added).

[0129] Thus, according to the face authentication system 1 according to the third embodiment, it is possible to appropriately correct the matching threshold in the face authentication process based on the difference between the matching score and the matching threshold. As a result, in the face authentication system 1, the accuracy of the user's face authentication process can be improved.

[0130] (Fourth Embodiment) Next, with reference to FIGS. 20 to 22, the face authentication system 1 according to the fourth embodiment of the present disclosure will be described. Regarding the face authentication system 1 according to the fourth embodiment, for the components similar to those in any of the first to third embodiments, the corresponding components are denoted by the same reference numerals and detailed descriptions thereof are omitted. Also, for the matters not particularly mentioned below regarding the face authentication system 1 according to the fourth embodiment, the same shall apply as in any of the first to third embodiments.

[0131] In FIGS. 20 and 21, except for steps ST506, ST512, and ST513, the same reference numerals (ST501 to ST505, ST507 to ST511) are assigned to the corresponding processes. However, in FIG. 21, a matching score equal to or higher than the matching threshold is detected in step ST503 of FIG. 20 (Yes in ST503), a registration operation by the user is not executed in step ST506 (No in ST506), an update operation by the user is executed in step ST507 (Yes in ST507), and the case where the user ID is valid in step ST509 (Yes in ST509) is shown. Also, the screens shown in (B1) and (B2) of FIG. 22 are displayed instead of the screen shown in (B) of FIG. 8.

[0132] For example, in the face authentication system 1 according to the above-described first embodiment, face registration processing is mainly assumed when each user who is an authenticator of the face authentication service does not recognize duplicate registration of his or her own face information (see steps ST106 to ST107 in FIG. 6, etc.). In contrast, the face authentication system 1 according to the fourth embodiment can also handle updates to the user's face information.

[0133] As shown in FIGS. 20 and 21, in the face registration processing according to the fourth embodiment, steps ST501 to 506 similar to steps ST101 to ST106 shown in FIGS. 6 and 7 are executed.

[0134] When the user terminal 3 receives a display command for the registration operation screen from the face authentication server 2 in step ST505, a registration / update operation screen 166 (an example of an update operation screen) is displayed on the display of the user terminal 3, for example, as shown in FIG. 22(B1). In this embodiment, the registration / update operation screen 166 is configured to be smaller in size than the face capture screen 61 and is pop-up displayed so as to overlap the face capture screen 61, similar to the above-described registration operation screen 66.

[0135] The registration / update operation screen 166 includes alert information indicating the possibility of duplicate registration, similar to the registration operation screen 66 shown in FIG. 8(B) above. Also, the registration / update operation screen 166 includes an image registration button 167 for the user to perform a registration operation of face information, similar to the above-described image registration button 67. On the other hand, different from the above-described registration operation screen 66, the registration / update operation screen 166 includes an image update button 168 for the user to perform an update operation of face information.

[0136] On the registration / update operation screen 166, the user can press the image update button 168 to perform an update operation of face information (No in ST506 and Yes in ST507). Thereby, on the display of the user terminal 3, for example, as shown in FIG. 22(B2), a user ID input screen 171 (an example of an input operation screen for allowing the user to input information for identifying the user) for allowing the user to input a user ID is displayed. In the present embodiment, the user ID input screen 171 is configured to be smaller in size than the face capture screen 61 and is pop-up displayed so as to overlap the face capture screen 61, similar to the above-described registration / update operation screen 166.

[0137] Therefore, when the user inputs his / her ID in the ID input field 172 on the user ID input screen 171 and then presses the OK button 173 (ST508), the user terminal 3 sends a confirmation request for the input user ID (hereinafter referred to as the ID to be confirmed) to the face authentication server 2. At this time, the information of the ID to be confirmed is also sent to the face authentication server 2. Note that the user can cancel the input of the user ID by pressing the cancel button 174 on the user ID input screen 171.

[0138] When the face authentication server 2 receives a user ID confirmation request from the user terminal 3, it executes a process for confirming the validity of the ID to be confirmed (hereinafter referred to as ID confirmation process) (ST509). In the ID confirmation process, the face authentication server 2 determines whether there is a user ID that matches the ID to be confirmed among the user IDs related to one or more persons for whom a matching score equal to or higher than the matching threshold value was calculated in step ST503. At this time, the face authentication server 2 can determine whether each user ID associated with the face information of one or more persons for whom a matching score equal to or higher than the matching threshold value was calculated matches the ID to be confirmed, by referring to the registered user DB 31 (see FIG. 3).

[0139] Therefore, when there is a user ID that matches the ID to be confirmed, the face authentication server 2 determines that the ID to be confirmed is valid (Yes in ST509), and updates the face information associated with the ID to be confirmed (that is, the face information of the user for whom the user ID is determined to be valid) (ST510). At this time, the face information registered in the registered user DB 31 for the target user is replaced with the new face information obtained based on the face photographing in step ST501 (that is, stored in the storage unit 13). Subsequently, the face authentication server 2 transmits a display instruction for the registration completion screen to the user terminal 3 in order to notify the user of the completion of the registration (including update) of the user's face information (ST511).

[0140] On the other hand, if the face authentication server 2 determines that there is no user ID that matches the ID to be confirmed (No in ST509), it determines that the ID to be confirmed is invalid, and the process of updating the face information ends. However, when the face authentication server 2 determines that the ID to be confirmed is invalid (No in ST509), it may request the user terminal 3 to re-enter the user ID. At this time, a screen (including a message, etc.) that prompts the user to re-enter the user ID is displayed on the display of the user terminal 3. After that, when the user re-enters the user ID, the same processing as described above is executed again for the re-entered user ID (i.e., the new ID to be confirmed). This can avoid the situation where the process of updating the face information is immediately aborted when the user accidentally enters an incorrect user ID temporarily.

[0141] In addition, on the registration / update operation screen 166, when the user presses the cancel button 169 (No in ST507), the process ends without updating the user's face information.

[0142] Also, on the registration / update operation screen 166, when the user presses the image registration button 167 instead of the above-mentioned image update button 168 (Yes in ST506), similar to step ST107 shown in FIG. 6, the face authentication server 2 registers the face information of the user to be registered in the registered user DB 31 (ST512).

[0143] Further, when the face authentication server 2 fails to calculate a matching score equal to or higher than the matching threshold in the matching process (No in ST503), similar to step ST109 shown in FIG. 6, the face authentication server 2 registers the user's face information in the registered user DB 31 (ST513).

[0144] Also, FIG. 22(B) shows an example of the registration / update operation screen 166 that allows the user to selectively execute the registration and update of face information. However, on the user terminal 3, a screen for the user to execute the face information registration operation or update operation may be individually displayed. Further, in the present embodiment, based on the validity of the user ID input as information for identifying the user, a configuration is adopted to determine whether face information can be updated. However, instead of the user ID, for example, other information included in the above-described user information 52 may be used.

[0145] As described above, according to the face authentication system 1 according to the fourth embodiment, when the user desires to update their face information after understanding that their face information has already been registered, the system can appropriately respond to the user's request.

[0146] As described above, embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments with changes, replacements, additions, omissions, etc. Further, it is also possible to combine the respective components described in the above embodiments to form a new embodiment.

Industrial Applicability

[0147] The face authentication server, face authentication system, face authentication method, and face authentication program according to the present disclosure can prevent duplicate registration of the user's face information used for face authentication, and are useful as a face authentication server, face authentication system, face authentication method, face authentication program, etc. for registering the user's face information used for face authentication.

Explanation of Reference Numerals

[0148] 1: Face authentication system 2: Face authentication server 3: User terminal 5: Communication network 11: Communication unit 12: Control unit 13: Storage unit 21: Image acquisition unit 22: Face detection unit 23: Feature Quantity Generation Unit 24: Face Registration Unit 25: Face Authentication Unit 26: GUI Control Unit 41: Communication Unit 42: Photographing Unit 43: Operation Unit 44: Display Unit 45: Control Unit 46: Memory Unit 51: Face Authentication Application 52: User Information 61: Face Photographing Screen 62: Photographing Area 63: Photographing Button 64: Face Image Registration Button 66: Registration Operation Screen 67: Image Registration Button 68: Cancel Button 69: OK Button 71: Registration Completion Screen 81: Retake Screen 166: Update Operation Screen 167: Image Registration Button 168: Image Update Button 169: Cancel Button 171: User ID Input Screen 172: ID Input Field 173: OK Button 174: Cancel Button

Claims

1. A face authentication server that registers information about a face image of a user as face information for face authentication, A processor that executes a face registration process for registering face information of the user; a storage device that stores information about face images of a plurality of different people that have been registered in the past as registered face information; a communication device for communicating with a user terminal used by the user; Equipped with The processor, in the face registration process, Acquire face information of the user from the user terminal as first face information for matching; A first matching process is executed to match the first face information for matching with a plurality of registered face information, thereby calculating a matching score indicating a similarity of the face information; when a matching score equal to or greater than a predetermined threshold is calculated in the first matching process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal, the registration operation screen including alert information indicating that the user's face information has been registered; a face authentication server that stores the face information of the user in the storage device as the registered face information when a registration operation of the face information of the user is performed on the registration operation screen;

2. The processor, When a registration operation of face information of the user is performed on the registration operation screen, a re-photographing screen for allowing the user to re-photograph a face image is displayed on the user terminal; When a face image of the user is re-captured, information on the re-captured face image of the user is acquired from the user terminal as second face information for matching; A second matching process is executed to match the second face information for matching with a plurality of the registered face information, thereby calculating a second matching score indicating a similarity of the face information; 2. The face recognition server according to claim 1, wherein if a matching score equal to or greater than the threshold is not calculated in the second matching process, information relating to the re-captured face image of the user is stored in the storage device as the registered face information.

3. The processor, 2. The face recognition server according to claim 1, wherein, when a registration operation for the user's face information is executed on the registration operation screen, a flag indicating that similar face information exists is added to the user's face information newly stored in the storage device as the registered face information and to the registered face information stored in the storage device and for which a matching score equal to or greater than the threshold is calculated in the first matching process.

4. 4. The face recognition server according to claim 3, wherein the processor adds the flag only to the registered face information for which the highest matching score is calculated, among the registered face information for which a matching score equal to or higher than the threshold is calculated in the first matching process.

5. The processor, A face authentication process is executed for the user, and in the face authentication process, calculating the matching score indicating a similarity of the facial information by comparing information about the facial image of the user generated by photographing the user with the registered facial information stored in the storage device; if a matching score equal to or greater than the threshold is calculated for a plurality of pieces of registered face information in the calculation of the matching score, and thus the face authentication process is not performed normally, determining whether or not the flag has been added to the registered face information for which the matching score equal to or greater than the threshold has been calculated; 5. The face authentication server according to claim 3, further comprising: a correction unit that increases the threshold value for the registered face information to which the flag has been added when it is determined that the flag has been added to the registered face information.

6. The processor, 6. The face recognition server according to claim 5, wherein when it is determined that the flag has been added to the registered face information, a difference between the matching score for the registered face information and the threshold is obtained, and in the correction of the threshold, a value greater than the difference is added to the threshold.

7. The processor, When a matching score equal to or greater than a predetermined threshold is calculated in the first matching process, an update operation screen is displayed on the user terminal to allow the user to perform an update operation of the user's face information; When an update operation of the face information of the user is performed on the update operation screen, an input operation screen for allowing the user to input information for identifying the user is displayed on the user terminal; When the information for identifying the user input from the input operation screen matches the information for identifying the user associated with the registered face information corresponding to the matching score equal to or greater than the predetermined threshold, The face authentication server according to claim 1 , wherein the face information of the user is stored in the storage device as the registered face information.

8. A face authentication system that registers information about a face image of a user as face information for face authentication, A user terminal used by the user; A face authentication server that executes a face registration process for registering face information of the user; a storage device that stores information about face images of a plurality of different people that have been registered in the past as registered face information; a communication device for communicating with a user terminal used by the user; Equipped with The face authentication server, in the face registration process, Acquire face information of the user from the user terminal as first face information for matching; A first matching process is executed to match the first face information for matching with a plurality of registered face information, thereby calculating a matching score indicating a similarity of the face information; when a matching score equal to or greater than a predetermined threshold is calculated in the first matching process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal, the registration operation screen including alert information indicating that the user's face information has been registered; A face authentication system that stores the user's face information as the registered face information in the storage device when a registration operation of the user's face information is performed on the registration operation screen.

9. A face authentication method using a face authentication server that registers information about a face image of a user as face information for face authentication, comprising: acquiring face information of the user from a user terminal used by the user as first face information for matching; A first matching process is executed to match the first face information for matching with a plurality of registered face information, which is information on face images of a plurality of different persons, thereby calculating a matching score indicating a similarity of the face information; when a matching score equal to or greater than a predetermined threshold is calculated in the first matching process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal, the registration operation screen including alert information indicating that the user's face information has been registered; The face authentication method further comprises storing the user's face information as the registered face information in a storage device when a registration operation of the user's face information is performed on the registration operation screen.

10. A face recognition program that causes a computer to execute information processing for registering information about a face image of a user as face information for face recognition, The information processing includes: acquiring face information of the user from a user terminal used by the user as first face information for matching; A first matching process is executed to match the first face information for matching with a plurality of registered face information, which is information on face images of a plurality of different persons, thereby calculating a matching score indicating a similarity of the face information, when a matching score equal to or greater than a predetermined threshold is calculated in the first matching process, a registration operation screen for causing the user to execute a registration operation of the user's face information is displayed on the user terminal, the registration operation screen including alert information indicating that the user's face information has been registered; A face recognition program including a procedure for storing the user's face information as the registered face information in a storage device when a registration operation of the user's face information is performed on the registration operation screen.

Images