Face authentication system

Abstract

Provided is a face recognition system that does not require management by a management company or the like and can be safely started or the user can be changed only by the residents. 【Solution means】A face registration means for registering face data which is a face image of a user or its processed data, a photographing device installed in an apartment house, a resident registration means for registering the user as a resident of the apartment house, an authentication means for collating the face photographed by the photographing device with the face data of the resident, and a security token which is a physical object delivered to a resident of the apartment house and is a device, instrument, or electronic medium for proving that the user is a resident of the apartment house. The face recognition system solves this problem by requiring that the user performing the registration operation holds the security token at the time of resident registration.

Description

Technical Field

[0001] The present invention relates to a face recognition system.

Background Art

[0002] Due to the recent penetration of DX (Digital Transformation), the application range of face recognition technology is expanding. The main advantages of face recognition are the improvement of convenience and security in the authentication process. Face recognition, which is a biometric authentication, does not require memorizing a password or carrying an item, unlike knowledge authentication or possession authentication. And the shapes of people's faces are very diverse, making it difficult for others to imitate. Also, since it can be used without contact, it is excellent in terms of hygiene and is particularly effective as a measure against infectious diseases. Furthermore, technologies for dealing with changes in environmental illuminance and age have reached a practical level, ensuring stable authentication accuracy. Due to these characteristics, face recognition is expected to be applied in various fields.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The above Patent Document 1 discloses a face recognition system for condominiums. The face recognition system of Patent Document 1 is designed such that, on the premise that each household in the condominium is a rental property, the PM (resident management operator) performs management operations such as the entry and departure of residents.

[0005] On the other hand, for example, in the case of a condominium where a management association composed of the owners of each household manages the building and assets on its own or determines an outsourced management company, the management entity and the attribution of responsibility of the face recognition system become ambiguous.

[0006] In view of such problems, an object of the present invention is to provide a face recognition system that does not require management by a management company or the like and that can be safely started or the user changed by only the resident.

Means for Solving the Problems

[0007] To solve the above problems, a face recognition system according to the present invention includes a face registration means for registering face data that is a face image of a user or processed data thereof, a photographing device installed in a house, a resident registration means for registering the user as a resident of the house, an authentication means for comparing the face photographed by the photographing device with the face data of the resident, and a security token that is a physical object delivered to a resident of the house and is a device, instrument, or electronic medium for proving that the person is a resident of the house. The resident registration means requires that the user performing the registration operation possess the security token at the time of resident registration.

[0008] By the resident registration means confirming possession of the security token at the time of registration, unauthorized third-party resident registration is prevented and only legitimate users can perform registration as residents. This eliminates the need for identity verification by a management company and allows only residents to safely start using the face recognition system. Also, when changing the user of the face recognition system from the current resident to a new resident, this can be done between the parties without the intervention of the management company by transferring the security token from the current resident to the new resident.

[0009] At this time, as the security token, it is conceivable to employ a hardware token that displays a temporary password, a card or hardware with a built-in IC chip, or a peripheral device in which unique data is recorded. By using a physical object as the security token, the security level of resident registration in the face recognition system can be increased to the authentication strength of possession authentication.

[0010] Also at this time, the house is an apartment building, the photographing device is installed near the entrance door of the dwelling unit in the apartment building, the security token includes information for specifying the dwelling unit in the apartment building, and the resident registration means may register a user having the security token as a resident of the dwelling unit. By preparing a security token for each dwelling unit, each resident of each dwelling unit can independently start using the face recognition system or change the user of the face recognition system of that dwelling unit from the current resident to a new resident.

[0011] Moreover, it is desirable that the face recognition system of the present invention further includes a deregistration means by which a newly registered user as a resident of the dwelling unit can deregister the resident registration of the user account previously registered as a resident of that dwelling unit. Thereby, for example, even if a previous resident has forgotten to deregister the resident registration or for some reason cannot deregister it, the new resident can change the resident registration smoothly only by himself / herself.

[0012] Also, it is desirable that the photographing device is also installed near the entrance door of the building of the apartment building. Since the entrance door (shared entrance) of the building of the apartment building and the entrance door of the dwelling unit can be unlocked by face recognition, the resident can enter and leave the shared entrance and the dwelling unit without carrying a key or memorizing a passcode.

[0013] Moreover, it is desirable that the face recognition system of the present invention further includes a co-resident registration means by which the resident can additionally register the face data of the co-resident, and the authentication means collates the face photographed by the photographing device with the face data of the resident and the co-resident. Thereby, for example, even in a family with small children, all family members can use the face recognition system.

[0014] At this time, it is desirable that the face registration means, the resident registration means, and the co-resident registration means be provided using a user terminal, which is an information terminal owned by the resident. By providing these functions using the resident's user terminal (such as a smartphone or a PC), the usability is enhanced compared to separately preparing a dedicated device with an unclear operation method. Also, since the amount of dedicated equipment required for face authentication is reduced, the introduction cost of the face authentication system and the management burden on the resident are also reduced.

[0015] In addition, the face authentication system of the present invention may further include a resident tool, which is a user interface of the face registration means, and the resident tool may be configured to authenticate the user at the time of its login. Thereby, it becomes possible to treat being a resident of the house as one attribute of the resident's user account.

[0016] The face authentication system of the present invention also has a fixed code, which is an encoded code, a key composed of a character string, or a key composed of a numerical value, and is handed over to the resident of the house together with the security token. The fixed code is unique for each security token. The resident registration means may be configured to require the input of the fixed code in addition to the fact that the user performing the registration operation holds the security token at the time of resident registration. More specifically, the security token is a hardware token that displays a one-time password, the fixed code is an encoded code, and the resident registration means identifies the individual of the hardware token by reading the fixed code, and confirms the possession of the hardware token when the one-time password displayed on the hardware token is input. In this way, by separately preparing the fixed code, the individual of the security token can be identified by the resident registration means.

[0017] The house may be an apartment house, and more specifically, a condominium.

[0018] Further, to solve the above problems, the face recognition system of the present invention includes a face registration means for registering face data, which is a face image of a user or its processed data, a photographing device installed near the entrance door of a dwelling unit in an apartment building, an occupant registration means for registering a user as an occupant of the dwelling unit, an authentication means for comparing the face photographed by the photographing device with the face data of the occupant, and an occupant tool which is a user interface of the face registration means and the occupant registration means. The user account of the occupant tool is handed over to the occupant of the dwelling unit together with the key to the entrance door, and the user account of the occupant tool may be configured to be registered in advance for each dwelling unit of the apartment building.

[0019] By creating a user account for the occupant tool that includes a face registration means and an occupant registration means for each dwelling unit and handing over the user account to the occupant together with the key to the entrance door, only the occupant can safely start using the face recognition system. Also, when changing the user of the face recognition system from the current occupant to a new occupant, this can be done between the parties without the intervention of the management company by handing over the user account from the current occupant to the new occupant. In this case, the new occupant changes the password of the user account to a unique one after receiving the handover of the user account.

[0020] Further, to solve the above problems, the face recognition system of the present invention includes a face registration means for registering face data, which is a face image of a user or its processed data, a photographing device installed near the entrance door of a dwelling unit in an apartment building, an occupant registration means for registering a user as an occupant of the dwelling unit, an authentication means for comparing the face photographed by the photographing device with the face data of the occupant, and an occupant tool which is a user interface of the face registration means and the occupant registration means, and a manager tool which is a user interface for approving the registration operation by the occupant registration means. The user account of the occupant tool and the user account of the manager tool are different user accounts, the user account of the manager tool is handed over to the occupant of the dwelling unit together with the key to the entrance door, and the user account of the manager tool may be configured to be registered in advance for each dwelling unit of the apartment building.

[0021] Prepare a separate administrator tool for performing the approval operation of resident registration, and create user accounts for the administrator tool in advance for each household. Then, by delivering the user account together with the key to the entrance door to the resident, only the resident can safely start using the face recognition system. Also, when changing the user of the face recognition system from the current resident to a new resident, this can be done between the parties without the intervention of the management company by delivering the user account of the administrator tool from the current resident to the new resident. In this case, the new resident changes the password of the user account of the administrator tool to a unique one after the delivery.

[0022] Also, in order to solve the above problems, the face recognition system of the present invention includes a face registration means for registering face data which is a face image of a user or its processed data, a photographing device installed near the entrance door of a household in an apartment building, a resident registration means for registering the user as a resident of the household, an authentication means for collating the face photographed by the photographing device with the face data of the resident, and a resident tool which is a user interface of the face registration means. For the execution of the resident registration means, it is necessary that the execution authority of the resident registration means is granted to the user account of the resident tool, or the user account is set as the transmission destination of a temporary password issued at the time of execution of the resident registration means. The execution authority and the transmission destination of the password of the resident registration means are set for each household of the apartment building, and the resident of any one of the households may be configured to be able to transfer the setting of the execution authority or the transmission destination of the password to the user account of another person.

[0023] The execution authority of the resident registration means and the transmission destination of the password are divided for each dwelling unit, and together with the handing over of the key to the entrance door, the above-mentioned execution authority, etc. for that dwelling unit are also handed over to the resident's user account, so that only the resident can safely start using the face recognition system. Also, when changing the user of the face recognition system from the current resident to a new resident, the above-mentioned execution authority, etc. can be transferred from the current resident's user account to the new resident's user account, enabling this to be done between the parties without the intervention of the management company.

Effect of the Invention

[0024] As described above, according to the face recognition system of the present invention, it is not necessary to rely on management by a management company or the like, and only the resident can safely start using it or change the user.

Brief Description of the Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Best Mode for Carrying Out the Invention

[0026] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The face recognition system F described below is an example of the face recognition system of the present invention introduced into a condominium apartment, which is a collective housing. When a user registers himself / herself as a resident of the condominium apartment, the face recognition system F confirms by possession authentication that the person performing the registration operation is a resident of any of the households. As a result, the face recognition system F can safely start its use or change users only by the residents without the need for identity verification by a management company or the like. Hereinafter, embodiments will be described as an example for this feature of the face recognition system F and each feature associated therewith.

[0027] <System Overview> FIG. 1 is a use case diagram showing an overview of the face recognition system F of this embodiment. The face recognition system F of this embodiment mainly includes a server device 20, a user app 30 (resident tool), and an authentication device 40. The authentication device 40 of this embodiment is installed near the door of each household (front door) of the condominium apartment and near the door of the common entrance (the entrance door of the condominium apartment).

[0028] The user app 30 is a dedicated application installed on a smartphone (user terminal) owned by a resident. The user app 30 is a UI (user interface) for a resident to perform an operation of registering his / her face data in the face recognition system F or an operation of registering himself / herself as a resident of the condominium apartment. The authentication device 40 is a device that captures the face of the person facing it, compares and authenticates it with the registered face data, and unlocks the entrance door and the household door. The server device 20 is a device that communicates with the user app 30 and the authentication device 40, processes various registration requests from residents, and distributes legitimate resident face data to each authentication device 40. Note that the "resident" mentioned here may include a person scheduled to move in who is in the process of moving-in procedures.

[0029] Figure 2 is an image diagram showing an example of use of the face recognition system F. Figure 2(a) is an example of use of the authentication device 40 installed at the entrance door 19 of the condominium. Figure 2(b) is an example of use of the authentication device 40 installed at the apartment door 11 of each dwelling unit 10.

[0030] As shown in Figure 2(a), the authentication device 40a for the entrance door 19 is installed on the decorative column of the shared entrance. The resident of the condominium can open the entrance door 19 by taking a picture of their face with the camera 41 (imaging device) of the authentication device 40a. Also, as shown in Figure 2(b), the authentication device 40b for the apartment door 11 is installed adjacent to each apartment door 11. The resident of each dwelling unit 10 can unlock the apartment door 11 by taking a picture of their face with the camera 41 of the authentication device 40b. Note that a cylinder lock 111 is also provided on the apartment door 11, and the resident can also unlock the apartment door 11 with a key.

[0031] In this way, each resident of the condominium can use face recognition to unlock the entrance door 19 and the apartment door 11, so they can enter and leave the condominium and the dwelling unit 10 without, for example, carrying a key or memorizing a passcode.

[0032] <Functional Configuration> Figure 3 is an arrangement diagram showing the functional configuration of the face recognition system F. Each function of the face recognition system F will be described below with reference to Figure 3.

[0033] As shown in Figure 3, the authentication device 40 and the user app 30 of the face recognition system F are network-connected to the server device 20. In this embodiment, the authentication device 40 and the user app 30 transmit and receive data to and from the server device 20 via the Internet.

[0034] As described above, the user app 30 is a dedicated application installed on the resident's smartphone. The form of the user app 30 may be provided not only as a smartphone app but also as dedicated software installed on the resident's PC or as a web service using a web browser. The user app 30 includes a camera 31 for photographing the resident's face and an operation panel 32 for performing various operations on the face recognition system F. In the face recognition system F of this embodiment, by using the resident's smartphone for the UI of the face recognition system F, the usability is improved compared to preparing a dedicated device with an unclear operation method. In addition, since the number of dedicated devices required for using the face recognition system F is reduced, the introduction cost of the face recognition system F and the management burden on the residents are also reduced.

[0035] The server device 20 of this embodiment has a user registration program 21 (face registration means) and a user database 25, a resident registration program 22, and token data 27. Hereinafter, the resident when viewed from the system perspective of the face recognition system F will also be referred to as "user" as appropriate. The user registration program 21 is a program for registering the face image P of the user of the face recognition system F and registering the user data 26, which is the personal information and attribute information of the user, in the user database 25. The resident registration program 22 is a program for registering the user as a resident of any of the households 10 in the condominium where the face recognition system F is introduced. The token data 27 is data for confirming whether the person performing the registration operation is a legitimate resident. Specifically, the token data 27 is data such as the serial number, secret key, and one-time password of the hardware token 26 described later. The server device 20 distributes the face image P of the user registered as a resident of any of the households 10 to the authentication device 40a of the entrance door 19 and the authentication device 40b of the household door 11 of that household 10.

[0036] The server device 20 of this embodiment is a virtual server constructed using a cloud hosting service. The method of constructing the server device 20 is not limited to a cloud server, and it may be an on-premises server installed within the LAN of the operator providing the face recognition system F or within the LAN of a condominium.

[0037] Each authentication device 40 has a camera 41 for photographing the face of the person facing it and an authentication program 42 for collating and authenticating the face photographed by the camera 41 with a pre-registered face template T. The face template T mentioned here is biometric data for comparison obtained by extracting the features of the face image P distributed from the server device 20. In addition to being called a face template, it may also be called, for example, a face vector, feature quantity, face map, etc. Each authentication device 40 converts the face image P distributed from the server device 20 into the face template T using the same algorithm as the authentication program 42 and stores it. That is, the face recognition system F of this embodiment is a so-called edge type face recognition system.

[0038] The physical arrangement of each function shown in FIG. 3 is merely an example and is not limited to the configuration of this embodiment. The arrangement of these functions can be appropriately changed according to the nature, scale, number of users, budget, and other installation and operation constraints and requirements of the facility where the face recognition system F is introduced. For example, the authentication program 42 and the face template T can be provided in the server device 20 to form a cloud type face recognition system. In this case, furthermore, it is also conceivable to outsource the face collation and authentication function to an external service. Also, it is conceivable to install an operation panel 32 in the authentication device 40 and provide the UI function of the user app 30, for example, in each authentication device 40b.

[0039] <Method of delivering the property> FIG. 4 is an explanatory image diagram for explaining the handover method of the dwelling unit 10. In order for a resident to start using the face recognition system F, the resident needs to create a user account 30a of the face recognition system F and register himself / herself as a resident of any of the dwelling units 10. The resident registration program 22 of the face recognition system F in this embodiment checks whether the user performing the registration operation has a hardware token 36 (security token) when registering a resident.

[0040] When the dwelling unit 10 in this embodiment is handed over, as shown in FIG. 4(a), when the dwelling unit 10 is a newly constructed property, it is handed over from the developer to the prospective occupant (property purchaser), and when the dwelling unit 10 is a used property, it is handed over from the current resident to the new resident, together with the key 39 of the dwelling unit door 11 and the hardware token 36. The hardware token 36 is a device that displays a one-time password (temporary passcode).

[0041] The hardware token 36 is accompanied by a three-dimensional code Q (fixed code) for identifying the individual, and this three-dimensional code Q is also handed over together with the hardware token 36. Here, the three-dimensional code Q may be information that can uniquely identify the hardware token 36, that is, information unique to each hardware token 36, and may be another encoded code such as a two-dimensional code, a key consisting of a character string, or a key consisting of a numerical value.

[0042] Also, the hardware token 36 of this embodiment is prepared for each dwelling unit 10. That is, the serial number and secret key of the hardware token 36 are associated with any one dwelling unit 10. The resident registration program 22 registers the user having the hardware token 36 as a resident of the dwelling unit 10 associated with the hardware token 36. In this embodiment, since the hardware token 36 is prepared for each dwelling unit 10, the residents of each dwelling unit 10 can start using the face recognition system F individually or change the user of the face recognition system F of that dwelling unit 10 from the current resident to the new resident.

[0043] When a resident registers himself / herself as a resident of any of the households 10, the resident etc. scans the 3D code Q with the camera 31 of the user app 30 to let the resident registration program 22 recognize the individual (serial number etc.) of the hardware token 36, and then proves that he / she possesses the hardware token 36 by inputting the one-time password displayed on the hardware token 36. Thereby, the resident registration program 22 determines that the user performing the operation is a legitimate resident, and registers that user as a resident of the household 10.

[0044] As described above, in the face authentication system F of this embodiment, the resident registration program 22 checks the possession of the hardware token 36 at the time of registration, thereby preventing resident registration by an unrelated third party, and only legitimate users can register as residents of the household 10. In particular, since the hardware token 36, which is a physical object, is used, the security level of resident registration is enhanced to the authentication strength of possession authentication. This eliminates the need for identity verification by a management company etc., and only residents can safely start using the face authentication system F. Also, when changing the user of the face authentication system F from the current resident to a new resident, by transferring the 3D code Q and the hardware token 36 from the current resident to the new resident, this can be done between the parties without the intervention of a management company etc.

[0045] <Registration Process> FIG. 5 is a sequence diagram showing the process of various registration operations for the face authentication system F. Here, the process will be described in the order of user registration, resident registration, and co-resident registration for the face authentication system F.

[0046] (User Registration) When a resident registers a user account 30a with the face recognition system F, first, the user installs the user app 30 on their smartphone and sets a user ID and password. Then, the user inputs their personal information and face image P from the user app 30. The user registration program 21 stores the user data 26 such as the input user ID and the face image P in the user database 25. This completes the user registration of the face recognition system F.

[0047] (Resident registration) When the user registers themselves as a resident of any of the households 10, the user first performs a prescribed operation for resident registration with the user app 30. The resident registration program 22 of the server device 20 receives this operation and requests the user to read the 3D code Q. When the user scans the 3D code Q at hand with the camera 31, the resident registration program 22 identifies the individual of the hardware token 36 from the restored data of the 3D code Q and requests the user to input a one-time password. When the user inputs the one-time password displayed on the hardware token 36 at hand, the resident registration program 22 checks its validity. If the one-time password is correct, it is determined that the user is the holder of the hardware token 36 (authentication successful), and the face image P of the user is distributed to each authentication device 40. Each authentication device 40 converts the face image P distributed from the server device 20 into a face template T and notifies the server device 20 of the completion of the registration process. The resident registration program 22 receives this notification and notifies the user of the completion of the resident registration.

[0048] As described above, in the face recognition system F of this embodiment, the process of registering a user of the face recognition system F and the process of registering the user as a resident of the dwelling unit 10 are separate processes. In this embodiment, being a resident of the dwelling unit 10 is set as an attribute of the user's user account 30a. Also, although the one-time password displayed by the hardware token 36 of this embodiment is mainly a password consisting of numerical values, it is also conceivable to display, for example, a temporary three-dimensional code, a two-dimensional code, a temporary passphrase consisting of text, a temporary freehand pattern, and the like.

[0049] (Co-resident registration) The face recognition system F of this embodiment includes a co-resident registration program 23 that allows a user registered as a resident to additionally register co-residents such as family members living together in the dwelling unit 10. With this function, for example, in a family with small children, all family members can use the face recognition system F. When registering a co-resident, the resident inputs the personal information and face image P of the co-resident from the user app 30. The co-resident registration program 23 receives this operation and distributes the face image P of the co-resident to each authentication device 40. Each authentication device 40 converts the face image P distributed from the server device 20 into a face template T and notifies the server device 20 of the completion of the registration process. The co-resident registration program 23 receives this notification and notifies the user of the completion of the co-resident registration. As a result, each authentication device 40 will collate the captured face not only with the face template T of the resident but also with the face template T of the co-resident.

[0050] <Deregistration process> FIG. 6 is a sequence diagram showing a process of canceling the resident registration of the face authentication system F. In the face authentication system F of the present embodiment, the resident registration program 22 also serves as its cancellation function (registration cancellation means). There are two major methods for canceling the resident registration. One is a method of deleting only the resident registration associated with the operator's (resident's) own user account 30a (individual cancellation), and the other is a method of deleting all residents and co-residents registered for the dwelling 10 including other user accounts 30a of previous residents, etc. (bulk cancellation). Each will be described in this order below.

[0051] (Individual cancellation) When the resident unlocks the resident registration of the resident / co-resident associated with his / her own user account 30a, the resident performs an individual cancellation operation on the user app 30. The resident registration program 22 of the server device 20 receives this request and instructs each authentication device 40 to delete the face template T of the resident / co-resident associated with the user account 30a. Each authentication device 40 deletes or invalidates the face template T instructed by the server device 20 and notifies the server device 20 of the completion of the deletion process. The resident registration program 22 receives this notification and notifies the resident of the completion of the registration cancellation.

[0052] (Bulk cancellation) When all the resident registrations of the residents and co-residents registered for the dwelling 10 are to be cancelled, the resident first performs a prescribed operation for batch cancellation on the user app 30. The resident registration program 22 of the server device 20 receives this operation and requests the user to scan the 3D code Q. When the resident scans the 3D code Q at hand with the camera 31, the resident registration program 22 identifies the individual of the hardware token 36 from the 3D code Q and requests the resident to input a one-time password. When the resident inputs the one-time password, the resident registration program 22 checks its validity. If the one-time password is correct, it is determined that the user is the holder of the hardware token 36 (authentication successful), and each authentication device 40 is instructed to delete all the face templates T of the dwelling unit 10. Each authentication device 40 receives this instruction, deletes or invalidates all the face templates T of the dwelling unit 10, and notifies the server device 20 of the completion of the deletion process. The resident registration program 22 receives this notification and notifies the resident of the completion of the batch cancellation.

[0053] In this way, in the face recognition system F of this embodiment, a user registered as a resident of the dwelling unit 10 can also cancel the resident registration of the user account 30a that was previously registered as a resident of the dwelling unit 10. Thereby, for example, even if a previous resident has forgotten to cancel the resident registration or for some reason could not cancel it, the new resident can change the resident registration smoothly by themselves. Note that the resident registration of co-residents associated with the user's own user account 30a can be cancelled by the resident arbitrarily and individually.

[0054] <Modification Example> In the above embodiment, a hardware token 36 is adopted as a physical object that proves to be a resident of the dwelling unit 10, that is, a security token. The security token that can be used in the face recognition system F is a unique physical object associated with the dwelling unit 10, and it suffices as long as its possession can be electronically confirmed. In addition to the hardware token 36, for example, a card or hardware with a built-in IC chip, or a computer peripheral device in which unique data is recorded may also be used.

[0055] FIG. 4(b) is an image diagram showing an example in which an IC card 37 compliant with the NFC standard or a USB token 38 is adopted instead of the hardware token 36 in a modification of the above embodiment. In the above embodiment, due to the convenience of adopting the hardware token 36 that only has the function of displaying a one-time password, it was necessary to identify the individual of the hardware token 36 by the three-dimensional code Q. When using the IC card 37 or the USB token 38 instead of the hardware token 36, since these include data for identifying the individual, it is not necessary to use the three-dimensional code Q.

[0056] FIG. 7(a) is a sequence diagram showing a resident registration process when using the IC card 37 as a security token. FIG. 7(b) is a sequence diagram showing a resident registration process when using the USB token 38 as a security token. Each example in FIG. 7 is only different in that the possession item by which the resident registration program 22 confirms the legitimacy of the user is different from that in the above embodiment, and other configurations of the face recognition system F are the same as those in the above embodiment.

[0057] As shown in Fig. 7(a), when performing resident registration using the IC card 37, the user first performs a prescribed operation for resident registration in the user application 30. The resident registration program 22 of the server device 20 receives this operation and requests the user to read the IC card 37. When the user scans the IC card 37 at hand with the NFC reader of their smartphone, the resident registration program 22 checks the data of the scanned IC card 37. If the IC card 37 is legitimate (authentication successful), the face image P of the user is distributed to each authentication device 40 of the household door 11 and the entrance door 19 associated with the IC card 37. The subsequent process is the same as that of the above embodiment.

[0058] As shown in Fig. 7(b), when performing resident registration using the USB token 38, the user connects the USB token 38 to their PC and performs a prescribed operation for resident registration, for example, from the user application 30 of the web service. The resident registration program 22 of the server device 20 receives this operation and checks the data of the USB token 38 connected to the PC. If the USB token 38 is legitimate (authentication successful), the face image P of the user is distributed to each authentication device 40 of the household door 11 and the entrance door 19 associated with the USB token 38. The subsequent process is the same as that of the above embodiment.

[0059] <Other Embodiments> Figs. 8 and 9 are diagrams for explaining other embodiments of the face authentication system of the present invention. In the following description, only the differences from the above embodiment will be explained. It may be considered that the parts not particularly explained are the same or similar to the above embodiment. Also, the components with the same reference numerals as those in the above embodiment are the same or similar components as those in the above embodiment. Also, in the following description, for convenience, the above embodiment is also referred to as the "main embodiment".

[0060] FIG. 8 is an image diagram for explaining a handover method of the dwelling unit 10 in another embodiment. FIG. 9 is a sequence diagram showing a process of resident registration using the administrator app 50 (administrator tool). In the above embodiment, by using the hardware token 36, the security level of resident registration in the face authentication system F is increased to the authentication strength of possession authentication. On the other hand, the method of identity verification in the face authentication system of the present invention is not limited to possession authentication. Each of the embodiments described below is an example of verifying the identity by access control of the user account of the face authentication system without using the security token or token data 27 which are physical objects.

[0061] (Another Embodiment 1) In the above embodiment, the user app 30, its user account 30a, and the server device 20 constituting the face authentication system F are not limited to use within a condominium, and are designed to be commonly used in face authentication systems of other facilities. On the other hand, in the example of FIG. 8(a), the user account 30a is limited to use within a condominium, and the user account 30a is prepared in advance for each dwelling unit 10. That is, in the example of FIG. 8(a), the user account 30a is a dedicated user account for the face authentication system of that condominium (hereinafter, referred to as "face authentication system Fb" for convenience), and is not used outside the face authentication system Fb.

[0062] In the example of Fig. 8(a), when handing over the property, the user account 30a of the face recognition system Fb is handed over together with the key 39. That is, the user ID and password of the user account 30a of the dwelling unit 10 are notified to the prospective occupant. After the handover of the user account 30a, the prospective occupant changes the personal information, attribute information, and password of the user account 30a to their own. The prospective occupant can use this user account 30a to register themselves as an occupant of the dwelling unit 10 or register cohabitants. In the example of Fig. 8(a), the resident registration program 22 determines that the user is an occupant of the dwelling unit 10 if they know the user ID and password of the user account 30a. Therefore, it is not required to possess a security token or the like in various operations. Alternatively, at the time of resident registration or mass cancellation thereof, a one-time password may be push-notified to the user app 30, or the one-time password may be notified to the email address or phone number (SMS receiving number) set in the user account 30a to request the input.

[0063] In this way, in the example of Fig. 8(a), by creating a user account 30a of the user app 30 for each dwelling unit 10 and handing over the user account 30a to the prospective occupant together with the key 39, only the resident can safely start using the face recognition system Fb. Also, when changing the user of the face recognition system Fb from the current resident to a new resident, this can be done between the parties without the intervention of the management company by handing over the user account 30a from the current resident to the new resident.

[0064] (Other Embodiment 2) In the example of Fig. 8(b), similar to the main embodiment, the user account 30a is also used in the face recognition systems of other facilities. And in the example of Fig. 8(b), when delivering the property, together with the key 39, the authority 60 to execute programs such as the resident registration program 22 and the co-resident registration program 23 is delivered. The execution authority 60 is divided for each dwelling unit 10, and only the execution authority 60 for the corresponding dwelling unit 10 is granted to the prospective occupant. By granting this execution authority 60 to the user account 30a of the prospective occupant, the prospective occupant can register themselves as a resident of the dwelling unit 10 or register co-residents. Also in the example of Fig. 8(b), the resident registration program 22 determines that the user is a resident of the dwelling unit 10 based on the fact that the execution authority 60 is granted to the user account 30a. Therefore, it is not required to possess a security token or the like in various operations.

[0065] Here, instead of or in addition to the execution authority 60, when the resident registration program 22 performs resident registration or mass cancellation thereof, it is also conceivable to change the setting of the transmission destination for sending a temporary password to the user account 30a of the prospective occupant. The password can be notified, for example, by push notification to the user app 30 or to the email address or phone number (SMS receiving number) set in the user account 30a.

[0066] In this way, in the example of FIG. 8(b), the execution authority 60 of the resident registration program 22 and the like and the setting of the destination of the password D are divided for each dwelling unit, and together with the handover of the key 39, these settings for the dwelling unit 10 are handed over to the user account 30a of the prospective occupant, so that only the parties can safely start using the face recognition system. Also, when changing the user of the face recognition system from the current resident to a new resident, by transferring these execution authorities 60 and the like from the user account 30a of the current resident to the user account 30a of the new resident, this can be done between the parties without the intervention of the management company. Note that as a method of transferring the execution authority 60 and the setting of the password destination, for example, the current resident or the developer displays a three-dimensional code for transfer on the screen of their own user application 30, and the prospective occupant scans it with their user application 30, or the current resident or the developer designates the user account 30a of the transfer destination and sets a simple password in their user application 30, and the user account 30a of the prospective occupant receives this and enters the password notified separately.

[0067] (Other Embodiment 3) Also in the example of FIG. 8(c), similar to the main embodiment, the user account 30a is also used in the face recognition systems of other facilities. And in the example of FIG. 8(c), separately from the user account 30a of the user application 30, a management tool 50 which is a UI for performing an approval operation for requests such as resident registration from the user application 30 is prepared. And the management account 50a which is the user account of the management tool 50 is prepared for each dwelling unit 10. In the example of FIG. 8(c), when handing over the property, together with the key 39, the management account 50a of the dwelling unit 10 is handed over. That is, the user ID and password of the management account 50a are notified to the prospective occupant. After the handover of the management account 50a, the prospective occupant changes the password of the management account 50a to their own.

[0068] Figure 9 shows the resident registration process in the example of Fig. 8(c). When a resident performs a resident registration operation on the user app 30, the request is sent to the administrator app 50. The resident logs in to the administrator app 50 with the administrator account 50a and approves their own request. Thereby, the resident registration program 22 distributes the face image P of the user to each authentication device 40. Also in the example of Fig. 8(c), the resident registration program 22 determines that the resident of the household 10 is the one who knows the user ID and password of the administrator account 50a. Therefore, although it is not required to possess a security token or the like in various operations, for safety, a temporary password may be notified to the administrator account 50a at the time of approval in the administrator tool 50.

[0069] As described above, in the example of Fig. 8(c), a separate administrator tool 50 for performing the approval operation of the resident registration program 22 is prepared, and the administrator account 50a of the administrator tool 50 is created for each household 10. Then, by delivering the administrator account 50a together with the key 39 to the person scheduled to move in, only the resident can safely start using the face authentication system. Also, when changing the user of the face authentication system from the current resident to a new resident, this can be done between the parties without the involvement of the management company by delivering the administrator account 50a from the current resident to the new resident.

[0070] Although the embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and various changes can be made without departing from the gist of the invention. For example, each of the above embodiments is an example in which the face authentication system of the present invention is introduced into a condominium, but the face authentication system of the present invention can also be applied to, for example, detached houses for sale or rental properties.

Explanation of reference numerals

[0071] F: Facial recognition system, 10: Dwelling unit, 11: Dwelling unit door (front door), 111: Cylinder lock, 19: Entrance door, 20: Server device, 21: User registration program (face registration means), 22: Occupant registration program (occupant registration means, registration cancellation means), 23: Co-resident registration program (co-resident registration means), 25: User database, 26: User data, P: Facial image (face data), 27: Token data, 30: User app, 30a: User account, 31: Camera, 32: Operation panel, 36: Hardware token (security token), Q: 3D code, 37: IC card (security token), 38: USB token, 39: Key, 40, 40a, 40b: Authentication device, 41: Camera (imaging device), 42: Authentication program (authentication means), T: Face template (face data), 50: Administrator app (administrator tool), 50a: Administrator account (user account), 60: Execution authority

Claims

1. A face registration means for registering a face image of a user or face data which is processed data of the face image; A photographing device installed in the house; A resident tool that is a user interface of a resident registration means for registering a user as a resident of the house; an authentication means for comparing a face photographed by the photographing device with the face data of the resident; A security token is a tangible object that is delivered to a resident of the house and is a device, instrument, or electronic medium for verifying that the resident is a resident of the house; said resident tool authenticates the user upon login; the resident registration means, when registering a resident, confirms that the user performing the registration operation has the security token, and registers the user as a resident of the house; Facial recognition system.

2. A face registration means for registering face data which is a face image or processed data of a user; A photographing device installed in the house; A resident registration means for registering a user as a resident of the house; a roommate registration means for allowing the resident to additionally register the face data of the roommate; an authentication means for comparing a face photographed by the photographing device with the face data of the resident and the housemate; A security token is a tangible object that is delivered to a resident of the house and is a device, instrument, or electronic medium for verifying that the resident is a resident of the house; the resident registration means, when registering a resident, confirms that the user performing the registration operation has the security token, and registers the user as a resident of the house; Facial recognition system.

3. the face registration means, the resident registration means, and the co-roommate registration means are provided using a user terminal which is an information terminal owned by the resident; The face authentication system according to claim 2 .

4. A face registration means for registering face data which is a face image or processed data of a user; A camera is installed near the entrance door of the apartment building. A resident registration means for registering a user as a resident of the house; an authentication means for comparing a face photographed by the photographing device with the face data of the resident; A registration cancellation means for allowing a user newly registered as a resident of the dwelling unit to cancel the resident registration of a user account previously registered as a resident of the dwelling unit; A security token is a tangible object that is delivered to a resident of the house and is a device, instrument, or electronic medium for verifying that the resident is a resident of the house; the security token includes information for identifying the dwelling unit within the housing complex; the resident registration means, when registering a resident, confirms that the user performing the registration operation has the security token, and registers the user as a resident of the dwelling unit; Facial recognition system.

5. A face registration means for registering face data which is a face image or processed data of a user; A photographing device installed in the house; A resident registration means for registering a user as a resident of the house; an authentication means for comparing a face photographed by the photographing device with the face data of the resident; A security token is a tangible object that is delivered to a resident of the house and is a device, instrument, or electronic medium for verifying that the resident is a resident of the house; the resident registration means, when registering a resident, verifies that the user performing the registration operation possesses the security token, and registers the user as a resident of the house; The fixed code refers to an encoded code, a key consisting of a character string, or a key consisting of a number, which is delivered to the resident of the house together with the security token. the fixed code is unique for each of the security tokens; the resident registration means, when registering a resident, requires that a user performing the registration operation possess the security token and input the fixed code; Facial recognition system.

6. the security token is a hardware token that displays a one-time password; the fixed code is an encoded code; The resident registration means includes: Identifying the individual hardware token by reading the fixed code; Possession of the hardware token is confirmed by entering the one-time password displayed on the hardware token. The face authentication system according to claim 5 .

7. The security token is A hardware token that displays a temporary passcode; A card or hardware with an embedded IC chip, or A peripheral device with unique data recorded on it. A face authentication system according to any one of claims 1 to 5.

8. The residence is an apartment building, The imaging device is installed near an entrance door of a dwelling unit of the apartment building, the security token includes information for identifying the dwelling unit within the housing complex; The resident registration means registers a user who possesses the security token as a resident of the dwelling unit. A face authentication system according to any one of claims 1 to 6.

9. The photographing device is also installed near the entrance door of the building of the apartment building. The face authentication system according to claim 8.

10. The house is an apartment building or even a condominium. A face authentication system according to any one of claims 1 to 6.

Images