Facial recognition system

Abstract

We provide a facial recognition system that does not require management by a management company or other third party, allowing residents to safely initiate use and change users on their own. [Solution] The system comprises a face registration means for registering a user's face image or processed face data, a camera installed near the entrance door of a dwelling unit in an apartment building, a resident registration means for registering a user as a resident of the dwelling unit, an authentication means for comparing the face captured by the camera with the resident's face data, and a resident tool which is the user interface for the face registration means and the resident registration means. The user account for the resident tool is handed over to the resident of the dwelling unit along with the key to the entrance door, and the user account for the resident tool is resolved by a face authentication system that is pre-registered for each dwelling unit in the apartment building.

Description

Technical Field

[0001] The present invention relates to a face recognition system.

Background Art

[0002] In recent years, with the penetration of DX (Digital Transformation), the application scope of face recognition technology is expanding. The main advantages of face recognition are the improvement of convenience and security in the authentication process. As a biometric authentication, face recognition, unlike knowledge authentication or possession authentication, does not require memorization of a password or carrying of an item. Moreover, the shapes of human faces are extremely diverse, making it difficult for others to imitate. Also, since it can be used without contact, it is excellent in terms of hygiene and is particularly effective as a countermeasure against infectious diseases. Furthermore, technologies for coping with changes in environmental illuminance and age have reached a practical level, ensuring stable authentication accuracy. Due to these characteristics, face recognition is expected to be applied in various fields.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above Patent Document 1, a face recognition system for apartment houses is disclosed. The face recognition system of Patent Document 1 is designed such that, on the premise that each household in an apartment house is a rental property, a PM (resident management operator) performs management operations such as the entry and departure of residents

[0005] On the other hand, for example, in the case of a condominium where a management association composed of the owners of each household manages the building and assets by themselves or determines an outsourced management company, the management entity and the attribution of responsibility of the face recognition system become ambiguous.

[0006] In view of these challenges, the present invention aims to provide a facial recognition system that does not require management by a management company or the like, and that residents can safely start using or change users of the system themselves. [Means for solving the problem]

[0007] To solve the above problems, the facial recognition system of the present invention comprises: a facial registration means for registering a user's facial image or processed facial data thereof; a shooting device installed near the entrance door of a dwelling unit in an apartment building; a resident registration means for registering a user as a resident of the dwelling unit; an authentication means for comparing the face captured by the shooting device with the resident's facial data; and a resident tool which is the user interface for the facial registration means and the resident registration means. The user account for the resident tool is handed over to the resident of the dwelling unit along with the key to the entrance door, and the user account for the resident tool is pre-registered for each dwelling unit in the apartment building.

[0008] By creating a user account for each dwelling unit using a resident tool that includes both facial recognition and resident registration methods, and handing over this user account along with the front door key to the resident, the resident can securely begin using the facial recognition system on their own. Furthermore, when changing the user of the facial recognition system from the current resident to a new resident, this can be done between the parties involved without the management company's intervention by simply handing over the user account from the current resident to the new resident. In this case, the new resident will change the password to their own after the user account is handed over.

[0009] Furthermore, in order to solve the above problems, the facial recognition system of the present invention comprises: a facial registration means for registering a user's facial image or processed facial data thereof; a shooting device installed near the entrance door of a dwelling unit in an apartment building; a resident registration means for registering a user as a resident of the dwelling unit; an authentication means for comparing the face captured by the shooting device with the resident's facial data; a resident tool which is the user interface for the facial registration means and the resident registration means; and an administrator tool which is the user interface for approving the registration operation by the resident registration means. The user account for the resident tool and the user account for the administrator tool are different user accounts, the user account for the administrator tool is handed over to the resident of the dwelling unit along with the key to the entrance door, and the user account for the administrator tool may be pre-registered for each dwelling unit in the apartment building.

[0010] A separate administrator tool is provided to approve resident registrations, and user accounts for this administrator tool are created in advance for each dwelling unit. By handing over this user account along with the front door key to the resident, the resident can securely start using the facial recognition system on their own. Furthermore, when changing the user of the facial recognition system from the current resident to the new resident, this can be done between the parties involved without the management company's intervention by handing over the administrator tool user account from the current resident to the new resident. In this case, the new resident will change the password for the administrator tool user account to their own after the handover.

[0011] Furthermore, in order to solve the above problems, the facial recognition system of the present invention comprises: a facial registration means for registering a user's facial image or processed facial data thereof; a shooting device installed near the entrance door of a dwelling unit in an apartment building; a resident registration means for registering a user as a resident of the dwelling unit; an authentication means for comparing the face captured by the shooting device with the resident's facial data; and a resident tool which is the user interface of the facial registration means. For the execution of the resident registration means, the user account of the resident tool must be granted the right to execute the resident registration means, or the user account must be set as the destination for a temporary passcode issued when the resident registration means is executed. The execution rights of the resident registration means and the destination for the passcode may be set on a per-dwelling-unit basis for each dwelling unit in the apartment building, and a resident of any of the dwelling units may be able to transfer the setting of the execution rights or the destination for the passcode to another person's user account.

[0012] By dividing the execution rights for resident registration and the destination of passcodes for each dwelling unit, and transferring these execution rights, etc., to the resident's user account along with the handover of the front door key, residents can securely start using the facial recognition system on their own. Furthermore, when changing the user of the facial recognition system from the current resident to the new resident, the execution rights, etc., can be transferred from the current resident's user account to the new resident's user account, allowing the parties involved to do so without the management company's intervention.

[0013] Furthermore, in order to solve the above problems, the facial recognition system of the present invention comprises: a facial registration means for registering a user's facial image or processed facial data thereof; a shooting device installed near the entrance door of a dwelling unit in an apartment building; a resident registration means for registering a user as a resident of the dwelling unit; an authentication means for comparing a face captured by the shooting device with the resident's facial data; a resident tool which is the user interface of the facial registration means; a security token which is a tangible object delivered to the resident of the dwelling and is a device, instrument, or information medium for proving that the person is a resident of the dwelling; and a fixed code which is an encoded code, a key consisting of a string, or a key consisting of a number, which is delivered to the resident of the dwelling together with the security token. The resident registration means may be configured to require, when registering a resident, that the user performing the registration operation possesses the security token and also inputs the fixed code. [Effects of the Invention]

[0014] Thus, the facial recognition system of the present invention does not require management by a management company or the like, and residents can safely start using it or change users on their own. [Brief explanation of the drawing]

[0015] [Figure 1] This is a use case diagram illustrating the overview of facial recognition system F. [Figure 2] This is an illustrative diagram showing an example of the use of facial recognition system F. [Figure 3] This is a layout diagram showing the functional configuration of facial recognition system F. [Figure 4] This is an illustrative diagram explaining the handover method for apartment unit 10. [Figure 5] This is a sequence diagram showing the process of various registration operations for the facial recognition system F. [Figure 6] This is a sequence diagram showing the process of deregistering a resident from the facial recognition system F. [Figure 7]It is a sequence diagram showing the process of resident registration when using an IC card 37 or a USB token 38 as a security token. [Figure 8] It is an image diagram explaining the handover method of the housing unit 10 in other embodiments. [Figure 9] It is a sequence diagram showing the process of resident registration using the administrator app 50.

Mode for Carrying Out the Invention

[0016] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The face recognition system F described below is an example of the face recognition system of the present invention introduced into a condominium which is a collective housing. When a user registers himself / herself as a resident of the condominium, the face recognition system F confirms by possession authentication that the person performing the registration operation is a resident of any of the housing units. Thereby, the face recognition system F can safely start its use or change the user only by the residents without the need for identity verification by a management company or the like. Hereinafter, embodiments of this feature of the face recognition system F and each feature associated therewith will be described as examples.

[0017] <System Overview> FIG. 1 is a use case diagram showing the overview of the face recognition system F of this embodiment. The face recognition system F of this embodiment mainly includes a server device 20, a user app 30 (resident tool), and an authentication device 40. The authentication device 40 of this embodiment is installed near the housing door (front door) of each housing unit in the condominium and near the door of the common entrance (the entrance door of the condominium).

[0018] The user app 30 is a dedicated application installed on the smartphone (user terminal) owned by the resident. The user app 30 is a UI (user interface) for the resident to perform operations such as registering their face data in the face recognition system F and registering themselves as a resident of the condominium. The authentication device 40 is a device that captures the face of the person facing it, compares and authenticates it with the registered face data, and unlocks the entrance door and the apartment door. The server device 20 is a device that communicates with the user app 30 and the authentication device 40, processes various registration requests from the residents, and distributes the legitimate face data of the residents to each authentication device 40. Here, the "resident" may include a person who is scheduled to move in and is in the process of completing the move-in procedures.

[0019] Figure 2 is an image diagram showing an example of the use of the face recognition system F. Figure 2(a) is an example of the use of the authentication device 40 installed at the entrance door 19 of the condominium. Figure 2(b) is an example of the use of the authentication device 40 installed at the apartment door 11 of each apartment 10.

[0020] As shown in Figure 2(a), the authentication device 40a for the entrance door 19 is installed on the decorative column of the shared entrance. The resident of the condominium can open the entrance door 19 by capturing their face with the camera 41 (imaging device) of the authentication device 40a. Also, as shown in Figure 2(b), the authentication device 40b for the apartment door 11 is installed adjacent to each apartment door 11. The resident of each apartment 10 can unlock the apartment door 11 by capturing their face with the camera 41 of the authentication device 40b. Note that the apartment door 11 is also provided with a cylinder lock 111, and the resident can also unlock the apartment door 11 with a key.

[0021] In this way, each resident of the condominium can use face recognition to unlock the entrance door 19 and the apartment door 11, so they can enter and leave the condominium and the apartment 10 without, for example, carrying a key or memorizing a passcode.

[0022] <Functional Configuration> Figure 3 is a diagram showing the functional configuration of the facial recognition system F. The functions of the facial recognition system F will be explained below with reference to Figure 3.

[0023] As shown in Figure 3, the authentication device 40 and user application 30 of the facial recognition system F are connected to the server device 20 via a network. In this configuration, the authentication device 40 and user application 30 send and receive data with the server device 20 via the internet.

[0024] As mentioned above, the user app 30 is a dedicated application installed on the resident's smartphone. The user app 30 may take the form of a smartphone app, or it may be provided as dedicated software installed on the resident's PC, or as a web service using a web browser. The user app 30 is equipped with a camera 31 that captures the resident's face and an operation panel 32 for performing various operations on the facial recognition system F. In this form of facial recognition system F, the use of the resident's smartphone as the UI of the facial recognition system F improves usability compared to providing dedicated equipment whose operation method is unknown. In addition, the reduction in the amount of dedicated equipment required to use the facial recognition system F reduces the introduction cost of the facial recognition system F and the management burden on the resident.

[0025] The server device 20 in this configuration includes a user registration program 21 (face registration means), a user database 25, a resident registration program 22, and token data 27. Hereinafter, residents from the perspective of the facial recognition system F will also be referred to as "users" as appropriate. The user registration program 21 is a program that registers the facial image P of a user of the facial recognition system F and user data 26, which is the user's personal information and attribute information, in the user database 25. The resident registration program 22 is a program that registers a user as a resident of one of the dwelling units 10 in an apartment building where the facial recognition system F is installed. The token data 27 is data used to verify that the person performing the registration operation is a legitimate resident. Specifically, the token data 27 is data such as the serial number, secret key, and one-time password of the hardware token 26, which will be described later. The server device 20 distributes the facial image P of a user registered as a resident of one of the dwelling units 10 to the authentication device 40a on the entrance door 19 and the authentication device 40b on the dwelling unit door 11 of that dwelling unit 10.

[0026] The server device 20 in this configuration is a virtual server built using a cloud hosting service. The method of building the server device 20 is not limited to a cloud server; it may also be an on-premise server installed within the LAN of the provider of the facial recognition system F or within the LAN of an apartment building.

[0027] Each authentication device 40 has a camera 41 that captures the face of the person it is interacting with, and an authentication program 42 that compares and authenticates the face captured by the camera 41 against a pre-registered face template T. The face template T is biometric data for comparison, extracted from the features of the face image P distributed from the server device 20, and is also sometimes called a face vector, feature quantity, or face map. Each authentication device 40 converts the face image P distributed from the server device 20 into a face template T using the same algorithm as the authentication program 42, and stores it. In other words, this embodiment of the face authentication system F is a so-called edge-type face authentication system.

[0028] The physical arrangement of each function shown in Figure 3 is merely an example and is not limited to this configuration. The arrangement of these functions can be appropriately changed according to the nature, size, number of users, budget, and other implementation and operational constraints and requirements of the facility where the facial recognition system F will be introduced. For example, the authentication program 42 and face template T could be stored on the server device 20, creating a cloud-based facial recognition system. In this case, it is also conceivable to delegate the face matching and authentication functions to an external service. Furthermore, it is conceivable to equip the authentication device 40 with an operation panel 32 and, for example, provide the UI functions of the user application 30 to each authentication device 40b.

[0029] <Property handover method> Figure 4 is an illustrative diagram explaining the handover method for dwelling unit 10. In order for a resident to start using the facial recognition system F, the resident must create a user account 30a for the facial recognition system F and register themselves as a resident of one of the dwelling units 10. In this configuration, the resident registration program 22 of the facial recognition system F verifies whether the user performing the registration operation possesses a hardware token 36 (security token) when registering a resident.

[0030] In this configuration, when the dwelling unit 10 is handed over, as shown in Figure 4(a), if the dwelling unit 10 is a newly constructed property, the developer hands over the hardware token 36 along with the key 39 for the dwelling unit door 11. If the dwelling unit 10 is a used property, the current resident hands over the hardware token 36 to the new resident. The hardware token 36 is a device that displays a one-time password (temporary passcode).

[0031] Each hardware token 36 is accompanied by a 3D code Q (fixed code) for identifying its individual token, and this 3D code Q is also delivered along with the hardware token 36. Here, the 3D code Q only needs to be information that can uniquely identify the hardware token 36, that is, information unique to each hardware token 36, and may be other encoded codes such as 2D codes, keys consisting of strings, or keys consisting of numbers.

[0032] Furthermore, in this configuration, a hardware token 36 is provided for each dwelling unit 10. In other words, the serial number and secret key of the hardware token 36 are associated with one of the dwelling units 10. The resident registration program 22 registers the user who possesses the hardware token 36 as a resident of the dwelling unit 10 associated with that hardware token 36. In this configuration, because a hardware token 36 is provided for each dwelling unit 10, the residents of each dwelling unit 10 can start using the facial recognition system F independently, or change the user of the facial recognition system F for that dwelling unit 10 from the current resident to a new resident.

[0033] When a resident registers themselves as a resident of any of the dwelling units 10, the resident scans the 3D code Q with the camera 31 of the user app 30 to allow the resident registration program 22 to recognize the individual hardware token 36 (serial number, etc.), and then enters the one-time password displayed on the hardware token 36 to prove that they possess the hardware token 36. Based on this, the resident registration program 22 determines that the user performing the operation is a legitimate resident and registers that user as a resident of dwelling unit 10.

[0034] Thus, in this form of facial recognition system F, the resident registration program 22 verifies the possession of the hardware token 36 during registration, preventing unauthorized third parties from registering as residents, and ensuring that only legitimate users can register as residents of dwelling unit 10. In particular, the use of a tangible hardware token 36 enhances the security level of resident registration to the level of authentication strength of possession authentication. This eliminates the need for identity verification by management companies, etc., allowing residents to safely begin using the facial recognition system F on their own. Furthermore, when changing the user of the facial recognition system F from the current resident to a new resident, this can be done between the parties involved without the intervention of management companies, etc., by transferring the 3D code Q and the hardware token 36 from the current resident to the new resident.

[0035] <Registration Process> Figure 5 is a sequence diagram showing the process of various registration operations for the facial recognition system F. Here, the process is explained in the order of user registration, resident registration, and cohabitant registration for the facial recognition system F.

[0036] (User registration) When a resident registers a user account 30a with the facial recognition system F, they first install the user app 30 on their smartphone and set a user ID and password. Then, they enter their personal information and facial image P into the user app 30. The user registration program 21 saves the entered user data 26, such as the user ID, and the facial image P to the user database 25. This completes the user registration for the facial recognition system F.

[0037] (Resident registration) When a user registers themselves as a resident of one of the dwelling units 10, the user first performs the prescribed operation for resident registration using the user application 30. The resident registration program 22 on the server device 20 receives this operation and requests the user to scan a 3D code Q. When the user scans the 3D code Q with the camera 31, the resident registration program 22 identifies the hardware token 36 from the restored data of the 3D code Q and requests the user to enter a one-time password. When the user enters the one-time password displayed on the hardware token 36, the resident registration program 22 checks its validity. If the one-time password is correct, it determines that the user is the owner of the hardware token 36 (authentication successful) and distributes the user's face image P to each authentication device 40. Each authentication device 40 converts the face image P distributed from the server device 20 into a face template T and notifies the server device 20 that the registration process is complete. The resident registration program 22 receives this notification and notifies the user that resident registration is complete.

[0038] Thus, in this embodiment of the facial recognition system F, the process of registering a user of the facial recognition system F and the process of registering the user as a resident of dwelling unit 10 are separate processes. In this embodiment, being a resident of dwelling unit 10 is set as one attribute of the user's user account 30a. In addition, the one-time password displayed by the hardware token 36 in this embodiment is mainly a password consisting of numbers, but it is also conceivable to display other types of passwords, such as a temporary 3D code or 2D code, a temporary passphrase consisting of text, or a temporary one-stroke pattern.

[0039] (Co-resident registration) This form of facial recognition system F includes a co-resident registration program 23 that allows a registered resident to add co-residents, such as family members, who live in the same dwelling unit 10. This function allows all family members, even in households with young children, to use the facial recognition system F. To register a co-resident, the resident inputs the co-resident's personal information and facial image P from the user application 30. The co-resident registration program 23 receives this input and distributes the co-resident's facial image P to each authentication device 40. Each authentication device 40 converts the facial image P distributed from the server device 20 into a facial template T and notifies the server device 20 of the completion of the registration process. The co-resident registration program 23 receives this notification and notifies the user that the co-resident's registration is complete. As a result, each authentication device 40 will now compare the captured face not only with the resident's facial template T but also with the co-resident's facial template T.

[0040] <Unsubscription Process> Figure 6 is a sequence diagram showing the process of deregistering a resident from the facial recognition system F. In this embodiment of the facial recognition system F, the resident registration program 22 also serves as the deregistration function (deregistration means). There are two main methods for deregistering a resident: one is to delete only the resident registration associated with the operator's (resident's) own user account 30a (individual deregistration), and the other is to delete all residents and cohabitants registered for the residence 10, including other user accounts 30a such as previous residents (bulk deregistration). These methods will be explained below in this order.

[0041] (Individual cancellation) When a resident wants to unlock the resident registration of a resident or cohabitant associated with their user account 30a, the resident performs an individual deactivation operation in the user app 30. The resident registration program 22 on the server device 20 receives this request and instructs each authentication device 40 to delete the resident or cohabitant's face template T associated with the user account 30a. Each authentication device 40 deletes or disables the face template T instructed by the server device 20 and notifies the server device 20 of the completion of the deletion process. The resident registration program 22 receives this notification and notifies the resident that the deregistration is complete.

[0042] (Unblock all at once) When deregistering all residents and cohabitants registered for residence 10, the resident first performs a prescribed operation for batch deregistration using the user application 30. The resident registration program 22 on the server device 20 receives this operation and requests the user to scan a 3D code Q. When the resident scans the 3D code Q with the camera 31, the resident registration program 22 identifies the hardware token 36 from the 3D code Q and requests the resident to enter a one-time password. When the resident enters the one-time password, the resident registration program 22 checks its validity. If the one-time password is correct, it determines that the user is the owner of the hardware token 36 (authentication successful) and instructs each authentication device 40 to delete all face templates T for that residence 10. Each authentication device 40 receives this instruction and deletes or disables all face templates T for residence 10, and notifies the server device 20 of the completion of the deletion process. The resident registration program 22 receives this notification and notifies the resident that the batch deregistration is complete.

[0043] Thus, in this form of facial recognition system F, a user registered as a resident of dwelling unit 10 can also deregister the resident of user account 30a that was previously registered as a resident of dwelling unit 10. This allows the new resident to change their resident registration smoothly, even if, for example, the previous resident forgot to deregister or was unable to do so for some reason. Furthermore, the resident can arbitrarily and individually deregister the resident registrations of cohabitants associated with the resident's own user account 30a.

[0044] <Variation> In the above embodiment, a hardware token 36 is used as a tangible object, i.e., a security token, to prove that the person is a resident of dwelling unit 10. The security token usable with the facial recognition system F is a unique tangible object associated with dwelling unit 10, and can be electronically verified for possession. In addition to the hardware token 36, it may be, for example, a card or hardware with a built-in IC chip, or a computer peripheral device on which unique data is recorded.

[0045] Figure 4(b) is a modified example of the above embodiment, illustrating an example in which an NFC-compliant IC card 37 or a USB token 38 is used instead of the hardware token 36. In the above embodiment, because a hardware token 36 that only has a one-time password display function is used, it was necessary to identify each hardware token 36 using a 3D code Q. When an IC card 37 or USB token 38 is used instead of the hardware token 36, these can contain data to identify the individual, so there is no need to use a 3D code Q.

[0046] Figure 7(a) is a sequence diagram showing the resident registration process when using an IC card 37 as a security token. Figure 7(b) is a sequence diagram showing the resident registration process when using a USB token 38 as a security token. Each example in Figure 7 differs from the above embodiment only in the possessions used by the resident registration program 22 to verify the user's legitimacy; the other configurations of the facial recognition system F are the same as in the above embodiment.

[0047] As shown in Figure 7(a), when registering a resident using an IC card 37, the user first performs the prescribed operation for resident registration using the user application 30. The resident registration program 22 on the server device 20 receives this operation and requests the user to read the IC card 37. When the user scans the IC card 37 with the NFC reader on their smartphone, the resident registration program 22 checks the data on the scanned IC card 37. If the IC card 37 is valid (authentication successful), the program distributes the user's facial image P to the authentication devices 40 on the dwelling door 11 and entrance door 19 associated with the IC card 37. The subsequent process is the same as in the embodiment described above.

[0048] As shown in Figure 7(b), when resident registration is performed using a USB token 38, the user connects the USB token 38 to their PC and performs the prescribed operation for resident registration from, for example, a user application 30 of a web service. The resident registration program 22 on the server device 20 receives this operation and checks the data on the USB token 38 connected to the PC. If the USB token 38 is valid (authentication successful), the user's facial image P is distributed to the authentication devices 40 of the apartment door 11 and entrance door 19 associated with the USB token 38. The subsequent process is the same as in the embodiment described above.

[0049] <Other Embodiments> Figures 8 and 9 illustrate another embodiment of the facial recognition system of the present invention. In the following description, only the differences from the above embodiment will be described. Parts that are not specifically described may be considered to be the same as or similar to the above embodiment. Also, components that are denoted by the same reference numerals as in the above embodiment are the same as or of the same type as the components in the above embodiment. Furthermore, in the following description, for convenience, the above embodiment will also be referred to as the "main embodiment".

[0050] Figure 8 is an illustrative diagram illustrating the handover method of the dwelling unit 10 in another embodiment. Figure 9 is a sequence diagram showing the resident registration process using the administrator application 50 (administrator tool). In the above embodiment, the security level of resident registration to the facial recognition system F is increased to the authentication strength of possession authentication by using a hardware token 36. On the other hand, the method of identity verification in the facial recognition system of the present invention is not limited to possession authentication. Each embodiment described below is an example in which identity is verified by access control of the user account of the facial recognition system without using a tangible security token or token data 27.

[0051] (Other Embodiment 1) In the above embodiment, the user application 30, its user account 30a, and the server device 20 that constitute the facial recognition system F are not limited to use within a single apartment building, but are designed to be used in common with facial recognition systems in other facilities. On the other hand, in the example of Figure 8(a), the user account 30a is limited to use within a single apartment building, and a user account 30a is prepared in advance for each dwelling unit 10. In other words, in the example of Figure 8(a), the user account 30a is a user account dedicated to the facial recognition system of that apartment building (hereinafter referred to as "facial recognition system Fb" for convenience), and will not be used outside of facial recognition system Fb.

[0052] In the example shown in Figure 8(a), when the property is handed over, the user account 30a of the facial recognition system Fb is handed over along with the key 39. In other words, the user ID and password for the user account 30a of the dwelling unit 10 are notified to the prospective resident. After the handover of the user account 30a, the prospective resident changes the personal information, attribute information, and password of the user account 30a to their own. The prospective resident can use this user account 30a to register themselves as a resident of the dwelling unit 10 and to register co-residents. In the example shown in Figure 8(a), the resident registration program 22 determines that a person is a resident of the dwelling unit 10 if they know the user ID and password of the user account 30a. Therefore, possession of a security token or the like is not required for various operations. Alternatively, when registering or deregistering residents, a one-time password may be push-notified to the user app 30, or a one-time password may be sent to the email address or phone number (SMS receiving number) set for the user account 30a, and the user may be required to enter it.

[0053] Thus, in the example shown in Figure 8(a), a user account 30a for the user application 30 is created for each dwelling unit 10, and by handing over this user account 30a along with the key 39 to the prospective resident, the resident alone can safely begin using the facial recognition system Fb. Furthermore, when changing the user of the facial recognition system Fb from the current resident to the new resident, this can be done between the parties involved without the management company's intervention by handing over the user account 30a from the current resident to the new resident.

[0054] (Another Embodiment 2) In the example shown in Figure 8(b), similar to the primary embodiment, user account 30a is also used in the facial recognition system of other facilities. In the example in Figure 8(b), when the property is handed over, along with the key 39, the authority 60 to execute the resident registration program 22 and the co-resident registration program 23 is also handed over. The execution authority 60 is divided for each dwelling unit 10, and the prospective resident is granted only the execution authority 60 for the dwelling unit 10 in question. By granting this execution authority 60 to their user account 30a, the prospective resident can register themselves as a resident of that dwelling unit 10 and register co-residents. In the example in Figure 8(b), the resident registration program 22 determines that the user is a resident of that dwelling unit 10 based on the fact that user account 30a has been granted the execution authority 60. Therefore, possession of security tokens or the like is not required for various operations.

[0055] Here, instead of using the execution permission 60, or in addition to the execution permission 60, it is also possible to change the setting for the destination to which the temporary passcode is sent when the resident registration program 22 performs resident registration or mass deregistration, to the user account 30a of the prospective resident. The passcode could be sent, for example, as a push notification to the user app 30, or to the email address or phone number (SMS receiving number) set in the user account 30a.

[0056] Thus, in the example shown in Figure 8(b), the execution rights 60 for the resident registration program 22 and the settings for the destination of the passcode D are divided for each dwelling unit, and these settings for that dwelling unit 10 are handed over to the prospective resident's user account 30a along with the handover of the key 39, allowing the parties involved to securely start using the facial recognition system. Furthermore, when changing the user of the facial recognition system from the current resident to the new resident, these execution rights 60 etc. are handed over from the current resident's user account 30a to the new resident's user account 30a, allowing this to be done between the parties without the intervention of the management company. As for the method of handing over the execution rights 60 and the destination settings for the passcode, for example, the current resident or developer may display a 3D code for handover on the screen of their user app 30, which the prospective resident's user app 30 may scan, or the current resident or developer may specify the recipient user account 30a in their user app 30 and set a simple password, which the prospective resident's user account 30a receives and enters a separately notified password.

[0057] (Other Embodiment 3) In the example shown in Figure 8(c), as in the main embodiment, the user account 30a is also used in the facial recognition system of other facilities. In the example in Figure 8(c), separate from the user account 30a of the user app 30, there is an administrator tool 50, which is a UI for approving requests such as resident registration from the user app 30. An administrator account 50a, which is the user account of the administrator tool 50, is provided for each dwelling unit 10. In the example in Figure 8(c), when the property is handed over, the administrator account 50a for that dwelling unit 10 is handed over along with the key 39. In other words, the user ID and password of the administrator account 50a are notified to the prospective resident. After the handover of the administrator account 50a, the prospective resident changes the password of the administrator account 50a to their own.

[0058] Figure 9 shows the resident registration process in the example of Figure 8(c). When a resident performs a resident registration operation using the user application 30, the request is sent to the administrator application 50. The resident logs into the administrator application 50 with the administrator account 50a and approves their request. As a result, the resident registration program 22 distributes the user's facial image P to each authentication device 40. In the example of Figure 8(c), the resident registration program 22 determines that the user is a resident of the dwelling unit 10 based on knowing the user ID and password of the administrator account 50a. Therefore, possession of security tokens, etc., is not required for various operations, but for security reasons, a temporary passcode may be sent to the administrator account 50a when approval is made by the administrator tool 50.

[0059] As shown in Figure 8(c), in the example, a separate administrator tool 50 is provided to perform the approval operation of the resident registration program 22, and an administrator account 50a for the administrator tool 50 is created for each dwelling unit 10. By handing over this administrator account 50a along with the key 39 to the prospective resident, the resident can safely start using the facial recognition system on their own. Furthermore, when changing the user of the facial recognition system from the current resident to the new resident, this can be done between the parties involved without the management company's intervention by handing over the administrator account 50a from the current resident to the new resident.

[0060] Although embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and various modifications can be made without departing from the spirit of the invention. For example, the above embodiments are examples in which the facial recognition system of the present invention is introduced into condominiums, but the facial recognition system of the present invention can also be applied to, for example, detached houses for sale or rental properties. [Explanation of symbols]

[0061] F: Facial recognition system, 10: Dwelling unit, 11: Dwelling unit door (front door), 111: Cylinder lock, 19: Entrance door, 20: Server device, 21: User registration program (facial registration means), 22: Resident registration program (resident registration means, deregistration means), 23: Co-resident registration program (co-resident registration means), 25: User database, 26: User data, P: Facial image (facial data), 27: Token data, 30: User application, 30a: User Account, 31: Camera, 32: Control Panel, 36: Hardware Token (Security Token), Q: 3D Code, 37: IC Card (Security Token), 38: USB Token, 39: Key, 40, 40a, 40b: Authentication Device, 41: Camera (Shooting Device), 42: Authentication Program (Authentication Method), T: Face Template (Face Data), 50: Administrator App (Administrator Tool), 50a: Administrator Account (User Account), 60: Execution Permissions

Claims

1. A face registration means for registering a user's face image or processed face data, A camera installed near the entrance door of an apartment unit in a multi-unit building, A resident registration means for registering a user as a resident of the aforementioned dwelling unit, Authentication means for comparing the face captured by the aforementioned camera with the facial data of the resident, The system comprises the face registration means and the resident tool, which is the user interface for the resident registration means, The user account for the resident tool is handed over to the resident of the dwelling unit along with the key to the front door. User accounts for the aforementioned resident tools are pre-registered for each dwelling unit in the aforementioned apartment building. Facial recognition system.

2. A face registration means for registering a user's face image or processed face data, A camera installed near the entrance door of an apartment unit in a multi-unit building, A resident registration means for registering a user as a resident of the aforementioned dwelling unit, Authentication means for comparing the face captured by the aforementioned camera with the facial data of the resident, The resident tool is a user interface for the face registration means and the resident registration means, The system includes an administrator tool, which is a user interface for approving registration operations performed by the resident registration means, The user account for the resident tool and the user account for the administrator tool are different user accounts. The user account for the aforementioned administrator tool is handed over to the resident of the aforementioned dwelling unit along with the key to the front door. The user accounts for the aforementioned administrator tool are pre-registered for each dwelling unit in the aforementioned apartment building. Facial recognition system.

3. A face registration means for registering a user's face image or processed face data, A camera installed near the entrance door of an apartment unit in a multi-unit building, A resident registration means for registering a user as a resident of the aforementioned dwelling unit, Authentication means for comparing the face captured by the aforementioned camera with the facial data of the resident, The facial registration means includes a resident tool which is the user interface, For the resident registration means to be executed, the user account of the resident tool must be granted the right to execute the resident registration means, or the user account must be set as the recipient of the temporary passcode issued when the resident registration means is executed. The execution authority of the resident registration means and the destination of the passcode are set on a per-unit basis for each dwelling unit of the apartment building. Any resident of the aforementioned dwelling unit may transfer the execution permissions or the settings for the destination of the passcode to another person's user account. Facial recognition system.

4. A face registration means for registering a user's face image or processed face data, A camera installed near the entrance door of an apartment unit in a multi-unit building, A resident registration means for registering a user as a resident of the aforementioned dwelling unit, Authentication means for comparing the face captured by the aforementioned camera with the facial data of the resident, The resident tool is the user interface for the aforementioned face registration means, A security token is a tangible object delivered to the resident of the said residence, and is a device, instrument, or information medium for proving that the person is a resident of said residence. A fixed code, which is an encoded code, a key consisting of a string, or a key consisting of a number, is delivered to the resident of the said residence along with the security token, The resident registration means, when registering a resident, requires that the user performing the registration operation possesses the security token and also requires the input of the fixed code. Facial recognition system.

Images