Authentication system

Abstract

Shared facilities that require different behavior depending on the authenticated user can be made available using facial recognition. [Solution] This problem is solved by an authentication system comprising: a face data storage unit that stores a user's face image or processed face data; a shooting means installed for the entrance door of a shared facility used by multiple users; and an authentication unit that compares the face captured by the shooting means with the face data and unlocks the entrance door; and further comprising a conversion unit that converts the user's unique information or attribute information into data conforming to a data format adopted by the control unit of the shared facility or partial data including unique values ​​of that data, or a storage unit that stores data or partial data associated with the user.

Description

Technical Field

[0001] The present invention relates to an authentication system.

Background Art

[0002] In recent years, even in the real estate industry, the reconstruction of business models using digital technology, that is, DX (Digital Transformation), is rapidly spreading.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to make shared facilities that need to change their behavior according to an authenticated user available for face authentication.

Means for Solving the Problems

[0005] To solve the above problems, the authentication system of the present invention includes a face data storage unit that stores face images of users or face data that is processed data thereof, imaging means installed for an entrance door of shared facilities used by a plurality of the users, and an authentication unit that collates the face imaged by the imaging means with the face data and unlocks the entrance door. The authentication system further includes a conversion unit that converts the unique information or attribute information of the user into data conforming to a data format adopted by a control unit of the shared facilities or partial data including a hash value of the data, or a storage unit that stores the data or partial data associated with the user.

Effects of the Invention

[0006] Thus, according to the authentication system of the present invention, it becomes possible to use facial recognition for shared facilities that need to change their behavior according to the authenticated user. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram outlining the authentication system S. [Figure 2] This is a block diagram showing the types of authentication devices D installed in apartment building 10. [Figure 3] This is an illustrative diagram showing an example of how authentication device D is used. [Figure 4] This block diagram shows the functional configuration of each authentication device D. [Figure 5] This is a block diagram showing the mechanical configuration of the server device 30. [Figure 6] This is a sequence diagram showing the main processing steps in the authentication system S. [Figure 7] This is a data flow diagram illustrating the process by which resident ID 34 is distributed to authentication device d, which is responsible for room numbering equipment. [Figure 8] This is a data flow diagram showing the authentication process performed by authentication device d. [Figure 9] These are block diagrams and sequence diagrams showing modified versions of the authentication system S. [Modes for carrying out the invention]

[0008] Embodiments of the present invention will be described below with reference to the drawings. The authentication system S described below is a system that enables the operation of various living facilities in apartment buildings and other multi-unit dwellings by facial recognition of the resident.

[0009] <System Overview> Figure 1 is a block diagram illustrating the overview of the authentication system S in this embodiment. The authentication system S in this embodiment mainly consists of a server device 30, a user application 20, a resident management tool 29, and multiple authentication devices D.

[0010] The server device 30 holds various data necessary for the operation of the authentication system S, receives requests from the user application 20 and the resident management tool 29, and operates the settings of the authentication device D. In this configuration, the server device 30 is a virtual server built using a cloud hosting service, and the user application 20, the resident management tool 29, and each authentication device D are connected to the server device 30 via the internet. Note that the server device 30 is not limited to a cloud server, but may also be an on-premise server installed within the LAN of the apartment building 10 or its management company.

[0011] User app 20 is a dedicated application installed on smartphones owned by residents of apartment building 10. User app 20 is an example of a registration method that acquires facial images of residents of apartment building 10 (including prospective residents) and their families, and registers them as users of the authentication system S. User app 20 may also be dedicated software installed on the resident's PC or a web application.

[0012] The occupancy management tool 29 is a web application used by the apartment building manager, i.e., the management company or owner of apartment building 10. It operates the settings of each authentication device D by registering users registered in the user application 20 as residents of apartment building 10 and deregistering them when they move out.

[0013] Authentication device D is a camera installed near each piece of equipment in apartment building 10. When the captured face is successfully authenticated, it unlocks the door to that piece of equipment. As will be described in more detail later, each authentication device D in this configuration generates face data for matching from the face image acquired by the user application 20, and also includes an authentication unit that compares the captured face with that face data.

[0014] <Authentication Device Overview> FIG. 2 is a block diagram showing the types of authentication devices D installed in the condominium 10. In the condominium 10 of this embodiment, a first authentication device 41 is provided near the entrance door 11, which is the entrance door of the building of the condominium 10, a second authentication device 42 is provided near the household door 12, which is the entrance door of each household, a third authentication device 43 is provided near the mailbox 13, which is a collective mailbox, a fourth authentication device 44 is provided near the delivery box 14, and a fifth authentication device 45 is provided near the elevator door 15 on the same floor as the entrance door 11. The authentication device D of this embodiment is an example, and in addition to this, for example, an authentication device for unlocking the entrance door of the site garbage disposal area, the entrance door of the bicycle parking lot, or the entrance door of the parking lot may also be considered.

[0015] Here, among the authentication devices D of this embodiment, the second authentication device 42 provided on the household door 12 is not a common facility of the condominium 10, but is a proprietary facility basically used only by the residents of that household. And the second authentication device 42 is a facility that is not used when the household is vacant. Therefore, it seems reasonable that the second authentication device 42 uses the proprietary part power contracted by the resident. However, in this embodiment, the second authentication device 42 also operates with the common part power of the condominium 10. This is to enable management operations and the like of the second authentication device 42 even when the household is vacant. In addition, for example, it is also conceivable to supply the common part power only when the household is vacant, that is, only when the proprietary part power is not supplied.

[0016] <Details of the authentication device><体 FIG. 3 is an image diagram showing a usage example of the authentication device D. FIG. 3(a) shows a usage example of the first authentication device 41 of the entrance door 11, and FIG. 3(b) shows a usage example of the second authentication device 42 of the household door 12.

[0017] As shown in Fig. 3(a), the first authentication device 41 of this embodiment is installed on the decorative column at the entrance. The resident of the condominium 10 can open the entrance door 11 by having their face photographed by the camera 51 (first photographing means) of the first authentication device 41. The first authentication device 41 is provided with an LED light 54 (lighting) for illuminating the face of the subject, and the face of the resident can be photographed even at night.

[0018] In addition, the first authentication device 41 of this embodiment is installed outdoors where sunlight shines, and an ND filter 511 (light reduction filter) is attached to the camera 51. For example, the illuminance of direct sunlight in midsummer or its reflected light may exceed 100,000 lux depending on the time of day. When the ambient illuminance exceeds the limit of the camera 51, so-called whiteout or white blur may occur in the photographed image, and face authentication may stop functioning. That is, there is a possibility that the entrance door 11 cannot be unlocked by face authentication. For example, even if the camera 51 has an automatic exposure correction function and its maximum rated illuminance has not been exceeded, the accuracy of photography may be significantly reduced in an environment where the illuminance exceeds 50,000 lux. On the other hand, the illuminance required for face photography is about 500 lux even for a visible light camera, and it can be sufficiently covered by only the LED light 54. If it has an infrared camera, even a lower illuminance is sufficient. That is, the ambient illuminance that can be a problem for the first authentication device 41 installed outdoors is only "excessively high illuminance". Therefore, in this embodiment, an ND filter 511 is attached to the camera 51 of the first authentication device 41, and the amount of light entering the camera lens is restricted in advance so as to have a margin with respect to the maximum rated illuminance even in the ambient illuminance in midsummer. Specifically, the ND filter 511 is selected so that the illuminance after light reduction does not exceed 50,000 lux throughout the year. It is also conceivable to use a hood that surrounds at least a part of the lens of the camera 51 or the first authentication device 41 instead of the ND filter 511.

[0019] Furthermore, as shown in Figure 3(a), in addition to the first authentication device 41, the entrance in this configuration is also equipped with a keypad 111 for entering a PIN code to unlock the entrance door 11. In other words, the entrance door 11 in this configuration is equipped with both the first authentication device 41, which is the first unlocking means, and the keypad 111, which is the second unlocking means other than facial recognition. By preparing an alternative means in advance for when facial recognition is not possible, such as when the facial recognition equipment malfunctions, problems with facial recognition can be dealt with quickly.

[0020] As shown in Figure 3(b), the second authentication device 42 in this embodiment is installed adjacent to the apartment door 12. Residents of the apartment building 10 can unlock the apartment door 12 by having their face photographed by the camera 51 (second photographing means) of the second authentication device 42. The second authentication device 42, like the first authentication device 41, is also equipped with an LED light 54 that illuminates the face of the subject.

[0021] Furthermore, the apartment door 12, like the entrance door 11, is also equipped with a cylinder lock 121, which is a second unlocking means. Using the cylinder lock 121, the apartment door 12 can be unlocked even in the event of a power outage. In this type of apartment building 10, each resident can choose to disable the second authentication device 42 on the apartment door 12, that is, to unlock the apartment door 12 using only the cylinder lock 121 without using facial recognition. This allows residents who do not wish to use facial recognition to unlock their apartment door 12 to live in the same way as in conventional apartment buildings. Moreover, the apartment door 12 in this type of building can be configured so that it cannot be unlocked unless the cylinder lock 121 is turned with a key after successful authentication by the second authentication device 42. In other words, unlocking the apartment door 12 requires MFA (Multi-Factor Authentication) using both biometric authentication (facial recognition) and owner authentication (physical key). This can meet the needs of residents who require higher security, such as celebrities or women living alone.

[0022] Furthermore, in this configuration, the apartment door 12 is automatically locked by an auto-lock function 129 (see Figure 2) when the door is closed. By enabling the entrance door 11 and apartment door 12 of the apartment building 10 to be unlocked by facial recognition, residents can enter and exit the building and their apartments without having to carry keys or card keys or remember PINs. However, if the apartment door 12 does not have an auto-lock function 129, residents would have to lock the apartment door 12 themselves when going out, meaning they would end up taking their keys with them anyway. In this configuration, the apartment door 12 is equipped with an auto-lock function 129 as standard, thus making the introduction of facial recognition to the apartment door 12 fully effective. It is desirable that the auto-lock function 129 also be disabled when the second authentication device 42 is disabled, in order to prevent residents from being unexpectedly locked out. In this case, it is even more desirable that residents be able to switch the auto-lock function 129 on and off as they wish. This is because residents can turn the automatic locking function 129 on and off themselves, eliminating the need to coordinate with the apartment building manager or other relevant parties each time the function is switched on or off.

[0023] Figure 4 is a block diagram showing the functional configuration of each authentication device D. In this embodiment of the authentication system S, each authentication device D is equipped with a memory 52, which is a face data storage unit where each resident's face template 22 (described later) is stored, and an authentication program 53 that compares the face captured by the camera 51 with the face template 22 and unlocks the doors of each facility. In other words, this embodiment of the authentication system S is an edge-type face recognition system. Here, the cameras 51 equipped in the third authentication device 43, the fourth authentication device, and the fifth authentication device are all third-stage capturing means. Note that "memory" in this embodiment means memory in a broad sense and includes not only RAM and cache memory but also all storage devices. For example, memory here includes persistent storage such as HDDs, SSDs, and flash memory, regardless of whether it is internal or external storage.

[0024] The face template 22 referred to here is comparative face data obtained by extracting features from the resident's face image acquired by the user application 20, and is sometimes also called face vector, feature quantity, face model, face map, or biometric data. In this configuration, each authentication device D acquires the resident's face image from the server device 30, generates a face template 22 from this face image using the algorithm of the authentication program 53, and saves it.

[0025] In this embodiment, only the first authentication device 41 is equipped with the ND filter 511, because in this embodiment, the only authentication device D installed outdoors is the first authentication device 41. The ND filter 511 may be installed on all authentication devices D.

[0026] Furthermore, in this form of authentication system S, the authentication strength of the second authentication device 42 for the dwelling door 12 (see Figure 2) and the third authentication device 43 for the delivery box 14 are set more strictly than the other authentication devices D. Here, "authentication strength" refers to the strictness of authentication by the authentication program 53, that is, the high level of matching required. By making these authentication strengths stricter or more lenient according to the security risk (safety) of each piece of equipment, it is possible to achieve both the safety and convenience of residents' lives. In this form, the safety of the dwelling door 12, which directly affects the safety of daily life, and the delivery box 14, which may store expensive goods, are highly valued. It should be noted that the setting of authentication strength is not limited to this example; depending on the nature of the apartment building, one should be made stricter than the others, or one should be made more lenient than the others.

[0027] <Server equipment> Figure 5 is a block diagram showing the mechanical configuration of the server device 30. In this configuration, the server device 30 holds resident information 31, which is personal information of the residents of the apartment building 10. The resident information 31 includes the resident's name and contact information, as well as a resident ID 34 that identifies the resident's room number, and a resident's facial image 21 obtained by the user application 20. These are stored in the memory 39 of the server device 30. The server device 30 also holds authentication device information 32, which is address information, assigned equipment, and other management information for each authentication device D. Note that the functions and data of the server device 30 shown in Figure 5 are just examples, and the server device 30 has a wide variety of other functions and data.

[0028] The mailbox 13, parcel locker 14, and elevator door 15 in this configuration are equipment whose behavior changes according to the resident's room number. Specifically, when the third authentication device 43 of the mailbox 13 successfully authenticates, the door to the compartment corresponding to the authenticated resident's room number is unlocked. When the fourth authentication device 44 of the parcel locker 14 successfully authenticates, the door to the compartment where packages addressed to the authenticated resident's room number are stored is unlocked. When the fifth authentication device 45 of the elevator door 15 successfully authenticates, the destination of the elevator carrying the authenticated resident is automatically set to the floor indicated by the resident's room number. These pieces of equipment are products from various manufacturers, each with its own unique API. Hereinafter, such shared equipment will also be referred to as "room number equipment," and the third authentication device 43, fourth authentication device 44, and fifth authentication device 45 responsible for this room number equipment will be collectively referred to as "authentication device d (small D)."

[0029] Furthermore, the server device 30 in this configuration has a key conversion program 33 that converts the resident's room number into a native key, which is data that can be interpreted by the control unit of the room number equipment. The native key is data that conforms to the data format adopted by the control unit of each room number equipment, or partial data that includes the unique value of that data, i.e., the value of the room number portion. In the authentication system S in this configuration, the resident ID 34 corresponds to this partial data. In other words, the resident ID 34 in this configuration is information that can identify the resident's room number, and is also the native key. Therefore, the memory 39 in this configuration is also a key storage unit. The authentication device d in charge of the room number equipment obtains this resident ID 34 along with the resident's facial image 21 from the server device 30, thereby realizing behavior according to the resident's room number. As a result, residents and managers of the apartment building 10 can register or remove users from various room number equipment using only the room number, without having to understand the detailed specifications of each. In this configuration, as a result of the multi-purpose nature of resident ID 34, resident ID 34 also serves as the native key. However, the native key may be data separate from resident ID 34. In this case, the key conversion program 33 generates a separate native key from the room number and resident ID 34 set by the apartment manager in the occupancy management tool 29.

[0030] <Key processes of the authentication system> Figure 6 is a sequence diagram showing the main processing steps in the authentication system S. The processes performed by the authentication system S are broadly divided into "move-in procedures," daily "authentication processing," "re-registration processing" of face template 22, and "move-out procedures." Each of these will be explained below in reference to Figure 6.

[0031] When adding a new resident to apartment building 10, the apartment building manager first registers the prospective resident's name and contact information (phone number, email address, etc.) using the resident management tool 29. Upon registration, the server device 30 sends an email or SMS with move-in instructions to the prospective resident. The prospective resident then installs the user app 20 on their smartphone and registers other personal information and a facial image 21. In other words, they complete user registration. This step can be omitted if the prospective resident has already completed user registration. At this point, the facial image 21 taken using the user app 20 is pre-checked for image quality by the server device 30. If the facial image 21 is of insufficient quality, re-photography is requested. After user registration, the prospective resident applies to move into apartment building 10 using the user app 20. The apartment building manager receives and approves the application from the prospective resident. Once the apartment building manager approves the application for tenancy, the prospective resident's facial image 21 and the resident ID 34, which is a native key associated with the prospective room number, are distributed to each authentication device D. This completes the tenancy procedure.

[0032] In this configuration, the user application 20 can register the faces of not only the owner of the smartphone on which it is installed, but also multiple cohabitants, including family members of the resident, by associating them with the same room number. This allows cohabitants who do not own their own smartphones or PCs, such as children, to start using facial recognition smoothly.

[0033] In the authentication system S, daily authentication processing is primarily performed between the authentication device D and the equipment it is responsible for. By performing resident authentication and equipment unlocking operations between on-site devices, i.e., between edge devices, smooth authentication and unlocking processes are achieved. Only authentication processing logs are sent to the server device 30. This also prevents the server device 30 from being overloaded with authentication processing and other related tasks.

[0034] Unlike the move-in procedure, the re-registration process for face template 22 is completed solely through the user app 20. Residents can re-register their own face template 22 at their discretion using the user app 20. This is because a person's face is not permanently unchanged, and the accuracy of captured facial images may sometimes be insufficient. By allowing residents to quickly re-register their faces themselves without the need for support from the apartment building manager, smooth facial recognition can be easily maintained.

[0035] In the tenant move-out procedure, the apartment manager performs the move-out operation for that tenant using the tenant management tool 29. As a result, the tenant's face template 22 is deleted or deactivated in each authentication device D.

[0036] <Native key distribution process> Figure 7 is a data flow diagram showing the process by which resident ID 34 is distributed as a native key to authentication device d, which is responsible for the room number equipment. As mentioned above, authentication device d is a shared piece of equipment whose behavior changes depending on the resident's room number. Therefore, it is not enough to simply authenticate the resident's face and send a fixed signal to the equipment; the resident's room number must be determined, and then instructions that can be interpreted by the control unit of each piece of equipment must be given according to the room number. The distribution process of resident ID 34 will be explained below in accordance with Figure 7.

[0037] First, during the move-in procedure, the user application 20 obtains the prospective resident's facial image 21 and personal information. The apartment manager adds the room number set in the move-in management tool 29, and the key conversion program 33 (see Figure 5) generates a resident ID 34. Each authentication device d obtains the prospective resident's facial image 21 and its resident ID 34 from the server device 30. If the resident ID 34 is in a format unrelated to the native key, the server device 30 uses the key conversion program 33 to generate a native key that can be interpreted by the control unit of each piece of equipment, based on the room number set in the move-in management tool 29 and the resident ID 34, and distributes this to each authentication device d. Subsequently, each authentication device d extracts features from the obtained facial image 21 and generates a face template 22. In this configuration, the first authentication device 41 and the second authentication device 42, in addition to authentication device d, also obtain the facial image 21 and resident ID 34 from the server device 30.

[0038] Figure 8 is a data flow diagram showing the authentication process performed by authentication device d. When authentication device d authenticates a resident's face, it encodes the resident ID 34 corresponding to that resident and creates a data frame. This encoding process involves converting the resident ID 34 to hexadecimal and replacing the variable parts of standard commands with the resident ID 34. In this configuration, the resident ID 34 is a partial data part of the data format adopted by the control unit of authentication device d, which includes a unique value indicating the room number. In the encoding process, the resident ID 34 is converted to hexadecimal, and various flags, checksums, parity, etc., are added. As a result, the resident ID 34 becomes a native command for authentication device d to identify the door to be unlocked. The closer the data format of the resident ID 34 is to the final data frame beforehand, the less processing is required after successful authentication. The encoded data frame is transmitted to each piece of equipment as an RS422 signal.

[0039] In this embodiment of the authentication system S, the server device 30 generates a native key from the room number in advance and distributes it to each authentication device d. However, the method of generating the native key is not limited to this embodiment. For example, each authentication device d could be equipped with a key conversion program that dynamically converts the room number into a native key, or it could be equipped with a key storage unit in which the correspondence between the room number and the native key is predefined. In this case, during move-in procedures and facial re-registration processes, only information that can identify the room number is distributed to each authentication device d instead of the native key.

[0040] <Variation> Figure 9 shows a block diagram and sequence diagram illustrating a modified version of the authentication system S. In the above embodiment, the authentication system S was described as a so-called edge-type facial recognition system. However, the authentication system S is not limited to an edge configuration and can also be built as a cloud-type facial recognition system.

[0041] Figure 9(a) is a block diagram of the server device 30+ according to this modified example. The server device 30+ of this modified example includes a face template 22 and an authentication program 36 in addition to the configuration of the server device 30 of the above embodiment. In other words, the memory 39 of the server device 30+ in this modified example also serves as a face data storage unit. On the other hand, the authentication device D- in this embodiment lacks the face template 22 and the authentication program 53 from the configuration of the authentication device D of the above embodiment.

[0042] Figure 9(b) is a sequence diagram of the authentication process in this modified example. In this modified example, the facial image captured by the authentication device D- is directly transferred to the server device 30+. The server device 30+ compares the transferred facial image with the facial template 22 using the authentication program 36 and returns the authentication result to the authentication device D-. If authentication is successful, the authentication device D- unlocks the door of the equipment it is responsible for.

[0043] Although embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and various modifications can be made without departing from the spirit of the invention. For example, in the above embodiment, the authentication system S includes a server device 30, a user application 20, and a resident management tool 29, thereby automating many management tasks such as move-in and move-out procedures for the apartment building 10 and the re-registration process of the face template 22. However, the present invention can also be used in an authentication system that does not include, for example, a server device 30, and in which the administrator manually performs move-in and move-out procedures and face registration / re-registration procedures. [Explanation of symbols]

[0044] S: Authentication system, D, D-: Authentication device, d: Authentication device that changes behavior depending on the room number, 10: Apartment building (multi-unit housing), 20: User application (registration method), 21: Face image, 22: Face template (face data), 29: Tenant management tool, 30, 30+: Server device, 31: Resident information, 32: Authentication device information, 33: Key conversion program (key conversion unit), 34: Resident ID (information that can identify the room number, native key), 36: Authentication program (authentication unit), 39: Memory (room number storage unit, key storage unit, face data storage unit), 11: Entrance door (building entrance door), 111: Keypad (second unlocking means), 12: Apartment door (entrance door to apartment), 121: Cylinder lock, 129: Auto-lock function, 13: Mailbox (communal mailbox), 14: Parcel delivery box, 15: Elevator door, 41: First authentication device (first shooting means, first unlocking means), 42: Second authentication device (second shooting means, first unlocking means), 43: Third authentication device (third shooting means), 44: Fourth authentication device, 45: Fifth authentication device, 51: Camera, 511: ND filter (neutral density filter), 52: Memory (face data storage unit), 53: Authentication program (authentication unit), 54: LED light (lighting)

Claims

1. A face data storage unit where the user's face image or processed face data is stored, A photographic means installed for the entrance door of a shared facility used by multiple users, The system includes an authentication unit that compares the face captured by the aforementioned photographic means with the aforementioned facial data and unlocks the entrance door, The system further comprises a conversion unit that converts the user's unique information or attribute information into data conforming to a data format adopted by the control unit of the shared equipment, or partial data including unique values ​​of such data, or a storage unit in which the data or partial data associated with the user is stored. Authentication system.

2. The aforementioned shared facility is a parking facility. The authentication system according to claim 1.

3. The aforementioned photographic means includes both a light source and a light-reducing filter to illuminate the subject's face. The authentication system according to claim 1.

4. The registration means for acquiring the user's face image when registering the aforementioned face data is provided. The registration means is provided using a user terminal, which is an information terminal owned by the resident. The authentication system according to claim 1.

5. The user can re-register their own facial data at will using the registration means. The authentication system according to claim 4.

Images