Visitor management system and visitor management method
The QR code is generated by the portable terminal for ID and face authentication, which solves the privacy protection problem caused by pre-registration of facial images in the prior art, and realizes an entry and exit management system suitable for a variety of scenarios.
Patent Information
- Application Number
- CN202210089565.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-25
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2042-01-25
AI Technical Summary
The existing room management system has shortcomings in privacy protection, especially the pre-registration of facial images leads to user privacy leakage, and is not suitable for a variety of customer scenarios, especially outside the company.
The portable terminal generates and displays a QR code containing facial image feature quantity and authentication ID. The room control device reads the QR code for ID authentication and facial authentication, avoiding facial images registered in the system and achieving privacy protection.
It realizes the composite authentication of ID authentication and facial authentication without leaking facial image information, improves privacy protection, and is suitable for a variety of scenarios, especially customer management outside the company.
Smart Images

Figure CN115100771B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a visitor management system and a visitor management method for managing the entry and exit of visitors in a building such as a building. Background Art
[0002] The following entry and exit management system has been proposed (see patent document 1): a camera installed in front of the room is used to photograph the user, the photographed image is compared with the facial image of a pre-registered user to identify the user, an authentication code is sent to the user's portable terminal and the authentication is performed using the authentication code, and the electronic lock of the door is unlocked.
[0003] Patent Literature
[0004] Patent Document 1: Japanese Patent Application Publication No. 2020-42374 Summary of the invention
[0005] The technology disclosed in Patent Document 1 combines authentication using a facial image of a user pre-registered in a data center (face authentication) and authentication using an authentication code sent to a portable terminal (ID authentication) to achieve highly secure entry and exit management.
[0006] However, it is necessary to fetch the user's facial image into the data center in advance. Therefore, from the perspective of privacy protection, it is not suitable for users who are disgusted by obtaining their own facial images. In particular, the entry and exit management system disclosed in Patent Document 1 is not suitable for the use scenario of entertaining various customers outside the company to the company.
[0007] In view of the above situation, a visitor management method capable of performing composite authentication of ID authentication and face authentication while realizing privacy protection of the visitor is desired.
[0008] In order to solve the above-mentioned problems, a visitor management system according to one aspect of the present invention is a system including a portable terminal carried by a visitor and an entry and exit control device for controlling the entry and exit of the visitor to a facility provided with an electronic lock.
[0009] The portable terminal generates a two-dimensional code based on an authentication ID acquired in advance from an information management device and a feature amount of a facial image of a visitor, and displays the two-dimensional code.
[0010] The access control device obtains and stores the authentication ID issued by the information management device in advance, obtains the authentication ID read from the two-dimensional code displayed on the portable terminal and the feature amount of the visitor's facial image. Then, the access control device compares the authentication ID obtained from the two-dimensional code with the authentication ID issued by the information management device to perform ID authentication processing, and also compares the feature amount of the visitor's facial image obtained from the two-dimensional code with the feature amount of the visitor's facial image captured by the camera in the facility to perform facial authentication processing. Then, the access control device controls the unlocking and locking of the electronic lock based on the results of the ID authentication processing and the facial authentication processing.
[0011] According to at least one embodiment of the present invention, the feature value of the facial image and the authentication ID are converted into a QR code and displayed in a portable terminal carried by the visitor, and the QR code is read by the entry and exit control device, and the QR code is used as an authentication unit when entering the room. With such a structure, the facial image of the visitor is not registered in the system, so it is possible to perform a composite authentication of ID authentication and facial authentication while protecting privacy.
[0012] Other problems, structures, and effects than those described above will become apparent from the following description of the embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Figure 1 This is a schematic configuration diagram showing an example of a visitor management system in one embodiment of the present invention.
[0014] Figure 2 This is a block diagram showing a hardware configuration example of the entry and exit control device in one embodiment of the invention.
[0015] Figure 3 This is a block diagram showing a hardware configuration example of an information management device according to one embodiment of the present invention.
[0016] Figure 4 This is a block diagram showing a hardware configuration example of a portable terminal in one embodiment of the present invention.
[0017] Figure 5 It is a diagram showing a configuration example of authentication information held by the entry and exit control device in one embodiment of the present invention.
[0018] Figure 6 This is a diagram showing a configuration example of a QR code reading result held by the entry and exit control device in one embodiment of the present invention.
[0019] Figure 7 It is a diagram showing a configuration example of a user information table held by the information management device according to one embodiment of the present invention.
[0020] Figure 8 It is a diagram showing a configuration example of an authentication information table held by the information management device in one embodiment of the present invention.
[0021] Fig. 9 It is a diagram showing a configuration example of a visitor information table held by the information management device according to one embodiment of the present invention.
[0022] Fig.10 It is a diagram showing a configuration example of user information held by a portable terminal in one embodiment of the present invention.
[0023] Fig.11 It is a diagram showing a configuration example of visitor information held in a portable terminal according to one embodiment of the present invention.
[0024] Fig.12 This is a sequence diagram showing an example of a process procedure from visitor information registration to unlocking / normalization of an electronic lock based on user authentication using a QR code in one embodiment of the present invention.
[0025] Fig.13 This is a diagram showing a display example of a visitor information list and an authentication QR code in one embodiment of the present invention.
[0026] Description of Reference Numerals
[0027] 1…Visitor management system, 10…Building, 20…Entry and exit control device, 21…Processing unit, 22…Storage unit, 23…Authentication information, 24…QR code reading result, 25…External input and output unit, 26…Image acquisition and analysis unit, 27…Communication processing unit, 31…QR code reader, 32…Camera, 33…Electronic lock, 40…Network line, 50…Information management device, 51…Visitor information registration unit, 52…Authentication ID issuing unit, 53… User registration unit, 54… storage unit, 55… user information table, 56… authentication information table, 57… visitor information table, 60… portable terminal, 61… dedicated application, 62… user registration request unit, 63… facial photo registration unit, 64… QR code generation unit, 65… storage unit, 211… information acquisition unit, 212… authentication ID comparison unit, 213… feature value comparison unit, 214… door control unit, 640… display device, 641… authentication QR code. DETAILED DESCRIPTION
[0028] Hereinafter, examples of the mode for implementing the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same function or structure are denoted by the same reference numerals and repeated descriptions are omitted.
[0029] <Overall structure of visitor management system>
[0030] Figure 1 1 is a schematic diagram showing an example of a visitor management system in one embodiment of the present invention. The visitor management system 1 shown in the figure includes an entry and exit control device 20 installed for each building 10, an information management device 50 installed in a data center, and a portable terminal 60. A plurality of entry and exit control devices 20 may be installed. The entry and exit control device 20 installed in the building 10 is connected to the information management device 50 via a network line 40 such as the Internet.
[0031] [Building facilities]
[0032] The building 10 is provided with a QR code reader 31, a camera 32, and an electric lock 33 as the entry and exit equipment of the building 10. The entry and exit control device 20 is connected to the QR code reader 31, the camera 32, and the electric lock 33 as the entry and exit equipment.
[0033] The QR code reader 31 is a device that reads the QR code (registered trademark) possessed by a person entering or leaving the building 10 and converts it into binary data. The QR code reader is an example of a two-dimensional code reader. In this embodiment, the QR code is used as the two-dimensional code, but a matrix type two-dimensional code or a stack type two-dimensional code other than the QR code may also be applied.
[0034] The camera 32 is a device for capturing facial images of people entering and exiting the managed area of the building 10. Buildings and managed areas are examples of facilities that are targets of the entry and exit control device 20 to control the entry and exit of visitors.
[0035] The electronic lock 33 is a lock installed at the boundary of each management zone of the building 10. A QR code reader 31 and a camera 32 are installed in pairs on one side or both sides of the management zone boundary. The electronic lock 33 is unlocked and locked according to the unlocking command and locking command from the entry and exit control device 20, thereby opening and closing the door and controlling the passage of users to the management zone.
[0036] [Entry and exit control device]
[0037] The entry and exit control device 20 includes a processing unit 21 , a storage unit 22 , an external input and output unit 25 , an image acquisition and analysis unit 26 , and a communication processing unit 27 .
[0038] The processing unit 21 is connected to the storage unit 22, the external input / output unit 25, the image acquisition and analysis unit 26, and the communication processing unit 27. The processing unit 21 is embodied by executing the control program stored in the storage unit 22, and controls the operation of the entry and exit control device 20. The processing unit 21 includes an information acquisition unit 211, an authentication ID comparison unit 212, a feature comparison unit 213, and a door control unit 214.
[0039] The information acquisition unit 211 acquires information required for the entry and exit control of the entry and exit control device 20. For example, the information acquisition unit 211 acquires the visit information input by the meeting person in charge, the information contained in the QR code read by the QR code reader 31, the feature amount of the facial image obtained by the image acquisition and analysis unit 26, etc. As described later, in this embodiment, the feature amount information of the facial image is transmitted from the portable terminal 60 to the entry and exit control device 20 using the QR code in which the feature amount information of the facial image is embedded. Since the amount of information of the feature amount of the facial image is large, the two-dimensional code with a large amount of data is suitable for transmitting the feature amount information of the facial image between two devices.
[0040] The authentication ID comparison unit 212 performs a process of comparing the authentication ID (authentication identifier) included in the QR code read by the QR code reader 31 with a previously stored authentication ID issued in association with a visitor's visit schedule (ID authentication process).
[0041] The feature amount comparison unit 213 performs a process (face recognition process) of comparing the feature amount of the facial image of the visitor included in the QR code read by the QR code reader 31 with the feature amount of the facial image of the visitor captured by the camera 32 in the visited facility (for example, the management section of the building 10). Since a known technique can be used in the process of comparing whether the feature amount of one image is consistent with the feature amount of another image, a detailed description is omitted.
[0042] The door control unit 214 controls unlocking / locking of the electronic lock 33 based on the result of the ID authentication process by the authentication ID comparison unit 212 and the result of the face authentication process by the feature amount comparison unit 213 .
[0043] Authentication information 23 and a QR code reading result 24 are stored in the storage section 22. Details of the authentication information 23 and the QR code reading result 24 will be described later.
[0044] The external input / output unit 25 is connected to the QR code reader 31, the camera 32, and the electronic lock 33. The external input / output unit 25 inputs information output from the QR code reader 31, the camera 32, and the electronic lock 33 to the processing unit 21. The external input / output unit 25 also inputs information output from the processing unit 21 to the QR code reader 31, the camera 32, and the electronic lock 33.
[0045] The image acquisition and analysis unit 26 acquires and analyzes the captured image captured by the camera 32. The image acquisition and analysis unit 26 extracts the facial image of the person who is going to enter or exit the managed area based on the analysis result and calculates the feature value of the facial image.
[0046] The communication processing unit 27 processes data input and output via, for example, Ethernet (registered trademark) etc. Data communication is performed between the processing unit 21 and the network line 40 via the communication processing unit 27 .
[0047] [Information management device]
[0048] The information management device 50 includes a visitor information registration unit 51 , an authentication ID issuing unit 52 , a user registration unit 53 , a storage unit 54 , and a communication processing unit 58 .
[0049] The visit information registration unit 51 is a function for registering visitor information (name, affiliation, and email address of the visitor) who visits the building 10 and visit schedule information (visit name, date and time, and location) as visit information.
[0050] When the visitor information (visitor information and visit schedule information) is registered in the visitor information registration unit 51, the authentication ID issuing unit 52 issues an authentication ID assigned to the visitor. The issued authentication ID is sent to the entry and exit control device 20 and the portable terminal 60, and is used for user authentication of the visitor on the day of the visit.
[0051] The user registration unit 53 is a function to confirm the authenticity of the email address specified by the user. The user registration unit 53 issues a one-time password to the email address specified by the user, and monitors whether the one-time password is input into the information management device 50 within a certain period of time. Then, the user registration unit 53 confirms and registers that the specified email address is a legitimate email address managed by the user by inputting the one-time password.
[0052] The storage unit 54 includes a user information table 55, an authentication information table 56, and a visitor information table 57. Details of these information tables will be described later.
[0053] The communication processing unit 58 processes data input and output via Ethernet, for example. Data communication is performed between the information management device 50 and the network line 40 via the communication processing unit 58 .
[0054] [Portable terminal]
[0055] The portable terminal 60 is a portable terminal that can be installed with applications such as a smart phone or a tablet computer carried by a visitor. In addition, it is not limited to a terminal owned by an individual, and a terminal lent from a company, etc. The portable terminal 60 includes a dedicated application 61, a camera 68, and a communication processing unit 69.
[0056] The dedicated application 61 is an application for visitors installed in the portable terminal 60 for use. Hereinafter, the dedicated application is simply referred to as a “dedicated application.” The dedicated application 61 includes a user registration request unit 62 , a facial photo registration unit 63 , a QR code generation unit 64 , and a storage unit 65 .
[0057] The user registration request unit 62 is a function for requesting user authentication from the user registration unit 53 of the information management device 50 based on the email address registered by the user. By performing user authentication in this function, it is possible to prevent a third party from impersonating a legitimate visitor and illegally using the dedicated application 61.
[0058] The facial photo registration unit 63 is a function for taking in the facial photo data of the user and registering and maintaining it as feature data used in facial authentication. In addition, the facial photo data can be taken by specifying and taking in the saved facial photo data, or by cooperating with the camera of the portable terminal 60 to directly take in the facial photo taken at the location.
[0059] The QR code generation unit 64 is a function of generating a QR code based on data obtained by combining the authentication ID associated with the visit information specified by the user with the pre-stored feature data. In addition, when generating the QR code, the authentication ID and the feature data are encrypted and then QR-encoded, so that the authentication ID and the feature data can be concealed.
[0060] The storage section 65 has user information 66 and visitor information 67. Details of the user information 66 and visitor information 67 will be described later.
[0061] The camera 68 is a device for photographing an arbitrary subject. In the present embodiment, the camera 68 is used to photograph the face of a person visiting the building 10.
[0062] The communication processing unit 69 processes data input and output by wireless communication, for example. Data communication is performed between the portable terminal 60 and the network line 40 via the communication processing unit 69 .
[0063] [Hardware structure of the access control device]
[0064] Figure 2 Yes means Figure 1 1 is a block diagram of a hardware configuration example of the entry and exit control device 20 shown. Figure 2 The hardware configuration example of the entry and exit control device 20 shown corresponds to a computer and can be realized using a personal computer or the like.
[0065] The entry and exit control device 20 includes a CPU (Central Processing Unit) 210 connected to a system bus, a ROM (Read Only Memory) 220, a RAM (Random Access Memory) 230, and a nonvolatile memory 240. In addition, it includes a network interface (denoted as "network IF" in the figure) 250 for communicating with an external device.
[0066] The CPU 210 reads out and executes the program code of the software that realizes the functions of each part of the entry and exit control device 20 from the ROM 220. Variables generated in the middle of the calculation process performed in the entry and exit control device 20 are temporarily written in the RAM 230. The CPU 210 executes the program code recorded in the ROM 220 to realize the various functions of the entry and exit control device 20.
[0067] As the network interface 250 , for example, a NIC (Network Interface Card) or the like is used, and various data can be transmitted and received between devices via a LAN (Local Area Network) or a dedicated line connected to a terminal of the NIC. Figure 1 The functions of the communication processing unit 27 are implemented through the network interface 250 .
[0068] The nonvolatile memory 240 is composed of a nonvolatile storage device such as a hard disk or a SSD (Solid State Drive), and semi-permanently stores and saves programs and data required for the CPU 210 to operate. Figure 1 The storage unit 22.
[0069] The entry and exit control device 20 is provided with an input unit 260 and an output unit 270 as needed. The reading results of each QR code reader 31, the captured images of each camera 32, the sensor signals indicating the opening and closing states of each electronic lock 33, etc. are input to each input unit 260. In addition, the output unit 270 outputs control signals for each QR code reader 31, each camera 32, and each electronic lock 33, respectively.
[0070] [Hardware structure of information management device]
[0071] Figure 3 Yes means Figure 1 2 is a block diagram of an example of a hardware configuration of the information management device 50 shown in FIG. Figure 3 The hardware configuration of the information management device 50 shown is an example of a computer and can be realized using a personal computer or the like.
[0072] The information management device 50 also includes a CPU 510, a ROM 520, a RAM 530, and a non-volatile memory 540 (equivalent to a memory card) connected to the system bus. Figure 1 In addition, the information management device 50 has a network interface (referred to as "network IF" in the figure) 550 for communicating with external devices. Figure 2 The hardware structure and function of the entry and exit control device 20 described in the above are the same, so the description is omitted. However, the information management device 50 does not have a function equivalent to Figure 2 The structures of the input part 260 and the output part 270 are shown.
[0073] [Hardware structure of portable terminal]
[0074] Figure 4 Yes means Figure 1 1 is a block diagram of an example of a hardware configuration of the portable terminal 60 shown. Figure 4 The hardware configuration of the portable terminal 60 shown is an example of a computer and can be realized using a personal computer or the like.
[0075] The portable terminal 60 also includes a CPU 610, a ROM 620, a RAM 630, and a non-volatile memory 660 (equivalent to Figure 1 The CPU 610 executes the program code of the dedicated application 61 recorded in the ROM 620, thereby realizing various functions of the portable terminal 60. In addition, the portable terminal 60 has a network interface (marked as "network IF" in the figure) 670 for communicating with external devices. These structures and functions are similar to Figure 2 The hardware configuration and function of the entry and exit control device 20 described in are the same as those described in , so the description is omitted.
[0076] In addition, the portable terminal 60 includes a display device 640 and an input device 650. The display device 640 is a display panel such as a liquid crystal display, and displays a GUI (Graphical User Interface) screen, the result of processing performed by the CPU 610, etc. The input device 650 uses a touch panel, a pointing device such as a mouse, a keyboard, etc., and the user can operate the input device 650 to input information and instructions. The input device 650 generates an input signal corresponding to the user's operation and provides it to the CPU 610. In addition, the entry and exit control device 20 and the information management device 50 may also include a display device 640 and an input device 650.
[0077] Next, information (table) stored in the storage unit included in each of the entry and exit control device 20, the information management device 50, and the portable terminal 60 will be described.
[0078] [Authentication information of access control device]
[0079] Figure 5 The following is a configuration example of the authentication information 23 held by the room entry and exit control device 20 in this embodiment. The authentication information 23 includes an authentication ID 23a, a pass-through reader number 23b, a valid period start date 23c, a valid period end date 23d, and a pass-through time zone 23e.
[0080] The authentication ID 23a item stores unique authentication information issued to the visitor when the visitor information is registered. Even when the same visitor registers the visitor information, a different unique ID (identification information) is given as the authentication information, thereby further improving security. In this embodiment, the ID is composed of numbers and letters.
[0081] In the item of the pass-through reader number 23 b , a list of numbers uniquely identifying the pass-through QR code readers 31 is stored for the authentication ID 23 a assigned to the visitor.
[0082] In the item of the effective period start date 23c, the date when authentication permission starts is stored for the authentication ID 23a assigned to the visitor.
[0083] In the item of the validity period end date 23d, the date when the authentication permission ends is stored for the authentication ID 23a assigned to the visitor.
[0084] In the item of the permitted travel time period 23e, a time period during which authentication is permitted is stored for the authentication ID 23a assigned to the visitor.
[0085] [QR code reading result of access control device]
[0086] Figure 6 The structure example of the QR code reading result 24 held by the room entry and exit control device 20 in this embodiment is shown. The QR code reading result 24 has an item of reading date and time 24a, an item of reading reader number 24b, an item of authentication ID 24c, and an item of feature quantity 24d. The QR code reading result 24 is an area for temporarily storing the result of reading the QR code generated by the visitor through the dedicated application 61 from the QR code reader 31.
[0087] The date and time when the QR code reader 31 reads the QR code is stored in the item of the reading date and time 24 a .
[0088] The item of the reading reader number 24 b stores a number that uniquely identifies the QR code reader 31 that has read the QR code.
[0089] The authentication ID 24c item stores the authentication ID read from the QR code.
[0090] The feature amount 24d item stores the feature amount of the face image read from the QR code.
[0091] [User information table of information management device]
[0092] Figure 7 FIG. 5 shows a configuration example of a user information table 55 maintained by the information management device 50 in this embodiment. The information management device 50 maintains a record of the user information table 55 for the visitor in advance, or detects a visitor information registration ( Fig.12 A record is generated when a visitor who starts registering in step S1) inputs input.
[0093] The user information table 55 has an item of user ID 55a, an item of name 55b, an item of affiliation 55c, an item of mail address 55d, and an item of confirmation completion flag 55e.
[0094] In the item of user ID 55 a , a unique number for uniquely identifying a record stored in the user information table 55 is stored.
[0095] The name of the user registered in the record is stored in the item of name 55b.
[0096] The item of the affiliation 55c stores information such as the affiliation company and the affiliation department of the user registered in the record.
[0097] The item of the email address 55d stores the email address held by the user registered in the record. In the visitor management system 1 of the present embodiment, since the email address is associated with the visitor on a one-to-one basis, the information stored in the item of the email address 55d is not allowed to be duplicated.
[0098] The item of the confirmation completion flag 55e stores flag information of 0 or 1 indicating whether the user (i.e., the email address) registered in the record has confirmed the user registration through the dedicated application 61. As described above, the confirmation of the email address is performed by issuing a one-time password to the email address from the information management device 50. In addition, since the information stored in these user information tables 55 includes personal information, it is preferably stored after encryption.
[0099] [Authentication information table of information management device]
[0100] Figure 8FIG. 5 shows an example of the structure of the authentication information table 56 maintained by the information management device 50 in this embodiment. The records stored in the authentication information table 56 are recorded by the visitor information registration unit 51 when the visitor information (visitor information and visitor schedule information) is registered, and when the authentication ID is issued by the authentication ID issuing unit 52 ( Fig.12 Step S1) is generated.
[0101] The authentication information table 56 has items of authentication information ID 56a, authentication ID 56b, building ID 56c, access-permitted reader number 56d, valid period start date 56e, valid period end date 56f, and access-permitted time period 56g.
[0102] In the item of authentication information ID56a, a unique number for uniquely identifying a record (authentication information) in the authentication information table 56 is stored.
[0103] In the item of the authentication ID 56 b , unique authentication information (here, authentication ID) issued to the visitor when registering visit information is stored.
[0104] The building ID 56 c item stores a unique number that uniquely identifies the building that is allowed to pass through by the authentication information registered in the record. The building ID is associated with a place (building, facility, etc.) registered in the place 57 f of the visitor information table 57 .
[0105] In the entry of the pass-permitted reader number 56d, a list of numbers of the QR code readers 31 that uniquely identify the building 10 to which the pass is permitted is stored for the authentication ID 56b assigned to the visitor.
[0106] In the item of the effective period start date 56e, the date when authentication permission starts is stored for the authentication ID 56b assigned to the visitor.
[0107] In the item of the valid period end date 56f, the date when the authentication permission ends is stored for the authentication ID 56b assigned to the visitor.
[0108] In the item of the permitted passage time period 56g, a time period during which passage (authentication) is permitted is stored for the authentication ID 56b assigned to the visitor.
[0109] The effective period start date 56 e , the effective period end date 56 f , and the permitted travel time zone 56 g are set based on the contents of the visit date and time 57 e of the visit information table 57 .
[0110] [Incoming information table of the information management device 50]
[0111] Fig. 9The following is a configuration example of the visitor information table 57 held by the information management device 50 in this embodiment. The visitor information table 57 has visitor ID 57a, user ID 57b, authentication information ID 57c, visitor name 57d, visit date and time 57e, and location 57f.
[0112] In the item of visitor ID 57 a , a unique number for uniquely identifying a record in the visitor information table 57 (hereinafter also referred to as a “visitor information record”) is stored.
[0113] The item of user ID 57 b stores the item of user ID 55 a in the user information table 55 for uniquely identifying the visitor associated with the visit information record.
[0114] The item of authentication information ID57c stores the item of authentication information ID56a of the authentication information table 56 for uniquely identifying the authentication ID assigned to the visitor associated with the visit information record.
[0115] The item of the visit name 57d stores a registered name indicating the purpose of the visit and the like added to the visit information record.
[0116] The item of the visit date and time 57e stores the date and time registered as the schedule of the visit information record.
[0117] The place visited by the visitor associated with the visit information record is stored in the item of the place 57f.
[0118] [User information of portable terminal]
[0119] Fig.10 The following is a diagram showing a configuration example of user information 66 stored in the dedicated application 61 of the portable terminal 60 in the present embodiment. The user information 66 includes an item of user ID 66a, an item of name 66b, an item of affiliation 66c, an item of email address 66d, an item of confirmation mark 66e, an item of facial photo 66f, and an item of feature amount 66g. The user generates the user information 66 in advance through the dedicated application 61 and stores it in the storage unit 65.
[0120] In the item of the user ID 66 a , the value of the user ID 55 a of the record related to the user who possesses the portable terminal 60 among the records of the user information table 55 held by the information management device 50 is stored.
[0121] In the item of the name 66 b , the value of the name 55 b of the record related to the user among the records in the user information table 55 is stored.
[0122] The item of the category 66 c stores the value of the category 55 c of the record related to the user in the record of the user information table 55 .
[0123] The item of the mail address 66 d stores the value of the mail address 55 d of the record related to the user in the record of the user information table 55 .
[0124] The item of the confirmed flag 66 e stores the value of the confirmed flag 55 e of the record related to the user in the record of the user information table 55 .
[0125] The facial photo data (facial image) taken in by the facial photo registration unit 63 or information indicating a storage destination of the facial photo data is stored in the facial photo 66f item.
[0126] The feature amount data calculated from the facial photo data taken in by the facial photo registration unit 63 is stored in the feature amount 66g item.
[0127] [Incoming information from mobile terminals]
[0128] Fig.11 The following is a diagram showing a configuration example of visit information 67 stored in the dedicated application 61 of the portable terminal 60 in the present embodiment. The visit information 67 includes a visit ID 67a, a visit name 67b, a visit date and time 67c, a location 67d, and an authentication ID 67e. Before visiting a target facility, the user uses the dedicated application 61 to obtain information related to the visit information 67 from the information management device 50, and stores the obtained information in the visit information 67.
[0129] In the item of the visitor ID 67 a , the value of the visitor ID 57 a of the record related to the user who owns the portable terminal 60 among the records of the visitor information table 57 held in the information management device 50 is stored.
[0130] The item of the visitor name 67 b stores the value of the visitor name 57 d of the record related to the user in the record of the visitor information table 57 .
[0131] The item of the visit date and time 67 c stores the value of the visit date and time 57 e of the record related to the user in the record of the visit information table 57 .
[0132] The item of the place 67 d stores the value of the place 57 f of the record related to the user among the records in the visit information table 57 .
[0133] The value of the authentication ID 56b of the authentication information table 56 identified by the value of the authentication information ID 57c of the record related to the user in the record of the visitor information table 57 is stored in the item of the authentication ID 67e.
[0134] [Operation of visitor management system 1]
[0135] Next, we will refer to Fig.12 The operation of the visitor management system 1 according to the present embodiment will be described.
[0136] Fig.12 This is a sequence diagram showing the entire process from visitor information registration to unlocking / locking of the electronic lock 33 based on user authentication using a QR code (checking of an authentication ID and checking of feature amounts of a facial image) in the present embodiment.
[0137] The meeting person in charge uses the GUI (web application) of the visitor information registration unit 51 of the information management device 50 installed in the data center to register the visitor information (visitor information and visit schedule information). If the meeting person in charge visits the information management device 50 from an information processing device (such as a personal computer) not shown in the figure via the network line 40, the visitor information registration unit 51 provides the information processing device with a GUI for registering the visitor information. The visitor information registration unit 51 registers each item of the visitor information table 57 based on the input to the GUI of the meeting person in charge. When the visitor information registration operation is performed, the process starts. Fig.12 Processing shown.
[0138] First, in step S1, if the visit information (visitor information and visit schedule information) of the person in charge of the meeting is registered in the information management device 50, the authentication ID issuing unit 52 of the information management device 50 will number the authentication ID assigned to the registered visitor and store it in the authentication information table 56. In the case of a visitor who registers for the first time, a record containing the name, affiliation, and email address of the visitor is newly stored in the user information table 55. At this time, "0" is written to the confirmation completion flag 55e of the record. In addition, the visit schedule information and the user ID and authentication information ID of the visitor associated with the visit schedule information are stored in the visit information table 57.
[0139] Next, in step S2, the information management device 50 (for example, the authentication ID issuing unit 52) transmits the information of the record stored in the authentication information table 56 to the entry and exit control device 20 of the building 10 visited by the visitor registered in step S1. That is, the information management device 50 transmits the items of the authentication information ID 56a, the authentication ID 56b, the building ID 56c, the pass-through reader number 56d, the effective period start date 56e, the effective period end date 56f, and the pass-through allowed time period 56g to the entry and exit control device 20.
[0140] In step S3, the processing unit 21 (information acquisition unit 211) of the entry and exit control device 20 stores each information of the authentication information table 56 received from the information management device 50 in the authentication information 23 (except the authentication information ID 56a).
[0141] In step S4, the visitor uses the dedicated application 61 of the portable terminal 60 carried by the visitor to make a user registration request to the information management device 50 from the user registration request unit 62 of the dedicated application 61. The user registration request is mainly for the purpose of confirming the authenticity of the email address input by the user, and is only performed once after the dedicated application 61 is installed.
[0142] Next, in step S5, the user registration unit 53 of the information management device 50 issues a one-time password to the email address input by the user. Then, the user registration unit 53 confirms the email address of the user by sending the one-time password from the user registration request unit 62 of the dedicated application 61 within a certain period of time. When the user registration unit 53 correctly confirms the email address of the user, it rewrites the confirmation completion flag 55e of the record of the user stored in the user information table 55 from "0" to "1". In addition, in the user registration request unit 62 of the dedicated application 61, if the confirmation of the user's email address is successful, the confirmation completion flag 66e of the user information 66 is rewritten from "0" to "1".
[0143] Next, in step S6, the information management device 50 (e.g., the authentication ID issuing unit 52) sends the authentication ID 56b of the authentication information table 56 generated in step S1 and the visit information including at least the visit schedule information of the visit information table 57 to the portable terminal 60 of the visitor (e.g., equivalent to user ID "1"). In addition, when the confirmation completion flag 55e of the record of the visitor stored in the user information table 55 is "1", step S5 is not necessary, so step S6 is performed immediately after step S2 is completed.
[0144] Next, in step S7 , the dedicated application 61 (eg, user registration request unit 62 ) of the portable terminal 60 stores the information (authentication ID and visit information including at least visit schedule information) received from the information management device 50 in the visit information 67 .
[0145] Next, in step S8, the visitor obtains his / her own facial photo from the dedicated application 61 (facial photo registration unit 63) of the portable terminal 60. The facial photo registration unit 63 stores the acquired facial photo data (facial image) and the feature quantity data calculated based on the facial photo data in the user information 66. In addition, the acquisition of the visitor's facial photo only needs to be performed once after the dedicated application 61 is installed. In addition, in the acquisition of the facial photo, the facial photo data stored in advance in the non-volatile memory 660 of the portable terminal 60 may be acquired, or the feature quantity data (data set) extracted from the facial photo data by other applications of the portable terminal 60 may be used.
[0146] Next, in step S9, the visitor selects arbitrary visitor information from the list of visitor information 67 maintained by the dedicated application 61 through the dedicated application 61. Then, the QR code generation unit 64 of the dedicated application 61 generates a QR code based on the authentication ID 67e of the record corresponding to the selected visitor information and the feature amount 66g of the facial photo 66f registered in the user information 66, and displays it on the display device 640 of the portable terminal 60.
[0147] Here, we explain the visitor information list and the QR code for authentication.
[0148] Fig.13 An example of displaying a visitor information list and a QR code for authentication is shown. Fig.13 The upper side shows a screen showing a list of visitor information. Fig.13 The lower side shows a screen displaying a QR code for authentication.
[0149] The visitor information list displays the information stored in the portable terminal 60 carried by the visitor (for example, user ID "1"). Fig.11 The visit information 67 shown is visit schedule information (visit name 67b, visit date and time 67c, and location 67d). Fig.13 It also shows Fig.11 When the visitor selects the intended visitor information from the visitor information list displayed on the screen of the display device 640, a verification QR code 641 for the selected visitor information is displayed.
[0150] In addition, Fig.13 In the example, it is basically determined that the destination management area (in Fig.13 The path of the conference room B) is the door and the QR code reader 31, so the pass-through reader number is not displayed. However, the pass-through reader number can also be displayed on the screen displaying the authentication QR code 641.
[0151] Next, in step S10 , the visitor places the QR code (authentication QR code 641 ) generated and displayed by the dedicated application 61 on the reading surface of the QR code reader 31 installed in the management section of the building 10 at the visit destination.
[0152] Next, in step S11, the QR code reader 31 of the entry and exit control device 20 reads the QR code (authentication QR code 641) displayed on the display device 640 of the portable terminal 60. Then, the processing unit 21 (information acquisition unit 211) of the entry and exit control device 20 acquires the authentication ID and the feature value of the facial image from the QR code read by the QR code reader 31.
[0153] Next, in step S12, the information acquisition unit 211 uses the read authentication ID 24c as a key to acquire a record having the same authentication ID 23a from the authentication information 23. Then, the authentication ID comparison unit 212 determines whether (1) the reader number of the QR code reader 31 that read the QR code is included in the pass-through reader number 23b of the record acquired from the authentication information 23, and (2) the date of the reading day is included between the effective period start date 23c and the effective period end date 23d, and (3) the time when the QR code was read is included in the pass-through time period 23e. Then, the authentication ID comparison unit 212 authenticates the authentication ID as a pass-through ID if the judgment conditions (1) to (3) are satisfied. When the authentication ID checking unit 212 authenticates the authentication ID 24c as a pass-permitted ID, the reading date and time 24a, the reading reader number 24b, and the feature value 24d associated with the authentication ID 24c are newly added to the QR code reading result 24 and stored.
[0154] Next, in step S13, the image acquisition and analysis unit 26 periodically acquires images of people within the photographing range of the camera 32 installed in pair with the QR code reader 31. Basically, from the perspective of monitoring and prevention, the camera 32 installed in the management area of the building 10 periodically performs photography. In addition, the camera 32 may perform photography when it detects that a person is within the photographing range including the QR code reader 31.
[0155] Next, in step S14, the image acquisition and analysis unit 26 cuts out the face part from the acquired photographic image and then calculates the feature amount. When the image acquisition and analysis unit 26 acquires the facial images of multiple persons, it calculates the feature amount of all persons. Then, the feature amount comparison unit 213 acquires the record from the QR code reading result 24 using the reader number 24b of the QR code reader 31 paired with the camera 32 that acquired the photographic image as a key. If the feature amount 24d of the acquired record is compared with the feature amount calculated based on the image captured by the camera 32 and they are consistent, the person captured by the camera 32 is authenticated as a user allowed to pass.
[0156] As described above, in the present embodiment, while the visitor passes by while placing the mobile terminal 60 displaying the QR code on the QR code reader 31 , user authentication based on the composite authentication of ID authentication and face authentication can be completed.
[0157] Next, in step S15, the door control unit 214 of the room entry and exit control device 20 unlocks the QR code reader 31 used in the user authentication process of steps S11 to S14 and the electronic lock 33 at the boundary of the management area managed by the camera 32, and opens the door. When the door opening and closing of the electronic lock 33 is completed, the door control unit 214 locks the electronic lock 33 again.
[0158] Next, in step S16, the processing unit (e.g., information acquisition unit 211) of the room entry and exit control device 20 periodically deletes the records of the reading date and time 24a in the records of the QR code reading results 24 for which a certain time has passed. Thus, the time during which user authentication based on the feature amount of the facial image can be performed in step S14 is limited. In addition, by performing the processing of step S16, the number of records of the QR code reading results 24 can be prevented from expanding, which helps to shorten the processing time of the facial authentication processing based on the feature amount of step S14 and improve the authentication accuracy.
[0159] As described above, the visitor management system (visitor management system 1) of one embodiment is a system composed of a portable terminal carried by a visitor and an entry and exit control device for controlling the entry and exit of a visitor to a facility provided with an electronic lock.
[0160] The portable terminal (portable terminal 60) has a two-dimensional code generating unit (QR code generating unit 64), which generates a two-dimensional code (authentication QR code 641) based on the authentication ID (authentication ID 67e) obtained in advance from the information management device (information management device 50) and the feature value (feature value 66g) of the visitor's facial image and displays the two-dimensional code on the screen.
[0161] The entry and exit control device (entry and exit control device 20) includes: an information acquisition unit (information acquisition unit 211) that acquires and holds the authentication ID (authentication ID 56b) issued in advance by the information management device (information management device 50), and acquires the authentication ID (authentication ID 24c) read from the two-dimensional code (authentication QR code 641) displayed by the portable terminal (portable terminal 60) and the feature amount (feature amount 24d) of the facial image of the visitor. In addition, the entry and exit control device (entry and exit control device 20) includes: an authentication ID comparison unit (authentication ID comparison unit 212) that compares the authentication ID (authentication ID 24c) obtained from the two-dimensional code with the authentication ID (authentication ID 23a) issued by the information management device (information management device 50) to perform ID authentication processing. In addition, a feature quantity comparison unit (feature quantity comparison unit 213) is provided, which performs facial recognition processing by comparing the feature quantity (feature quantity 24d) of the facial image of the visitor obtained from the two-dimensional code with the feature quantity of the facial image of the visitor captured by the camera (camera 32) capturing the visitor entering and exiting the room. In addition, the entry and exit control device (entry and exit control device 20) is provided with a door control unit (door control unit 214) that controls the unlocking and locking of the electronic lock based on the results of the ID authentication processing and the facial authentication processing.
[0162] According to one embodiment of the structure, the facial image feature and the ID for authentication are converted into a QR code and displayed in the portable terminal carried by the visitor, and the QR code displayed on the portable terminal is transmitted to the room entry and exit control device, thereby using the QR code as an authentication unit when entering the room. With such a structure, a composite authentication of ID authentication using a QR code and facial authentication using the facial image feature can be realized.
[0163] At this time, the visitor takes a picture of his / her own face in advance through the portable terminal, and only the data of the face image is kept in the portable terminal. Therefore, it is not necessary to register and keep the face image of the visitor as personal information in a system other than the portable terminal. Therefore, the visitor management system will not register the face image of the visitor into the system, and can perform a composite authentication of ID authentication and face authentication while realizing privacy protection. The visitor management system can be said to be a system that users who have strict considerations for privacy protection do not have aversion and are easy to accept.
[0164] In addition, the visitor management system in this embodiment only needs to keep the feature amount of the visitor's facial image in at least the portable terminal. In this case, facial authentication can be performed without recording the facial image in any component of the visitor management system. Therefore, in the visitor management system, it is not necessary to accumulate or manage the facial image of the visitor as personal information. In addition, since the feature amount of the facial image used becomes unnecessary after facial authentication, it can also be discarded.
[0165] In addition, in the visitor management system (visitor management system 1) involved in one embodiment, the structure is that after the authentication ID comparison unit (authentication ID comparison unit 212) of the entry and exit control device (entry and exit control device 20) authenticates the authentication ID (authentication ID24c) read from the two-dimensional code (authentication QR code 641) in the ID authentication process, the feature value comparison unit (feature value comparison unit 213) performs the facial authentication process.
[0166] In the case of a structure in which the authentication code is resent after authentication based on a facial image, as in the technology disclosed in Patent Document 1, the time required for the entire authentication is long, and therefore it is not suitable for places with a lot of traffic, such as the entrance of a building. In contrast, according to the visitor management system of this embodiment, the facial authentication process is performed after the authentication ID is authenticated in the ID authentication process, so the time required for the entire authentication can be shortened. Therefore, compared with the prior art, the visitor management system has a high degree of freedom in the place where it can be applied.
[0167] In addition, in the visitor management system (visitor management system 1) involved in one embodiment, the entry and exit control device (entry and exit control device 20) and the portable terminal (portable terminal 60) receive the authentication ID (authentication ID 56b) from the information management device (information management device 50), and receive the visit reservation information of the visitor registered in the information management device (information management device 50) (the allowed access reader number 56d, the valid period start date 56e, the valid period end date 56f, and the allowed access time period 56g).
[0168] In addition, in the entry and exit control device (entry and exit control device 20), the information acquisition unit (information acquisition unit 211) acquires the authentication ID (authentication ID 24c), the feature value of the facial image (feature value 24d), and the visit reservation information (access reader number 23b, validity period start date 23c, validity period end date 23d, access time period 23e) sent from the information management device (information management device 50) by associating them with the reading date and time of the QR code (reading date and time 24a). Then, in the entry and exit control device (entry and exit control device 20), the authentication ID comparison unit (authentication ID comparison unit 212) compares the reading date and time of the QR code (reading date and time 24a) and the visit reservation information (allowed access reader number 23b, valid period start date 23c, valid period end date 23d, allowed access time period 23e) sent from the information management device (information management device 50) based on the authentication ID (authentication ID24c) read from the QR code, and performs ID authentication processing.
[0169] According to the visitor management system of this embodiment constructed in this way, not only the consistency of the authentication ID read from the two-dimensional code and the authentication ID obtained in advance from the information management device is confirmed, but also the authentication ID is authenticated by comparing the reading date and time of the two-dimensional code and the visit schedule information. By adopting such an authentication step, a more secure ID authentication process can be achieved. Therefore, the security of the composite authentication composed of ID authentication and facial authentication can be improved.
[0170] Furthermore, the present invention is not limited to the above-described embodiment, and various other application examples and modified examples can be adopted as long as they do not depart from the gist of the present invention described in the claims for patent protection.
[0171] For example, the embodiment described is to explain the present invention in detail and specifically for easy understanding, and is not limited to all the structural elements described. In addition, for a part of the structure of an embodiment, other structural elements can also be added, replaced or deleted.
[0172] In addition, part or all of the above structures, functions, processing units, etc. may be implemented by hardware, for example, by designing with integrated circuits, etc. As hardware, a broad processor device such as FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit) may be used.
[0173] In addition, Fig.12 In the timing chart shown, a plurality of processes may be executed in parallel or the order of the processes may be changed within a range that does not affect the process results.
Claims
1. A visitor management system, comprising a portable terminal carried by a visitor and an entry and exit control device for controlling the visitor's entry and exit into a facility equipped with an electronic lock, It is characterized in that The portable terminal has: Camera; a non-volatile memory storing a facial image of the visitor; a registration unit that calculates a feature value of the facial image of the visitor captured by the camera or the facial image of the visitor stored in the nonvolatile memory, and performs registration; as well as A two-dimensional code generating unit generates a two-dimensional code based on an authentication ID obtained in advance from an information management device and a feature amount of a facial image of the visitor and displays the two-dimensional code on a screen, The entry and exit control device comprises: an information acquisition unit that acquires and stores an authentication ID issued in advance by the information management device, and acquires a feature value of the authentication ID and the facial image of the visitor read from the two-dimensional code displayed on the portable terminal; an authentication ID comparison unit that compares the authentication ID obtained from the two-dimensional code with the authentication ID issued by the information management device to perform ID authentication processing; a feature quantity comparison unit that compares the feature quantity of the facial image of the visitor obtained from the two-dimensional code with the feature quantity of the facial image of the visitor captured by a camera for capturing the visitor entering and leaving the room, and performs facial authentication processing; as well as A door control unit controls unlocking and locking of the electronic lock according to the results of the ID authentication process and the face authentication process.
2. The visitor management system according to claim 1, It is characterized in that In the room entry and exit control device, the feature amount comparison unit performs the face authentication process after the authentication ID comparison unit authenticates the authentication ID read from the two-dimensional code in the ID authentication process.
3. The visitor management system according to claim 2, It is characterized in that The entry and exit control device and the portable terminal receive the authentication ID and the visitor's visit schedule information registered in the information management device from the information management device, In the room entry and exit control device, the information acquisition unit acquires the authentication ID read from the two-dimensional code displayed on the portable terminal, the feature value of the facial image, and the visit schedule information sent from the information management device by associating them with the reading date and time of the two-dimensional code, In the entry and exit control device, the authentication ID comparison unit compares the read date and time of the two-dimensional code with the visit schedule information sent from the information management device based on the authentication ID read from the two-dimensional code to perform the ID authentication process.
4. The visitor management system according to claim 3, It is characterized in that The visit reservation information includes a pass reader number of a two-dimensional code reader set on a door that allows the visitor to pass, a valid start date and end date of the pass, and a pass time period. In the room entry and exit control device, the authentication ID comparison unit determines whether the reader number of the two-dimensional code reader that reads the two-dimensional code is included in the permitted access reader number obtained from the information management device, and the date of reading is between the start date of the validity period and the end date of the validity period, and the time when the two-dimensional code was read is included in the permitted access time period. If the judgment conditions are met, the authentication ID is authenticated as an ID permitted access.
5. The visitor management system according to claim 4, It is characterized in that The room entry and exit control device is connected to the two-dimensional code reader that reads the two-dimensional code displayed on the screen of the portable terminal, the camera, and the electronic lock.
6. A visitor management method in a visitor management system, the visitor management system comprising a portable terminal carried by a visitor having a camera and a non-volatile memory and an entry and exit control device for controlling the visitor's entry and exit into a facility provided with an electronic lock, It is characterized in that The portable terminal calculates the feature value of the facial image of the visitor captured by the camera or the facial image of the visitor stored in the non-volatile memory, logs in, generates a two-dimensional code based on the authentication ID obtained in advance from the information management device and the feature value of the facial image of the visitor, and displays the two-dimensional code on the screen, The entry and exit control device performs the following processing: Obtain and save the authentication ID issued in advance by the information management device, acquiring the feature quantity of the authentication ID and the facial image of the visitor read from the two-dimensional code displayed on the portable terminal, The authentication ID obtained from the two-dimensional code is compared with the authentication ID issued by the information management device to perform ID authentication processing, The facial recognition process is performed by comparing the feature quantity of the facial image of the visitor obtained from the two-dimensional code with the feature quantity of the facial image of the visitor captured by the camera capturing the visitor entering and leaving the room, The unlocking and locking of the electronic lock are controlled according to the results of the ID authentication process and the face authentication process.
Citation Information
Patent Citations
Room entry / exit management system
JP2020042374A
Authentication system
JP2010055149A
Entrance and exit area collation system, entrance and exit area collation method, and program therefor
JP2010090677A
Entry management system and entry management method
JP2020087129A
