Enter the management system

Abstract

The invention comprises: an intercom sub-unit (10) which is arranged around a business office (110), obtains facial image data and voice data of a delivery person (60), and outputs voice; an electronic lock (30) which is arranged on a door (113) of the business office (110); and a server (50), wherein the server (50) obtains facial image data of a delivery person (60) from the intercom sub-unit (10), performs facial authentication of the delivery person (60), and causes the intercom sub-unit (10) to output voice guidance to the delivery person (60), obtains voice data of a response of the delivery person (60) to the voice guidance, performs voice response authentication of the delivery person (60) based on the obtained voice data of the response, and unlocks the electronic lock (30) when both facial authentication and voice response authentication are successful.

Description

Technical Field

[0001] The present invention relates to an access management system using facial authentication and voice response authentication. Background Art

[0002] In recent years, a management system has been proposed for opening the door of a secure area based on personal information and visit information of the user and biometric information such as a facial image registered in advance (for example, see Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-30675 Summary of the invention

[0006] Problems to be solved by the invention

[0007] But, sometimes the purpose that visitor enters safe area is different from the visit information registered in advance. In such a case, need make not allow visitor to enter, but, in the prior art of patent documentation 1 record, in such a case, also can allow visitor to enter sometimes, sometimes becomes problem on safety.

[0008] Therefore, an object of the present invention is to improve the security of visitor access management.

[0009] Means for solving problems

[0010] The access management system of the present invention is characterized in that it includes: an intercom sub-unit, which is arranged around a building, obtains facial image data and voice data of a visitor, and outputs voice; an electronic lock, which is installed on the door of the building; and a server, which is connected to the intercom sub-unit and the electronic lock, the server obtains the facial image data of the visitor from the intercom sub-unit, performs facial authentication of the visitor, and causes the intercom sub-unit to output voice guidance to the visitor, obtains the voice data of the visitor's response to the voice guidance, performs voice response authentication of the visitor based on the obtained response voice data, and unlocks the electronic lock when the facial authentication is successful and the voice response authentication is successful.

[0011] In this way, since the electronic lock is unlocked by face authentication and voice response authentication, it is possible to improve the security of visitor access management.

[0012] In the access management system of the present invention, the visitor may be a delivery person who moves goods into or out of the building, and the voice guidance may include a plurality of questions related to the scheduled transportation information of the goods, and the scheduled transportation information may include the scheduled date and time of transportation of the goods, the moving-in and moving-out locations, the moving-out / moving-in classification, the starting point for moving in of the goods or the end point for moving out of the goods, the transportation management number and the number of goods. When all the responses of the delivery person to the questions are correct, the server determines that the voice response authentication is successful.

[0013] In this way, since the transportation schedule information of the cargo is confirmed by voice response, the security of access management of the cargo delivery person can be improved.

[0014] In the access management system of the present invention, the intercom sub-machine may be connected to the electronic lock, and the access management system may further include an intercom master machine, which is connected to the server and the intercom sub-machine, and outputs the unlocking instruction of the electronic lock input by the operator to the intercom sub-machine. When the facial recognition or the voice response recognition fails, the server outputs the authentication failure signal to the intercom master machine without unlocking the electronic lock. When the unlocking instruction of the electronic lock is input from the intercom master machine, the intercom sub-machine outputs the input unlocking instruction to the electronic lock.

[0015] In this way, when the server fails to authenticate the visitor, the operator can use the intercom master to unlock the electronic lock, thereby automating and saving effort in access management and preventing entry in the event of an authentication error or the like.

[0016] Effects of the Invention

[0017] The present invention can improve the security of visitor access management. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 1 is a system diagram showing the structure of the access management system according to the embodiment.

[0019] Figure 2 yes Figure 1 The functional block diagram of the intercom slave, intercom master, electronic lock and communication device shown.

[0020] Figure 3 yes Figure 1 Functional block diagram of the server shown.

[0021] Figure 4 It is shown Figure 3 A diagram showing the structure of the distributor database.

[0022] Figure 5 It is shown Figure 3 The diagram shows the structure of the transport schedule database.

[0023] Figure 6 It is shown Figure 1 , Figure 3 Flowchart of the actions of the server shown. DETAILED DESCRIPTION

[0024] The following describes the access management system 100 according to the embodiment. Figure 1 As shown, the access management system 100 includes: an intercom slave 10, which is installed in a business office 110 as a first building; an intercom master 15, which is installed in a branch store 120 as a second building; an electronic lock 30, which is installed in a door 113 of the business office 110; and a server 50, which is connected to the intercom slave 10 and the electronic lock 30. Here, the business office 110 and the branch store 120 are buildings owned by the same company and are arranged separately. In addition, in the following embodiment, it is assumed that the visitor to the business office 110 is a delivery person 60 who delivers goods 61.

[0025] The business office 110 is composed of a delivery and receiving room 111 and an office 112. The delivery and receiving room 111 is, for example, an area where parts required for maintenance are retained or stored before the mechanical products delivered from the factory are installed. The office 112 is an area where the company's operators who perform installation and maintenance operations on mechanical products work. Both the delivery and receiving room 111 and the office 112 are safe areas, but the delivery and receiving room 111 is a first-level safe area that can be entered by the external delivery person 60, and the office 112 is a second-level safe area that is higher than the first level and cannot be entered by the external delivery person 60 in principle.

[0026] A door 113 is provided in the delivery and receiving room 111 of the business office 110 to separate the interior from the exterior, and an electronic lock 30 is installed in the door 113. The electronic lock 30 is connected to the server 50 via a communication device 40 disposed in the office 112 and a remote communication network 32 that has ensured security. Here, the communication device 40 is a gateway device that connects the LAN line in the business office 110 to which the electronic lock 30 is connected to the remote communication network 32. In addition, the electronic lock 30 is connected to the intercom slave 10 via the LAN line in the business office 110.

[0027] The intercom sub-unit 10 is installed on the outer wall surface near the door 113 of the business office 110, and is connected to the server 50 via the communication device 40 arranged in the office 112 and the remote communication network 32 that has ensured security, similarly to the electronic lock 30. The intercom sub-unit 10 includes: a camera 11 that obtains a facial image of the delivery person 60; a microphone 13 that obtains voice data of the delivery person 60; a speaker 12 that outputs voice guidance to the delivery person 60; and a call button 14. In addition, the intercom sub-unit 10 can be installed around the business office 110, and is not limited to the outer wall surface near the door 113. For example, it can also be installed on a door leaf or a rod near the door 113.

[0028] The intercom master 15 is installed in the branch 120 and is connected to the intercom slave 10 via a remote communication network 34 such as the Internet. The intercom master 15 has a display 16 for displaying the facial image of the delivery person 60 obtained by the intercom slave 10, a speaker 17 and a microphone 18 for inputting and outputting voice data. In addition, the intercom master 15 is provided with an unlock button 19 for outputting an unlock command of the electronic lock 30.

[0029] The server 50 is a computer having a CPU 51 for performing information processing, a storage unit 52 for storing data or programs, and a communication unit 53. The server 50 may be connected to a network, and may be, for example, a server device on a cloud or a server device installed in a data center located far away from the business office 110 or the branch store 120.

[0030] like Figure 2 As shown, the intercom slave 10 transmits the facial image data acquired by the camera 11 and the voice data of the delivery person 60 acquired by the microphone 13 to the server 50 via the communication device 40. In addition, the speaker 12 receives the voice guidance data from the server 50 via the communication device 40 and outputs the voice guidance to the visitor.

[0031] In addition, the intercom sub-unit 10 sends the facial image data obtained by the camera 11 and the voice data of the delivery person 60 obtained by the microphone 13 to the intercom main unit 15, and receives the voice signal of the operator obtained by the microphone 18 of the intercom main unit 15, and outputs it from the speaker 12. In addition, the unlocking command received from the intercom main unit 15 is output to the electronic lock 30.

[0032] The electronic lock 30 receives an unlock command from the server 50 via the communication device 40 , and then performs unlock control according to the received unlock command. In addition, the electronic lock 30 performs unlock control according to the unlock command received from the intercom master unit 15 via the intercom slave unit 10 .

[0033] like Figure 3As shown, the server 50 includes functional blocks such as a communication unit 53, a facial authentication unit 54, a speech synthesis unit 55, a speech response authentication unit 56, an unlocking determination unit 57, a delivery person database 58, and a transportation schedule database 59. The communication unit 53, the facial authentication unit 54, the speech synthesis unit 55, the speech response authentication unit 56, and the unlocking determination unit 57 are connected to each other through Figure 1 The CPU 51 shown in FIG. 1 executes the program stored in the storage unit 52. In addition, the distributor database 58 and the transport schedule database 59 can be realized by storing data of a predetermined data structure in the Figure 1 The storage unit 52 shown is implemented.

[0034] like Figure 4 As shown in FIG. 1 , the delivery person database 58 is a database that stores the ID number, name, work unit, and facial image data of the delivery person 60 in association with each other. Figure 4 In the storage column of the facial image data, the number of the location where the image data of the facial image is stored is stored is made to be stored, but the actual facial image data may also be associated with data such as an ID number and a name and stored.

[0035] like Figure 5 As shown, the transportation schedule database 59 is a database that stores the transportation schedule date and time of the goods 61, the place where the goods 61 are transported in and out, the transport classification of the goods 61, the name of the transport start point or the transport end point of the goods 61, the transportation management number, and the number of goods in association. Here, the transportation schedule date and time of the goods 61, the place where the goods 61 are transported in and out, the transport classification of the goods 61, the name of the transport start point or the transport end point of the goods 61, the transportation management number, and the number of goods constitute the transportation schedule information.

[0036] An example of transport schedule information is described. For example, in the case of data set No. 1, 10 goods 61 are transported to business office A at a specified transport date and time. Goods 61 are transported from AAA. Data with a transport management number of X101 is stored. Here, the transport management number can be, for example, a delivery number, or, in the case of transporting equipment out of the shipping and receiving room 111, the management number of the equipment to be transported out.

[0037] return Figure 3 The facial authentication unit 54 of the server 50 performs facial authentication by comparing the facial image data of the delivery person 60 received from the camera 11 of the intercom slave 10 via the communication unit 53 with the facial image data of the delivery person 60 stored in the delivery person database 58. The facial authentication unit 54 outputs the result of the facial authentication to the unlocking determination unit 57 and the speech synthesis unit 55.

[0038] The speech synthesis unit 55 refers to the transportation schedule database 59 and performs speech synthesis of speech guidance including a plurality of questions related to the transportation schedule information of the goods 61, the transportation schedule information including the transportation schedule date and time, the place of carrying in and out, the classification of carrying in / out, the starting point of carrying in of the goods 61 or the end point of carrying out of the goods 61, the transportation management number, and the number of goods. For example, speech synthesis of speech guidance including questions such as "When is the transportation schedule date and time", "Is it the carrying in or carrying out of the goods", "Where is the starting point of carrying in of the goods", "Where is the end point of carrying out of the goods", "What is the transportation management number", "How many goods are there", etc. is performed. Then, the speech synthesis unit 55 transmits the speech synthesised speech guidance data to the intercom slave 10 via the communication unit 53.

[0039] The voice response authentication unit 56 performs voice response authentication based on the voice guidance data input from the voice synthesis unit 55 and the voice data of the delivery person 60's response to the voice guidance input from the intercom slave unit 10, according to whether the response content of the delivery person 60 is consistent with the content of the transport schedule information stored in the transport schedule database 59. The voice response authentication unit 56 outputs the result of the voice response authentication to the unlocking determination unit 57.

[0040] The unlocking determination unit 57 makes an unlocking determination based on the result of the facial authentication input from the facial authentication unit 54 and the result of the voice response authentication input from the voice response authentication unit 56, and when unlocking is permitted, outputs an unlocking instruction to the electronic lock 30 via the communication unit 53. In addition, when the result of the facial authentication or the result of the voice response authentication fails, an authentication failure signal is sent to the intercom master unit 15.

[0041] Next, refer to Figure 6 , the operation of the entry management system 100 of the implementation method is explained.

[0042] like Figure 1 As shown, the situation where the delivery person 60 carries the goods 61 into the delivery and receiving room 111 is described. When the delivery person 60 arrives at the business office 110 and presses the call button 14 of the intercom handset 10, the intercom handset 10 captures the facial image of the delivery person 60 through the camera 11, and transmits the captured facial image data to the server 50 via the communication device 40 and the remote communication network 32.

[0043] like Figure 6 As shown in step S101, the facial authentication unit 54 of the server 50 waits until the facial image data is received from the intercom slave 10. Then, after receiving the facial image data from the intercom slave 10, Figure 6 In step S101, if it is judged as "yes", enter Figure 6In step S102, a facial authentication process is performed. Figure 6 As shown in step S102, the facial image data of the delivery person 60 received from the intercom slave 10 is determined to be consistent with one of the facial image data stored in the delivery person database 58. Then, the facial authentication unit 54 Figure 6 If the judgment in step S102 is "yes", enter Figure 6 In step S104, the facial authentication is assumed to be successful, and a facial authentication success signal is output to the speech synthesis unit 55 and the unlocking determination unit 57. On the other hand, the facial authentication unit 54 Figure 6 If the judgment in step S102 is "No", it is assumed that the face authentication has failed and the process proceeds to step S103. Figure 6 In step S103, a facial authentication failure signal is output to the unlocking determination unit 57.

[0044] The speech synthesis unit 55 Figure 6 After receiving the facial authentication success signal from the facial authentication unit 54 in step S104, Figure 6 In step S105, the counter N is set to 1. Then, the speech synthesis unit 55 enters Figure 6 In step S106 , the transport schedule database 59 is referenced, first voice guidance data is generated by voice synthesis, and the generated voice guidance data is transmitted to the intercom slave 10 via the communication unit 53 .

[0045] The voice response authentication unit 56 Figure 6 In step S107, the process waits until the voice response data of the delivery person 60 to the first voice guidance is received from the intercom slave 10. Then, after receiving the voice data, the process proceeds to step S110. Figure 6 In step S108, it is determined whether the response of the delivery person 60 is a correct answer. Then, if the response of the delivery person 60 is a correct answer, the voice response authentication unit 56 Figure 6 In step S108, if it is judged as "yes", enter Figure 6 Step S109, determine whether N is the final counter value Nend, Figure 6 If the judgment is "No" in step S110, Figure 6 In step S110, the counter N is incremented by 1, and the return Figure 6 Step S106.

[0046] Then, the speech synthesis unit 55 Figure 6 The next voice guidance data is generated in step S106 and sent to the intercom slave 10. The voice response authentication unit 56 Figure 6 In step S107, the delivery person 60 waits until receiving the voice data of the response to the next voice guidance. After receiving the voice data, Figure 6 In step S107, it is determined whether the response content of the distributor 60 is a correct answer.

[0047] In this way, the speech synthesis unit 55 and the speech response authentication unit 56 repeatedly execute Figure 6 Steps S106 to S108 are repeated until the counter N reaches the final counter value Nend.

[0048] Then, the voice response authentication unit 56 Figure 6 If the judgment in step S109 is "yes", enter Figure 6 In step S111 , a voice authentication success signal is output to the unlocking determination unit 57 .

[0049] Because in Figure 6 In step S104, the face authentication success signal is input to the unlocking determination unit 57, so the unlocking determination unit 57 Figure 6 When a voice authentication success signal is input in step S111, it is determined that both facial authentication and voice authentication are successful, and the process proceeds to step S113. Figure 6 In step S112, an unlocking command is sent to the electronic lock 30 via the communication unit 53. As a result, the electronic lock 30 is unlocked, and the delivery person 60 can enter the delivery and receiving room 111.

[0050] On the other hand, Figure 6 In step S108, if the voice response authentication unit 56 determines that the result is "No", the voice response authentication unit 56 enters Figure 6 In step S114 , a voice authentication failure signal is output to the unlocking determination unit 57 .

[0051] exist Figure 6 In the case where a facial authentication failure signal is input from the facial authentication unit 54 in step S113, or in the case where Figure 6 In the case where a voice response authentication failure signal is input from the voice response authentication unit 56 in step S114, Figure 6 In step S115, the unlock determination unit 57 transmits an authentication failure signal to the intercom master unit 15. In this case, the unlock determination unit 57 does not output an unlock command.

[0052] When the intercom master unit 15 receives an authentication failure signal from the server 50, an operator located near the intercom master unit 15 communicates with the intercom slave unit 10 and manually confirms with the delivery person 60. After obtaining the confirmation of the delivery person 60, the operator presses the unlock button 19 of the intercom master unit 15. Then, an unlock command is sent to the intercom slave unit 10, and the intercom slave unit 10 outputs the received unlock command to the electronic lock 30. As a result, the electronic lock 30 is unlocked, and the delivery person 60 can enter the delivery and receiving room 111.

[0053] The speech synthesis unit 55 and the speech response authentication unit 56 repeatedly perform Figure 6 Examples of questions asked by voice guidance and examples of responses by the delivery person 60 in the case of steps S106 to S108.

[0054] First, the speech synthesis unit 55 generates voice guidance data including the question "When is the scheduled delivery date and time?" and transmits it to the intercom handset 10. The intercom handset 10 outputs the received voice guidance data from the speaker 12. Then, the intercom handset 10 obtains the voice data of the delivery person 60's response from the microphone 13 and transmits it to the server 50. The voice response authentication unit 56 analyzes the voice data received from the intercom handset 10, extracts the data of the scheduled delivery date and time from the voice data, and determines whether it is consistent with one of the scheduled delivery dates and times stored in the delivery schedule database 59. If they are consistent, the voice response authentication unit 56 checks the voice data received from the intercom handset 10. Figure 6 In step S108, if it is judged as "yes", the system returns Figure 6 Step S106.

[0055] Next, the speech synthesis unit 55 generates voice guidance data including the question "What is the transport management number?" and transmits it to the intercom sub-unit 10. The voice response authentication unit 56 obtains the voice data of the response of the delivery person 60. Then, the voice response authentication unit 56 reads the transport management number included in the data set corresponding to the transport schedule date and time answered by the previous question in the transport schedule database 59, and determines whether it is consistent with the response content of the delivery person 60. Then, in the case of consistency, the voice response authentication unit 56 checks the transport management number contained in the data set corresponding to the transport schedule date and time answered by the previous question. Figure 6 In step S108, it is judged as "yes", and the Figure 6 Step S106.

[0056] Next, the speech synthesis unit 55 generates voice guidance data including the question "How many pieces of cargo are there?" and transmits it to the intercom handset 10. The voice response authentication unit 56 obtains the voice data of the delivery person 60's response. Then, the voice response authentication unit 56 reads the number of pieces of cargo 61 included in the data set corresponding to the delivery schedule date and time answered by the previous question in the delivery schedule database 59, and determines whether it is consistent with the delivery person 60's response content. Then, in the case of consistency, the voice response authentication unit 56 checks the delivery schedule database 59. Figure 6 In step S108, if it is judged as "yes", the system returns Figure 6 Step S106.

[0057] In this way, if all of the responses of the delivery person 60 to the questions included in the plurality of voice guidances are correct, Figure 6 In step S111 , the voice response authentication unit 56 outputs a voice response authentication success signal to the unlock determination unit 57 .

[0058] As described above, the access management system 100 of the embodiment unlocks the electronic lock 30 through facial authentication and voice response authentication, thereby improving the security of the access management of the delivery person 60. In addition, the access management system 100 of the embodiment confirms the transportation schedule information of the goods 61 through voice response, thereby improving the security of the access management of the delivery person 60 of the goods 61. Furthermore, in the case where the server 50 fails to authenticate the delivery person 60, the operator can respond with the intercom master 15 to unlock the electronic lock 30, thereby automating the access management and saving labor, and preventing the inability to enter in the case of authentication errors, etc.

[0059] In the above description, the entry management of the delivery person 60 carrying the goods 61 to the delivery and receiving room 111 is described, but it is not limited to this and can also be applied to the entry management of visitors for other purposes. In this case, instead of the transportation schedule database 59, the voice guidance data can be generated based on the visitor business database storing the business information of the visitor, and the voice response can be authenticated.

[0060] Description of symbols

[0061] 10: intercom slave; 11: camera; 12, 17: loudspeaker; 13, 18: microphone; 14: call button; 15: intercom mother unit; 16: display; 19: unlock button; 30: electronic lock; 32, 34: telecommunication network; 40: communication device; 50: server; 51: CPU; 52: storage unit; 53: communication unit; 54: face authentication unit; 55: speech synthesis unit; 56: speech response authentication unit; 57: unlock determination unit; 58: delivery person database; 59: transportation reservation database; 60: delivery person; 61: goods; 100: access management system; 110: business office; 111: shipping and receiving room; 112: office; 113: door; 120: branch store.

Claims

1. A system for entering the management system, It is characterized in that The access management system includes: Intercom handsets are placed around the building to obtain facial image data and voice data of visitors and output voice; an electronic lock, which is provided on the door of the building and connected to the intercom handset; A server connected to the intercom sub-unit and the electronic lock; as well as A walkie-talkie master unit, which is connected to the server and the walkie-talkie slave unit, The server obtains facial image data of the visitor from the intercom sub-unit, performs facial authentication of the visitor, causes the intercom sub-unit to output voice guidance to the visitor, obtains voice data of the visitor's response to the voice guidance, and performs voice response authentication of the visitor based on the obtained response voice data. When the facial authentication is successful and the voice response authentication is successful, the server unlocks the electronic lock. In the event that the facial authentication or the voice response authentication fails, the server outputs an authentication failure signal to the intercom master unit without unlocking the electronic lock. When the authentication failure signal is input from the server, the intercom master unit outputs the unlocking command of the electronic lock to the intercom slave unit when the operator inputs the unlocking command of the electronic lock. When the unlock command of the electronic lock is input from the intercom main unit, the intercom slave unit outputs the input unlock command to the electronic lock to unlock the electronic lock.

2. The access management system according to claim 1, It is characterized in that The visitor is a delivery person who brings goods into the building or takes goods out of the building, The voice guidance includes a plurality of questions related to the scheduled transportation information of the goods, wherein the scheduled transportation information includes the scheduled transportation date and time of the goods, the carrying-in and carrying-out locations, the carrying-out / carrying-in classification, the carrying-in starting point of the goods or the carrying-out end point of the goods, the transportation management number, and the number of goods. When all responses of the delivery person to the question are correct answers, the server determines that the voice response authentication is successful.

Images