Method and system for collaborative fetching of intelligent lock and confidential cabinet

Abstract

The invention discloses an intelligent lock and confidential cabinet collaborative fetching method and system, and the method comprises the steps: enabling a confidential cabinet intelligent lock to compare a face image of a field fetching person A with a person registration list stored in the intelligent lock through face recognition, and unlocking a confidential cabinet door if the comparison succeeds; a remote entrusting person B establishes a video call with the on-site pickup person A through the confidential cabinet intelligent lock APP, and the remote entrusting person B selects a pendant lock number needing to be entrusted to be unlocked through the APP and informs the pendant lock number A; enabling the A to approach the mobile phone to the pendant lock specified by the B, reading the NFC-ID of the pendant lock through NFC, collecting the timestamp and the face image / feature vector of the B through the APP, and pushing the information to the pendant lock subsystem; and after the A presses down the pendant lock unlocking button, the pendant lock subsystem performs multi-item comparison, and if the multi-item comparison is successful, the pendant lock is unlocked, so that the A extracts the article. By utilizing the embodiment of the invention, the security of the process of remotely entrusting a field pick-up person to unlock and pick up an article can be ensured by strict security measures.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a method and system for collaborative item retrieval between an intelligent lock and a safe. Background Art

[0002] The safe with an intelligent lock has very high requirements for the security management of stored items, and it is necessary to unlock and open the door to retrieve items only after strict authentication verification. Especially in a safe with multiple compartments / compartments that require multiple unlocking controls, the items in the compartments / compartments of the safe belong to different personnel. When it is necessary to retrieve or store items on behalf of others, it is necessary to unlock after face recognition and comparison verification by the original item owner. However, when the original item owner cannot arrive at the scene for face recognition and comparison verification, it is difficult for the entrusted on-site personnel to retrieve or store items on behalf of others. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for collaborative item retrieval between an intelligent lock and a safe to solve the deficiencies in the prior art and ensure the security of the process of remotely entrusting on-site item pickers to unlock and retrieve items with strict security measures.

[0004] An embodiment of the present application provides a method for collaborative item retrieval between an intelligent lock and a safe, and the method includes: Face recognition and safe unlocking: The intelligent lock of the safe compares the face image of on-site item picker A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; Remote entrustment and video call establishment: Remote entrusting person B establishes a video call with on-site item picker A through the intelligent lock APP of the safe. B selects the pendant lock number to be entrusted to unlock through the APP and tells A the pendant lock number; Pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and B's face image / feature vector through the APP, and pushes the information to the pendant lock subsystem; Multiple comparisons and pendant lock unlocking: After A presses the pendant lock unlocking button, the pendant lock subsystem conducts multiple comparisons. If all multiple comparisons are successful, the pendant lock is unlocked so that A can retrieve the item.

[0005] Optionally, the face recognition and safe unlocking include: The intelligent lock of the safe collects A's face image through the camera; Compares A's face image with the face image / feature vector in the personnel registration list stored in the intelligent lock; If the comparison is successful, the safe door is unlocked, and the unlocking event is written into the intelligent lock unlocking event list.

[0006] Optionally, the establishment of the remote entrustment and video call includes: B selects A from the face list through the intelligent lock APP of the safe, and initiates a video call request; A responds to the video call request through the APP to establish a real-time video call; B selects the number of the pendant lock to be entrusted for unlocking through the APP and informs A of the number.

[0007] Optionally, the acquisition and push of the pendant lock information include: A brings the mobile phone close to the pendant lock designated by B, and reads the NFC-ID of the pendant lock through NFC; The APP of A collects the current timestamp and the face image / feature vector of B during the video call; The APP of A pushes the NFC-ID, timestamp, and the face image / feature vector of B to the pendant lock subsystem.

[0008] Optionally, the multiple comparisons and unlocking of the pendant lock include: The pendant lock subsystem collects the face image of A through the pendant lock camera and compares it with the personnel registration list of the intelligent lock; Compare the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the pendant lock dynamic list; Compare the NFC-ID pushed by the APP with the NFC-ID in the pendant lock dynamic list; Compare the timestamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than the preset threshold; If all four comparisons are successful, unlock the pendant lock; otherwise, trigger an alarm and reject the unlocking.

[0009] Another embodiment of the present application provides a system for collaborative item retrieval between an intelligent lock and a safe, the system includes: An identification module for face recognition and unlocking of the safe: The intelligent lock of the safe compares the face image of the on-site item retrieval personnel A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, unlock the safe door; A establishment module for establishing remote entrustment and video call: The remote entrustment personnel B establish a video call with the on-site item retrieval personnel A through the intelligent lock APP of the safe. B selects the number of the pendant lock to be entrusted for unlocking through the APP and informs A of the pendant lock number; An acquisition module for acquiring and pushing pendant lock information: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; Unlocking module, for multiple comparisons and unlocking of the pendant lock: After A presses the unlocking button of the pendant lock, the pendant lock subsystem performs multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item.

[0010] Another embodiment of the present application provides a storage medium in which a computer program is stored. Wherein, the computer program is configured to execute the method described in any one of the above when running.

[0011] Another embodiment of the present application provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the method described in any one of the above.

[0012] Compared with the prior art, a method for collaborative item retrieval between an intelligent lock and a safe provided by the present invention. The intelligent lock of the safe compares the face image of the on-site item picker A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; the remotely authorized person B establishes a video call with the on-site item picker A through the safe intelligent lock APP. B selects the pendant lock number to be authorized for unlocking through the APP and tells the pendant lock number to A; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem performs multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item, thereby being able to ensure the security of the process of remotely authorizing the on-site item picker to unlock and retrieve the item with strict security measures. Description of the Drawings

[0013] Figure 1 It is a hardware structure block diagram of a computer terminal for a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention; Figure 2 It is a flow schematic diagram of a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention; Figure 3 It is a structure schematic diagram of a system for collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention. Detailed Embodiments

[0014] The embodiments described below with reference to the drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0015] An embodiment of the present invention first provides a method for collaborative item retrieval between an intelligent lock and a safe. This method can be applied to an electronic device, such as a computer terminal, specifically, such as an ordinary computer, etc.

[0016] The following takes the operation on a computer terminal as an example for a detailed description. Figure 1 The following is a hardware structure block diagram of a computer terminal for a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention. As Figure 1 shown, the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0017] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any method of collaborative item retrieval between an intelligent lock and a safe.

[0018] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0019] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any method of collaborative item retrieval between an intelligent lock and a safe.

[0020] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in

[0021] is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0022] Refer to Figure 2 , an embodiment of the present invention provides a method of collaborative item retrieval between an intelligent lock and a safe, which may include the following steps: S201, Face Recognition and Safe Unlocking: The intelligent lock of the safe compares the face image of the on-site pick-up person A obtained through face recognition with the personnel registration list stored in the intelligent lock. If the comparison is successful, the safe door will be unlocked. Specifically, the face recognition and safe unlocking include: The intelligent lock of the safe captures the face image of A through a camera. Compare the face image of A with the face images / feature vectors in the personnel registration list stored in the intelligent lock. If the comparison is successful, unlock the safe door and write the unlocking event into the intelligent lock unlocking event list.

[0023] S202, Remote Entrustment and Video Call Establishment: The remote entrusting person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be entrusted for unlocking through the APP and notifies A of the number. Specifically, the remote entrustment and video call establishment include: B selects A from the face list through the safe intelligent lock APP and initiates a video call request. A responds to the video call request through the APP to establish a real-time video call. B selects the number of the pendant lock to be entrusted for unlocking through the APP and notifies A of the number.

[0024] S203, Pendant Lock Information Collection and Push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem. Specifically, the pendant lock information collection and push include: A brings the mobile phone close to the pendant lock designated by B and reads the NFC-ID of the pendant lock through NFC. A's APP collects the current timestamp and the face image / feature vector of B during the video call. A's APP pushes the NFC-ID, timestamp, and the face image / feature vector of B to the pendant lock subsystem.

[0025] S204, Multiple Comparisons and Pendant Lock Unlocking: After A presses the pendant lock unlocking button, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item. Specifically, the multiple comparisons and pendant lock unlocking include: The pendant lock subsystem captures the face image of A through the pendant lock camera and compares it with the personnel registration list in the intelligent lock. Compare the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the pendant lock dynamic list. Compare the NFC-ID pushed by the APP with the NFC-ID in the pendant lock dynamic list. Compare the timestamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than a preset threshold; If all four comparisons are successful, unlock the pendant lock; otherwise, trigger an alarm and reject the unlocking.

[0026] The present invention provides a method for remotely authorizing the opening of a safe by means of a video call constructed through a mobile phone APP. By combining remote face authorization with on-site trustworthy personnel, the problem of insufficient security in authentication and unlocking by single remote authorization is solved, so that even when a person is not on site, the intelligent lock of the safe can be entrusted to others to open in the form of remote authorization, and others can be entrusted to operate the personal items in the cabinet.

[0027] This solution proposes a method for secure authentication of remote authorization unlocking of a safe. By identifying and comparing to confirm that the on-site pick-up person is trustworthy, comparing the face of the principal extracted through APP video call to ensure that the pick-up person unlocks the lock of the principal, comparing the NFC-ID identified by the mobile phone to confirm that the pick-up person uses the APP on site, and comparing the timestamps sent by the mobile phone to exclude malicious attacks by hackers, so as to maximize the security of remote entrusted unlocking. In practical applications, a complete process of a technology is as follows: (1) Prerequisites: Install an intelligent lock on the safe door: Support face comparison. The intelligent lock of the safe stores a personnel registration list (data items include: personnel serial number, name, APP-ID, face image / feature vector, pendant lock ID, etc.). Install a pendant lock and a pendant lock subsystem in the safe: Support face comparison, support NFC (with an NFC-ID number uniquely identifying the NFC chip of the pendant lock), maintain a dynamic list of pendant locks (data items include: pendant lock ID, occupied personnel serial number, occupied personnel face image / feature vector, NFC-ID). The pendant subsystem is a subsystem of the intelligent lock. Intelligent lock: Refers to a lock improved on the basis of a traditional mechanical lock, which is more intelligent and simpler in terms of user security, identification, and management. The intelligent lock mentioned in this article has the function of opening the door by face recognition. Safe: A security device for storing important items. The safe in this article is equipped with an intelligent lock.

[0028] Description: NFC, Near Field Communication, is a short-range wireless communication technology, a contactless identification and interconnection technology. When a mobile phone supporting NFC approaches the pendant lock, short-range wireless communication with a maximum distance of no more than 10 cm can be carried out. Currently, most smartphone terminals on the market support NFC. The NFC-ID number is usually generated during the manufacturing of the NFC chip, and the ID number of each NFC device is unique; the unlocking of the safe includes the unlocking control of the cabinet door lock and the pendant lock inside the cabinet; the pendant lock inside the cabinet is a lock that locks the compartments or items inside the safe door. Each pendant lock corresponds to a different ID number (Note: In order for on-site personnel to distinguish and find the pendant lock, the ID number of the pendant lock is printed on each pendant lock, such as 1#, 2#, 3#,...), and there is an unlocking button and a camera; the form of the pendant lock can be various, such as having different compartments / cabinets for storing items, or a locked hook for locking items; there is an indicator light on the pendant lock that shows red or green (red indicates the occupied state, and green indicates the idle state and can be occupied); for the convenience of description, the pendant locks inside the safe are uniformly referred to as pendant locks in this document. The occupied personnel serial number and the occupied personnel's face image / feature vector data items in the pendant lock dynamic list are simultaneously bound to the corresponding data items in the safe intelligent lock personnel registration list; NFC-ID is the ID of the NFC chip of the pendant lock; the timestamp data items are all empty / null, which is the current clock of the pendant lock recorded when the pendant lock button is triggered).

[0029] The on-site pick-up personnel and the remotely commissioned personnel carry mobile phones: The mobile phone installs the APP of the safe intelligent lock, which has a unique APP-ID (such as the ID number + mobile phone number used during registration). The APP supports NFC reading applications (used to read the NFC-ID number of the pendant lock), supports collecting the face images / feature vectors of both parties during video calls between A and B, and supports collecting timestamps; the mobile phone supports NFC, and the "NFC" option in the mobile phone settings is turned on; when registering the mobile phone APP, the APP-ID, the mobile phone NFC-ID, etc. are reported, and the APP personnel list stored in the intelligent lock is synchronized from the intelligent lock (the data items include: personnel serial number, name, APP-ID).

[0030] (2) When personnel access their personal items on-site, unlocking and occupancy are carried out through the face recognition of on-site personnel; Pre-configure the occupancy relationship of the pendant lock: When the safe is enabled, according to the needs of each person, the occupancy relationship of the pendant lock for each person is pre-established on the intelligent lock management system and stored in the pendant lock dynamic list. The data items include: pendant lock ID, occupied personnel serial number, occupied personnel's face image / feature vector, NFC-ID.

[0031] Note: Assume that A has pre-configured the key lock it occupies as the key lock with the key lock ID of 3#. Then, the information record corresponding to the key lock with ID 3# in the dynamic key lock list is as follows: key lock ID (3#), occupant serial number (A), occupant's face image / feature vector (A), NFC-ID.

[0032] On-site occupancy of key lock by personnel: When personnel B (for the convenience of describing the usage process of the key lock, taking personnel B as an example, the operation process for other personnel to activate the key lock is the same as that of B) activates the key lock, B unlocks and opens the safe door through face recognition comparison of the intelligent lock, then selects a key lock (such as the key lock numbered 1#, and the indicator light of this key lock is green), and presses the unlock button on the 1# key lock. The key lock opens directly (since the 1# key lock is not occupied, it can be opened directly); after B finishes storing items on the 1# key lock (it is allowed not to store items, just for occupying the 1# key lock) and closes the key lock, and presses the unlock button on the 1# key lock twice continuously (B pressing the unlock button twice continuously indicates B's confirmation of the formal occupancy of this key lock), the key lock subsystem writes the face image / feature vector of B captured by the camera on the 1# key lock into the relevant data items of the 1# key lock in the dynamic key lock list of the key lock (the data items include: key lock ID (1#), occupant serial number (B), occupant's face image / feature vector (B), NFC-ID). The indicator light of the 1# key lock shows red, and at this time, B successfully occupies the 1# key lock.

[0033] Instructions for using the unlock button of the key lock: The key lock has an indicator light that shows red or green (red indicates the occupied state, and green indicates the idle state and can be occupied). When the indicator light of the 1# shows red, it means that the 1# has been successfully occupied; when the indicator light of the key lock is green, pressing the unlock button indicates triggering unlocking. When the indicator light of the key lock is red, face recognition is required to unlock; pressing the unlock button twice within 5 seconds after the operation of the key lock ends and the key lock is closed indicates new occupancy (at this time, the indicator light shows red), pressing the unlock button once indicates continued occupancy (at this time, the indicator light shows red), and not pressing the unlock button indicates giving up occupancy (at this time, the indicator light shows green).

[0034] Person opens the hanging lock on-site to access items: When a person (such as Person C, whose occupied hanging lock is 2#) arrives at the scene of the confidential cabinet, the intelligent lock of the confidential cabinet unlocks and opens the cabinet door through face recognition. C finds and presses the unlock button of the 2# hanging lock according to the ID number of the occupied hanging lock. The hanging lock subsystem captures C's face image through the camera of the 2# hanging lock and conducts a face comparison with the face image / feature vector of the 2# hanging lock in the dynamic list of hanging locks. After the comparison is successful, the 2# hanging lock is unlocked, and C can open the 2# hanging lock to access items. After accessing the items, close the 2# hanging lock, and then press the unlock button of the 2# hanging lock as needed (C chooses whether to continue to occupy or give up the occupation according to his own will). Pressing once means continuing to occupy, and not pressing means giving up the occupation. The indicator light of the 2# hanging lock shows red or green according to whether it is occupied.

[0035] Note: On-site unlocking of the hanging lock requires a face comparison of the occupant himself, and it can only be unlocked if the comparison is successful. If C mistakenly presses the unlock button of the 1# hanging lock (assuming the 1# hanging lock has been occupied by B and the indicator light shows red), C cannot open the 1# hanging lock at this time. If C leaves without pressing the unlock button of the 2# hanging lock after completing the access and closing the 2# hanging lock, it means giving up the occupation of the 2# hanging lock. If there are still items in it, they will be taken away by others. Therefore, everyone should remember that if there are still items to be stored and you need to continue to occupy, press the unlock button once and observe whether the indicator light turns red. If C presses the unlock button of the 2# hanging lock twice after completing the access and closing the 2# hanging lock, it doesn't matter at this time. C still occupies the 2# hanging lock because the hanging lock has been re-occupied in the name of C.

[0036] (3) Person B and Person A establish a video call through the APP: In order to entrust Person A to open Person B's hanging lock to pick up items on behalf of Person B, Person B makes a video call with Person A through the APP of the intelligent lock of the confidential cabinet; Note: For the convenience of explanation, hereinafter, the on-site entrusted personnel will be simply referred to as Person A, and the remote entrusted personnel will be simply referred to as Persons B, C, and D. Here, Person B entrusts Person A to open Person B's hanging lock to extract items.

[0037] Person B opens the APP of the intelligent lock of the confidential cabinet on the mobile phone, queries Person A from the APP face list, and the APP calls Person A through Person A's APP-ID for a video call. Person A opens the APP to respond to Person B's call. At this time, a real-time online video call is established between Person A's and Person B's mobile phones, and the APP video call between the two parties must be maintained thereafter.

[0038] Description: Person B is not at the scene of the safe. Someone needs to be found to replace B to retrieve items from the safe. Based on judgment or speculation, it is estimated that A is at the scene. Then, A is called through the APP. The two parties confirm that A is at the scene of the safe through a video call. If it is learned during the video call that A is not at the scene, other people will continue to be searched until someone at the scene is found. Here, it is assumed that A is at the scene. At the same time, since A is also the person registered with the intelligent lock of the safe, and choosing the person registered with the intelligent lock of the safe as the trustee has a higher level of trust. During the subsequent process, the two parties maintain a video call until A opens the pendant lock, retrieves the items, and closes the pendant lock.

[0039] (4)After the intelligent lock of the safe unlocks the safe door by recognizing person A through face recognition detection The intelligent lock of the safe performs face recognition on person A and unlocks: When person A comes to the intelligent lock of the safe, the intelligent lock collects A's face image and compares it with the face images / feature vectors in the person registration list stored in the intelligent lock through face recognition. When the comparison is successfully A, the intelligent lock of the safe unlocks, and A can open the safe door.

[0040] Description: Since there are still many pendant locks inside the safe door, B's items are stored under the pendant lock. At this time, opening the safe door cannot retrieve the items entrusted by B.

[0041] When the intelligent lock unlocks successfully, the unlocking and door-opening event of person A is written into the intelligent lock unlocking event list for storage (the storage time is generally set to 1 year), including the unlocking time, the unlocker serial number (the serial number of person A), the unlocking and door-opening time of the intelligent lock of the safe, and the face image (the face image of A collected during unlocking).

[0042] Description: When the intelligent lock unlocks successfully, it will record the unlocking event for subsequent query when needed.

[0043] (5)Person A holds the mobile phone close to B's No. 1 pendant lock, and the mobile phone APP pushes the information collected by the mobile phone APP to the pendant lock subsystem; Through the video call between A and B, person B operates the mobile phone APP, clicks on the No. 1 pendant lock owned by B in the list of pendant locks owned by B for entrustment setting (Description: For the convenience of description, it is assumed at this time that the pendant lock entrusted by B to unlock is No. 1 of the pendant locks owned by B; B may own multiple pendant locks, so B must clearly select which number of the pendant lock to entrust to retrieve the items; B's operation of entrustment setting in the mobile phone APP is to inform the pendant lock subsystem of the number of the pendant lock that B wants to entrust to unlock), and tells A the No. 1 pendant lock number through the video call.

[0044] After Person A opens the confidential cabinet door, Person A brings the mobile phone close to the No. 1 pendant lock informed by Person B (the pendant lock number is printed on the pendant lock). The NFC reading application on Person A's mobile phone collects the NFC-ID of the No. 1 pendant lock. The mobile phone APP of Person A sends a message to the pendant lock subsystem according to the pendant lock number set by Person B (which is No. 1 at this time). After receiving the message, the pendant lock subsystem compares it with the relevant data items of the No. 1 pendant lock in the stored dynamic pendant lock list (4 comparisons are made, and the comparison method is shown in step (6)). The payload of the sent message packet includes: the NFC-ID of the pendant lock collected by Person A's mobile phone, the timestamp (the current clock when the NFC-ID is collected), the time point when the message is sent, and the face image / feature vector of Person B collected by Person A's mobile phone APP from the video call. At the same time, Person A's mobile phone emits a "beep" to prompt Person A that the mobile phone can be removed.

[0045] Note: The face image / feature vector of Person B is the face image of Person B intercepted by the mobile phone APP during the video call and the feature vector is parsed and calculated; retaining the face image while sending the feature vector of the face image is for use in face comparison when the feature vector comparison is abnormal.

[0046] (6) Processing of the pendant lock subsystem after Person A presses the unlock button on the No. 1 pendant lock informed by Person B: Perform four comparisons: face comparison of Person A, face comparison of Person B, NFC-ID comparison, and timestamp comparison; After Person A brings the mobile phone close to the No. 1 pendant lock informed by Person B and hears a "beep", Person A removes the mobile phone and immediately reaches out to press the unlock button of the No. 1 pendant lock. At this time, the pendant lock subsystem must perform the following 4 comparisons. All comparisons must be successful simultaneously for the pendant lock subsystem to trigger the unlocking of the No. 1 pendant lock. If any one comparison fails, unlocking is not possible (Note: The success of the following four comparisons is a necessary condition for unlocking the pendant lock, and all comparisons must be successful to unlock): 1) Face comparison of Person A: The pendant lock subsystem captures the face image of Person A through the face camera on the No. 1 pendant lock and performs a face comparison with the face image / feature vector in the intelligent lock personnel registration list; Note: At this time, the face comparison of Person A is used to confirm that Person A is at the scene of the pendant lock. If Person A is not at the scene of the pendant lock, unlocking the pendant lock is not allowed because there may be another person C at the scene at this time; if an abnormal opening occurs when Person A is not at the scene, it may lead to the loss of things; if the face comparison of Person A fails, unlocking the pendant lock is not possible, and the pendant lock subsystem triggers an alarm; 2) Face comparison of B: The pendant lock subsystem compares the face image / feature vector of B in the message sent by mobile phone A with the face image / feature vector of the occupant of the No. 1 pendant lock in the dynamic list of the pendant lock (Note: The No. 1 pendant lock is occupied by B, and the face image / feature vector of B has been associated during occupancy). Note: At this time, the face comparison of B is used to verify that the unlock button pressed by A is for the pendant lock occupied by B. If the face comparison of B fails, that is, the faces do not match, it means that A pressed the wrong button, and the pendant lock cannot be unlocked. The pendant lock subsystem triggers an alarm. 3) NFC-ID comparison: The pendant lock subsystem compares the NFC-ID in the message sent by mobile phone A APP bit by bit with the NFC-ID of the No. 1 pendant lock in the dynamic list of the pendant lock. Note: At this time, the comparison between the NFC-ID collected by mobile phone A and the NFC-ID of the pendant lock chip is used to confirm that the mobile phone APP of A is used at the scene of the pendant lock. If the NFC-ID comparison fails, it means that the APP is not used at the scene, and the pendant lock cannot be unlocked. The pendant lock subsystem triggers an alarm. 4) Timestamp comparison: The pendant lock subsystem compares the timestamp (abbreviated as the sent timestamp) in the message sent by mobile phone A APP with the current clock of the pendant lock subsystem (abbreviated as the current clock). The comparison method is: the value of the current clock - the value of the sent timestamp < the set threshold (the threshold can generally be set to 10 seconds). Note: At this time, the comparison between the timestamp when the NFC-ID is collected by mobile phone A and the current clock of the pendant lock is used to exclude forged messages received by the pendant lock. If the calculated difference above is greater than the set threshold, it means that the timestamp comparison fails, indicating that the message with this timestamp may be forged, most likely by a hacker attack, and should be rejected. At this time, the pendant lock cannot be unlocked, and the pendant lock subsystem triggers an alarm. (7) The pendant lock is unlocked successfully. After person A finishes extracting the item, close the No. 1 pendant lock and the confidential cabinet door.

[0047] After the pendant lock is unlocked, A performs the operation of extracting the item according to B's entrustment. After completing the operation, close the pendant lock and press the unlock button on the pendant lock once (Note: Pressing once represents maintaining the occupied state of the pendant lock).

[0048] If, after A finishes the operation of extracting items as entrusted by B, it is learned from the video call that B no longer occupies the pendant lock, then after A finishes the operation of extracting items, A closes the pendant lock and leaves without pressing the unlock button. At this time, the occupied state of the pendant lock is released and becomes the vacant state. After the pendant lock is closed, it triggers the pendant lock subsystem to update the dynamic list of pendant locks, and the occupancy personnel serial number and the occupancy personnel face image / feature vector data items corresponding to each pendant lock ID are cleared and set to empty / null.

[0049] If, after A finishes the operation of extracting items as entrusted by B, and it is learned from the video call that B no longer occupies the No. 1 pendant lock, but at this time A wants to occupy the No. 1 pendant lock, then A can deposit his own items and close the pendant lock according to the method described in step (2), and then press the unlock button twice to occupy the No. 1 pendant lock by A.

[0050] After all operations on the pendant lock are completed, A closes the confidential cabinet door and the process ends.

[0051] Note: To facilitate B to guide A to handle the items in the pendant lock, the video call between A and B can be kept connected all the time, or ended according to the wishes of both parties. However, the call should not be ended before the pendant lock is unlocked, because relevant information required for unlocking needs to be collected and reported using the mobile APP. Prematurely disconnecting the APP video call may affect unlocking. At the same time, warning information from the pendant lock subsystem can also be received through the APP.

[0052] The intelligent lock of the confidential cabinet can authorize on-site personnel remotely to unlock and open the door safely. The confidential cabinet opens the confidential cabinet door by identifying and comparing the on-site item pick-up personnel through the intelligent lock, uses the face recognition of the on-site item pick-up person by the pendant lock to ensure that the on-site item pick-up person is indeed on-site, uses the comparison of the face image of the principal collected through the video call of the mobile APP to confirm that the lock to be opened is the principal's lock, uses the comparison of the NFC-ID collected by the mobile phone to verify that the APP is used on-site, and uses the verification of the time stamp to exclude possible malicious attacks by hackers, so as to ensure the security of the process of remotely entrusting on-site item pick-up personnel to unlock and pick up items with strict security measures.

[0053] It can be seen that the intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A through face recognition with the personnel registration list stored in the intelligent lock. If the comparison is successful, the safe door is unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can pick up the item, thereby ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0054] Another embodiment of the present invention provides a system for collaborative item retrieval between an intelligent lock and a safe. Refer to Figure 3 , the system may include: An identification module 301 for face recognition and safe unlocking: The intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A through face recognition with the personnel registration list stored in the intelligent lock. If the comparison is successful, the safe door is unlocked; A establishment module 302 for remote authorization and video call establishment: The remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A collection module 303 for pendant lock information collection and pushing: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; An unlocking module 304 for multiple comparisons and pendant lock unlocking: After A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can pick up the item.

[0055] It can be seen that the intelligent lock of the security cabinet compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the security cabinet door is unlocked; the remotely commissioned person B establishes a video call with the on-site pick-up person A through the intelligent lock APP of the security cabinet. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells the pendant lock number to A; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item, thereby ensuring the security of the process of remotely commissioning the on-site pick-up person to unlock and pick up the item with strict security measures.

[0056] The embodiment of the present invention also provides a storage medium, in which a computer program is stored. Wherein, the computer program is set to execute the steps in any one of the above method embodiments when running.

[0057] Specifically, in this embodiment, the above storage medium can be set to store a computer program for executing the following steps: S201, Face recognition and security cabinet unlocking: The intelligent lock of the security cabinet compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the security cabinet door is unlocked; S202, Remote commissioning and video call establishment: The remotely commissioned person B establishes a video call with the on-site pick-up person A through the intelligent lock APP of the security cabinet. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells the pendant lock number to A; S203, Pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; S204, Multiple comparisons and pendant lock unlocking: After A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item.

[0058] It can be seen that the intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the intelligent lock APP of the safe. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item, thereby ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0059] An embodiment of the present invention further provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0060] Specifically, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0061] Specifically, in this embodiment, the above processor may be configured to execute the following steps through a computer program: S201, Face recognition and safe unlocking: The intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; S202, Remote authorization and video call establishment: The remotely authorized person B establishes a video call with the on-site pick-up person A through the intelligent lock APP of the safe. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; S203, Pendant lock information collection and pushing: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; S204, Multiple comparisons and pendant lock unlocking: After A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item.

[0062] It can be seen that the intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item, thus ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0063] The structure, features and effects of the present invention have been described in detail based on the embodiments shown in the drawings. The above are only the preferred embodiments of the present invention, but the present invention is not limited to the scope of implementation shown in the drawings. Any changes made according to the concept of the present invention, or equivalent embodiments modified into equivalent changes, should still be within the protection scope of the present invention as long as they do not exceed the spirit covered by the specification and the drawings.

Claims

1. A method for collaboratively taking items using a smart lock and a safe, characterized in that: The method comprises: Face recognition and safe unlocking: The safe smart lock compares the face image of the on-site pickup person A with the personnel registration list stored in the smart lock through face recognition. If the comparison is successful, the safe door is unlocked; Remote entrustment and video call establishment: The remote entrusting person B establishes a video call with the on-site pickup person A through the safe smart lock APP. B selects the pendant lock number to be unlocked through the APP and informs A of the pendant lock number; Information collection and push of pendant lock: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, collects the timestamp and B's face image / feature vector through the APP, and pushes the information to the pendant lock subsystem; Multiple comparisons and pendant lock unlocking: After A presses the pendant lock unlocking button, the pendant lock subsystem performs multiple comparisons. If the multiple comparisons are successful, the pendant lock is unlocked to allow A to extract the item.

2. The method according to claim 1, characterized in that The face recognition and safe unlocking include: The safe smart lock collects A's facial image through the camera; Compare A's facial image with the facial images / feature vectors in the personnel registration list stored in the smart lock; If the comparison is successful, the safe door is unlocked and the unlock event is written into the smart lock unlock event list.

3. The method according to claim 2, characterized in that The remote delegation and video call establishment include: B selects A from the face list through the safe smart lock app and initiates a video call request; A responds to the video call request through the APP and establishes a real-time video call; B selects the number of the pendant lock to be unlocked through the APP and informs A of the number.

4. The method according to claim 3, characterized in that The pendant lock information collection and push includes: A brings his mobile phone close to the pendant lock specified by B and reads the NFC-ID of the pendant lock through NFC; A's app collects the current timestamp and B's face image / feature vector during the video call; A's APP pushes the NFC-ID, timestamp and B's face image / feature vector to the pendant lock subsystem.

5. The method according to claim 4, characterized in that The multiple comparisons and unlocking of the pendant lock include: The pendant lock subsystem collects A's facial image through the pendant lock camera and compares it with the smart lock personnel registration list; Compare the facial image / feature vector of B pushed by the APP with the occupant information of B in the dynamic list of the pendant lock; Compare the NFC-ID pushed by the APP with the NFC-ID in the dynamic list of the pendant lock; Compare the timestamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than the preset threshold; If all four comparisons are successful, the pendant lock will be unlocked; otherwise, an alarm will be triggered and unlocking will be refused.

6. A system for collaborative retrieval of items by a smart lock and a safe, characterized in that: The system comprises: Identification module, used for face recognition and safe unlocking: The safe smart lock compares the face image of the on-site pickup person A with the personnel registration list stored in the smart lock through face recognition. If the comparison is successful, the safe door is unlocked; Establish a module for remote entrustment and video call establishment: remote entrusting person B establishes a video call with on-site pickup person A through the safe smart lock APP. B selects the pendant lock number to be unlocked through the APP and informs A of the pendant lock number; The acquisition module is used for collecting and pushing information from the pendant lock: A brings the mobile phone close to the pendant lock specified by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and B's face image / feature vector through the APP, and pushes the information to the pendant lock subsystem; The unlocking module is used for multiple comparisons and pendant lock unlocking: after A presses the pendant lock unlocking button, the pendant lock subsystem performs multiple comparisons. If the multiple comparisons are successful, the pendant lock is unlocked to allow A to extract the item.

7. The system according to claim 6, characterized in that The identification module is specifically used for: The safe smart lock collects A's facial image through the camera; Compare A's facial image with the facial images / feature vectors in the personnel registration list stored in the smart lock; If the comparison is successful, the safe door is unlocked and the unlock event is written into the smart lock unlock event list.

8. The system according to claim 7, characterized in that The establishment module is specifically used for: B selects A from the face list through the safe smart lock app and initiates a video call request; A responds to the video call request through the APP and establishes a real-time video call; B selects the number of the pendant lock to be unlocked through the APP and informs A of the number.

9. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 5 when executed.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 5.

Images