A method and system for collaborative item retrieval between an intelligent lock and a safe

Abstract

The present invention discloses a method and system for collaborative item retrieval between an intelligent lock and a safe. The method includes: the intelligent lock of the safe compares the face image of the on-site item pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; the remote consigning person B establishes a video call with the on-site item pick-up person A through the intelligent lock APP of the safe. B selects the number of the pendant lock to be entrusted for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can retrieve the item. By using the embodiment of the present invention, the security of the process of remotely entrusting the on-site item pick-up person to unlock and retrieve the item can be guaranteed with strict security measures.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a method and system for collaborative item retrieval between an intelligent lock and a safe. Background Art

[0002] For the security management of stored items, a safe with an intelligent lock has very high requirements. It needs to be unlocked and opened only after strict authentication verification to retrieve items. Especially in a safe with multiple compartments / compartments that require multiple unlocking controls, the items in the compartments / compartments of the safe belong to different personnel. When someone needs to retrieve or store items on behalf of others, it is necessary to unlock after face recognition comparison verification by the original item owner. However, when the original item owner cannot be present for face recognition comparison verification, it is difficult for the entrusted on-site personnel to retrieve or store items on behalf of them. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for collaborative item retrieval between an intelligent lock and a safe to solve the deficiencies in the prior art and ensure the security of the process of remotely entrusting on-site item retrievers to unlock and retrieve items with strict security measures.

[0004] An embodiment of the present application provides a method for collaborative item retrieval between an intelligent lock and a safe, and the method includes:

[0005] Face recognition and safe unlocking: The intelligent lock of the safe compares the face image of on-site item retriever A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked;

[0006] Remote entrustment and video call establishment: Remote entrusting person B establishes a video call with on-site item retriever A through the intelligent lock APP of the safe. B selects the pendant lock number to be entrusted to unlock through the APP and tells A the pendant lock number;

[0007] Pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and B's face image / feature vector through the APP, and pushes the information to the pendant lock subsystem;

[0008] Multiple comparisons and pendant lock unlocking: After A presses the pendant lock unlocking button, the pendant lock subsystem performs multiple comparisons. If all multiple comparisons are successful, the pendant lock is unlocked so that A can retrieve the item.

[0009] Optionally, the face recognition and safe unlocking include:

[0010] The intelligent lock of the safe collects the face image of A through the camera;

[0011] Compare the face image of A with the face images / feature vectors in the personnel registration list stored in the smart lock;

[0012] If the comparison is successful, unlock the confidential cabinet door and write the unlocking event into the smart lock unlocking event list.

[0013] Optionally, the establishment of the remote commission and video call includes:

[0014] B selects A from the face list through the confidential cabinet smart lock APP and initiates a video call request;

[0015] A responds to the video call request through the APP to establish a real-time video call;

[0016] B selects the pendant lock number to be entrusted for unlocking through the APP and notifies A of the number.

[0017] Optionally, the acquisition and push of the pendant lock information includes:

[0018] A brings the mobile phone close to the pendant lock designated by B and reads the NFC-ID of the pendant lock through NFC;

[0019] The APP of A collects the current timestamp and the face image / feature vector of B during the video call;

[0020] The APP of A pushes the NFC-ID, timestamp, and the face image / feature vector of B to the pendant lock subsystem.

[0021] Optionally, the multiple comparisons and pendant lock unlocking include:

[0022] The pendant lock subsystem collects the face image of A through the pendant lock camera and compares it with the personnel registration list in the smart lock;

[0023] Compare the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the pendant lock dynamic list;

[0024] Compare the NFC-ID pushed by the APP with the NFC-ID in the pendant lock dynamic list;

[0025] Compare the timestamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than the preset threshold;

[0026] If all four comparisons are successful, unlock the pendant lock; otherwise, trigger an alarm and reject the unlocking.

[0027] Another embodiment of the present application provides a system for collaborative item retrieval between a smart lock and a confidential cabinet, and the system includes:

[0028] An identification module for face recognition and unlocking of the safe: The intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked.

[0029] A establishment module for remote commission and video call establishment: The remote commissioning person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells A the number of the pendant lock.

[0030] A collection module for pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem.

[0031] An unlocking module for multiple comparisons and unlocking of the pendant lock: After A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item.

[0032] Another embodiment of the present application provides a storage medium in which a computer program is stored. Among them, the computer program is set to execute the method described in any one of the above when running.

[0033] Another embodiment of the present application provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is set to run the computer program to execute the method described in any one of the above.

[0034] Compared with the prior art, a method for collaborative item retrieval by an intelligent lock and a safe provided by the present invention is as follows: The intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked. The remote commissioning person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells A the number of the pendant lock. A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem. After A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item, thereby being able to ensure the security of the process of remotely commissioning the on-site pick-up person to unlock and retrieve the item with strict security measures. Description of the Drawings

[0035] Figure 1Hardware structure block diagram of a computer terminal for a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention;

[0036] Figure 2 Schematic flow chart of a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention;

[0037] Figure 3 Schematic structural diagram of a system for collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention. Detailed implementation manners

[0038] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0039] An embodiment of the present invention first provides a method for collaborative item retrieval between an intelligent lock and a safe. This method can be applied to electronic devices, such as computer terminals, specifically ordinary computers, etc.

[0040] The following takes running on a computer terminal as an example for a detailed description. Figure 1 Hardware structure block diagram of a computer terminal for a method of collaborative item retrieval between an intelligent lock and a safe provided by an embodiment of the present invention. As Figure 1 shown, this computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory can include a non-volatile storage medium and an internal memory.

[0041] The non-volatile storage medium can store an operating system and computer programs. These computer programs include program instructions, and when these program instructions are executed, the processor can execute any method for collaborative item retrieval between an intelligent lock and a safe.

[0042] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0043] The internal memory provides an environment for the operation of the computer programs in the non-volatile storage medium. When these computer programs are executed by the processor, the processor can execute any method for collaborative item retrieval between an intelligent lock and a safe.

[0044] This network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0045] It should be understood that the processor can be a Central Processing Unit (CPU), and the processor can also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0046] See Figure 2 , embodiments of the present invention provide a method for collaborative item retrieval between an intelligent lock and a safe, which may include the following steps:

[0047] S201, face recognition and safe unlocking: The intelligent lock of the safe compares the face image of the on-site item pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; specifically, the face recognition and safe unlocking include:

[0048] The intelligent lock of the safe collects the face image of A through a camera;

[0049] Compare the face image of A with the face images / feature vectors in the personnel registration list stored in the intelligent lock;

[0050] If the comparison is successful, the safe door is unlocked, and the unlocking event is written into the intelligent lock unlocking event list.

[0051] S202, remote entrustment and video call establishment: The remote entrusting person B establishes a video call with the on-site item pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be entrusted with unlocking through the APP and tells the number to A; specifically, the remote entrustment and video call establishment include:

[0052] B selects A from the face list through the safe intelligent lock APP and initiates a video call request;

[0053] A responds to the video call request through the APP to establish a real-time video call;

[0054] B selects the number of the pendant lock to be entrusted with unlocking through the APP and tells the number to A.

[0055] S203, Hanger Lock Information Collection and Push: A brings the mobile phone close to the hanger lock designated by B, reads the NFC-ID of the hanger lock through NFC, and collects the timestamp and B's face image / feature vector through the APP, and pushes the information to the hanger lock subsystem; specifically, the hanger lock information collection and push includes:

[0056] A brings the mobile phone close to the hanger lock designated by B and reads the NFC-ID of the hanger lock through NFC;

[0057] A's APP collects the current timestamp and B's face image / feature vector during the video call;

[0058] A's APP pushes the NFC-ID, timestamp, and B's face image / feature vector to the hanger lock subsystem..

[0059] S204, Multiple Comparisons and Hanger Lock Unlocking: After A presses the hanger lock unlocking button, the hanger lock subsystem performs multiple comparisons. If all multiple comparisons are successful, the hanger lock is unlocked so that A can extract the item. Specifically, the multiple comparisons and hanger lock unlocking include:

[0060] The hanger lock subsystem collects A's face image through the hanger lock camera and compares it with the intelligent lock personnel registration list;

[0061] Compare the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the hanger lock dynamic list;

[0062] Compare the NFC-ID pushed by the APP with the NFC-ID in the hanger lock dynamic list;

[0063] Compare the timestamp pushed by the APP with the current clock of the hanger lock to determine whether the time difference is less than the preset threshold;

[0064] If all four comparisons are successful, the hanger lock is unlocked; otherwise, an alarm is triggered and unlocking is refused.

[0065] The present invention provides a method for remotely authorizing the opening of a safe through a video call assisted by a mobile phone APP. By combining remote face authorization with on-site trustworthy personnel, the problem of insufficient security in authentication and unlocking by single remote authorization is solved, so as to realize that even when the personnel are not on-site, the intelligent lock of the safe can be opened by remotely authorizing others to entrust others to operate the personal items in the cabinet.

[0066] This solution proposes a method for secure authentication of remote authorization to unlock a security cabinet. By identifying and comparing to confirm that the on-site pick-up person is trustworthy, comparing the face of the principal extracted through an APP video call to ensure that the pick-up person unlocks the lock of the principal, comparing the recognition of the NFC-ID by the mobile phone to confirm that the pick-up person uses the APP on-site, and comparing the time stamps sent by the mobile phone to exclude malicious attacks by hackers, the above is used to maximize the security of remote entrusted unlocking. In practical applications, the complete process of a technical implementation is as follows:

[0067] (1)Preconditions:

[0068] Install an intelligent lock on the security cabinet door: Support face comparison. The intelligent lock of the security cabinet stores a personnel registration list (data items include: personnel serial number, name, APP-ID, face image / feature vector, pendant lock ID, etc.).

[0069] Install a pendant lock and a pendant lock subsystem inside the security cabinet: Support face comparison, support NFC (with an NFC-ID number that uniquely identifies the NFC chip of the pendant lock), maintain a dynamic list of pendant locks (data items include: pendant lock ID, occupied personnel serial number, occupied personnel face image / feature vector, NFC-ID). The pendant subsystem is a subsystem of the intelligent lock. Intelligent lock: Refers to a lock improved on the basis of a traditional mechanical lock, which is more intelligent and simpler in terms of user security, identification, and management. The intelligent lock mentioned in this article has the function of opening the door by face recognition. Security cabinet: A security device for storing important items. The security cabinet in this article is equipped with an intelligent lock.

[0070] Description: NFC, Near Field Communication, is a short-range wireless communication technology, which is a contactless identification and interconnection technology. When a mobile phone supporting NFC approaches the pendant lock, short-range wireless communication with a maximum distance of no more than 10 cm can be carried out. Currently, most smartphone terminals on the market support NFC. The NFC-ID number is usually generated by the NFC chip during manufacturing, and the ID number of each NFC device is unique; the unlocking of the safe includes the unlocking control of the cabinet door lock and the pendant lock inside the cabinet; the pendant lock inside the cabinet is a lock that locks the compartments or items inside the safe door. Each pendant lock corresponds to a different ID number (Note: In order for on-site personnel to distinguish and find the pendant lock, the ID number of the pendant lock is printed on each pendant lock, such as 1#, 2#, 3#,...), and there is an unlocking button and a camera; the form of the pendant lock can be various, such as having different compartments / cabinets for storing items, or a locked hook for locking items; there is an indicator light on the pendant lock that shows red or green (red indicates the occupied state, and green indicates the idle state and can be occupied); for the convenience of description, the pendant locks inside the safe are uniformly referred to as pendant locks in this document. The occupied personnel serial number and the occupied personnel's face image / feature vector data items in the pendant lock dynamic list are simultaneously bound to the corresponding data items in the personnel registration list of the safe intelligent lock; NFC-ID is the ID of the NFC chip of the pendant lock; the timestamp data items are all empty / null, which is the current clock of the pendant lock recorded when the pendant lock button is triggered).

[0071] The on-site pick-up personnel and the remotely commissioned personnel carry mobile phones: The mobile phone installs the APP of the safe intelligent lock, which has a unique APP-ID (such as the ID number + mobile phone number used during registration). The APP supports NFC reading applications (used to read the NFC-ID number of the pendant lock), supports collecting the face images / feature vectors of both parties during video calls between A and B, and supports collecting timestamps; the mobile phone supports NFC, and the "NFC" option in the mobile phone settings is turned on; when registering the mobile phone APP, the APP-ID, the mobile phone NFC-ID, etc. are reported, and the APP personnel list stored in the intelligent lock is synchronized from the intelligent lock (the data items include: personnel serial number, name, APP-ID).

[0072] (2) When personnel access personal items on-site, unlocking and occupancy are carried out through the face recognition of on-site personnel;

[0073] Pre-configure the occupancy relationship of the pendant lock: When the safe is enabled, the occupancy relationship of the pendant lock for each person is pre-established on the intelligent lock management system according to the needs of each person and stored in the pendant lock dynamic list. The data items include: pendant lock ID, occupied personnel serial number, occupied personnel's face image / feature vector, NFC-ID.

[0074] Description: Assume that A has pre-configured to occupy the hanging lock with the hanging lock ID of 3#. Then, the information record in the dynamic list of the hanging lock corresponding to the 3# hanging lock is: hanging lock ID (3#), serial number of the occupying person (A), face image / feature vector of the occupying person (A), NFC-ID.

[0075] On-site occupation of the hanging lock by personnel: When personnel B (for the convenience of describing the usage process of the hanging lock, taking personnel B as an example, the operation process for other personnel to enable the hanging lock is the same as that of B) enables the hanging lock, B unlocks and opens the safe cabinet door through face recognition comparison of the intelligent lock, then selects a hanging lock (such as the hanging lock numbered 1#, and the indicator light of this hanging lock is green), and presses the unlock button on the 1# hanging lock. The hanging lock opens directly (since the 1# hanging lock is not occupied, it can be opened directly); after B has stored the items on the 1# hanging lock (it is allowed not to store items, just for occupying the 1# hanging lock) and closed the hanging lock, and presses the unlock button on the 1# hanging lock twice continuously (B pressing the unlock button twice continuously indicates B's confirmation of the formal occupation of this hanging lock), the hanging lock subsystem writes the face image / feature vector of B collected by the camera on the 1# hanging lock into the relevant data items of the 1# hanging lock in the dynamic list of the hanging lock (the data items include: hanging lock ID (1#), serial number of the occupying person (B), face image / feature vector of the occupying person (B), NFC-ID). The indicator light of the 1# hanging lock shows red, and at this time, B successfully occupies the 1# hanging lock.

[0076] Instructions for using the unlock button of the hanging lock: The hanging lock has an indicator light that shows red or green (red indicates the occupied state, and green indicates the idle state and can be occupied). When the indicator light of the 1# shows red, it means that the 1# has been successfully occupied; when the indicator light of the hanging lock is green, pressing the unlock button indicates triggering unlocking. When the indicator light of the hanging lock is red, face comparison is required to unlock; Pressing the unlock button twice within 5 seconds after the operation of the hanging lock is completed and the hanging lock is closed indicates a new occupation (at this time, the indicator light shows red), pressing the unlock button once indicates continued occupation (at this time, the indicator light shows red), and not pressing the unlock button indicates giving up occupation (at this time, the indicator light shows green).

[0077] Person opens the hanging lock on-site to access items: When a person (such as Person C, whose occupied hanging lock is 2#) arrives at the site of the security cabinet, the intelligent lock of the security cabinet unlocks and opens the cabinet door through face recognition. C finds and presses the unlock button of the 2# hanging lock according to the ID number of the hanging lock he / she occupies. The hanging lock subsystem captures C's face image through the camera of the 2# hanging lock and conducts a face comparison with the face image / feature vector of the 2# hanging lock in the dynamic list of hanging locks. After the comparison is successful, the 2# hanging lock unlocks, and C can open the 2# hanging lock to access items. After accessing the items, close the 2# hanging lock, and then press the unlock button of the 2# hanging lock as needed (C chooses whether to continue to occupy or give up the occupancy according to his / her own will). Pressing once means continuing to occupy, and not pressing means giving up the occupancy. The indicator light of the 2# hanging lock shows red or green according to whether it is occupied.

[0078] Note: To unlock the hanging lock on-site, a face comparison of the occupant himself / herself is required, and it can only be unlocked after the comparison is successful. If C mistakenly presses the unlock button of the 1# hanging lock (assuming the 1# hanging lock has been occupied by B and the indicator light shows red), C cannot open the 1# hanging lock at this time. If C leaves without pressing the unlock button of the 2# hanging lock after completing the access and closing the 2# hanging lock, it means giving up the occupancy of the 2# hanging lock. If there are still items in it, they will be taken away by others. Therefore, everyone should remember that if there are still items to be saved and you need to continue to occupy, press the unlock button once and observe whether the indicator light turns red. If C presses the unlock button of the 2# hanging lock twice after completing the access and closing the 2# hanging lock, it doesn't matter at this time. C still occupies the 2# hanging lock because the hanging lock has been re-occupied in the name of C.

[0079] (3) Person B and Person A establish a video call through the APP: In order for B to entrust A to open B's hanging lock to pick up items, B makes a video call with A through the APP of the intelligent lock of the security cabinet;

[0080] Note: For the convenience of explanation, hereinafter, the on-site entrusted personnel will be simply referred to as Person A, and the remote entrusted personnel will be simply referred to as Persons B, C, and D. Here, B entrusts A to open B's hanging lock to pick up items.

[0081] Person B opens the APP of the intelligent lock of the security cabinet on the mobile phone, queries Person A from the APP face list, and the APP calls Person A through A's APP-ID for a video call. Person A opens the APP to respond to B's call. At this time, a real-time online video call is established between Person A's and B's mobile phones, and then the APP video call between the two parties must be maintained.

[0082] Note: Person B is not at the scene of the safe. Someone needs to be found to replace B to retrieve items from the safe. Based on judgment or speculation, it is estimated that A is at the scene. Then, A is called through the APP, and both parties confirm A's presence at the safe scene through a video call. If it is learned during the video call that A is not at the scene, other people will continue to be searched until a person at the scene is found. Here, it is assumed that A is at the scene. At the same time, since A is also a person registered in the smart lock of the safe, and choosing a person registered in the smart lock of the safe as the entrusted person has a higher level of trust. During the subsequent process, the two parties maintain a video call until A opens the pendant lock, retrieves the items, and closes the pendant lock.

[0083] (4)After the smart lock of the safe recognizes person A through face recognition detection, the safe door unlocks

[0084] The smart lock of the safe performs face recognition on person A and unlocks: When person A comes to the smart lock of the safe, the smart lock captures A's face image and compares it with the face images / feature vectors in the person registration list stored in the smart lock through face recognition. When the comparison is successfully identified as A, the smart lock of the safe unlocks, and A can open the safe door.

[0085] Note: Since there are still many pendant locks inside the safe door and B's items are stored under the pendant lock, the items entrusted by B cannot be retrieved at this time when the safe door is opened.

[0086] When the smart lock unlocks successfully, the unlocking event of person A is written into the smart lock unlocking event list for storage (the storage time is generally set to 1 year), including the unlocking time, the unlocking person's serial number (the serial number of person A), the unlocking time of the smart lock of the safe, and the face image (the face image of A captured during unlocking).

[0087] Note: When the smart lock unlocks successfully, the unlocking event will be recorded for future query if needed.

[0088] (5)Person A holds the mobile phone close to B's No. 1 pendant lock, and the mobile phone APP pushes the information collected by the mobile phone APP to the pendant lock subsystem;

[0089] Through the video call between A and B, person B operates the mobile phone APP and clicks on the No. 1 pendant lock owned by B in the list of pendant locks owned by B for entrustment setting (Note: For the convenience of description, it is assumed here that the pendant lock entrusted by B to unlock is No. 1 of the pendant locks owned by B; B may own multiple pendant locks, so B must clearly select which numbered pendant lock is needed for entrusting to retrieve items; B's operation of entrustment setting in the mobile phone APP is to inform the pendant lock subsystem of the number of the pendant lock that B wants to entrust to unlock), and tells A the No. 1 pendant lock number through the video call.

[0090] After Person A opens the confidential cabinet door, Person A brings the mobile phone close to the #1 pendant lock informed by Person B (the pendant lock number is printed on the pendant lock), and the NFC reading application on Person A's mobile phone collects the NFC-ID of the #1 pendant lock. The mobile phone APP of Person A sends a message to the pendant lock subsystem according to the pendant lock number set by Person B (which is #1 at this time). After receiving the message, the pendant lock subsystem compares it with the relevant data items of the #1 pendant lock corresponding in the stored dynamic pendant lock list (4 comparisons are made, and the comparison method is shown in step (6)). The payload of the sent message packet includes: the NFC-ID of the pendant lock collected by Person A's mobile phone, the time stamp (the current clock when the NFC-ID is collected), the time point when the message is sent, and the face image / feature vector of Person B collected by Person A's mobile phone APP from the video call. At the same time, Person A's mobile phone emits a "beep" to prompt Person A that the mobile phone can be removed.

[0091] Note: The face image / feature vector of Person B is the face image of Person B intercepted by the mobile phone APP during the video call and the feature vector is parsed and calculated; while sending the feature vector of the face image, the face image is retained so that the face image can be used for comparison when the feature vector comparison is abnormal.

[0092] (6) Processing of the pendant lock subsystem after Person A presses the unlock button on the #1 pendant lock informed by Person B: Perform four comparisons: comparison of Person A's face, comparison of Person B's face, comparison of NFC-ID, and comparison of time stamp;

[0093] After Person A brings the mobile phone close to the #1 pendant lock informed by Person B and hears a "beep", Person A removes the mobile phone and immediately reaches out to press the unlock button of the #1 pendant lock. At this time, the pendant lock subsystem must perform the following 4 comparisons. All comparisons must be successful at the same time for the pendant lock subsystem to trigger the unlocking of the #1 pendant lock. If any one comparison fails, the unlocking cannot be performed (Note: The success of the following four comparisons are all necessary conditions for the unlocking of the pendant lock, and all comparisons must be successful to unlock):

[0094] 1) Comparison of Person A's face: The pendant lock subsystem captures Person A's face image through the face camera on the #1 pendant lock and compares it with the face image / feature vector in the intelligent lock personnel registration list;

[0095] Note: At this time, for the comparison of Person A's face, it is used to confirm that Person A is at the scene of the pendant lock. If Person A is not at the scene of the pendant lock, the unlocking of the pendant lock is not allowed because there may be someone else C at the scene at this time; if there is an abnormal opening when Person A is not at the scene, it may cause things to be lost; if the comparison of Person A's face fails, the unlocking of the pendant lock cannot be performed, and the pendant lock subsystem triggers an alarm;

[0096] 2) Face comparison of B: The pendant lock subsystem compares the face image / feature vector of B in the message sent by mobile phone A with the face image / feature vector of the occupant of the No. 1 pendant lock in the dynamic list of the pendant lock (Note: The No. 1 pendant lock is occupied by B, and the face image / feature vector of B has been associated when it is occupied).

[0097] Note: At this time, the face comparison of B is used to check whether the unlock button pressed by A is for the pendant lock occupied by B. If the face comparison of B fails, that is, the faces do not match, it means that A pressed the wrong button, and the pendant lock cannot be unlocked. The pendant lock subsystem triggers an alarm.

[0098] 3) NFC-ID comparison: The pendant lock subsystem compares the NFC-ID in the message sent by mobile phone A's APP bit by bit with the NFC-ID of the No. 1 pendant lock in the dynamic list of the pendant lock.

[0099] Note: At this time, the comparison between the NFC-ID collected by mobile phone A and the NFC-ID of the pendant lock chip is used to confirm that mobile phone A's APP is used on the spot of the pendant lock. If the NFC-ID comparison fails, it means that the APP is not used on the spot, and the pendant lock cannot be unlocked. The pendant lock subsystem triggers an alarm.

[0100] 4) Timestamp comparison: The pendant lock subsystem compares the timestamp (referred to as the sent timestamp) in the message sent by mobile phone A's APP with the current clock of the pendant lock subsystem (referred to as the current clock). The comparison method is: the value of the current clock - the value of the sent timestamp < the set threshold (the threshold can generally be set to 10 seconds).

[0101] Note: At this time, the comparison between the timestamp when the NFC-ID is collected by mobile phone A and the current clock of the pendant lock is used to exclude forged messages received by the pendant lock. If the calculated difference above is greater than the set threshold, it means that the timestamp comparison fails, indicating that the message with this timestamp may be forged, most likely being attacked by a hacker and should be rejected. At this time, the pendant lock cannot be unlocked, and the pendant lock subsystem triggers an alarm.

[0102] (7) The pendant lock is unlocked successfully. After person A finishes extracting the item, close the No. 1 pendant lock and the confidential cabinet door.

[0103] After the pendant lock is unlocked, A performs the operation of extracting the item according to B's entrustment. After completing the operation, close the pendant lock and press the unlock button on the pendant lock once (Note: Pressing once represents maintaining the occupied state of the pendant lock).

[0104] If after A finishes the operation of extracting items as entrusted by B, and it is known from the video call that B no longer occupies the pendant lock, then after A finishes the operation of extracting items, A closes the pendant lock and leaves without pressing the unlock button. At this time, the occupied state of the pendant lock is released and becomes the vacant state. After the pendant lock is closed, it triggers the pendant lock subsystem to update the dynamic list of pendant locks, and the occupancy personnel serial number and the occupancy personnel face image / feature vector data items corresponding to each pendant lock ID are cleared and set to empty / null.

[0105] If after A finishes the operation of extracting items as entrusted by B, and it is known from the video call that B no longer occupies the No. 1 pendant lock, but at this time A wants to occupy the No. 1 pendant lock, then A can deposit his own items and close the pendant lock according to the method described in step (2), and after pressing the unlock button twice continuously, the No. 1 pendant lock can be occupied by A.

[0106] When all operations on the pendant lock are completed, A closes the confidentiality cabinet door, and the process ends.

[0107] Note: For the convenience of B to guide A to handle the items in the pendant lock, the video call between A and B can be kept connected all the time, or the call can be ended according to the wishes of both parties, but the call should not be ended before the pendant lock is unlocked, because relevant information required for unlocking needs to be collected and reported using the mobile APP. If the video call of the APP is disconnected prematurely, it may affect unlocking. At the same time, the warning information of the pendant lock subsystem can also be received through the APP.

[0108] The intelligent lock of the confidentiality cabinet can authorize on-site personnel remotely to unlock and open the door safely. The confidentiality cabinet opens the confidentiality cabinet door by identifying and comparing the on-site item pick-up personnel through the intelligent lock, uses the face recognition of the on-site item pick-up person by the pendant lock to ensure that the on-site item pick-up person is indeed on-site, uses the comparison of the face image of the principal collected through the video call of the mobile APP to confirm that the lock to be opened is the principal's lock, uses the comparison of the NFC-ID collected by the mobile phone to verify that the APP is used on-site, and uses the verification of the time stamp to eliminate possible malicious attacks by hackers, so as to ensure the security of the process of remotely entrusting on-site item pick-up personnel to unlock and pick up items with strict security measures.

[0109] It can be seen that the intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can pick up the item, thus ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0110] Another embodiment of the present invention provides a system for collaborative item retrieval between an intelligent lock and a safe. Refer to Figure 3 , the system may include:

[0111] An identification module 301, used for face recognition and safe unlocking: The intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked;

[0112] A establishment module 302, used for remote authorization and video call establishment: The remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock;

[0113] A collection module 303, used for pendant lock information collection and pushing: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem;

[0114] An unlocking module 304, used for multiple comparisons and pendant lock unlocking: After A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can pick up the item.

[0115] It can be seen that the intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; the remotely commissioned person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item, thus ensuring the security of the process of remotely commissioning the on-site pick-up person to unlock and pick up the item with strict security measures.

[0116] An embodiment of the present invention further provides a storage medium, in which a computer program is stored. Wherein, the computer program is set to execute the steps in any one of the above method embodiments when running.

[0117] Specifically, in this embodiment, the above storage medium can be set to store a computer program for executing the following steps:

[0118] S201, Face recognition and safe unlocking: The intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked;

[0119] S202, Remote commissioning and video call establishment: The remotely commissioned person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be commissioned for unlocking through the APP and tells A the number of the pendant lock;

[0120] S203, Pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem;

[0121] S204, Multiple comparisons and pendant lock unlocking: After A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item.

[0122] It can be seen that the intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item, thereby ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0123] An embodiment of the present invention further provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0124] Specifically, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0125] Specifically, in this embodiment, the above processor may be configured to execute the following steps through a computer program:

[0126] S201, Face recognition and safe unlocking: The intelligent lock of the safe unlocks the safe door by comparing the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door is unlocked;

[0127] S202, Remote authorization and video call establishment: The remotely authorized person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock;

[0128] S203, Pendant lock information collection and pushing: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem;

[0129] S204, Multiple comparisons and pendant lock unlocking: After A presses the unlock button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item.

[0130] It can be seen that the intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; the remotely authorized person B establishes a video call with the on-site pick-up person A through the intelligent lock APP of the safe. B selects the number of the pendant lock to be authorized for unlocking through the APP and tells A the number of the pendant lock; A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B through the APP, and pushes the information to the pendant lock subsystem; after A presses the unlocking button of the pendant lock, the pendant lock subsystem conducts multiple comparisons. If all the multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item, thereby ensuring the security of the process of remotely authorizing the on-site pick-up person to unlock and pick up the item with strict security measures.

[0131] The structure, features and effects of the present invention have been described in detail based on the embodiments shown in the drawings. The above are only the preferred embodiments of the present invention, but the present invention is not limited to the scope of implementation shown in the drawings. Any changes made according to the concept of the present invention, or equivalent embodiments modified into equivalent changes, should still be within the protection scope of the present invention when they do not exceed the spirit covered by the description and the drawings.

Claims

1. A method for collaborative item retrieval between an intelligent lock and a safe, characterized in that, The method includes: Face recognition and safe unlock: The intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; Remote entrustment and video call establishment: The remote entrusting person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be entrusted for unlocking through the APP and tells A the number of the pendant lock; Pendant lock information collection and push: A brings the mobile phone close to the pendant lock designated by B, reads the NFC-ID of the pendant lock through NFC, and collects the time stamp and the face image / feature vector of B during the video call through the APP, and pushes the information to the pendant lock subsystem; Multiple comparisons and pendant lock unlock: After A presses the pendant lock unlock button, the pendant lock subsystem conducts multiple comparisons. If all multiple comparisons are successful, the pendant lock will be unlocked so that A can extract the item. Among them, the pendant lock subsystem collects the face image of A through the pendant lock camera and compares it with the personnel registration list in the intelligent lock; compares the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the pendant lock dynamic list; compares the NFC-ID pushed by the APP with the NFC-ID in the pendant lock dynamic list; compares the time stamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than the preset threshold; if all four comparisons are successful, the pendant lock will be unlocked; otherwise, an alarm will be triggered and the unlock will be refused.

2. The method according to claim 1, wherein The face recognition and safe unlock include: The intelligent lock of the safe collects the face image of A through the camera; Compares the face image of A with the face image / feature vector in the personnel registration list stored in the intelligent lock; If the comparison is successful, the safe door will be unlocked and the unlock event will be written into the intelligent lock unlock event list.

3. The method according to claim 2, wherein The remote entrustment and video call establishment include: B selects A from the face list through the safe intelligent lock APP and initiates a video call request; A responds to the video call request through the APP to establish a real-time video call; B selects the number of the pendant lock to be entrusted for unlocking through the APP and tells A the number.

4. The method according to claim 3, wherein The pendant lock information collection and push include: A brings the mobile phone close to the pendant lock designated by B and reads the NFC-ID of the pendant lock through NFC; A's APP collects the current time stamp and the face image / feature vector of B during the video call; A's APP pushes the NFC-ID, time stamp and the face image / feature vector of B to the pendant lock subsystem.

5. A system for collaborative item retrieval between an intelligent lock and a safe, characterized in that, The system includes: An identification module for face recognition and safe unlock: The intelligent lock of the safe compares the face image of the on-site pick-up person A with the personnel registration list stored in the intelligent lock through face recognition. If the comparison is successful, the safe door will be unlocked; A establishment module for remote entrustment and video call establishment: The remote entrusting person B establishes a video call with the on-site pick-up person A through the safe intelligent lock APP. B selects the number of the pendant lock to be entrusted for unlocking through the APP and tells A the number of the pendant lock; Collection module, for collecting and pushing pendant lock information: A brings the mobile phone close to the pendant lock specified by B, reads the NFC-ID of the pendant lock through NFC, and collects the timestamp and B's face image / feature vector through the APP, and pushes the information to the pendant lock subsystem; Unlock module, for multiple comparisons and unlocking of the pendant lock: After A presses the unlock button of the pendant lock, the pendant lock subsystem performs multiple comparisons. If all multiple comparisons are successful, the pendant lock is unlocked so that A can extract the item. Among them, the pendant lock subsystem collects A's face image through the pendant lock camera and compares it with the list of registered personnel in the smart lock; compares the face image / feature vector of B pushed by the APP with the occupancy personnel information of B in the pendant lock dynamic list; compares the NFC-ID pushed by the APP with the NFC-ID in the pendant lock dynamic list; compares the timestamp pushed by the APP with the current clock of the pendant lock to determine whether the time difference is less than the preset threshold; if all four comparisons are successful, the pendant lock is unlocked; otherwise, an alarm is triggered and unlocking is refused.

6. The system according to claim 5, characterized in that The recognition module is specifically used for: The smart lock of the safe collects A's face image through the camera; Compares A's face image with the face image / feature vector in the list of registered personnel stored in the smart lock; If the comparison is successful, the safe door is unlocked, and the unlocking event is written into the smart lock unlocking event list.

7. The system according to claim 6, wherein The establishment module is specifically used for: B selects A from the face list through the safe smart lock APP and initiates a video call request; A responds to the video call request through the APP to establish a real-time video call; B selects the pendant lock number to be entrusted with unlocking through the APP and tells the number to A.

8. A storage medium, characterized in that, A computer program is stored in the storage medium, wherein the computer program is set to execute the method described in any one of claims 1-4 when running.

9. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is set to run the computer program to execute the method described in any one of claims 1-4.

Images