Quick door opening method and system based on pan-tilt door lock

Abstract

The invention discloses a quick door opening method and system based on a pan-tilt door lock, and the method comprises the steps: generating a broadcast message according to a family member face image of an intelligent lock A, so that other intelligent locks receive and update a local door lock list, and obtaining a shared door lock list; according to the face image recognized by the intelligent lock B, performing similarity comparison with the shared door lock list, generating a notification message that the member is about to arrive, and obtaining direction information of the member; according to a member arrival notification message received by the intelligent lock A, the preset position direction of the intelligent lock B in the door lock list is inquired, and the adjusted direction of the pan-tilt camera is obtained; according to a plurality of member arrival notification messages received by the intelligent lock A, obtaining an optimized pan-tilt camera direction; and obtaining a door opening result according to the adjusted direction of the holder camera. By utilizing the embodiment of the invention, an efficient, convenient and safe door opening solution can be realized, so that the dual requirements of modern families on quick door opening experience and safety can be met.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a fast door opening method and system based on a pan-tilt door lock. Background Art

[0002] With the rapid development of smart home, as an important part of home security, intelligent door locks are favored by more and more families. Traditional door locks usually rely on mechanical keys or simple password input, and there are certain limitations in both security and convenience. In order to improve the user experience and home security, many manufacturers have adopted biometric technologies such as face recognition technology and fingerprint recognition technology to realize the unlocking function of intelligent door locks. However, these technologies also face some challenges in practical applications. For example, the recognition speed is slow, the recognition accuracy is affected by light conditions, and the user fails to unlock the door in time when arriving at the door.

[0003] During the process of unlocking the door by face comparison using a pan-tilt intelligent lock, in order to perform face recognition in advance and unlock the door earlier, the surrounding pan-tilt door locks can be used to identify in advance and notify this lock, and then the pan-tilt camera can be rotated in advance to point to the direction of the person coming. However, there may be a problem that when multiple surrounding door locks recognize the owner, the pointing direction of the pan-tilt camera of this lock cannot be determined. And the networked intelligent lock is equipped with a pan-tilt camera, and the face images of the household owner may be successfully recognized in multiple intelligent locks in the corridor. Summary of the Invention

[0004] The purpose of the present invention is to provide a fast door opening method and system based on a pan-tilt door lock to solve the deficiencies in the prior art, and to be able to implement an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and security.

[0005] An embodiment of the present application provides a fast door opening method based on a pan-tilt door lock, and the method includes: Synchronization of family member feature vectors and update of the door lock list: According to the face image feature vectors of family members of intelligent lock A, generate a broadcast message including family member IDs and feature vectors, so that other intelligent locks can receive and update the local door lock list to obtain a shared door lock list including all family member feature vectors; Face recognition and direction judgment: According to the face image recognized by intelligent lock B, compare the similarity with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of intelligent lock A, then according to the positional relationship between intelligent lock B and A, generate a notification message that a member is about to arrive, and send it to intelligent lock A to obtain the direction information of the member; PTZ preset position adjustment and waiting: According to the notification message of the member's imminent arrival received by smart lock A, the preset position direction of smart lock B in the door lock list is queried; wherein, the preset position direction is used to adjust the direction of the PTZ camera, and start the waiting mode, waiting for the family member to enter the camera's field of view, and obtain the adjusted PTZ camera direction; Conflict message processing and lighting optimization: According to the notification messages of multiple members about to arrive received by smart lock A, it is determined whether there is a direction conflict; if there is a conflict, the final PTZ camera direction is determined according to the principle of minority obeys majority by broadcasting the light monitoring message and counting the feedback from other door locks, and the optimized PTZ camera direction is obtained; Face matching and early unlocking: According to the adjusted direction of the PTZ camera, the facial images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance, otherwise the door is unlocked after the family member arrives at the door lock to obtain the final door opening result and complete the quick door opening process.

[0006] Optionally, the synchronization of the family member feature vector and the update of the door lock list includes: Family member feature vector generation: extracting facial feature vectors based on the facial images of family members of smart lock A; wherein the feature vectors are generated by a deep learning model to obtain feature vector data of family members; Broadcast message generation and sending: Generate a broadcast message based on the family member ID and feature vector data; wherein the broadcast message is sent to other smart locks on the same floor through the local area network to obtain shared family member feature vector information; Door lock list update: Update the local door lock list according to the received broadcast message; wherein the door lock list includes family member ID, feature vector and door lock position relationship, and obtains an updated shared door lock list.

[0007] Optionally, the face recognition and direction determination include: Face image acquisition and feature extraction: Extract face feature vectors based on face images captured by the camera of smart lock B; wherein, the feature extraction uses a deep learning model to obtain real-time face feature vectors; Similarity comparison and member identification: Based on the real-time facial feature vector, the similarity is compared with the feature vector in the shared door lock list; if the similarity exceeds the preset threshold, it is identified as the corresponding family member and the identification result is obtained; Direction determination and notification message generation: Based on the positional relationship of smart lock B relative to smart lock A, a notification message is generated that the member is about to arrive; wherein, the notification message includes the member ID and the location information of door lock B, and the direction determination result is obtained.

[0008] Optionally, the pan-tilt preset position adjustment and waiting include: Notification message parsing and preset position query: According to the notification message that a member is about to arrive received by the smart lock A, parse the position information of the door lock B; wherein, the position information is used to query the preset position direction of the smart lock B in the door lock list to obtain the preset position direction information; Pan-tilt camera direction adjustment: According to the preset position direction information, adjust the orientation of the pan-tilt camera; wherein, the adjustment is achieved by controlling the pan-tilt motor to obtain the adjusted camera direction; Waiting mode start: According to the adjusted camera direction, start the waiting mode; wherein, the waiting mode lasts for 1 minute to wait for family members to enter the camera's field of view to obtain the waiting state.

[0009] Optionally, the conflict message processing and lighting optimization include: Conflict message detection: According to multiple notification messages that members are about to arrive received by the smart lock A, determine whether there is a direction conflict; wherein, the conflict detection is achieved by comparing the position information of different door locks to obtain the conflict detection result; Turn-on light monitoring message broadcast: According to the conflict detection result, generate a turn-on light monitoring broadcast message; wherein, the broadcast message is sent to other smart locks on the same floor through the local area network to obtain the turn-on light monitoring state; Feedback message statistics and direction optimization: According to the feedback messages of other smart locks, statistically analyze the direction information of members; wherein, the statistics determine the final pan-tilt camera direction according to the principle of the minority obeying the majority to obtain the optimized camera direction.

[0010] Another embodiment of the present application provides a fast door opening system based on a pan-tilt door lock, and the system includes: Synchronization module, used for family member feature vector synchronization and door lock list update: According to the face image feature vector of a family member of the smart lock A, generate a broadcast message containing the family member ID and the feature vector, so that other smart locks receive and update the local door lock list to obtain a shared door lock list containing the feature vectors of all family members; Recognition module, used for face recognition and direction judgment: According to the face image recognized by the smart lock B, compare the similarity with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of the smart lock A, generate a notification message that a member is about to arrive according to the position relationship of the smart lock B relative to A, and send it to the smart lock A to obtain the direction information of the member; Adjustment module, used for pan-tilt preset position adjustment and waiting: According to the notification message that a family member is about to arrive received by smart lock A, query the preset position direction of smart lock B in the door lock list; wherein, the preset position direction is used to adjust the orientation of the pan-tilt camera, and start the waiting mode to wait for the family member to enter the camera's field of view, and obtain the adjusted direction of the pan-tilt camera. Processing module, used for conflict message processing and lighting optimization: According to multiple notification messages that family members are about to arrive received by smart lock A, judge whether there is a direction conflict; wherein, if there is a conflict, broadcast a lighting monitoring message and count the feedback of other door locks, and determine the final direction of the pan-tilt camera according to the principle of the minority obeying the majority, and obtain the optimized direction of the pan-tilt camera. Comparison module, used for face comparison and early unlocking: According to the adjusted direction of the pan-tilt camera, capture the face image of the family member in real time and perform comparison; wherein, if the comparison is successful, unlock the door in advance, otherwise wait for the family member to arrive in front of the door and then perform identification and unlocking, and obtain the final door opening result to complete the fast door opening process.

[0011] Another embodiment of the present application provides a storage medium, in which a computer program is stored, wherein the computer program is set to execute the method described in any one of the above when running.

[0012] Another embodiment of the present application provides an electronic device, including a memory and a processor, a computer program is stored in the memory, and the processor is set to run the computer program to execute the method described in any one of the above.

[0013] Compared with the prior art, a fast door opening method based on a pan-tilt door lock provided by the present invention generates a broadcast message according to the face image of the family member of smart lock A, so that other smart locks receive and update the local door lock list to obtain a shared door lock list; according to the face image identified by smart lock B, compare the similarity with the shared door lock list, generate a notification message that a family member is about to arrive, and obtain the direction information of the family member; according to the notification message that a family member is about to arrive received by smart lock A, query the preset position direction of smart lock B in the door lock list to obtain the adjusted direction of the pan-tilt camera; according to multiple notification messages that family members are about to arrive received by smart lock A, obtain the optimized direction of the pan-tilt camera; according to the adjusted direction of the pan-tilt camera, obtain the final door opening result, so as to be able to implement an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and security. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a hardware structure block diagram of a computer terminal for a fast door opening method based on a pan-tilt door lock provided by an embodiment of the present invention; Figure 2 Schematic flowchart of a fast door opening method based on a pan-tilt door lock provided by an embodiment of the present invention; Figure 3 Schematic structural diagram of a fast door opening system based on a pan-tilt door lock provided by an embodiment of the present invention. Detailed implementation manners

[0015] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0016] An embodiment of the present invention first provides a fast door opening method based on a pan-tilt door lock. This method can be applied to an electronic device, such as a computer terminal, specifically, a general computer, etc.

[0017] The following takes running on a computer terminal as an example to describe it in detail. Figure 1 Hardware structure block diagram of a computer terminal for a fast door opening method based on a pan-tilt door lock provided by an embodiment of the present invention. As Figure 1 shown, the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0018] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions. When the program instructions are executed, the processor can execute any fast door opening method based on a pan-tilt door lock.

[0019] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0020] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any fast door opening method based on a pan-tilt door lock.

[0021] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0022] It should be understood that the processor can be a Central Processing Unit (CPU), and the processor can also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0023] See Figure 2 , an embodiment of the present invention provides a fast door opening method based on a pan-tilt door lock, which may include the following steps: S201, Family member feature vector synchronization and door lock list update: According to the face image feature vectors of family members of smart lock A, generate a broadcast message including family member IDs and feature vectors, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing all family member feature vectors; specifically, the family member feature vector synchronization and door lock list update includes: Family member feature vector generation: Extract face feature vectors according to the face images of family members of smart lock A; among them, the feature vectors are generated by a deep learning model to obtain the feature vector data of family members. Broadcast message generation and sending: Generate a broadcast message according to the family member ID and feature vector data; among them, the broadcast message is sent to other smart locks on the same floor through a local area network to obtain shared family member feature vector information. Door lock list update: Update the local door lock list according to the received broadcast message; among them, the door lock list includes family member IDs, feature vectors, and door lock position relationships to obtain an updated shared door lock list.

[0024] S202, Face recognition and direction judgment: Compare the face image recognized by smart lock B with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of smart lock A, generate a notification message that the member is about to arrive according to the position relationship of smart lock B relative to A, and send it to smart lock A to obtain the direction information of the member; specifically, the face recognition and direction judgment includes: Face image acquisition and feature extraction: Extract face feature vectors according to the face images collected by the camera of smart lock B; among them, the feature extraction uses a deep learning model to obtain real-time face feature vectors. Similarity comparison and member recognition: Compare the real-time face feature vector with the feature vectors in the shared door lock list; among them, if the similarity exceeds the preset threshold, it is recognized as the corresponding family member to obtain the recognition result; Direction judgment and notification message generation: Generate a notification message that a member is about to arrive according to the positional relationship of Smart Lock B relative to Smart Lock A; among them, the notification message includes the member ID and the location information of Smart Lock B to obtain the direction judgment result.

[0025] S203, PTZ preset position adjustment and waiting: According to the notification message that a member is about to arrive received by Smart Lock A, query the preset position direction of Smart Lock B in the door lock list; among them, the preset position direction is used to adjust the orientation of the PTZ camera and start the waiting mode to wait for the family member to enter the camera's field of view to obtain the adjusted PTZ camera direction; specifically, the PTZ preset position adjustment and waiting includes: Notification message parsing and preset position query: According to the notification message that a member is about to arrive received by Smart Lock A, parse the location information of Smart Lock B; among them, the location information is used to query the preset position direction of Smart Lock B in the door lock list to obtain the preset position direction information; PTZ camera direction adjustment: Adjust the orientation of the PTZ camera according to the preset position direction information; among them, the adjustment is achieved by controlling the PTZ motor to obtain the adjusted camera direction; Waiting mode start: Start the waiting mode according to the adjusted camera direction; among them, the waiting mode lasts for 1 minute to wait for the family member to enter the camera's field of view to obtain the waiting state.

[0026] S204, conflict message processing and lighting optimization: According to multiple notification messages that members are about to arrive received by Smart Lock A, judge whether there is a direction conflict; among them, if there is a conflict, broadcast a lighting monitoring message and count the feedback of other door locks, and determine the final PTZ camera direction according to the principle of the minority obeying the majority to obtain the optimized PTZ camera direction; specifically, the conflict message processing and lighting optimization includes: Conflict message detection: According to multiple notification messages that members are about to arrive received by Smart Lock A, judge whether there is a direction conflict; among them, the conflict detection is achieved by comparing the location information of different door locks to obtain the conflict detection result; Broadcast of lighting monitoring message: Generate a lighting monitoring broadcast message according to the conflict detection result; among them, the broadcast message is sent to other smart locks on the same floor through the local area network to obtain the lighting monitoring state; Feedback message statistics and direction optimization: According to the feedback messages of other intelligent locks, the direction information of members is statistically analyzed; among them, the final direction of the pan-tilt camera is determined according to the principle of the minority obeying the majority to obtain the optimized camera direction.

[0027] S205, face comparison and early unlocking: According to the adjusted direction of the pan-tilt camera, the face images of family members are captured in real time and compared; among them, if the comparison is successful, the door is unlocked in advance, otherwise, wait for the family member to arrive in front of the door lock and then perform identification and unlocking to obtain the final door opening result and complete the fast door opening process.

[0028] In practical applications, in order to perform face recognition comparison and unlock the door in advance for the host, the present invention designs an intelligent solution using multi-door lock collaboration.

[0029] 1. Core idea: Multiple door locks are networked; Door lock A broadcasts the feature vectors of its own family members to other door locks on the same floor; The default pan-tilt preset positions of all door locks face forward; When family member A of door lock A walks from the left towards door lock A, the door lock B on the left first recognizes the face of member A. If it finds that it is a member of door lock A, it sends a "member approaching" message to door lock A, including the position of door lock B; Door lock A adjusts the pan-tilt to face the left according to the position of door lock B; When member A enters the camera view of door lock A and the recognition is successful, the door is opened, thus improving the unlocking efficiency.

[0030] Further improvement: From door lock B to door lock A, there may be multiple door locks in between, and they may also recognize member A. So the optimization is as follows: After door lock B discovers member A, it sends a message to door lock A, with the destination IP being door lock A and the destination mac being broadcast, so that other door locks can also receive it; After other door locks receive it, they know that door lock B has already told door lock A, so even if they recognize member A, they will not repeat sending messages to door lock A. However, if the door lock on the right side of door lock A also thinks it is member A, it needs to send a message to notify door lock A; Door lock A adjusts the pan-tilt to face the left according to the position of door lock B. When member A enters the camera view of door lock A and the recognition is successful, the door is opened, thus facilitating the member to enter the door quickly.

[0031] Even further improvement: At this time, the door lock C on the right also recognizes a face. Through similarity comparison, it is considered to be member A. So door lock A receives two conflicting messages from both sides, which may be the result of complex lighting. So door lock A drives the corridor light to turn on and broadcasts a message to all door locks, asking everyone to continue to give feedback, and judges the coming direction of member A according to the principle of the minority obeying the majority - usually under good lighting conditions, there will no longer be a conflict phenomenon.

[0032] 2. Prerequisites: Install intelligent locks with pan-tilt cameras on each household door on the floor, and save the intelligent lock list of this floor (data items include: lock ID, lock geographical location, lock IP address, MAC address, family member ID, feature vector of family member's face image, ID of each intelligent lock on this floor / pan-tilt preset position (left / right), etc.). The intelligent lock is connected to the platform, registers with the platform, and periodically updates the intelligent lock list.

[0033] The platform records the intelligent lock list of the community. The intelligent lock list of the community includes: lock ID, lock geographical location, lock IP address, MAC address, the floor it belongs to, ID of each intelligent lock on this floor / pan-tilt preset position (left / right), etc.

[0034] 3. Pan-tilt camera preset position setting for intelligent locks: Before the platform synchronizes the intelligent lock list with the intelligent lock, according to the geographical locations of the intelligent locks on each floor, manually set the floor and subnet of the local area network to which each intelligent lock belongs (all intelligent locks on each floor are divided into a subnet or set as a VLAN), and the position relationship between other door locks on the floor and this lock (whether other intelligent locks are on the left or right of this lock), and save them into the corresponding pan-tilt preset position (left / right). Set the default pan-tilt preset position to face directly forward.

[0035] For example: Suppose intelligent locks A, B, C, D, and E belong to the 3rd floor, and their geographical location relationship is also ABCDE. Then the preset positions set by A for each door lock are lock ID (B) / pan-tilt preset position (left), lock ID (C) / pan-tilt preset position (left), lock ID (D) / pan-tilt preset position (left), lock ID (D) / pan-tilt preset position (left); the preset positions set by B for each door lock are lock ID (A) / pan-tilt preset position (right), lock ID (C) / pan-tilt preset position (left), lock ID (D) / pan-tilt preset position (left), lock ID (D) / pan-tilt preset position (left); and so on for the others.

[0036] 4. Synchronization of family member face feature vectors: Intelligent lock A broadcasts the family member ID and the feature vector of the family member's face image of this lock to other intelligent locks on this floor (only sent when the device is first connected to the network or when family members change). The content of the broadcast message includes lock ID, family member ID, feature vector of the family member's face image, etc. Other intelligent locks on the floor receive and update their own intelligent lock lists. The intelligent lock list includes: lock ID, lock IP address, lock geographical address, lock preset position (position relative to this lock, such as left or right), family member ID, feature vector of the family member's face image (if there are multiple family members under each lock ID, there will be corresponding multiple family member IDs and feature vectors of the family member's face image).

[0037] For example: if smart lock A has three family members a, b, and c, then A broadcasts the family member ID (a) / feature vector of face image (a), family member ID (b) / feature vector of face image (b), and family member ID (c) / feature vector of face image (c) to all smart locks on this floor. Each door lock receives and extracts the feature vector of family member ID / face image of a, b, and c, and updates it to the lock. If door lock B has two family members d and e, then after the update, there will be 5 people in the list of B smart locks, which are a, b, and c corresponding to the door lock ID, door lock geographic location, door lock IP address, and MAC address of A, and d and e of this lock. Similarly, the smart lock list of all door locks on this floor stores information such as the feature vector of the face image of the family members of other door locks on this floor.

[0038] 5. Processing of smart locks detecting and identifying people: After smart lock B detects and identifies a face image, it calculates the similarity with the feature vector of the face image in the smart lock list to see if it meets the threshold (the threshold of the similarity value is generally set to 80%). If it is identified as a family member of B, the door is unlocked. If smart lock B fails to recognize the person's face (in this case, the person may be a stranger, neither a family member of B nor a family member of other door locks), no processing is performed. If smart lock B recognizes the person as a family member of A, it will query A's IP address from the smart lock list and send a "member is about to arrive" notification message to A. The message content includes the door lock ID, the recognized person ID, etc.; after receiving B's notification message, A will query B's preset position in the smart lock list (if B is on the left side of A), and point the pan-tilt camera to the left. A will wait and track the arrival of family members according to the preset pan-tilt direction. When the face recognition and comparison of the family member is successful, the door will be unlocked and opened in advance, and then the pan-tilt camera will return to the normal preset position facing straight ahead. If multiple "members are about to arrive" notification messages are received, multiple preset positions will be set and the pan-tilt patrol method will be used to wait for 1 minute.

[0039] For example: after smart lock A receives the "Member is about to arrive" notification message sent by B about person ID (a), it queries the smart lock list stored in A according to the door lock ID (B) in the message and obtains that the preset position of door lock ID (B) relative to A is the left side, then A immediately turns the direction of the PTZ camera from the normal forward direction to the left side, waiting for the arrival of person ID (a). Since there may be multiple "Member is about to arrive" notification messages, it can be divided into two cases for explanation: there is only one "Member is about to arrive" notification message, and there are multiple "Member is about to arrive" notification messages.

[0040] If there is only one notification message of "Member is about to arrive": If A only receives and waits for the arrival of person ID (a) sent by B, if person ID (a) is detected within 1 minute, it will track and identify and compare person ID (a). If the comparison is successful, unlock the door for person ID (a) in advance; if the comparison is not successful during the tracking process, until person ID (a) arrives in front of the door lock, the door lock camera will identify and compare and unlock the door. After tracking person ID (a) to arrive in front of the door lock, the PTZ camera resets to the normal preset position facing forward to guard.

[0041] If there are multiple "Members are about to arrive" notification messages: If A receives a "Members are about to arrive" notification message from D for Personnel ID (b) while waiting for B to send a notification message for Personnel ID (a): 1) If person ID (a) and person ID (b) come from the same direction, for example, both from the left side, the PTZ camera calculates the waiting time (1 minute) based on the time of the waiting notification message. If no person is found arriving at the end of their respective waiting times, the PTZ camera resets to the normal preset position facing forward to guard. If one of the persons arrives, the camera continues to track, identify and compare the person until he arrives in front of the smart lock. If the waiting time of the other person has not expired, the camera quickly returns to the left position to continue waiting. 2) If personnel ID (a), personnel ID (b), and personnel ID (c) come from different directions, the PTZ camera sets preset positions for personnel ID (a), personnel ID (b), and personnel ID (c) in different directions. For example, if personnel ID (a) and personnel ID (c) come from the left, and personnel ID (b) comes from the right, the PTZ camera of the smart lock sets two inspection positions on the left and right, and immediately starts patrolling (stays in one direction for 5 seconds and then immediately switches to the other direction, patrolling in turn). As long as a person is found coming in any direction (for example, person ID (a) on the left arrives first), it immediately enters the one-way continuous tracking and identification and comparison mode for person ID (a) until the person arrives. If the one-way tracking ends (the continuous tracking and matching is successful, or it has arrived in front of the smart lock, and the door lock camera will capture and match it later), the camera will quickly return to patrol (for example, at this time, person ID (c) is on the left, person ID (b) is on the right, and both are within the waiting period) or the other direction (for example, only person ID (b) on the right is left to wait for the arrival of person ID (b) in one direction, and enter the one-way continuous tracking and identification and matching mode for person ID (a) until person ID (a) is successfully matched or arrives in front of the smart lock. If the waiting time in each direction expires (1 minute), the PTZ camera will reset to the normal preset position facing straight ahead for guarding.

[0042] 6. Further optimization: When B identifies and matches A's family members, it sends a broadcast message of "Members are about to arrive" to A. At the same time, other door locks can also receive the broadcast message and cache it for 1 minute before deleting it. During this period, when other door locks (such as door lock C) also identify A's family members, they are the same person based on the comparison with the broadcast message, then C will no longer send "Members are about to arrive" to A.

[0043] In the above step 5, if A's family member passes through multiple smart locks on the way home, each smart lock will repeatedly send the "member is about to arrive" notification message to the person when it recognizes A's family member, and reset the PTZ camera preset position once. However, this is often a repeated and meaningless reset, which additionally causes frequent resets of the PTZ camera of smart lock A. In order to reduce the number of "members are about to arrive" notification messages sent by other door locks to family members, the following optimizations are made: Smart lock B identifies and matches A's family member, and after querying A's IP address, it sends a message to A with A's IP address as the destination IP address and the broadcast mac address as the destination mac address. After receiving the message, A processes it according to step (5): that is, after receiving B's notification message, A queries B's preset position in the smart lock list (assuming B is on A's left), and points the PTZ camera to the left. A waits and tracks the arrival of family members according to the preset PTZ direction. When the family member's face recognition is successful, it immediately unlocks the door for them in advance. Smart lock C (referring to other smart locks) caches the message after listening to the broadcast message, and deletes it after 1 minute. If C also identifies A's family member during the 1-minute cache period, it will no longer send messages to A repeatedly. If C identifies A's family member after the 1-minute cache expires, C will send a message to A in the same way (sending a broadcast message of "members are about to arrive").

[0044] The detailed description is as follows: Smart lock B recognizes person a of A and sends a broadcast message: If person a of smart lock A passes by smart lock B and is successfully identified by B's face recognition, and it is known from the smart lock list stored in B that a is a family member of smart lock A, then B will query the smart lock list and set A's IP address as the destination IP address, and set mac to the broadcast address "FF:FF:FF:FF:FF:FF", and send a notification message of "members are about to arrive" to A. The message content includes the door lock ID (B) of this lock, the recognized door lock ID (A) and the person ID (a), etc. Smart lock C will not resend the message of a after receiving the broadcast message from B: Other smart locks on the floor belong to the same subnet and can also monitor the notification message of "member about to arrive" sent by B (taking smart lock C as an example). After smart lock C monitors the notification message sent by B, it compares the destination IP address and finds that it is not the IP address of C (indicating that the purpose of B sending the notification is not C, but C can receive this notification message to avoid C resending the notification message of a). It extracts and caches the message content including door lock ID (B), recognized door lock ID (A), and personnel ID (a), etc. The storage period is 1 minute (which can generally be set to 1 minute according to the time it takes for people to move on the floor). When C also detects and recognizes personnel a, it queries the smart lock list stored in A according to the smart lock list and knows the door lock ID (A) and personnel ID (a) to which a belongs. By comparing with the cached message of B, it can be known that it is the same person. C will no longer send the "member about to arrive" notification message to A (because B has already sent a message to notify A, and other door locks do not need to notify again); if C does not recognize personnel a within the storage period after B sends the notification message, it will delete this notification message; if C recognizes personnel a after the storage period of B sending the notification message (at this time, it may be because a has been delayed somewhere on the floor or appears again), then C will send the "member about to arrive" notification message to A according to the method of B, and the message content includes door lock ID (C), recognized door lock ID (A), and personnel ID (a), etc.

[0045] After receiving the broadcast message from B, smart lock A adjusts the orientation of the pan-tilt camera towards the direction of the incoming person: Smart lock A receives the notification message of "member about to arrive" sent by B. By comparing the IP addresses, it can be known that the destination address of this message is the IP address of A. According to the door lock ID (B) in the message, it queries the smart lock list stored in A and obtains that the preset position of door lock ID (B) relative to A is on the left side. Then A immediately turns the orientation of the pan-tilt camera from the normal ultra-front direction to the left side to wait for the arrival of personnel ID (a). If no arrival of personnel ID (a) is found after waiting for 1 minute, the orientation of the pan-tilt camera will be restored to the normal ultra-front direction. If the arrival of personnel ID (a) is found, it will be tracked, recognized, and compared.

[0046] 7. Further optimization: When door lock A receives the "member about to arrive" notification messages for the same personnel a from the left door lock B and the right door lock C, which are determined to be two conflicting messages, it will drive the corridor lights to turn on and send a broadcast message of "turn on the lights for monitoring" for personnel a to all door locks on the floor. After other door locks receive the "turn on the lights for monitoring" message and recognize personnel a, they will immediately reply with the "member about to arrive" notification message to A. A will judge the side with more reply messages as the direction to adjust the orientation of the pan-tilt camera according to the principle of the minority obeying the majority.

[0047] In the above step 5 process, if the family members of door lock A pass by multiple smart locks on their way home, and if door lock B on the left side of A recognizes a face and, through similarity comparison, determines that it is family member a of A, and at the same time, door lock C on the right side also recognizes a face and, through similarity comparison, also determines that it is family member a of A, then both door lock B and door lock C send the notification message of "member about to arrive" for this family member to A. As a result, door lock A receives two conflicting messages from both sides, which may be due to complex lighting. To avoid the situation where other door locks in different directions recognize the same person due to the lighting in the corridor where the smart door lock is located and send "member about to arrive" notification messages from different directions for the same person, the following optimizations are made: When both B on the left side and C on the right side of smart lock A detect and recognize family member a of A: If B on the left side of smart lock A recognizes a first, query the IP address of A from the smart lock list and send a broadcast (with the IP address of A as the destination IP address and the broadcast mac address as the destination mac address) message of "member about to arrive" to A. The message content includes the door lock ID (B), the recognized person ID (a), etc.; At this time, when C on the right side of smart lock A hears B's broadcast message and also recognizes family member a of A, and C is located on the right side of A through position check, it cannot ignore B's broadcast message (based on the pre-set assumption that family members from different directions should be regarded as different people), and send a broadcast (with the IP address of A as the destination IP address and the broadcast mac address as the destination mac address) message of "member about to arrive" to A in the same way as B. The message content includes the door lock ID (C), the recognized person ID (a), etc.; After receiving B's broadcast message, smart lock A adjusts the orientation of the pan-tilt camera to the left side. At this time, when it receives C's broadcast message, it adjusts the orientation of the pan-tilt camera to the right side. Since a has not yet arrived in front of the door lock of A, it enters the patrol state of the two preset positions (left side, right side) at this time.

[0048] If when smart lock A receives the "member about to arrive" broadcast messages from B on the left side and C on the right side regarding the same family member a of A, it is determined that the two messages conflict with each other, which may be due to complex lighting in the corridor, and conflict message exclusion is required. The method is as follows: Add preset conditions: The smart lock is connected to the corridor lighting control system; The floor is equipped with a smart lighting control system that can receive instructions from the smart lock to control the opening and closing of the corridor lights.

[0049] Smart Lock A lights up the corridor lights: When receiving two conflicting messages, Smart Lock A sends a "turn on the lights" control signal to the corridor lighting control system, which contains the door lock ID (A), the current clock, etc. After receiving the "turn on the lights" control signal from A, the corridor lighting control system turns on the corridor lights and starts timing. The corridor lights will automatically turn off after 5 minutes. After the corridor lights are turned on, it is beneficial for face recognition comparison under good lighting conditions.

[0050] Smart Lock A sends a broadcast message of "turn on the lights for monitoring" to all door locks on the floor. The message content includes: door lock ID (A), door lock IP address (A), feature vector of the face image (a), etc. After receiving the broadcast message of "turn on the lights for monitoring", other door locks cache the message and delete it after 1 minute when it expires.

[0051] As a continues to walk, assuming that person a is successfully recognized and compared by other door locks (such as Door Lock D, and no matter whether more other door locks are on the same side as Door Locks B or C, the same process is used to reply if a is recognized). A notice message of "member is about to arrive" is broadcast and replied to A in the previous method. The message content includes the door lock ID (D) of this lock, the recognized door lock ID (A), and the person ID (a), etc. After receiving the reply message from D (or possibly multiple reply messages for a), A immediately counts (real-time counting, that is, each time a reply message for a is received, a count is made) the number of door locks on the left side (assuming there are M) and the right side (assuming there are N) of A that have feedback on a, and compares the sizes of M and N in real time. Adjust the orientation of the pan-tilt camera of A to the left (there are M messages on the left side) according to the larger of M and N (for example, if M is larger than N, this method is that the minority obeys the majority). If M and N are equal, adjust the orientation of the pan-tilt camera according to the orientation of the door lock received most recently (for example, if the door lock D on the left side of A was recognized most recently, then adjust the orientation of the pan-tilt camera to the left).

[0052] Note: After the corridor lights are turned on, face recognition and comparison will be more accurate, and the probability of being recognized by different door locks with a large geographical location gap is extremely low; if a is still recognized by multiple door locks with a large geographical location gap, it means that a is wandering in the corridor. At this time, adjust the pan-tilt camera according to the orientation of the door lock recognized most recently and wait for a to arrive, so as to conduct early recognition and comparison and early door opening.

[0053] Beneficial effects: The smart door lock adjusts the orientation of the pan-tilt camera towards the direction of the incoming person in advance according to the notification of the neighboring door locks, and conducts face recognition and unlocks the door in advance for the host.

[0054] It can be seen that, based on the facial images of family members of the intelligent lock A, a broadcast message is generated to enable other intelligent locks to receive and update the local door lock list, obtaining a shared door lock list; based on the facial image recognized by the intelligent lock B, a similarity comparison is made with the shared door lock list to generate a notification message that a member is about to arrive, and the direction information of the member is obtained; according to the notification message that a member is about to arrive received by the intelligent lock A, the preset direction of the intelligent lock B in the door lock list is queried to obtain the adjusted direction of the pan-tilt camera; according to multiple notification messages that a member is about to arrive received by the intelligent lock A, an optimized direction of the pan-tilt camera is obtained; according to the adjusted direction of the pan-tilt camera, a final door opening result is obtained, so as to be able to implement an efficient, convenient and safe door opening solution to meet the dual requirements of modern families for a fast door opening experience and security.

[0055] Another embodiment of the present invention provides a fast door opening system based on a pan-tilt door lock, see Figure 3 , the system may include: A synchronization module 301, configured to synchronize family member feature vectors and update the door lock list: based on the facial image feature vectors of family members of the intelligent lock A, generate a broadcast message including the family member ID and the feature vector, so that other intelligent locks receive and update the local door lock list, obtaining a shared door lock list including the feature vectors of all family members; An identification module 302, configured to perform facial recognition and direction judgment: based on the facial image recognized by the intelligent lock B, make a similarity comparison with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of the intelligent lock A, according to the positional relationship of the intelligent lock B relative to A, generate a notification message that a member is about to arrive, and send it to the intelligent lock A, obtaining the direction information of the member; An adjustment module 303, configured to adjust the pan-tilt preset position and wait: according to the notification message that a member is about to arrive received by the intelligent lock A, query the preset direction of the intelligent lock B in the door lock list; where the preset direction is used to adjust the orientation of the pan-tilt camera, and start the waiting mode to wait for the family member to enter the camera's field of view, obtaining the adjusted direction of the pan-tilt camera; A processing module 304, configured to process conflict messages and optimize lighting: based on multiple notification messages that a member is about to arrive received by the intelligent lock A, judge whether there is a direction conflict; among them, if there is a conflict, broadcast a lighting monitoring message and count the feedback of other door locks, and determine the final direction of the pan-tilt camera according to the principle of the minority obeying the majority, obtaining an optimized direction of the pan-tilt camera; A comparison module 305, configured to perform facial comparison and unlock in advance: according to the adjusted direction of the pan-tilt camera, capture the facial image of the family member in real time and make a comparison; among them, if the comparison is successful, unlock the door in advance, otherwise wait for the family member to arrive in front of the door and then perform identification and unlocking, obtaining the final door opening result and completing the fast door opening process.

[0056] It can be seen that according to the face images of family members of the intelligent lock A, a broadcast message is generated so that other intelligent locks can receive and update the local door lock list to obtain a shared door lock list; according to the face images recognized by the intelligent lock B, a similarity comparison is made with the shared door lock list to generate a notification message that a member is about to arrive, and the direction information of the member is obtained; according to the notification message that a member is about to arrive received by the intelligent lock A, the preset direction of the intelligent lock B in the door lock list is queried to obtain the adjusted direction of the pan-tilt camera; according to multiple notification messages that members are about to arrive received by the intelligent lock A, an optimized direction of the pan-tilt camera is obtained; according to the adjusted direction of the pan-tilt camera, a final door opening result is obtained, so that an efficient, convenient and safe door opening solution can be realized to meet the dual requirements of modern families for a fast door opening experience and security.

[0057] An embodiment of the present invention also provides a storage medium, in which a computer program is stored, and the computer program is configured to execute the steps in any one of the above method embodiments when running.

[0058] Specifically, in this embodiment, the above storage medium can be configured to store a computer program for executing the following steps: S201, synchronization of family member feature vectors and update of door lock list: According to the face image feature vectors of family members of the intelligent lock A, a broadcast message including the family member ID and the feature vector is generated so that other intelligent locks can receive and update the local door lock list to obtain a shared door lock list including the feature vectors of all family members; S202, face recognition and direction judgment: According to the face images recognized by the intelligent lock B, a similarity comparison is made with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of the intelligent lock A, a notification message that a member is about to arrive is generated according to the positional relationship of the intelligent lock B relative to A and sent to the intelligent lock A to obtain the direction information of the member; S203, pan-tilt preset position adjustment and waiting: According to the notification message that a member is about to arrive received by the intelligent lock A, the preset direction of the intelligent lock B in the door lock list is queried; the preset direction is used to adjust the orientation of the pan-tilt camera and start the waiting mode to wait for the family member to enter the camera's field of view to obtain the adjusted direction of the pan-tilt camera; S204, conflict message processing and lighting optimization: According to multiple notification messages that members are about to arrive received by the intelligent lock A, it is judged whether there is a direction conflict; if there is a conflict, a broadcast message for turning on the light for monitoring is sent and the feedback of other door locks is counted, and the final direction of the pan-tilt camera is determined according to the principle of the minority obeying the majority to obtain the optimized direction of the pan-tilt camera; S205, Face comparison and early unlocking: According to the adjusted direction of the pan-tilt camera, capture the face images of family members in real time and perform comparison; among them, if the comparison is successful, unlock the door in advance, otherwise wait for the family member to reach the door lock before performing identification and unlocking to obtain the final door opening result and complete the fast door opening process.

[0059] It can be seen that according to the face images of family members of Smart Lock A, a broadcast message is generated so that other smart locks can receive and update the local door lock list to obtain a shared door lock list; according to the face images identified by Smart Lock B, perform a similarity comparison with the shared door lock list, generate a notification message that a member is about to arrive, and obtain the direction information of the member; according to the notification message that a member is about to arrive received by Smart Lock A, query the preset direction of Smart Lock B in the door lock list to obtain the adjusted direction of the pan-tilt camera; according to multiple notification messages that a member is about to arrive received by Smart Lock A, obtain the optimized direction of the pan-tilt camera; according to the adjusted direction of the pan-tilt camera, obtain the final door opening result, so as to be able to implement an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and security.

[0060] The embodiment of the present invention also provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0061] Specifically, the above electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0062] Specifically, in this embodiment, the above processor may be configured to execute the following steps through a computer program: S201, Synchronization of family member feature vectors and update of the door lock list: According to the face image feature vectors of family members of Smart Lock A, generate a broadcast message containing family member IDs and feature vectors, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing all family member feature vectors; S202, Face recognition and direction judgment: According to the face images identified by Smart Lock B, perform a similarity comparison with the feature vectors in the shared door lock list. Among them, if the comparison is a family member of Smart Lock A, generate a notification message that a member is about to arrive according to the positional relationship of Smart Lock B relative to A, and send it to Smart Lock A to obtain the direction information of the member; S203, PTZ preset position adjustment and waiting: according to the member arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried; wherein the preset position direction is used to adjust the direction of the PTZ camera, and start the waiting mode, waiting for the family member to enter the camera field of view, and obtain the adjusted PTZ camera direction; S204, conflict message processing and lighting optimization: According to the notification messages of multiple members about to arrive received by smart lock A, it is determined whether there is a direction conflict; if there is a conflict, the final pan-tilt camera direction is determined according to the principle of minority obeys majority by broadcasting the light-on monitoring message and counting the feedback from other door locks, and the optimized pan-tilt camera direction is obtained; S205, face matching and early unlocking: according to the adjusted direction of the pan-tilt camera, the face images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance, otherwise, the identification and unlocking are performed after the family member arrives at the door lock to obtain the final door opening result and complete the quick door opening process.

[0063] It can be seen that according to the facial images of family members of smart lock A, a broadcast message is generated to enable other smart locks to receive and update the local door lock list to obtain a shared door lock list; according to the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the upcoming arrival of members, and the direction information of the members is obtained; according to the notification message of the upcoming arrival of members received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; according to the notification messages of the upcoming arrival of multiple members received by smart lock A, the optimized pan-tilt camera direction is obtained; according to the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and safety.

[0064] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings. The above is only a preferred embodiment of the present invention, but the present invention is not limited to the scope of implementation shown in the drawings. Any changes made according to the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the description and drawings, should be within the protection scope of the present invention.

Claims

1. A fast door opening method based on a pan-tilt door lock, characterized in that, The method includes: Family member feature vector synchronization and door lock list update: Generate a broadcast message containing the family member ID and feature vector based on the face image feature vector of the family members of Smart Lock A, so that other smart locks can receive and update the local door lock list, and obtain a shared door lock list containing the feature vectors of all family members; Face recognition and direction judgment: Compare the similarity between the face image recognized by Smart Lock B and the feature vectors in the shared door lock list. Among them, if the comparison is a family member of Smart Lock A, generate a notification message that the member is about to arrive according to the positional relationship of Smart Lock B relative to A, and send it to Smart Lock A to obtain the direction information of the member; PTZ preset position adjustment and waiting: Query the preset position direction of Smart Lock B in the door lock list according to the notification message that the member is about to arrive received by Smart Lock A; among them, the preset position direction is used to adjust the orientation of the PTZ camera and start the waiting mode to wait for the family member to enter the camera's field of view, and obtain the adjusted PTZ camera direction; Conflict message processing and lighting optimization: Judge whether there is a direction conflict according to multiple notification messages that the members are about to arrive received by Smart Lock A; among them, if there is a conflict, broadcast a lighting monitoring message and count the feedback of other door locks, and determine the final PTZ camera direction according to the principle of the minority obeying the majority to obtain the optimized PTZ camera direction; Face comparison and early unlocking: Capture the face image of the family member in real time and compare it according to the adjusted PTZ camera direction; among them, if the comparison is successful, unlock the door in advance, otherwise wait for the family member to arrive in front of the door and then identify and unlock it to obtain the final door opening result and complete the fast door opening process.

2. The method according to claim 1, wherein The family member feature vector synchronization and door lock list update includes: Family member feature vector generation: Extract the face feature vector according to the face image of the family members of Smart Lock A; among them, the feature vector is generated by a deep learning model to obtain the feature vector data of the family members; Broadcast message generation and sending: Generate a broadcast message according to the family member ID and feature vector data; among them, the broadcast message is sent to other smart locks on the same floor through the local area network to obtain the shared family member feature vector information; Door lock list update: Update the local door lock list according to the received broadcast message; among them, the door lock list contains the family member ID, feature vector and door lock positional relationship to obtain the updated shared door lock list.

3. The method according to claim 2, characterized in that, The face recognition and direction judgment includes: Face image acquisition and feature extraction: Extract the face feature vector according to the face image collected by the camera of Smart Lock B; among them, the feature extraction uses a deep learning model to obtain the real-time face feature vector; Similarity comparison and member recognition: Compare the similarity between the real-time face feature vector and the feature vectors in the shared door lock list; among them, if the similarity exceeds the preset threshold, it is recognized as the corresponding family member to obtain the recognition result; Direction Judgment and Notification Message Generation: Generate a notification message indicating that a member is about to arrive based on the positional relationship of Smart Lock B relative to Smart Lock A; wherein, the notification message includes the member ID and the location information of Door Lock B, and a direction judgment result is obtained.

4. The method according to claim 3, characterized in that The PTZ Preset Position Adjustment and Waiting includes: Notification Message Parsing and Preset Position Query: Parse the location information of Door Lock B according to the notification message indicating that a member is about to arrive received by Smart Lock A; wherein, the location information is used to query the preset position direction of Smart Lock B in the door lock list, and a preset position direction information is obtained. PTZ Camera Direction Adjustment: Adjust the orientation of the PTZ camera according to the preset position direction information; wherein, the adjustment is achieved by controlling the PTZ motor, and an adjusted camera direction is obtained. Waiting Mode Start: Start the waiting mode according to the adjusted camera direction; wherein, the waiting mode lasts for 1 minute to wait for family members to enter the camera's field of view, and a waiting status is obtained.

5. The method according to claim 4, characterized in that, The Conflict Message Handling and Lighting Optimization includes: Conflict Message Detection: Judge whether there is a direction conflict according to multiple notification messages indicating that members are about to arrive received by Smart Lock A; wherein, the conflict detection is achieved by comparing the location information of different door locks, and a conflict detection result is obtained. On - light Monitoring Message Broadcasting: Generate an on - light monitoring broadcast message according to the conflict detection result; wherein, the broadcast message is sent to other smart locks on the same floor through the local area network, and an on - light monitoring status is obtained. Feedback Message Statistics and Direction Optimization: Statistically analyze the direction information of members according to the feedback messages of other smart locks; wherein, the final PTZ camera direction is determined according to the principle of the minority obeying the majority, and an optimized camera direction is obtained.

6. A fast door opening system based on a pan-tilt door lock, characterized in that, The system includes: Synchronization Module, used for Family Member Feature Vector Synchronization and Door Lock List Update: Generate a broadcast message including the family member ID and the feature vector according to the facial image feature vector of family members of Smart Lock A, so that other smart locks can receive and update the local door lock list, and a shared door lock list including all family member feature vectors is obtained. Recognition Module, used for Facial Recognition and Direction Judgment: Compare the similarity between the facial image recognized by Smart Lock B and the feature vectors in the shared door lock list. Among them, if the comparison is for a family member of Smart Lock A, generate a notification message indicating that the member is about to arrive according to the positional relationship of Smart Lock B relative to A, and send it to Smart Lock A, and the direction information of the member is obtained. Adjustment Module, used for PTZ Preset Position Adjustment and Waiting: Query the preset position direction of Smart Lock B in the door lock list according to the notification message indicating that a member is about to arrive received by Smart Lock A; wherein, the preset position direction is used to adjust the orientation of the PTZ camera and start the waiting mode to wait for family members to enter the camera's field of view, and an adjusted PTZ camera direction is obtained. Processing module, used for conflict message handling and lighting optimization: Based on multiple member approaching notification messages received by smart lock A, determine whether there is a direction conflict; among them, if there is a conflict, broadcast a lighting monitoring message and count the feedback of other door locks, and determine the final direction of the pan-tilt camera according to the principle of the minority obeying the majority, obtaining the optimized direction of the pan-tilt camera. Comparison module, used for face comparison and early unlocking: According to the adjusted direction of the pan-tilt camera, capture the face images of family members in real time and perform comparison; among them, if the comparison is successful, unlock the door in advance, otherwise wait for the family member to reach in front of the door lock and then perform identification and unlocking to obtain the final door opening result, completing the fast door opening process.

7. The system according to claim 6, wherein The synchronization module is specifically used for: Generating family member feature vectors: Extract face feature vectors according to the face images of family members of smart lock A; among them, the feature vectors are generated by a deep learning model to obtain the feature vector data of family members. Generating and sending broadcast messages: Generate broadcast messages according to family member IDs and feature vector data; among them, the broadcast messages are sent to other smart locks on the same floor through the local area network to obtain shared family member feature vector information. Updating the door lock list: Update the local door lock list according to the received broadcast messages; among them, the door lock list contains family member IDs, feature vectors, and the positional relationship of door locks, obtaining the updated shared door lock list.

8. The system according to claim 7, characterized in that The recognition module is specifically used for: Collecting face images and extracting features: Extract face feature vectors according to the face images collected by the camera of smart lock B; among them, the feature extraction uses a deep learning model to obtain real-time face feature vectors. Similarity comparison and member recognition: Perform similarity comparison between the real-time face feature vectors and the feature vectors in the shared door lock list; among them, if the similarity exceeds a preset threshold, identify it as the corresponding family member to obtain the recognition result. Direction judgment and notification message generation: Generate a notification message that a member is approaching according to the positional relationship between smart lock B and smart lock A; among them, the notification message contains the member ID and the location information of door lock B, obtaining the direction judgment result.

9. A storage medium, characterized in that, A computer program is stored in the storage medium, wherein the computer program is set to execute the method according to any one of claims 1-5 when running.

10. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is set to run the computer program to execute the method according to any one of claims 1-5.

Images