A quick door opening method and system based on pan-tilt door lock

Abstract

The present invention discloses a method and system for quickly opening doors based on a pan-tilt camera lock. The method comprises: generating a broadcast message based on a facial image of a family member of smart lock A, so that other smart locks receive and update a local door lock list to obtain a shared door lock list; performing a similarity comparison between the facial image recognized by smart lock B and the shared door lock list, generating a notification message of a member's impending arrival, and obtaining the member's direction information; querying the preset position direction of smart lock B in the door lock list based on the member's impending arrival notification message received by smart lock A, and obtaining an adjusted pan-tilt camera direction; obtaining an optimized pan-tilt camera direction based on multiple member's impending arrival notification messages received by smart lock A; and obtaining a door opening result based on the adjusted pan-tilt camera direction. Utilizing the embodiments of the present invention, an efficient, convenient, and secure door opening solution can be implemented to meet the dual needs of modern families for a quick door opening experience and safety.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and in particular to a quick door opening method and system based on a pan-tilt door lock. Background Art

[0002] With the rapid development of smart homes, smart door locks, as a crucial component of home security, are gaining popularity among more and more families. Traditional door locks typically rely on mechanical keys or simple password input, which has certain limitations in terms of security and convenience. To improve user experience and home security, many manufacturers are adopting biometric technologies such as facial recognition and fingerprint recognition to implement unlocking functions in smart door locks. However, these technologies also face challenges in practical application, such as slow recognition speed, lighting conditions affecting recognition accuracy, and users failing to unlock the door in time upon arrival.

[0003] When using a PTZ smart lock with facial recognition to unlock a door, nearby PTZ locks can be used to identify the person and notify the lock itself, which then rotates the PTZ camera in the direction of the incoming person. However, if multiple nearby locks have already recognized the occupant, the lock's PTZ camera may be unable to determine the correct direction. Since networked smart locks are equipped with PTZ cameras, the occupant's face may be successfully recognized by multiple smart locks in the hallway. Summary of the Invention

[0004] The purpose of the present invention is to provide a quick door opening method and system based on a pan-tilt door lock to address the deficiencies in the prior art and to achieve an efficient, convenient and safe door opening solution to meet the dual needs of modern families for quick door opening experience and safety.

[0005] An embodiment of the present application provides a method for quickly opening a door based on a pan-tilt door lock, the method comprising:

[0006] Family member feature vector synchronization and door lock list update: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing the feature vectors of all family members;

[0007] Face recognition and direction determination: Based on the face image recognized by smart lock B, a similarity comparison is performed with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival. The message is sent to smart lock A, and the family member's direction information is obtained.

[0008] PTZ preset position adjustment and waiting: Based on the notification message received by smart lock A that a family member is about to arrive, the preset position direction of smart lock B in the door lock list is queried. The preset position direction is used to adjust the direction of the PTZ camera, and waiting mode is activated to wait for a family member to enter the camera's field of view, and the adjusted PTZ camera direction is obtained.

[0009] Conflict message processing and lighting optimization: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it determines whether there is a direction conflict. If there is a conflict, it broadcasts a light-on monitoring message and collects feedback from other door locks. The final pan-tilt camera direction is determined according to the principle of majority rule, resulting in the optimized pan-tilt camera direction.

[0010] Face matching and early unlocking: Based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared. If the comparison is successful, the door is unlocked in advance. Otherwise, the system waits for the family member to arrive before the door lock and then performs recognition and unlocking to obtain the final unlocking result, completing the quick door opening process.

[0011] Optionally, the synchronization of the family member feature vectors and the update of the door lock list include:

[0012] Family member feature vector generation: Extract facial feature vectors based on the facial images of family members in smart lock A; wherein the feature vectors are generated by a deep learning model to obtain feature vector data of family members;

[0013] Broadcast message generation and transmission: Generate a broadcast message based on the family member ID and feature vector data; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain shared family member feature vector information;

[0014] Door lock list update: Update the local door lock list based on the received broadcast message; wherein, the door lock list includes family member ID, feature vector and door lock location relationship, and obtains an updated shared door lock list.

[0015] Optionally, the face recognition and direction determination include:

[0016] Facial image acquisition and feature extraction: Extract facial feature vectors based on facial images captured by the camera of smart lock B. The feature extraction uses a deep learning model to obtain real-time facial feature vectors.

[0017] Similarity comparison and member identification: Based on the real-time facial feature vector, the similarity is compared with the feature vectors in the shared door lock list. If the similarity exceeds the preset threshold, the person is identified as a family member and an identification result is obtained.

[0018] Direction judgment and notification message generation: Based on the positional relationship of smart lock B relative to smart lock A, a notification message is generated indicating that a member is about to arrive; wherein, the notification message includes the member ID and the location information of door lock B, and the direction judgment result is obtained.

[0019] Optionally, the pan / tilt preset position adjustment and waiting include:

[0020] Notification message parsing and preset position query: Based on the member arrival notification message received by smart lock A, the location information of door lock B is parsed; wherein, the location information is used to query the preset position direction of smart lock B in the door lock list to obtain the preset position direction information;

[0021] PTZ camera direction adjustment: adjusting the orientation of the PTZ camera according to the preset position direction information; wherein the adjustment is achieved by controlling the PTZ motor to obtain the adjusted camera direction;

[0022] Waiting mode is started: according to the adjusted camera direction, the waiting mode is started; wherein, the waiting mode lasts for 1 minute, waiting for family members to enter the camera's field of view and enter the waiting state.

[0023] Optionally, the conflict message processing and lighting optimization include:

[0024] Conflict message detection: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it is determined whether there is a direction conflict; wherein, the conflict detection is achieved by comparing the position information of different door locks to obtain the conflict detection result;

[0025] Light-on monitoring message broadcast: Generate a light-on monitoring broadcast message based on the conflict detection result; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain the light-on monitoring status;

[0026] Feedback message statistics and direction optimization: Based on the feedback messages of other smart locks, the direction information of the members is counted; wherein, the statistics are based on the principle of minority obeys majority to determine the final pan-tilt camera direction, and the optimized camera direction is obtained.

[0027] Another embodiment of the present application provides a rapid door opening system based on a pan-tilt door lock, the system comprising:

[0028] The synchronization module is used to synchronize family member feature vectors and update the door lock list: based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing the feature vectors of all family members;

[0029] The recognition module is used for face recognition and direction determination: the face image recognized by smart lock B is compared with the feature vectors in the shared door lock list for similarity. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival. The message is sent to smart lock A, and the family member's direction information is obtained.

[0030] The adjustment module is used for PTZ preset position adjustment and waiting: based on the notification message received by smart lock A that a family member is about to arrive, it queries the preset position direction of smart lock B in the door lock list; the preset position direction is used to adjust the direction of the PTZ camera, and the waiting mode is activated, waiting for the family member to enter the camera's field of view, and then the adjusted PTZ camera direction is obtained;

[0031] The processing module is used for conflict message handling and lighting optimization. Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it determines whether there is a direction conflict. If there is a conflict, it broadcasts a light-on monitoring message and collects feedback from other door locks. The final pan-tilt camera direction is determined according to the principle of majority rule, resulting in the optimized pan-tilt camera direction.

[0032] The matching module is used for face matching and early unlocking: based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared. If the matching is successful, the door is unlocked in advance. Otherwise, the system waits for the family member to arrive before the door lock and then performs recognition and unlocking to obtain the final door unlocking result, completing the quick door opening process.

[0033] Yet another embodiment of the present application provides a storage medium, wherein the storage medium stores a computer program, wherein the computer program is configured to execute any of the above methods when run.

[0034] Yet another embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any of the above methods.

[0035] Compared with the prior art, the present invention provides a quick door opening method based on a pan-tilt door lock, which generates a broadcast message based on the facial images of family members of smart lock A, so that other smart locks receive and update the local door lock list to obtain a shared door lock list; based on the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the member's impending arrival, and obtain the member's direction information; based on the member's impending arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; based on multiple member's impending arrival notification messages received by smart lock A, the optimized pan-tilt camera direction is obtained; based on the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for quick door opening experience and safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A hardware structure block diagram of a computer terminal for a quick door opening method based on a pan-tilt door lock provided in an embodiment of the present invention;

[0037] Figure 2 A schematic diagram of a process for quickly opening a door based on a pan-tilt door lock provided by an embodiment of the present invention;

[0038] Figure 3 A schematic structural diagram of a rapid door opening system based on a pan-tilt door lock provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and are not to be construed as limiting the present invention.

[0040] The embodiment of the present invention first provides a method for quickly opening a door based on a pan-tilt door lock. The method can be applied to electronic devices such as computer terminals, specifically ordinary computers, etc.

[0041] The following describes it in detail by taking running on a computer terminal as an example. Figure 1 The hardware structure block diagram of a computer terminal for a quick door opening method based on a pan-tilt door lock provided by an embodiment of the present invention. Figure 1 As shown, the computer device includes a processor, a memory, and a network interface connected via a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0042] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, which, when executed, can cause the processor to execute any one of the rapid door opening methods based on the pan-tilt door lock.

[0043] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0044] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any one of the quick door opening methods based on the pan-tilt door lock.

[0045] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0046] It should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0047] See also Figure 2 , an embodiment of the present invention provides a quick door opening method based on a pan-tilt door lock, which may include the following steps:

[0048] S201, Family Member Feature Vector Synchronization and Door Lock List Update: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks receive and update their local door lock lists, thereby obtaining a shared door lock list containing the feature vectors of all family members. Specifically, the family member feature vector synchronization and door lock list update include:

[0049] Family member feature vector generation: Extract facial feature vectors based on the facial images of family members in smart lock A; wherein the feature vectors are generated by a deep learning model to obtain feature vector data of family members;

[0050] Broadcast message generation and transmission: Generate a broadcast message based on the family member ID and feature vector data; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain shared family member feature vector information;

[0051] Door lock list update: Update the local door lock list based on the received broadcast message; wherein, the door lock list includes family member ID, feature vector and door lock location relationship, and obtains an updated shared door lock list.

[0052] S202, face recognition and direction determination: Based on the face image recognized by smart lock B, a similarity comparison is performed with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message of the family member's impending arrival is generated based on the position of smart lock B relative to A, and sent to smart lock A to obtain the family member's direction information. Specifically, the face recognition and direction determination includes:

[0053] Facial image acquisition and feature extraction: Extract facial feature vectors based on facial images captured by the camera of smart lock B. The feature extraction uses a deep learning model to obtain real-time facial feature vectors.

[0054] Similarity comparison and member identification: Based on the real-time facial feature vector, the similarity is compared with the feature vectors in the shared door lock list. If the similarity exceeds the preset threshold, the person is identified as a family member and an identification result is obtained.

[0055] Direction judgment and notification message generation: Based on the positional relationship of smart lock B relative to smart lock A, a notification message is generated indicating that a member is about to arrive; wherein, the notification message includes the member ID and the location information of door lock B, and the direction judgment result is obtained.

[0056] S203, PTZ preset position adjustment and waiting: Based on the notification message received by smart lock A indicating that a family member is about to arrive, the preset position direction of smart lock B in the door lock list is queried; the preset position direction is used to adjust the orientation of the PTZ camera, and waiting mode is activated to wait for the family member to enter the camera's field of view, and the adjusted PTZ camera direction is obtained. Specifically, the PTZ preset position adjustment and waiting include:

[0057] Notification message parsing and preset position query: Based on the member arrival notification message received by smart lock A, the location information of door lock B is parsed; wherein, the location information is used to query the preset position direction of smart lock B in the door lock list to obtain the preset position direction information;

[0058] PTZ camera direction adjustment: adjusting the orientation of the PTZ camera according to the preset position direction information; wherein the adjustment is achieved by controlling the PTZ motor to obtain the adjusted camera direction;

[0059] Waiting mode is started: according to the adjusted camera direction, the waiting mode is started; wherein, the waiting mode lasts for 1 minute, waiting for family members to enter the camera's field of view and enter the waiting state.

[0060] S204, conflict message processing and lighting optimization: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it is determined whether there is a direction conflict. If there is a conflict, the direction of the pan-tilt camera is determined by broadcasting a light-on monitoring message and collecting feedback from other door locks. The optimized pan-tilt camera direction is determined according to the principle of majority rule. Specifically, the conflict message processing and lighting optimization include:

[0061] Conflict message detection: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it is determined whether there is a direction conflict; wherein, the conflict detection is achieved by comparing the position information of different door locks to obtain the conflict detection result;

[0062] Light-on monitoring message broadcast: Generate a light-on monitoring broadcast message based on the conflict detection result; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain the light-on monitoring status;

[0063] Feedback message statistics and direction optimization: Based on the feedback messages of other smart locks, the direction information of the members is counted; wherein, the statistics are based on the principle of minority obeys majority to determine the final pan-tilt camera direction, and the optimized camera direction is obtained.

[0064] S205, face matching and early unlocking: Based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance, otherwise the door is unlocked after the family member arrives at the door lock, and the final door unlocking result is obtained, completing the quick door opening process.

[0065] In practical applications, in order to realize face recognition comparison and unlocking the door for the owner in advance, the present invention designs an intelligent solution that utilizes the collaboration of multiple door locks.

[0066] 1. Core Concept: Multiple door locks are networked. Door lock A broadcasts the feature vectors of its own family members to other door locks on the same floor. The default pan / tilt position of all door locks faces forward. When family member A walks towards door lock A from the left, door lock B on the left first recognizes member A's face. Upon discovering that it is a member of door lock A, it sends a "member is about to arrive" message to door lock A, containing door lock B's location. Door lock A uses door lock B's location to adjust the pan / tilt position to the left. Once member A enters the camera's field of view and is successfully identified, the door is opened, thereby improving unlocking efficiency.

[0067] For further improvement, there may be multiple door locks between door lock B and door lock A, and they will also recognize member A. Therefore, the optimization is as follows: After door lock B discovers member A, it sends a message to door lock A, with the destination IP address being door lock A and the destination MAC address being broadcast, so that other door locks can also receive it. After receiving the message, the other door locks know that door lock B has already informed door lock A, and even if they recognize member A, they will not send the message to door lock A again. However, if the door lock to the right of door lock A also thinks it is member A, it needs to send a message to notify door lock A. Door lock A adjusts the pan / tilt to the left based on the position of door lock B, waits for member A to enter the camera's field of view, and if recognition is successful, opens the door, allowing the member to enter quickly.

[0068] As a further improvement, door lock C on the right also recognizes a face and, through similarity comparison, identifies it as member A. Consequently, door lock A receives conflicting messages from both sides, likely due to complex lighting conditions. Door lock A then turns on the corridor light and broadcasts a message to all door locks, inviting continued feedback. The majority rule determines member A's direction. Typically, in good lighting conditions, this conflict will not occur.

[0069] 2. Prerequisites: Each floor entrance door is equipped with a smart lock equipped with a PTZ camera. A list of smart locks for that floor is stored (data items include: lock ID, lock location, lock IP address, MAC address, family member ID, family member facial image feature vector, and the ID and PTZ preset positions (left / right) of each smart lock on that floor). The smart locks are connected to the platform, registered with it, and the list is updated periodically.

[0070] The platform records the community smart lock list, which includes: door lock ID, door lock geographic location, door lock IP address, MAC address, floor to which it belongs, smart lock ID / pan / tilt preset position (left / right) of each floor, etc.

[0071] 3. Smart lock PTZ camera preset position setting: Before synchronizing the smart lock list with the smart lock, the platform manually sets the floor and LAN subnet of each smart lock according to the geographical location of the smart locks on each floor (all smart locks on each floor are divided into a subnet, or set to a VLAN), the position relationship between other door locks on the floor and this lock (are other smart locks on the left or right of this lock), and saves the corresponding PTZ preset position (left / right), setting the PTZ default preset position to face straight ahead.

[0072] For example, if smart locks A, B, C, D, and E belong to Layer 3 and are geographically located in the order ABCDE, then the preset positions set for each door lock in A are: Door Lock ID (B) / PTZ Preset (Left), Door Lock ID (C) / PTZ Preset (Left), Door Lock ID (D) / PTZ Preset (Left), and Door Lock ID (D) / PTZ Preset (Left); the preset positions set for each door lock in B are: Door Lock ID (A) / PTZ Preset (Right), Door Lock ID (C) / PTZ Preset (Left), Door Lock ID (D) / PTZ Preset (Left), and Door Lock ID (D) / PTZ Preset (Left); and the same applies to the others.

[0073] 4. Synchronization of family member facial feature vectors: Smart lock A broadcasts the family member ID and feature vectors of family member facial images of this lock to other smart locks on the same floor (sent only when the device is first connected to the network or when the family member changes). The content of the broadcast message includes the door lock ID, family member ID, feature vectors of family member facial images, etc. Other smart locks on the floor receive and update their own smart lock lists. The smart lock list includes: door lock ID, door lock IP address, door lock geographic address, door lock preset position (relative to the position of this lock, such as left or right), family member ID, feature vectors of family member facial images (if there are multiple family members under each door lock ID, there are corresponding multiple family member IDs and feature vectors of family member facial images).

[0074] For example, if smart lock A has three family members, a, b, and c, then A broadcasts the information: family member ID (a) / facial image feature vector (a), family member ID (b) / facial image feature vector (b), and family member ID (c) / facial image feature vector (c) to all smart locks on the same floor. Each lock receives and extracts the family member ID / facial image feature vectors of a, b, and c, and updates it to its own lock. If door lock B has two family members, d and e, then after the update, B's smart lock list will have five members: a, b, and c corresponding to A's door lock ID, door lock location, door lock IP address, and MAC address, and d and e corresponding to this lock. Similarly, the smart lock lists of all door locks on the same floor store information such as the facial image feature vectors of the family members of other door locks on the same floor.

[0075] 5. Processing of Person Detection by Smart Locks: After Smart Lock B detects and recognizes a person's face, it calculates the similarity between the feature vectors of the face images in the smart lock list and the threshold (typically set at 80%). If the person is a family member of B, the door is unlocked. If Smart Lock B fails to recognize the person's face (in this case, the person may be a stranger, neither a family member of B nor a family member of any other lock), no action is taken. If smart lock B identifies the person as a family member of A, it will query A's IP address from the smart lock list and send a "member is about to arrive" notification message to A. The message content includes the door lock ID, the identified person ID, etc.; after receiving B's notification message, A will query B's preset position in the smart lock list (if B is on the left of A), and point the pan-tilt camera to the left. A will wait and track the arrival of family members according to the preset pan-tilt direction. When the face recognition comparison of the family member is successful, the door will be unlocked for them in advance, and then the pan-tilt camera will return to the normal preset position facing straight ahead. If multiple "members are about to arrive" notification messages are received, multiple preset positions will be set and the pan-tilt patrol method will be used to wait for 1 minute.

[0076] For example, after smart lock A receives a "Member is about to arrive" notification message from lock B regarding person ID (a), it searches A's stored smart lock list based on lock ID (B) in the message and finds that lock ID (B) is positioned to the left relative to A. A then immediately turns the PTZ camera from its normal forward orientation to the left, awaiting the arrival of person ID (a). Since there may be multiple "Member is about to arrive" notification messages, two scenarios can be explained: a single "Member is about to arrive" notification message and multiple "Member is about to arrive" notification messages.

[0077] If there is only one "Member is about to arrive" notification message: If A only receives and waits for the arrival of person ID (a) from B, and if person ID (a) is detected within 1 minute, it will track and identify and compare person ID (a). If the comparison is successful, the door will be unlocked in advance for person ID (a). If the comparison is not successful during the tracking process, the door lock camera will identify and compare person ID (a) and unlock the door until they reach the front of the door lock. After tracking person ID (a) to reach the front of the door lock, the PTZ camera will return to its normal preset position facing straight ahead and remain stationed.

[0078] If there are multiple "Members are about to arrive" notification messages: If A receives a "Members are about to arrive" notification message from D for Person ID (b) while waiting for B to send a notification message for Person ID (a):

[0079] 1) If person ID (a) and person ID (b) come from the same direction, for example, both from the left, the PTZ camera calculates the waiting time (1 minute) based on the time of the waiting notification message. If no person is detected at the end of their respective waiting times, the PTZ camera resets to its normal preset position facing forward and continues to monitor. If one of the people arrives, it continues to track, identify, and compare that person until they reach the front of the smart lock. If the waiting time for the other person has not expired, the camera quickly returns to the left position to continue monitoring.

[0080] 2) If personnel ID (a), personnel ID (b), and personnel ID (c) come from different directions, the PTZ camera sets preset positions for different directions for personnel ID (a), personnel ID (b), and personnel ID (c). For example, if personnel ID (a) and personnel ID (c) come from the left, and personnel ID (b) comes from the right, the PTZ camera of the smart lock sets two inspection positions on the left and right, and immediately enters patrol (stays in one direction for 5 seconds and then immediately switches to the other direction, and patrols in turn). As long as a person is found coming in any direction (for example, person ID (a) on the left arrives first), it immediately enters the one-way continuous tracking and identification comparison mode for person ID (a) until the person arrives. If the one-way tracking ends (the continuous tracking and matching is successful, or the person has arrived in front of the smart lock, and the door lock camera will capture and match the person), the system will quickly return to patrol (for example, at this time, person ID (c) is on the left, person ID (b) is on the right, and both are within the waiting period) or to the other direction (for example, only person ID (b) on the right is left for one-way waiting for the arrival of person ID (b)), and enter the one-way continuous tracking and identification and matching mode for person ID (a) until person ID (a) is matched successfully or arrives in front of the smart lock. If the waiting time in each direction expires (1 minute), the PTZ camera will reset to its normal preset position facing straight ahead for stationing.

[0081] 6. Further optimization: When B identifies and matches A's family members, it sends a broadcast message to A saying "Members are about to arrive". At the same time, other door locks can also receive the broadcast message and cache it for 1 minute before deleting it. During this period, when other door locks (such as door lock C) also identify A's family members, and they are compared with the broadcast message to find that they are the same person, C will no longer send the "Members are about to arrive" message to A.

[0082] In step 5 above, if family member A passes multiple smart locks on their way home, each smart lock will repeatedly send the "family member is about to arrive" notification message to that person and reset the PTZ camera preset position. However, this is often a repetitive and meaningless reset, which causes the PTZ camera of smart lock A to reset frequently. To reduce the number of "family member is about to arrive" notification messages sent to family members by other door locks, the following optimization is implemented:

[0083] Smart lock B identifies and matches A's family member, and after querying A's IP address, it sends a message to A with A's IP address as the destination IP address and the broadcast MAC address as the destination MAC address. After receiving the message, A processes it according to step (5): that is, after receiving B's notification message, A queries B's preset position in the smart lock list (if B is on A's left), and points the pan-tilt camera to the left. A waits and tracks the arrival of family members according to the preset pan-tilt direction. When the family member's face recognition is successful, it immediately unlocks the door for them in advance. Smart lock C (referring to other smart locks) caches the message after listening to the broadcast message and deletes it after 1 minute. If C also recognizes A's family member during the 1-minute cache period, it will no longer send messages to A. If C recognizes A's family member after the 1-minute cache expires, C will send a message to A in the same way (sending a broadcast message of "members are about to arrive").

[0084] The detailed explanation is as follows: Smart lock B recognizes person a of A and sends a broadcast message: If person a of smart lock A passes by smart lock B and is successfully matched with the face by B, and according to the smart lock list stored in B, it is known that a is a family member of smart lock A, then B will query the smart lock list and set A's IP address as the destination IP address, and set the MAC address to the broadcast address "FF:FF:FF:FF:FF:FF", and send a "member is about to arrive" notification message to A. The message content includes the door lock ID of this lock (B), the recognized door lock ID (A) and the person ID (a), etc.

[0085] After receiving the broadcast message from B, smart lock C no longer sends the message from a repeatedly: other smart locks on the floor belong to the same subnet and can also monitor the "member is about to arrive" notification message sent by B (taking smart lock C as an example). After smart lock C monitors the notification message sent by B, it compares the IP address that is not C according to the destination IP address (indicating that the purpose of B sending the notification is not C, but it can allow C to receive the notification message and avoid C from repeatedly sending the notification message from a), extracts and caches the message content including the door lock ID (B), the identified door lock ID (A) and the person ID (a), etc. The storage period is 1 minute (based on the time taken for people to move around the floor, it can generally be set to 1 minute). When C also detects and identifies person a, according to smart lock C, The lock list query shows the door lock ID (A) and person ID (a) to which a belongs. By comparing with the cached message of B, it can be known that they are the same person. C no longer sends the "member is about to arrive" notification message to A (because B has already sent a message to notify A, and other door locks do not need to notify again); if C does not recognize person a within the storage period when B sends the notification message, the notification message will be deleted; if C recognizes person a after the storage period when B sends the notification message (this may be because a is delayed somewhere on the floor or appears again), C sends a "member is about to arrive" notification message to A according to B's method. The message content includes the door lock ID (C), the recognized door lock ID (A) and person ID (a), etc.

[0086] After receiving a broadcast message from B, smart lock A adjusts its PTZ camera's direction toward the incoming person: Smart lock A receives a "Member is about to arrive" notification message from B. Based on IP address comparison, it determines the message's destination address is A's IP address. Based on the door lock ID (B) in the message, it searches A's stored smart lock list and finds that door lock ID (B) is positioned to the left relative to A. A then immediately adjusts the PTZ camera's direction from its normal, forward-facing orientation to the left, awaiting the arrival of person ID (a). If person ID (a) is not detected after one minute of waiting, the PTZ camera's direction is restored to its normal, forward-facing orientation. If person ID (a) is detected, tracking, identification, and comparison are performed.

[0087] 7. Further optimization: When door lock A receives "members are about to arrive" notification messages from the left door lock B and the right door lock C for the same person a, it is determined that these are two conflicting messages. The corridor lights are then turned on, and a broadcast message of "turn on lights for monitoring" from person a is sent to all door locks on the floor. After receiving the "turn on lights for monitoring" message, the other door locks will reply to A with a "members are about to arrive" notification message as long as they recognize person a. Based on the principle of minority obeys majority, A determines the side with more reply messages as the direction to adjust the pan-tilt camera.

[0088] In the above step 5 process, if a family member of door lock A passes multiple smart locks on their way home, if door lock B on the left side of A recognizes a face and identifies it as member A through similarity comparison, and door lock C on the right side also recognizes a face and identifies it as member A through similarity comparison, then both door locks B and C send a "member is about to arrive" notification message to A. As a result, door lock A receives two conflicting messages from both sides. This may be the result of complex lighting. To avoid the situation where other door locks in different directions recognize the same person due to the lighting in the corridor where the smart door lock is located and send "member is about to arrive" notification messages for the same person from different directions, the following optimization is made:

[0089] When B on the left side of smart lock A and C on the right side both detect and identify A's family member a: If B on the left side of smart lock A recognizes a first, it will query A's IP address from the smart lock list and send a "member is about to arrive" broadcast message to A (with A's IP address as the destination IP address and the broadcast MAC address as the destination MAC address). The message content includes the door lock ID (B), the identified person ID (a), etc.; at this time, C on the right side of smart lock A also recognizes A's family member a when monitoring B's broadcast message. C is located on the right side of A through location check, so B's broadcast message cannot be ignored (based on According to the pre-set assumption that family members coming from different directions should be regarded as different persons), a "member is about to arrive" broadcast message (with A's IP address as the destination IP address and the broadcast MAC address as the destination MAC address) is sent to A according to B's method. The message content includes the door lock ID (C), the identified person ID (a), etc.; after receiving B's broadcast message, smart lock A adjusts the pan-tilt camera to the left. At this time, it receives C's broadcast message and turns the pan-tilt camera to the right. Since a has not yet arrived in front of A's door lock, it enters the patrol state of the preset positions on both sides (left and right).

[0090] If smart lock A receives a "Member is about to arrive" broadcast message from B on the left and C on the right about the same family member A, it is determined that these are two conflicting messages. This may be the result of complex lighting in the corridor. The conflicting messages need to be eliminated as follows:

[0091] Prerequisites added: The smart lock is connected to the corridor lighting control system; the floor is equipped with a smart lighting control system that can receive instructions from the smart lock to control the corridor lights on and off.

[0092] Smart lock A turns on the corridor lights: After receiving two conflicting messages, smart lock A sends a "lights on" control signal to the corridor lighting control system. This signal contains lock ID (A) and the current time. Upon receiving A's "lights on" control signal, the corridor lighting control system turns on the corridor lights and starts a timer, automatically turning them off after five minutes. When the corridor lights are on, good lighting conditions facilitate facial recognition and comparison.

[0093] Smart lock A sends a "light on monitoring" broadcast message to all door locks on the same floor. The message includes the door lock ID (A), the door lock IP address (A), and the facial image feature vector (a). Other door locks cache the "light on monitoring" broadcast message after receiving it and delete it after one minute.

[0094] As A continues walking, assume that Person A is successfully identified and matched by another door lock (e.g., door lock D; other door locks, regardless of whether they are on the same side as door locks B or C, all respond using the same process when A is recognized). Using the aforementioned method, a reply message "Member is about to arrive" is broadcast to A. The message content includes the lock ID of the lock (D), the identified door lock ID (A), and the person ID (a). After receiving the reply message from D (or possibly multiple reply messages for A), A immediately counts (in real time, i.e., counts once for each reply message received for A) all door locks reporting that A is to the left (assuming there are M) and right (assuming there are N). M and N are compared in real time, and A's PTZ camera is adjusted to face left (for M messages on the left) based on the larger of M and N (e.g., M is greater than N, in this method of minority-subject-majority). If M and N are equal, the PTZ camera is adjusted in direction according to the most recently received door lock orientation (for example, if the most recently detected door lock is D to the left of A, the PTZ camera is adjusted to face the left).

[0095] Note: After turning on the corridor lights, personnel identification and comparison will be more accurate, and the probability of being recognized by different door locks with large geographical differences is extremely low; if a is still recognized by multiple door locks with large geographical differences, it means that a is wandering in the corridor. At this time, adjust the PTZ camera according to the direction of the door lock that was most recently recognized to wait for a's arrival, so that early identification and comparison can be carried out and the door can be opened early.

[0096] Beneficial effect: The smart door lock will point the pan-tilt camera towards the direction of the incoming person in advance based on the notification from the neighbor's door lock, and perform facial recognition and unlock the door in advance for the owner.

[0097] It can be seen that based on the facial images of family members of smart lock A, a broadcast message is generated to enable other smart locks to receive and update the local door lock list to obtain a shared door lock list; based on the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the member's imminent arrival, and the member's direction information is obtained; based on the member's imminent arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; based on the multiple member's imminent arrival notification messages received by smart lock A, the optimized pan-tilt camera direction is obtained; based on the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and safety.

[0098] Another embodiment of the present invention provides a rapid door opening system based on a pan-tilt door lock, see Figure 3 , the system may include:

[0099] Synchronization module 301, for synchronizing family member feature vectors and updating the door lock list: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks receive and update the local door lock list, obtaining a shared door lock list containing the feature vectors of all family members;

[0100] Identification module 302, for face recognition and direction determination: Based on the face image recognized by smart lock B, it performs a similarity comparison with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival, and the message is sent to smart lock A to obtain the family member's direction information;

[0101] Adjustment module 303, for PTZ preset position adjustment and standby: Based on the notification message received by smart lock A indicating that a family member is about to arrive, it queries the preset position direction of smart lock B in the door lock list; the preset position direction is used to adjust the orientation of the PTZ camera, and standby mode is activated, waiting for a family member to enter the camera's field of view, to obtain the adjusted PTZ camera orientation;

[0102] Processing module 304 is used for conflict message processing and lighting optimization: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it determines whether there is a direction conflict. If there is a conflict, it broadcasts a light-on monitoring message and collects feedback from other door locks. The final pan-tilt camera direction is determined according to the principle of majority rule, resulting in an optimized pan-tilt camera direction.

[0103] The comparison module 305 is used for face matching and early unlocking: according to the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance; otherwise, the door is unlocked after the family member arrives at the door lock, and the final door opening result is obtained, completing the quick door opening process.

[0104] It can be seen that based on the facial images of family members of smart lock A, a broadcast message is generated to enable other smart locks to receive and update the local door lock list to obtain a shared door lock list; based on the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the member's imminent arrival, and the member's direction information is obtained; based on the member's imminent arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; based on the multiple member's imminent arrival notification messages received by smart lock A, the optimized pan-tilt camera direction is obtained; based on the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and safety.

[0105] An embodiment of the present invention further provides a storage medium storing a computer program, wherein the computer program is configured to execute the steps of any one of the above method embodiments when running.

[0106] Specifically, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for performing the following steps:

[0107] S201, family member feature vector synchronization and door lock list update: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks receive and update the local door lock list, and obtain a shared door lock list containing the feature vectors of all family members;

[0108] S202, face recognition and direction determination: Based on the face image recognized by smart lock B, a similarity comparison is performed with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival, and the message is sent to smart lock A to obtain the family member's direction information.

[0109] S203, PTZ preset position adjustment and standby: Based on the member arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried; the preset position direction is used to adjust the orientation of the PTZ camera, and standby mode is activated, waiting for the family member to enter the camera's field of view, and the adjusted PTZ camera direction is obtained;

[0110] S204, conflict message processing and lighting optimization: Based on the notification messages received by smart lock A regarding the impending arrival of multiple members, it is determined whether there is a direction conflict. If there is a conflict, the direction of the PTZ camera is determined by broadcasting a light-on monitoring message and collecting feedback from other door locks. The final direction is determined according to the principle of majority rule, resulting in an optimized PTZ camera direction.

[0111] S205, face matching and early unlocking: Based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance, otherwise the door is unlocked after the family member arrives at the door lock, and the final door unlocking result is obtained, completing the quick door opening process.

[0112] It can be seen that based on the facial images of family members of smart lock A, a broadcast message is generated to enable other smart locks to receive and update the local door lock list to obtain a shared door lock list; based on the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the member's imminent arrival, and the member's direction information is obtained; based on the member's imminent arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; based on the multiple member's imminent arrival notification messages received by smart lock A, the optimized pan-tilt camera direction is obtained; based on the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and safety.

[0113] An embodiment of the present invention further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.

[0114] Specifically, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0115] Specifically, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0116] S201, family member feature vector synchronization and door lock list update: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks receive and update the local door lock list, and obtain a shared door lock list containing the feature vectors of all family members;

[0117] S202, face recognition and direction determination: Based on the face image recognized by smart lock B, a similarity comparison is performed with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival, and the message is sent to smart lock A to obtain the family member's direction information.

[0118] S203, PTZ preset position adjustment and standby: Based on the member arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried; the preset position direction is used to adjust the orientation of the PTZ camera, and standby mode is activated, waiting for the family member to enter the camera's field of view, and the adjusted PTZ camera direction is obtained;

[0119] S204, conflict message processing and lighting optimization: Based on the notification messages received by smart lock A regarding the impending arrival of multiple members, it is determined whether there is a direction conflict. If there is a conflict, the direction of the PTZ camera is determined by broadcasting a light-on monitoring message and collecting feedback from other door locks. The final direction is determined according to the principle of majority rule, resulting in an optimized PTZ camera direction.

[0120] S205, face matching and early unlocking: Based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared; if the comparison is successful, the door is unlocked in advance, otherwise the door is unlocked after the family member arrives at the door lock, and the final door unlocking result is obtained, completing the quick door opening process.

[0121] It can be seen that based on the facial images of family members of smart lock A, a broadcast message is generated to enable other smart locks to receive and update the local door lock list to obtain a shared door lock list; based on the facial image recognized by smart lock B, a similarity comparison is performed with the shared door lock list to generate a notification message of the member's imminent arrival, and the member's direction information is obtained; based on the member's imminent arrival notification message received by smart lock A, the preset position direction of smart lock B in the door lock list is queried to obtain the adjusted pan-tilt camera direction; based on the multiple member's imminent arrival notification messages received by smart lock A, the optimized pan-tilt camera direction is obtained; based on the adjusted pan-tilt camera direction, the final door opening result is obtained, thereby realizing an efficient, convenient and safe door opening solution to meet the dual needs of modern families for fast door opening experience and safety.

[0122] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings. The above is only a preferred embodiment of the present invention, but the scope of implementation of the present invention is not limited to what is shown in the drawings. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which do not exceed the spirit covered by the description and drawings, should be within the scope of protection of the present invention.

Claims

1. A quick door opening method based on a pan-tilt door lock, characterized in that: The method comprises: Family member feature vector synchronization and door lock list update: Based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing the feature vectors of all family members; Face recognition and direction determination: Based on the face image recognized by smart lock B, a similarity comparison is performed with the feature vectors in the shared door lock list. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival. The message is sent to smart lock A, and the family member's direction information is obtained. PTZ preset position adjustment and waiting: Based on the notification message received by smart lock A that a family member is about to arrive, the preset position direction of smart lock B in the door lock list is queried. The preset position direction is used to adjust the direction of the PTZ camera, and waiting mode is activated to wait for a family member to enter the camera's field of view, and the adjusted PTZ camera direction is obtained. Conflict message processing and lighting optimization: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it determines whether there is a direction conflict. If there is a conflict, it broadcasts a light-on monitoring message and collects feedback from other door locks. The final pan-tilt camera direction is determined according to the principle of majority rule, resulting in the optimized pan-tilt camera direction. Face matching and early unlocking: Based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared. If the comparison is successful, the door is unlocked in advance. Otherwise, the system waits for the family member to arrive before the door lock and then performs recognition and unlocking to obtain the final unlocking result, completing the quick door opening process.

2. The method according to claim 1, characterized in that The synchronization of family member feature vectors and the update of door lock list include: Family member feature vector generation: Extract facial feature vectors based on the facial images of family members in smart lock A; wherein the feature vectors are generated by a deep learning model to obtain feature vector data of family members; Broadcast message generation and transmission: Generate a broadcast message based on the family member ID and feature vector data; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain shared family member feature vector information; Door lock list update: Update the local door lock list based on the received broadcast message; wherein, the door lock list includes family member ID, feature vector and door lock location relationship, and obtains an updated shared door lock list.

3. The method according to claim 2, characterized in that The face recognition and direction judgment include: Facial image acquisition and feature extraction: Extract facial feature vectors based on facial images captured by the camera of smart lock B. The feature extraction uses a deep learning model to obtain real-time facial feature vectors. Similarity comparison and member identification: Based on the real-time facial feature vector, the similarity is compared with the feature vectors in the shared door lock list. If the similarity exceeds the preset threshold, the person is identified as a family member and an identification result is obtained. Direction judgment and notification message generation: Based on the positional relationship of smart lock B relative to smart lock A, a notification message is generated indicating that a member is about to arrive; wherein, the notification message includes the member ID and the location information of door lock B, and the direction judgment result is obtained.

4. The method according to claim 3, characterized in that The PTZ preset position adjustment and waiting include: Notification message parsing and preset position query: Based on the member arrival notification message received by smart lock A, the location information of door lock B is parsed; wherein, the location information is used to query the preset position direction of smart lock B in the door lock list to obtain the preset position direction information; PTZ camera direction adjustment: adjusting the orientation of the PTZ camera according to the preset position direction information; wherein the adjustment is achieved by controlling the PTZ motor to obtain the adjusted camera direction; Waiting mode is started: according to the adjusted camera direction, the waiting mode is started; wherein, the waiting mode lasts for 1 minute, waiting for family members to enter the camera's field of view and enter the waiting state.

5. The method according to claim 4, characterized in that The conflict message processing and lighting optimization include: Conflict message detection: Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it is determined whether there is a direction conflict; wherein, the conflict message detection is achieved by comparing the position information of different door locks to obtain the conflict message detection result; Light-on monitoring message broadcast: Generate a light-on monitoring broadcast message based on the conflict message detection result; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain the light-on monitoring status; Feedback message statistics and direction optimization: Based on the feedback messages of other smart locks, the direction information of the members is counted; wherein, the statistics are based on the principle of minority obeys majority to determine the final pan-tilt camera direction, and the optimized camera direction is obtained.

6. A quick door opening system based on a pan-tilt door lock, characterized in that: The system comprises: The synchronization module is used to synchronize family member feature vectors and update the door lock list: based on the family member face image feature vector of smart lock A, a broadcast message containing the family member ID and feature vector is generated, so that other smart locks can receive and update the local door lock list to obtain a shared door lock list containing the feature vectors of all family members; The recognition module is used for face recognition and direction determination: the face image recognized by smart lock B is compared with the feature vectors in the shared door lock list for similarity. If the matched face is a family member of smart lock A, a notification message is generated based on the position of smart lock B relative to A, indicating the family member's impending arrival. The message is sent to smart lock A, and the family member's direction information is obtained. The adjustment module is used for PTZ preset position adjustment and waiting: based on the notification message received by smart lock A that a family member is about to arrive, it queries the preset position direction of smart lock B in the door lock list; the preset position direction is used to adjust the direction of the PTZ camera, and the waiting mode is activated, waiting for the family member to enter the camera's field of view, and then the adjusted PTZ camera direction is obtained; The processing module is used for conflict message handling and lighting optimization. Based on the notification messages received by smart lock A indicating that multiple members are about to arrive, it determines whether there is a direction conflict. If there is a conflict, it broadcasts a light-on monitoring message and collects feedback from other door locks. The final pan-tilt camera direction is determined according to the principle of majority rule, resulting in the optimized pan-tilt camera direction. The matching module is used for face matching and early unlocking: based on the adjusted pan-tilt camera direction, the facial images of family members are captured in real time and compared. If the matching is successful, the door is unlocked in advance. Otherwise, the system waits for the family member to arrive before the door lock and then performs recognition and unlocking to obtain the final door unlocking result, completing the quick door opening process.

7. The system according to claim 6, characterized in that The synchronization module is specifically used to: generate family member feature vectors: extract facial feature vectors based on the facial images of family members of smart lock A; wherein the feature vectors are generated by a deep learning model to obtain feature vector data of family members; Broadcast message generation and transmission: Generate a broadcast message based on the family member ID and feature vector data; wherein, the broadcast message is sent to other smart locks on the same floor via the local area network to obtain shared family member feature vector information; Door lock list update: Update the local door lock list based on the received broadcast message; wherein, the door lock list includes family member ID, feature vector and door lock location relationship, and obtains an updated shared door lock list.

8. The system according to claim 7, characterized in that The identification module is specifically used to: Facial image acquisition and feature extraction: Extract facial feature vectors based on facial images captured by the camera of smart lock B. The feature extraction uses a deep learning model to obtain real-time facial feature vectors. Similarity comparison and member identification: Based on the real-time facial feature vector, the similarity is compared with the feature vectors in the shared door lock list. If the similarity exceeds the preset threshold, the person is identified as a family member and an identification result is obtained. Direction judgment and notification message generation: Based on the positional relationship of smart lock B relative to smart lock A, a notification message is generated indicating that a member is about to arrive; wherein, the notification message includes the member ID and the location information of door lock B, and the direction judgment result is obtained.

9. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 5 when executed.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 5.

Images