A door lock cooperative identity recognition method and system

Abstract

The application discloses a door lock cooperative identity recognition method and system, and the method comprises the following steps: obtaining a MAC-face binding relationship table stored locally according to face recognition verification completed by a resident through a smart door lock; completing identity recognition cooperatively with the smart door lock through multicast communication according to the moving path of the resident from a floor entrance to the smart door lock, obtaining an identity confirmation result and constructing a directed multicast network; triggering the collection of information of a person leaving home by passing through a door lock according to a leaving-home event of the resident opening the door lock indoors, obtaining an identity confirmation result of the person leaving home; and selecting a unicast or multicast confirmation message to be sent by the smart door lock according to the completion degree of the identity confirmation of the person leaving home, triggering the sending of an IGMP leave message to a router by the door lock passing through, and obtaining a simplified multicast forwarding table. By using the embodiment of the application, seamless identity cooperation in the whole process from coming home to leaving home can be realized, and the automation degree and user experience of home security are improved.

Description

Technical Field

[0001] This invention belongs to the field of smart door lock technology, and in particular to a door lock collaborative identity recognition method and system. Background Technology

[0002] Existing smart lock systems generally use a single biometric feature (such as facial recognition) for identification. While this provides some convenience, it has significant limitations in real-world scenarios involving multiple locks working together in home corridors, elevators, and other similar environments. For example, as a resident walks from a public area to their home, each lock identifies the resident independently, failing to anticipate their intentions and coordinate accordingly, resulting in response delays. When a resident leaves home, the system struggles to proactively and accurately trigger and notify devices along their route, leading to resource waste and a fragmented user experience. Furthermore, relying solely on biometrics cannot effectively distinguish between family members living together or perceive their group behavior, making it difficult to support advanced applications such as "headcount counting" and "targeted services." Summary of the Invention

[0003] The purpose of this invention is to provide a door lock collaborative identity recognition method and system to overcome the shortcomings of the prior art, and to achieve seamless identity collaboration throughout the entire process from returning home to leaving home, thereby improving the automation level of home security and user experience.

[0004] One embodiment of this application provides a door lock collaborative identity recognition method, the method comprising:

[0005] Identity binding pre-configuration: Based on the facial recognition verification completed by the resident through the smart door lock, the resident's facial feature vector is bound to their mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table;

[0006] Homecoming route identity collaborative recognition: Based on the resident's movement path from the floor entrance to their own door lock, facial images and a list of WiFi MAC addresses are collected from the door locks along the way. Identity recognition is completed in collaboration with their own door lock through multicast communication, and the identity confirmation result is obtained and a directional multicast network is built.

[0007] Leaving Home Event Triggering and Identity Confirmation: Based on the event of a resident leaving home by unlocking the door from inside the house, the door lock of the resident's own house sends a multicast message containing the number of people leaving home and the WiFi MAC address, triggering the door locks passing by to collect information on the people leaving home, and obtaining the identity confirmation result of the people leaving home;

[0008] Dynamic optimization of multicast network: Based on the completion of the identity verification of the person leaving home, the door lock of the house can choose to send a unicast or multicast confirmation message, triggering the door locks passing through to send IGMP leave messages to the router, and obtaining a simplified multicast forwarding table.

[0009] Optionally, the identity binding pre-configuration includes:

[0010] Initial authentication: Based on the event that the resident successfully opens the door through the smart door lock's facial recognition, the door lock initiates a binding window and monitors surrounding mobile phone signals;

[0011] MAC address filtering: Based on the continuously monitored WiFi MAC addresses of mobile phones whose signal strength exceeds the threshold, a binding request is sent to the corresponding mobile phone;

[0012] Facial feature binding: Based on the facial data collection and verification results completed by the mobile phone user, the verified facial feature vector is associated with the MAC address;

[0013] Binding relationship storage: Based on the association results, store the binding relationship table of resident name-facial feature vector-MAC address locally on the door lock.

[0014] Optionally, the home return path identity collaborative recognition includes:

[0015] Path information collection: Based on the resident's movement from the floor entrance, the pan-tilt cameras on the door locks along the way collect facial images, and the WiFi module simultaneously captures a list of WiFi MAC addresses;

[0016] Identification Request Multicast: Based on the collected face image and MAC address list, an identification request message containing this information is sent to the multicast router through the door lock;

[0017] Identity matching verification: According to the forwarding rules of the multicast router, only the door lock that has been bound to the corresponding MAC address can receive the identification request and perform matching verification between the facial feature vector and the MAC address;

[0018] Directed multicast network construction: Based on the matching and verification results, each door lock sequentially sends IGMP registration MAC messages to the router, registers the valid resident MAC address at the router's outgoing interface, and constructs a directed multicast network.

[0019] Homecoming Time Record: Based on the event of a resident arriving at their own door lock and successfully opening the door, the current time is recorded as the homecoming time.

[0020] Optionally, the triggering of the departure event and identity verification include:

[0021] Away from home event detection: The door lock's internal orientation sensor detects an outward opening motion, triggering an away from home event.

[0022] Away from home multicast message: Based on the event of leaving home, the door lock of the house sends a multicast message containing the number of people leaving home and a list of WiFi MAC addresses to the multicast router;

[0023] Directed forwarding control: Based on the MAC address matching rules of the multicast router, only door locks that have registered the corresponding MAC address can receive the "Leaving Home" message.

[0024] PTZ camera rotation and data acquisition: Based on the received message indicating that the person has left home, the camera is controlled by the door lock to rotate in the direction of the door lock and acquire the facial image and MAC address of the person leaving home.

[0025] Identity verification request: Based on the collected facial image and MAC address, a unicast message requesting facial recognition is sent from the door lock to the door lock outside the home.

[0026] Optionally, the multicast network dynamic optimization includes:

[0027] Identity verification decision: Based on the degree of identity verification of the person leaving home by the door lock, decide the type of message to send. Specifically, a multicast confirmation message is sent when all identity verifications are completed, and a unicast confirmation message is sent when some identity verifications are completed.

[0028] MAC address cleanup: Based on the received confirmation message, the device sends an IGMP leave message to the router through the door lock, thus cleaning up the corresponding MAC address in the router's forwarding table;

[0029] Table space optimization: Timely cleanup based on MAC addresses reduces the space occupied by router forwarding table entries;

[0030] Departure Time Record: Based on the identity verification results of the person leaving home, the current time is recorded as the departure time of the corresponding resident.

[0031] Optionally, the method also includes the statistics and application of time spent at home:

[0032] Duration calculation: Calculate the actual time each household spends at home based on the recorded arrival and departure times;

[0033] Cost sharing: The amount of water and electricity costs shared is calculated based on the proportion of time each household spends at home;

[0034] Privacy protection: By configuring the door lock camera to be installed only outside the door, information about indoor activities is avoided, ensuring the privacy and security of residents.

[0035] Another embodiment of this application provides a door lock-assisted identity recognition system, the system comprising:

[0036] The configuration module is used for identity binding pre-configuration: based on the face recognition verification completed by the resident through the smart door lock, the resident's face feature vector is bound to its mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table;

[0037] The identification module is used for collaborative identification of the resident's home return path: based on the resident's movement path from the floor entrance to their own door lock, the module collects facial images and a list of WiFi MAC addresses from the door locks along the way, and completes the identification in collaboration with their own door lock through multicast communication, obtains the identity confirmation result, and builds a directional multicast network;

[0038] The confirmation module is used for triggering and verifying the identity of residents leaving home: based on the event of a resident leaving home by opening the door lock from inside the house, the door lock of the resident's own house sends a multicast message containing the number of people leaving home and the WiFi MAC address, triggering the door locks passing by to collect the information of the people leaving home, and obtaining the identity verification result of the people leaving home;

[0039] The optimization module is used for dynamic optimization of multicast networks: based on the completion of the identity verification of the person leaving home, the door lock of the house chooses to send a unicast or multicast confirmation message, triggering the door locks passing through to send IGMP leave messages to the router, and obtaining a simplified multicast forwarding table.

[0040] Another embodiment of this application provides a storage medium storing a computer program, wherein the computer program is configured to execute the method described in any of the preceding claims when running.

[0041] Another embodiment of this application provides an electronic device including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the method described in any of the preceding claims.

[0042] Compared with existing technologies, the present invention provides a door lock collaborative identity recognition method. Based on the resident's facial recognition verification completed through the smart door lock, a locally stored MAC-face binding relationship table is obtained. Based on the resident's movement path from the floor entrance to their own door lock, multicast communication is used to collaboratively complete identity recognition with their own door lock, obtaining an identity confirmation result and constructing a directional multicast network. Based on the resident's departure event of opening the door lock from inside the house, passing door locks are triggered to collect information on the departing person, obtaining an identity confirmation result for the departing person. Depending on the degree of completion of the departing person's identity confirmation, the home door lock chooses to send a unicast or multicast confirmation message, triggering passing door locks to send IGMP leave messages to the router, obtaining a simplified multicast forwarding table. This enables seamless identity collaboration throughout the entire process from returning home to leaving home, improving the automation level of home security and user experience. Attached Figure Description

[0043] Figure 1 A hardware structure block diagram of a computer terminal for a door lock collaborative identity recognition method provided in an embodiment of the present invention;

[0044] Figure 2 A flowchart illustrating a door lock-based identity recognition method provided in an embodiment of the present invention;

[0045] Figure 3 This is a schematic diagram of the pre-setting of pan-tilt-zoom cameras for each door lock on each floor, provided in an embodiment of the present invention.

[0046] Figure 4 This is a schematic diagram of a door lock collaborative identity recognition system provided in an embodiment of the present invention. Detailed Implementation

[0047] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0048] Currently, most apartment buildings only have one main water and electricity meter to measure the total water and electricity consumption of the entire unit. In shared rental scenarios with multiple rooms, residents typically share water and electricity costs equally—that is, regardless of the actual time each resident spends at home or the frequency of usage, everyone pays the same proportion. This traditional method of sharing costs is clearly unreasonable: for example, some residents who are frequently away on business trips and spend less than 10 days a month at home should pay the same fees as those who are home every day. In the long run, this can easily lead to conflicts between residents and reduce their living experience.

[0049] To address this issue, the core requirement is to establish a mechanism that allocates water and electricity costs based on actual time spent at home. The longer residents are at home, the more water and electricity they theoretically consume, and the higher their share of the costs should be. The key to implementing this mechanism lies in accurately and seamlessly tracking each resident's time at home while avoiding any invasion of privacy (e.g., avoiding the installation of surveillance equipment within the apartment). Currently, smart locks are widely used in apartment settings, possessing basic functions such as internet connectivity and identity verification (e.g., facial recognition). Simultaneously, residents' mobile phones, as everyday portable devices, can provide auxiliary identification through their Wi-Fi signals. Based on this, this invention combines smart locks with mobile phone Wi-Fi MAC information to construct a system that accurately tracks resident time spent at home while protecting privacy, providing data support for the fair allocation of water and electricity costs.

[0050] This invention first provides a door lock-assisted identity recognition method, which can be applied to electronic devices, such as computer terminals, specifically ordinary computers.

[0051] The following detailed explanation uses a computer terminal as an example. Figure 1 This is a hardware structure block diagram of a computer terminal for a door lock collaborative identity recognition method provided in an embodiment of the present invention. (See diagram below.) Figure 1 As shown, the computer device includes a processor, memory, and network interface connected via a system bus, wherein the memory may include non-volatile storage media and internal memory.

[0052] Non-volatile storage media can store an operating system and a computer program. This computer program includes program instructions that, when executed, cause the processor to perform any door lock cooperative identification method.

[0053] The processor provides computing and control capabilities, supporting the operation of the entire computer device.

[0054] Internal memory provides an environment for the execution of computer programs in non-volatile storage media. When executed by a processor, the computer program enables the processor to perform any door lock cooperative identification method.

[0055] This network interface is used for network communication, such as sending assigned tasks. Those skilled in the art will understand that... Figure 1 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0056] It should be understood that the processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0057] See Figure 2 and Figure 3 The present invention provides a door lock collaborative identity recognition method, which may include the following steps:

[0058] S201, Identity Binding Pre-configuration: Based on the facial recognition verification completed by the resident through the smart door lock, the resident's facial feature vector is bound to their mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table; specifically, the identity binding pre-configuration includes:

[0059] Initial authentication: Based on the event that the resident successfully opens the door through the smart door lock's facial recognition, the door lock initiates a binding window and monitors surrounding mobile phone signals;

[0060] MAC address filtering: Based on the continuously monitored WiFi MAC addresses of mobile phones whose signal strength exceeds the threshold, a binding request is sent to the corresponding mobile phone;

[0061] Facial feature binding: Based on the facial data collection and verification results completed by the mobile phone user, the verified facial feature vector is associated with the MAC address;

[0062] Binding relationship storage: Based on the association results, store the binding relationship table of resident name-facial feature vector-MAC address locally on the door lock.

[0063] S202, Homecoming Path Identity Collaborative Recognition: Based on the resident's movement path from the floor entrance to their own door lock, facial images and a list of WiFi MAC addresses are collected from the door locks along the way. Identity recognition is completed collaboratively with the resident's own door lock via multicast communication, obtaining an identity confirmation result and constructing a directional multicast network. Specifically, the homecoming path identity collaborative recognition includes:

[0064] Path information collection: Based on the resident's movement from the floor entrance, the pan-tilt cameras on the door locks along the way collect facial images, and the WiFi module simultaneously captures a list of WiFi MAC addresses;

[0065] Identification Request Multicast: Based on the collected face image and MAC address list, an identification request message containing this information is sent to the multicast router through the door lock;

[0066] Identity matching verification: According to the forwarding rules of the multicast router, only the door lock that has been bound to the corresponding MAC address can receive the identification request and perform matching verification between the facial feature vector and the MAC address;

[0067] Directed multicast network construction: Based on the matching and verification results, each door lock sequentially sends IGMP registration MAC messages to the router, registers the valid resident MAC address at the router's outgoing interface, and constructs a directed multicast network.

[0068] Homecoming Time Record: Based on the event of a resident arriving at their own door lock and successfully opening the door, the current time is recorded as the homecoming time.

[0069] S203, Departure Event Triggering and Identity Confirmation: Based on a resident's departure event (unlocking the door from inside), the resident's own door lock sends a multicast message containing the number of people leaving and their WiFi MAC address, triggering passing door locks to collect information on the departing person and obtaining an identity confirmation result. Specifically, the departure event triggering and identity confirmation includes:

[0070] Away from home event detection: The door lock's internal orientation sensor detects an outward opening motion, triggering an away from home event.

[0071] Away from home multicast message: Based on the event of leaving home, the door lock of the house sends a multicast message containing the number of people leaving home and a list of WiFi MAC addresses to the multicast router;

[0072] Directed forwarding control: Based on the MAC address matching rules of the multicast router, only door locks that have registered the corresponding MAC address can receive the "Leaving Home" message.

[0073] PTZ camera rotation and data acquisition: Based on the received message indicating that the person has left home, the camera is controlled by the door lock to rotate in the direction of the door lock and acquire the facial image and MAC address of the person leaving home.

[0074] Identity verification request: Based on the collected facial image and MAC address, a unicast message requesting facial recognition is sent from the door lock to the door lock outside the home.

[0075] S204, Dynamic Optimization of Multicast Network: Based on the completion status of identity verification for those leaving home, each door lock selects to send either a unicast or multicast confirmation message, triggering passing door locks to send IGMP leave packets to the router, resulting in a simplified multicast forwarding table. Specifically, the dynamic optimization of the multicast network includes:

[0076] Identity verification decision: Based on the degree of identity verification of the person leaving home by the door lock, decide the type of message to send. Specifically, a multicast confirmation message is sent when all identity verifications are completed, and a unicast confirmation message is sent when some identity verifications are completed.

[0077] MAC address cleanup: Based on the received confirmation message, the device sends an IGMP leave message to the router through the door lock, thus cleaning up the corresponding MAC address in the router's forwarding table;

[0078] Table space optimization: Timely cleanup based on MAC addresses reduces the space occupied by router forwarding table entries;

[0079] Departure Time Record: Based on the identity verification results of the person leaving home, the current time is recorded as the departure time of the corresponding resident.

[0080] Furthermore, the method also includes the statistics and application of time spent at home:

[0081] Duration calculation: Calculate the actual time each household spends at home based on the recorded arrival and departure times;

[0082] Cost sharing: The amount of water and electricity costs shared is calculated based on the proportion of time each household spends at home;

[0083] Privacy protection: By configuring the door lock camera to be installed only outside the door, information about indoor activities is avoided, ensuring the privacy and security of residents.

[0084] This invention aims to solve the problem of "inaccurate identity differentiation" in existing technologies: by "binding facial features with mobile phone Wi-Fi MAC addresses," it accurately identifies each resident's door opening and leaving events, ensuring the uniqueness of the statistical data on the time each resident spends at home. This invention avoids installing any detection devices inside the apartment, especially avoiding the installation of inward-facing cameras on smart door locks, thereby minimizing the risk of resident privacy leaks.

[0085] This invention proposes a door lock-based identity recognition method and system. Its core is to use a smart door lock equipped with a PTZ camera and the binding of facial features of residents in each room of the house with their mobile phone MAC addresses to calculate the duration of time residents are at home. The complete technical solution is as follows:

[0086] Each apartment entrance is equipped with a smart lock. Each smart lock has a pan-tilt camera at its entrance. All smart locks are networked and interconnected, knowing the relative positions of other locks to facilitate setting preset pan-tilt positions. By default, the pan-tilts of the locks are all facing the elevator / staircase entrance on each floor. The locks are pre-linked to facial features based on the resident's mobile phone Wi-Fi MAC address, and the MAC-identity matching relationship is stored locally.

[0087] 1. When multiple people exit the stairwell to return home, the system obtains a list of current Wi-Fi MAC addresses from all the door locks they pass through from the elevator to their homes. (This list is a collection of Wi-Fi MAC addresses, referred to as the Wi-Fi MAC address list, as it typically includes not only the MAC address of the person's mobile phone but also those of other nearby fixed devices and people.) Through verification, only the Wi-Fi MAC address list of returning residents is sent to the gateway router (all routers are multicast routers) via IGMP registration messages through the door locks. Upon receiving this message, the multicast router generates (*, G) entries, registering the Wi-Fi MAC address list on each outgoing interface. Thus, the door locks passing through the stairwell constitute a targeted network node for transmitting and receiving the Wi-Fi MAC address list of returning residents. This avoids adding non-resident (e.g., visitor) Wi-Fi MAC addresses to the router's outgoing interfaces, saving router table space.

[0088] 2. When a resident arrives at their own door, the door lock will rotate to face the homeowner for facial recognition to open the door, and the arrival time of the resident will be recorded. If a person enters the house without facial recognition, the resident's identity will be confirmed based on the Wi-Fi MAC address.

[0089] 3. When a resident leaves home, the door lock is opened from the inside out. After the door lock's own camera identifies the person leaving, the lock sends a multicast message with a destination address of G (containing the number of people leaving the lock). The router only forwards this multicast message from the outgoing interface registered with that Wi-Fi MAC address. Obviously, only locks facing the direction of the resident's door will receive this message; locks facing the opposite direction will not receive it. Upon receiving the message, the pan-tilt cameras passing by the locks all turn towards the direction of the departing resident and begin sequentially collecting facial and MAC addresses, requesting the departing lock to recognize and capture the captured faces. If the lock itself only completes the identification of some departing residents, it sends a unicast message to the requesting lock, instructing it to delete the Wi-Fi MAC address list from the confirmation message to save table space (subsequent passing locks will still continue to process the identification of departing residents). If the lock itself completes the identification of all departing residents, it sends a multicast confirmation message. All passing locks will receive this message and delete the Wi-Fi MAC address / list from the confirmation message, thus freeing up table space and avoiding interference with subsequent passing locks. The following is a detailed description of this solution.

[0090] I. System Composition and Prerequisites:

[0091] The core components of this system include: smart door locks with pan-tilt cameras (one at the main entrance of each apartment), multicast routers (deployed across the building, connecting all smart door locks), and resident mobile phones (serving as the carrier for Wi-Fi MAC address and identity association). The functions and pre-configured conditions of each component are as follows:

[0092] 1. Smart door lock with PTZ camera: Equipped with a Wi-Fi MAC detection module, supporting multicast message sending and receiving, and a PTZ camera (installed only on the outside of the door, no camera inside to avoid privacy leaks); supports facial feature storage and comparison module; all door locks are interconnected and can obtain the relative location of other door locks through pre-configured settings (e.g., ...). Figure 1 The text states, "On the 3rd floor, the lock on door 302 is to the left of the lock on suite 301, and to the right are locks on suites 303, 304, etc." The default orientation of the pan / tilt unit is towards the elevator / staircase entrance of the floor (see...). Figure 1 The orientation of the cameras on the left and right doors of the elevator lobby can be set via a pan-tilt-zoom preset.

[0093] 2. Binding of Resident's "Mobile Phone Wi-Fi MAC Address - Facial Feature Vector": When a mobile phone has its Wi-Fi function enabled, its Wi-Fi MAC address serves as a unique identifier for identity association. This can be bound to facial features to achieve a one-to-one correspondence between "Wi-Fi MAC address and facial feature vector" (referred to as "MAC-face"), and stored in the resident's door lock. The initial binding process between facial features and the mobile phone MAC address: If resident α of door lock 304 successfully opens the door via facial recognition, the door lock simultaneously initiates a binding window (e.g., 30 minutes). After the door lock detects a mobile phone signal strength ≥ a threshold (e.g., -70dBm) of MAC address AA:BB:CC:11:22:33 for a sustained period (e.g., 10 minutes), it can send a door lock binding request to that mobile phone. This request requires facial data collection and comparison with the door lock's facial database for verification. If the resident's facial identity is confirmed, the resident α's name, facial feature vector aa, and MAC address AA:BB:CC:11:22:33 are bound together and stored in this door lock.

[0094] 3. Improved multicast router and the first resident door lock to join a targeted multicast group: Deployed within the building floors, supporting the IGMP protocol, it can receive IGMP join messages sent by smart door locks, generate (*, G) entries (G is the preset multicast group address), and register the corresponding Wi-Fi MAC information on each outgoing interface of the entry. Subsequently, only messages matching the MAC address on the outgoing interface are forwarded by the router from that interface. For example, during the "Wi-Fi MAC - Face Feature Vector" binding process for resident α in door lock 4, door lock 4 sends an IGMP "Register MAC" message with multicast group G of 225.1.1.3. The IGMP message is then improved: resident α's mobile phone MAC address (AA:BB:CC:11:22:33) is added to the original IGMP message structure. Simultaneously, to achieve network-wide forwarding of multicast messages, the PIM join message is also improved: the mobile phone MAC address (AA:BB:CC:11:22:33) is added to the original PIM join message structure. The multicast router is responsible for caching and processing the improved IGMP and P1M messages: First, it stores the mobile phone MAC address (AA:BB:CC:11:22:33) in the outgoing interface of the forwarding table. Second, if the multicast router subsequently forwards a message carrying the mobile phone MAC address, it will check the matching status of the outgoing interface. If the MAC address of the mobile phone (AA:BB:CC:11:22:33) matches, the multicast message will be forwarded from the outgoing interface; otherwise, the message will be discarded.

[0095] II. Door locks used by residents on their way home constitute directional registration door locks:

[0096] Since the door locks don't know which room a resident is going to after exiting the elevator, each passing door lock collects facial images via face detection and capture modules, and the Wi-Fi module simultaneously captures the phone's Wi-Fi MAC address. If these passing door locks were to broadcast the Wi-Fi MAC address and facial feature vector information to all other locks, it would consume resources, interfere with the operation of other locks, and cause unnecessary busy activity for unrelated locks. Furthermore, since each lock currently lacks the IP address information of other locks, unicast is not feasible. Therefore, to address these issues, a multicast group can be set up for each floor to facilitate information exchange.

[0097] Therefore, this scenario uses multicast interaction. The network architecture is as follows: ordinary multicast messages from each door lock are typically forwarded to the entire multicast group G of the building for propagation. However, in the scenario of residents returning home, we want only the door locks along the route to participate in identity verification, while door locks in the opposite direction do not participate. Therefore, this solution optimizes the process by adding the door locks along the route to a targeted multicast group, achieving identity verification while controlling the propagation of multicast messages within the smallest possible scope. Simultaneously, only the Wi-Fi MAC address of returning residents is added to the router's outgoing interface (MAC addresses of non-residents, such as visitors, are not added), saving router table space. The detailed process is explained below:

[0098] 1. After resident α and visitor A exit from the stairwell / elevator, they walk together towards their own door lock N (e.g., their own door lock 304, where N=4), passing all the smart locks along the way. At each lock (locks 1 to N-1), the camera's Wi-Fi detection module simultaneously captures facial images and collects all Wi-Fi signals at that moment, thus obtaining the Wi-Fi MAC addresses of resident α and visitor A's mobile phones. After data collection, the lock's pan-tilt camera returns to its default position facing the floor entrance.

[0099] 2. The device passing through the door lock (e.g., door lock 1) sends a multicast data packet "Identification Request" to the multicast router. The request message includes: the door lock source IP (door lock 1), the multicast address G, the captured face (of resident α and visitor A), and the list of detected Wi-Fi MAC addresses (of resident α and visitor A).

[0100] 3. The improved multicast router will forward packets according to the (*,G) table entry and the outgoing interface MAC address matching rules; only the resident door lock N (N=4) that has added the Wi-Fi MAC address will receive the "identification request". In the router's outgoing interface, door lock 4, during the aforementioned face binding process, has already reported the MAC addresses of residents α and β to the gateway router via the first resident door lock to join the multicast group's IGMP "register MAC" message. The gateway router registers these MAC addresses on the outgoing interface. When the router receives an "identification request" multicast message from a passing door lock, it checks which outgoing interface in the (*,G) forwarding table entry contains one or more MAC addresses from the "identification request" multicast message. If so, it forwards the message from that interface. Therefore, only resident door lock 4 will receive the "identification request" multicast message. Door lock 4 compares its information with the resident information stored within its own lock, and unicasts the matching resident information back to the passing door lock. For example, door lock 4 stores information about residents α and β, such as resident α's name, facial feature vector aa, and MAC address AA:BB:CC:11:22:33. By parsing the captured face and MAC address in the recognition request, door lock 4 can match the legitimate resident of its own lock. Therefore, using the received door lock source IP (door lock 1), door lock 4 can unicast a "matching result" message back to the requesting door lock 1. The message content includes: door lock N, source IP (of door lock 4), and the MAC address / list of the identified resident α. Finally, door lock 4 turns the camera to face the camera.

[0101] 4. Passing locks (e.g., lock 1) sequentially join the targeted multicast network via "Register MAC". The passing lock (e.g., lock 1) parses the "Match Result" message received via unicast and sends the list of resident α's Wi-Fi MAC addresses (or a complete list of residents if multiple residents return home simultaneously) to the multicast router via an IGMP multicast protocol message "Register MAC". Upon receiving the IGMP "Register MAC" message, the router registers the list of valid resident Wi-Fi MAC addresses on the outgoing interface corresponding to the lock that sent the IGMP message (i.e., associating resident MAC addresses with the outgoing interface of the passing lock, ensuring targeted forwarding of subsequent multicast messages). This prevents visitor MAC addresses from being added to the outgoing interface, reducing the space required for the router's forwarding table entries.

[0102] 5. Subsequent door locks also join the directional multicast network by "registering MAC". Afterward, each door lock (door locks 2 to N-1) sends a multicast message "identification request" to the multicast router. At this time, both the door lock itself (door lock 4) and the preceding door locks (such as door lock 1) receive this message, but only door lock 4, which stores resident information, can perform facial feature vector and MAC address comparison upon receiving it. Similarly, after door lock 4 returns the "matching result" message to the passing door locks, the passing door locks also send an IGMP "register MAC" message to the router, ultimately making all passing door locks members of the directional multicast network.

[0103] 6. When lock N receives an "identification request" message from lock N-1, the pan-tilt camera of lock N adjusts from its original orientation towards the elevator to facing directly forward, waiting to identify the homeowner—without the preceding identification process, the pan-tilt camera defaults to facing the elevator and may not be able to identify the homeowner in time. When the resident arrives at their own lock (lock N, N=4), lock N has already confirmed the resident's identity in advance through the collaborative identification of the preceding locks, and opens the door after successful verification; at the moment the door is successfully opened, lock N records the current time as the "resident's return time," which serves as the starting point for calculating the duration of stay at home.

[0104] III. Verification of resident identity when leaving home and record of the end of time spent at home:

[0105] To protect privacy, smart door locks do not have cameras inside the door, so they cannot identify which room a resident is leaving via facial recognition. This solution transmits the resident's departure information and the number of people leaving between door locks within a directional multicast group. This ensures that only door locks that have registered the MAC address list with the multicast router's outgoing interface can receive the departure information—thus avoiding interference with unrelated door locks. Furthermore, the pan / tilt unit of a passing door lock rotates towards the departing door lock, sending back the collected facial image and MAC address list of the departing resident for identity verification. If the door lock only identifies some residents leaving the house, it only returns a unicast message (containing the MAC addresses of the identified residents, but not the visitors' MAC addresses). Passing door locks, upon receiving this message, send an IGMP leave message (containing the MAC addresses of the identified residents) to the multicast router. The router promptly deletes this MAC address from its outgoing interface upon receiving the message, thus reducing wasted space in the router's MAC address table. If all residents leaving the house are identified, the door lock sends a multicast message, allowing subsequent door locks in the multicast network to send IGMP leave messages, enabling the router to immediately delete the MAC addresses and reduce router table entries. Detailed implementation steps are given below:

[0106] 1. When someone unlocks their own door (door lock N, N=4) from inside to leave, the door lock detects the "opening from the inside" action (achieved through a direction sensor inside the door lock). Door lock N automatically sends a multicast "resident left home" message with a destination address G to the multicast router. The message includes: door lock N, source IP (of door lock N), multicast address G, number of people leaving home, and a list of Wi-Fi MAC addresses of those leaving home (for example, if there are 2 people leaving home, there are three scenarios: ① residents α and β; ② resident α and visitor A; ③ visitor A and B).

[0107] 2. The multicast router queries the (*, G) table entry and forwards the multicast message only from the outgoing interface that has the registered Wi-Fi MAC address of the resident, i.e., only to the door locks 1 to N-1 that the resident passes through on their way home. (The multicast router receives the message and queries its content. If the message does not contain the phone's MAC address, it is treated as a normal multicast and forwarded from the outgoing interface. If the message contains the phone's MAC address, it further queries the matching status of the outgoing interface. If it matches the MAC address of resident α's phone AA:BB:CC:11:22:33, it forwards the multicast message from the outgoing interface; otherwise, it discards the message.) Door locks in the opposite direction and those not passed through the multicast router cannot receive the message (not passed through the multicast router, such as door locks N+1 and N+2, do not have the resident α's phone MAC address stored because their outgoing interfaces connected to the multicast router's forwarding table have not received "registered MAC" messages). The address is AA:B3:CC:11:22:33, so the "resident away from home" message failed to match the MAC address, causing the router port to drop the message.

[0108] 1) Scenario ① and Scenario ②: Since the MAC address / list of Wi-Fi networks outside the home can match the MAC address of the resident at the router's outgoing interface, the multicast message will be forwarded to the door locks along the route of the router's outgoing interface;

[0109] 2) Scenario 3: Since the list of Wi-Fi MAC addresses / lists for those away from home only includes the visitor's MAC address, it cannot be matched with the resident's MAC address at the router's outgoing interface. Therefore, the multicast message will not be forwarded (because the visitor does not affect the statistics of the resident's time at home).

[0110] 3. Each passing door lock unicasts a "face recognition request" message to the door lock that is leaving the house. The multicast messages in scenarios ① and ② above will be received by the passing door locks (door locks N-1 to door lock 1). First, based on the Wi-Fi MAC address in the message, it determines that the resident of door lock N has left the house, and controls its own pan-tilt camera to turn from the default direction (i.e., towards the stairwell / elevator) towards the direction of resident α's door lock N; then, the passing door lock (such as the currently passing door lock 3) captures the signal of the MAC address (such as resident α) through the Wi-Fi module, and at the same time captures a photo (there may be multiple faces, such as resident α and visitor A / resident α and β, and other residents γ in the same room); finally, it directly sends a "face recognition request" unicast message to the source IP (door lock N). The message content includes: the door lock source IP (the passing door lock 3), a list of face feature vectors (resident α and visitor A / resident α and β, other residents γ), and a list of captured Wi-Fi MAC addresses (the MAC address list of the above 3 people).

[0111] 4. The door lock N determines the identity of the resident leaving home and sends unicast or multicast messages based on whether all confirmed residents have been identified. Specifically, upon receiving the unicast message:

[0112] 1) If the two people leaving home are resident α and visitor A (scenario ②) through lock 4, then the identity of resident α can be confirmed by matching the facial feature vector aa stored in the lock's own lock. Alternatively, the mobile phone address AA:BB:CC:11:22:33 of resident α can be retrieved from the "MAC-face" binding relationship table and found in the list of Wi-Fi MAC addresses in the returned message. Thus, lock N confirms that one of the people leaving home is resident α, and the identity of the other person is still unconfirmed. The current time is recorded as the "time of resident leaving home" as the end point for the statistics of resident α's time at home. Since there is a source IP of the lock (passing through lock 3), a unicast message "confirm MAC address of resident leaving home" is sent to lock 3. The message content includes: lock N, source IP (of lock N), multicast address G, and the Wi-Fi MAC address of the resident α who has left home.

[0113] 2) If the two people leaving home are both residents α and β of lock 4 (i.e., scenario ①), their identities are confirmed by matching their facial feature vectors with those stored on their own lock. Alternatively, querying the "MAC-face" binding table will also retrieve the MAC addresses of α and β, which are both in the list of Wi-Fi MAC addresses returned in the message. Thus, lock N confirms the identities of all those leaving home, and records the current time as the "resident's departure time," serving as the endpoint for calculating the time residents α and β spend at home. Since the identities of all those leaving home have been confirmed, a multicast message "Confirm Departure MAC" is sent to all passing locks. The message content includes: lock N, source IP (of lock N), multicast address G, and the list of Wi-Fi MAC addresses of residents α and β who have left home.

[0114] 5. After receiving a unicast or multicast message, the door lock sends an IGMP leave message to the router. The message contains the Wi-Fi MAC address / list parsed from the "Confirmed Leave MAC" so that the router can immediately delete the MAC address / list and reduce the number of entries in the router's forwarding table.

[0115] Note: If the resident did not take their mobile phone with them when leaving home, the "Resident Away" message will not include the phone's MAC address, and the multicast message range will not be optimized. That is, door lock N automatically sends a multicast "Resident Away" message with a destination address G to the multicast router. This message does not contain the Wi-Fi MAC address. Therefore, this multicast message will be sent throughout the entire multicast group G. All door locks on this floor (including those in opposite directions) within the multicast group will receive the multicast message and rotate their pan / tilt units according to their position relative to door lock N to prepare for capturing the departing resident's face for identity verification.

[0116] This solution achieves the following benefits through collaborative identification and interaction among multiple smart locks:

[0117] 1. Targeted multicast communication reduces device load. Improved IGMP and PIM messages only need to be sent to the door locks that pass through, only instructing the camera pan / tilt unit to rotate, reducing multicast network load and hardware consumption.

[0118] 2. The simplified design of the multicast forwarding table reduces the space occupied by the router. When adding a MAC address via the door lock during the homecoming process, only the verified resident's MAC address will be added to the router's outgoing interface, reducing the space occupied when adding MAC addresses of accompanying visitors. During the leaving process, the door lock promptly sends a unicast or multicast message after the resident's identity is identified, freeing up the MAC address space on the router's outgoing interface as soon as possible.

[0119] 3. Significantly improved accuracy in determining in-home status. Multi-lock collaborative sensing enables full-path identity tracking via "MAC-face," avoiding misjudgments common with single-device detection. For example, facial recognition may be obstructed by multiple people in the same group, and MAC sensing may be affected by the user not having their phone with them or being holding someone else's phone.

[0120] 4. Decentralized architecture, high system stability. Without relying on a centralized server, each lock stores its binding data locally, and the multicast router is only responsible for packet forwarding. Even if some locks or the router experience a brief failure, the remaining locks can still complete identity verification through local collaboration. The system's fault tolerance is significantly better than existing centralized solutions.

[0121] Key technical points of this invention:

[0122] All smart door locks are interconnected and have preset pan-tilt positions; when passing a door lock, the resident's identity is confirmed, and the IGMP join message sent to the multicast router contains only the resident's mobile phone Wi-Fi MAC address / list, reducing the number of entries in the router's forwarding table; the multicast router generates (*, G) entries associated with that MAC address, thereby building a targeted multicast network;

[0123] The steps for verifying a resident's identity when leaving home are as follows: The resident's own door lock sends a multicast message containing the MAC address / list of the resident leaving home; the multicast router forwards the message to the door locks that pass through; the door locks that pass through adjust the pan-tilt-zoom (PTZ) direction and record the face and MAC information, and send the above information back to the resident's own door lock to confirm the resident's identity and length of stay at home.

[0124] After completing the identity verification of all departing residents, the door lock will send a multicast "confirm departing MAC" message; if the door lock only completes the identity verification of some departing residents, it will return a unicast "confirm departing MAC" message.

[0125] When a door lock receives a unicast or multicast message, it sends an IGMP leave message to the router. The message contains the Wi-Fi MAC address / list parsed from the "confirmed away MAC address". The router immediately deletes the MAC address / list to reduce the number of entries in the router's forwarding table.

[0126] As can be seen, based on the facial recognition verification completed by the resident through the smart door lock, a locally stored MAC-face binding relationship table is obtained; based on the resident's movement path from the floor entrance to their own door lock, identity recognition is completed in collaboration with their own door lock through multicast communication, obtaining the identity confirmation result and constructing a directional multicast network; based on the resident's departure event of opening the door lock from inside the house, the passing door locks are triggered to collect the information of the departing person, obtaining the identity confirmation result of the departing person; based on the degree of completion of the departure person's identity confirmation, the own door lock chooses to send a unicast or multicast confirmation message, triggering the passing door locks to send an IGMP leave message to the router, obtaining a simplified multicast forwarding table, thereby realizing seamless identity collaboration throughout the entire process from returning home to leaving home, improving the automation level of home security and user experience.

[0127] Another embodiment of the present invention provides a door lock-assisted identity recognition system, see [link to relevant documentation]. Figure 4 The system may include:

[0128] Configuration module 401 is used for identity binding pre-configuration: based on the face recognition verification completed by the resident through the smart door lock, the resident's face feature vector is bound to its mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table;

[0129] The identification module 402 is used for collaborative identification of the home return path: based on the resident's movement path from the floor entrance to their own door lock, the facial image and WiFi MAC address list are collected from the door locks along the way, and the identification is completed in collaboration with the own door lock through multicast communication to obtain the identity confirmation result and build a directional multicast network;

[0130] The confirmation module 403 is used for triggering the departure event and confirming the identity: based on the departure event of the resident opening the door lock from the inside, the door lock of the resident sends a multicast message containing the number of people leaving home and the WiFi MAC address, triggering the door locks passing by to collect the information of the people leaving home, and obtaining the identity confirmation result of the people leaving home;

[0131] Optimization module 404 is used for dynamic optimization of multicast networks: based on the completion of the identity verification of the person leaving home, the door lock of the home chooses to send a unicast or multicast confirmation message, triggering the door locks passing through to send IGMP leave messages to the router, and obtaining a simplified multicast forwarding table.

[0132] This invention also provides a storage medium storing a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.

[0133] This invention also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0134] Specifically, the aforementioned electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the aforementioned processor, and the input / output device is connected to the aforementioned processor.

[0135] The above description, based on the embodiments shown in the figures, details the structure, features, and effects of the present invention. The above description is only a preferred embodiment of the present invention, but the present invention is not limited to the scope of implementation shown in the figures. Any changes made in accordance with the concept of the present invention, or equivalent embodiments modified to have equivalent changes, that do not exceed the spirit covered by the specification and figures, should be within the protection scope of the present invention.

Claims

1. A door lock-assisted identity recognition method, characterized in that, The method includes: Identity binding pre-configuration: Based on the facial recognition verification completed by the resident through the smart door lock, the resident's facial feature vector is bound to their mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table; Homecoming route identity collaborative recognition: Based on the resident's movement path from the floor entrance to their own door lock, facial images and a list of WiFi MAC addresses are collected from the door locks along the way. Identity recognition is completed in collaboration with their own door lock through multicast communication, and the identity confirmation result is obtained and a directional multicast network is built. Leaving Home Event Triggering and Identity Confirmation: Based on the event of a resident leaving home by unlocking the door from inside the house, the door lock of the resident's own house sends a multicast message containing the number of people leaving home and the WiFi MAC address, triggering the door locks passing by to collect information on the people leaving home, and obtaining the identity confirmation result of the people leaving home; Dynamic optimization of multicast network: Based on the completion of the identity verification of the person leaving home, the door lock of the house can choose to send a unicast or multicast confirmation message, triggering the door locks passing through to send IGMP leave messages to the router, and obtaining a simplified multicast forwarding table.

2. The method according to claim 1, characterized in that, The identity binding pre-configuration includes: Initial authentication: Based on the event that the resident successfully opens the door through the smart door lock's facial recognition, the door lock initiates a binding window and monitors surrounding mobile phone signals; MAC address filtering: Based on the continuously monitored WiFi MAC addresses of mobile phones whose signal strength exceeds the threshold, a binding request is sent to the corresponding mobile phone; Facial feature binding: Based on the facial data collection and verification results completed by the mobile phone user, the verified facial feature vector is associated with the MAC address; Binding relationship storage: Based on the association results, store the binding relationship table of resident name-facial feature vector-MAC address locally on the door lock.

3. The method according to claim 2, characterized in that, The home return path identity collaborative recognition includes: Path information collection: Based on the resident's movement from the floor entrance, the pan-tilt cameras on the door locks along the way collect facial images, and the WiFi module simultaneously captures a list of WiFi MAC addresses; Identification Request Multicast: Based on the collected face image and MAC address list, an identification request message containing this information is sent to the multicast router through the door lock; Identity matching verification: According to the forwarding rules of the multicast router, only the door lock that has been bound to the corresponding MAC address can receive the identification request and perform matching verification between the facial feature vector and the MAC address; Directed multicast network construction: Based on the matching and verification results, each door lock sequentially sends IGMP registration MAC messages to the router, registers the valid resident MAC address at the router's outgoing interface, and constructs a directed multicast network. Homecoming Time Record: Based on the event of a resident arriving at their own door lock and successfully opening the door, the current time is recorded as the homecoming time.

4. The method according to claim 3, characterized in that, The triggering of the departure event and identity verification include: Away from home event detection: The door lock's internal orientation sensor detects an outward opening motion, triggering an away from home event. Away from home multicast message: Based on the away from home event, the door lock of the home sends a multicast message containing the number of people away from home and a list of WiFi MAC addresses to the multicast router; Directed forwarding control: Based on the MAC address matching rules of the multicast router, only door locks that have registered the corresponding MAC address can receive the "Leaving Home" message. PTZ camera rotation and data acquisition: Based on the received message indicating that the person has left home, the camera is controlled by the door lock to rotate in the direction of the door lock and acquire the facial image and MAC address of the person leaving home. Identity verification request: Based on the collected facial image and MAC address, a unicast message requesting facial recognition is sent from the door lock to the door lock outside the home.

5. The method according to claim 4, characterized in that, The dynamic optimization of the multicast network includes: Identity verification decision: Based on the degree of identity verification of the person leaving home by the door lock, decide the type of message to send. Specifically, a multicast confirmation message is sent when all identity verifications are completed, and a unicast confirmation message is sent when some identity verifications are completed. MAC address cleanup: Based on the received confirmation message, the device sends an IGMP leave message to the router through the door lock, thus cleaning up the corresponding MAC address in the router's forwarding table; Table space optimization: Timely cleanup based on MAC addresses reduces the space occupied by router forwarding table entries; Departure Time Record: Based on the identity verification results of the person leaving home, the current time is recorded as the departure time of the corresponding resident.

6. The method according to claim 5, characterized in that, The method also includes the statistics and application of time spent at home: Duration calculation: Calculate the actual time each household spends at home based on the recorded arrival and departure times; Cost sharing: The amount of water and electricity costs shared is calculated based on the proportion of time each household spends at home; Privacy protection: By configuring the door lock camera to be installed only outside the door, information about indoor activities is avoided, ensuring the privacy and security of residents.

7. A door lock-assisted identity recognition system, characterized in that, The system includes: The configuration module is used for identity binding pre-configuration: based on the face recognition verification completed by the resident through the smart door lock, the resident's face feature vector is bound to its mobile phone WiFi MAC address to obtain a locally stored MAC-face binding relationship table; The identification module is used for collaborative identification of the resident's home return path: based on the resident's movement path from the floor entrance to their own door lock, the module collects facial images and a list of WiFi MAC addresses from the door locks along the way, and completes the identification in collaboration with their own door lock through multicast communication, obtains the identity confirmation result, and builds a directional multicast network; The confirmation module is used for triggering and verifying the identity of residents leaving home: based on the event of a resident leaving home by opening the door lock from inside the house, the door lock of the resident's own house sends a multicast message containing the number of people leaving home and the WiFi MAC address, triggering the door locks passing by to collect the information of the people leaving home, and obtaining the identity verification result of the people leaving home; The optimization module is used for dynamic optimization of multicast networks: based on the completion of the identity verification of the person leaving home, the door lock of the house chooses to send a unicast or multicast confirmation message, triggering the door locks passing through to send IGMP leave messages to the router, and obtaining a simplified multicast forwarding table.

8. The system according to claim 7, characterized in that, The configuration module is specifically used for: Initial authentication: Based on the event that the resident successfully opens the door through the smart door lock's facial recognition, the door lock initiates a binding window and monitors surrounding mobile phone signals; MAC address filtering: Based on the continuously monitored WiFi MAC addresses of mobile phones whose signal strength exceeds the threshold, a binding request is sent to the corresponding mobile phone; Facial feature binding: Based on the facial data collection and verification results completed by the mobile phone user, the verified facial feature vector is associated with the MAC address; Binding relationship storage: Based on the association results, store the binding relationship table of resident name-facial feature vector-MAC address locally on the door lock.

9. A storage medium, characterized in that, The storage medium stores a computer program, wherein the computer program is configured to execute the method of any one of claims 1-6 when it is run.

10. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to run the computer program to perform the method of any one of claims 1-6.

Images