Interaction control method and system based on multi-type intelligent locks and storage medium

Abstract

The invention provides an interaction control method and system based on multi-type intelligent locks and a storage medium. The mobile intelligent lock sends pre-stored user face information to the entrance guard by responding to close-range contact between the mobile intelligent lock and the entrance guard of the community; the access control obtains the face information of the user and collects first face image information currently carrying the mobile intelligent lock; and comparing the user face information with the first face image information, and controlling the entrance guard to be opened according to a comparison result. Compared with the prior art, the mobile intelligent lock carried by the user is fully utilized to automatically obtain the user information, so that access of community members is facilitated, privacy leakage is reduced to the maximum extent, and privacy is protected.

Description

Technical Field

[0001] The present invention relates to the technical field of smart door locks, and in particular to an interactive control method, system and storage medium based on multiple types of smart locks. Background Art

[0002] Suitcases, backpacks, etc. can all carry mobile smart locks. These smart locks have their own batteries and can be equipped with SIM cards, WiFi chips, NFC and other smart functions. Each carriage of the train has a WiFi listening function. Cameras in the city also have WiFi listening functions.

[0003] Newer suitcases usually come with smart locks, so if they are left at home for a long time (e.g. a week), it is usually a family member's suitcase. If they are left at home for a short time, it may be a neighbor or friend who is passing by temporarily.

[0004] The existing access control system generally requires the owners to go to the community front desk in advance to enter information such as face or fingerprint, which can easily cause security problems such as leakage of user face information. Summary of the invention

[0005] The purpose of the embodiment of the present invention is to make full use of the mobile smart lock carried by the user to automatically obtain user information, facilitate the entry and exit of community members, and minimize the leakage of user privacy.

[0006] A first aspect of the present invention provides an interactive control method based on multiple types of smart locks, wherein the multiple types of smart locks include smart door locks and mobile smart locks, and the method includes: In response to the close contact between the mobile smart lock and the community access control, the mobile smart lock sends the pre-stored user face information to the access control; wherein, before responding to the close contact between the mobile smart lock and the community access control, it also includes: determining the pre-stored user face information according to the inside opening and outside closing operation of the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock; The access control system obtains the user's facial information and collects the first facial image information of the person currently carrying the mobile smart lock; Compare the user face information and the first face image information, and control the door to be opened according to the comparison result.

[0007] Furthermore, the smart door lock has an indoor WiFi listening function; the mobile smart lock has WiFi; In response to the close contact between the mobile smart lock and the community access control, the method also includes: In response to the user's mobile smart lock carrying a smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; In response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; The smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second face information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second face information; The community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

[0008] Furthermore, the method further comprises: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

[0009] Further, in response to the close contact between the mobile smart lock and the community access control, the method also includes a storage step; the storage step includes: When a user carries a mobile smart lock and opens the door from the outside and closes the door from the inside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; when a user carries a mobile smart lock and opens the door from the inside and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the exit time of the mobile smart lock; Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

[0010] Further, the pre-stored user face information includes the face information set; Comparing the user face information and the first face image information, and controlling the door to be opened according to the comparison result, including: If it is determined that there is a person feature vector in the face information set whose similarity with the first face image information exceeds a preset threshold, the verification is passed and the community access control is controlled to be opened.

[0011] In addition, the second aspect of the present invention provides an interactive control system based on multiple types of smart locks, wherein the multiple types of smart locks include smart door locks and mobile smart locks, and the system includes a first response module, a first control and storage module, an acquisition module, and a comparison and control module, wherein: A first response module, configured to respond to the close contact between the mobile smart lock and the community access control system, and the mobile smart lock sends the pre-stored user face information to the access control system; The first control and storage module is used to determine the pre-stored user face information in response to the close contact between the mobile smart lock and the community access control system, based on the internal opening and external closing operations of the smart door lock carried by the user and the changes in the indoor WiFi MAC address set detected by the smart door lock; An acquisition module is used to control the access control to obtain the user's facial information and collect the first facial image information of the person currently carrying the mobile smart lock; The comparison and control module is used to compare the user's facial information and the first facial image information, and control the door to be opened according to the comparison result.

[0012] Furthermore, the smart door lock has an indoor WiFi listening function; the mobile smart lock has WiFi; The method of determining the pre-stored user face information according to the operation of opening and closing the door inside and outside the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock includes: In response to the user's mobile smart lock carrying a smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; In response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; The smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second face information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second face information; The community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

[0013] Furthermore, the system further comprises an association module, which is used to: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

[0014] Furthermore, the system further comprises a second control and storage module; the second control and storage module is used for: When a user carries a mobile smart lock and opens the door from the outside and closes the door from the inside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; when a user carries a mobile smart lock and opens the door from the inside and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the exit time of the mobile smart lock; Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

[0015] In addition, the third aspect of the present invention provides a storage medium, which stores a computer program; the program is loaded and executed by a processor to implement the steps of the interactive control method based on multiple types of smart locks as described in the first aspect above.

[0016] In the scheme of the present invention, in response to the close contact between the mobile smart lock and the community access control, the mobile smart lock sends the pre-stored user face information to the access control; wherein, before responding to the close contact between the mobile smart lock and the community access control, it also includes: determining the pre-stored user face information according to the operation of opening and closing the door inside the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock; the access control obtains the user face information and collects the first face image information of the current mobile smart lock; compares the user face information and the first face image information, and controls the access control to open according to the comparison result. Compared with the prior art, the embodiment of the present application has the following beneficial effects: making full use of the mobile smart lock carried by the user to automatically obtain user information facilitates the entry and exit of community members, and minimizes privacy leakage and protects privacy. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 It is a flowchart of the steps of the interactive control method based on multiple types of smart locks disclosed in an embodiment of the present invention; Figure 2 It is a flowchart of the method steps before responding to the close contact between the mobile smart lock and the community access control disclosed in the embodiment of the present invention; Figure 3 It is a schematic diagram of the structure of an interactive control system based on multiple types of smart locks disclosed in an embodiment of the present invention; Figure 4 It is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of this application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of this application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0020] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0021] It should be noted that the “plurality” mentioned in this article refers to two or more.

[0022] The implementation details of the technical solution of the embodiment of the present application are described in detail below: In the prior art, families use smart door locks, and with the update and iteration of intelligent products, many smart door locks have face recognition functions. On the other hand, suitcases, backpacks, etc. can carry mobile smart locks, which have their own batteries and can be equipped with sim cards, WiFi chips, NFC functions, etc. In smart door locks, each family's smart door lock records the facial feature vectors of family members. Family members or maintenance personnel enter facial images through the door lock, and the lock extracts the facial feature vectors, making it easier for family members to enter the house through facial verification.

[0023] In this embodiment, the door lock of each family can be registered to the lock management platform of the community, including the door lock ID, door lock IP address, etc. Each access control of the community is also registered to the lock management platform.

[0024] In the first aspect of this embodiment, an interactive control method based on multiple types of smart locks is implemented. Figure 1 , Figure 1 The present invention discloses a flow chart of an interactive control method based on multiple types of smart locks. Multiple types of smart locks include smart door locks and mobile smart locks. The method includes: S101, in response to the close contact between the mobile smart lock and the community access control, the mobile smart lock sends pre-stored user facial information to the access control.

[0025] Among them, in response to the close contact between the mobile smart lock and the community access control, it also includes: determining the pre-stored user face information according to the smart door lock opening and closing operations carried by the user and the smart door lock detecting the changes of the indoor WiFi MAC address set; Among them, according to the operation of opening and closing the door inside and outside the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock, the pre-stored user face information is determined, including: When a user carries a mobile smart lock and opens the door from the outside and closes the door from the inside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; when a user carries a mobile smart lock and opens the door from the inside and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the exit time of the mobile smart lock; Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

[0026] Specifically, in this embodiment, suitcase A has its own smart lock. When it is left at home for a long time (e.g., one week), it is usually a family member's suitcase. Based on this, an interactive trust mode between the door lock and the suitcase is set.

[0027] When family member A0 pulls suitcase A through the front door to enter the home, the family's entrance door lock B obtains the mobile smart lock ID of the suitcase's mobile smart lock A1 through close-range NFC communication, and the entrance door lock B records the ID of mobile smart lock A1 and its entry time. When the suitcase A is pulled out through the front door by a family member, the entrance door lock B records the exit time of mobile smart lock A1. By comparing the exit time and the entry time of mobile smart lock A1, if the difference is greater than a threshold (for example, 1 day or 3 days or a week, which can be managed and configured according to actual needs), it is considered to be a family member's suitcase. Therefore, the entrance door lock B sends the set of family member facial feature vectors that it maintains and saves to the mobile smart lock A1 of the suitcase. Mobile smart lock A1 records the family member feature vector.

[0028] S102, the access control system obtains the user's facial information and collects the first facial image information of the person currently carrying the mobile smart lock.

[0029] Specifically, in this embodiment, when family member A0 arrives at the community access control with large and small bags and suitcase A, it is not convenient to swipe the card. At this time, the mobile smart lock A1 on the suitcase A comes into close contact with the access control, and lock A sends the facial feature vector set of the family members to the access control.

[0030] The access control system obtains a set of facial feature vectors of family members from the mobile smart lock A1. At the same time, the access control system obtains the facial image of the on-site member A0 (i.e., family member A0) who is currently carrying the mobile smart lock A1 through a camera on site, and extracts its facial feature vector.

[0031] S103, comparing the user face information and the first face image information, and controlling the door to be opened according to the comparison result.

[0032] Furthermore, the pre-stored user facial information includes the facial information set.

[0033] Preferably, the user facial information and the first facial image information are compared, and the access control is controlled based on the comparison result, including: if it is determined that there is a person feature vector in the facial information set whose similarity with the first facial image information exceeds a preset threshold, the verification is passed, and the community access control is controlled to be opened.

[0034] Specifically, in this embodiment, the facial feature vector of the on-site member A0 is compared with the set of facial feature vectors obtained from the suitcase through the access control system. If it is found that there is a facial feature vector in the set whose similarity with the facial feature vector of the on-site member A0 is higher than a threshold, it is considered that the match is successful and the access control system allows passage; otherwise, passage is refused.

[0035] Preferably, in order to reduce the number of times that the door lock B assigns the facial feature vectors of all family members to the suitcase, the present embodiment may also have the following preferred solutions: Preferably, the smart door lock has an indoor WiFi listening function; and the mobile smart lock has WiFi.

[0036] In response to the close contact between the mobile smart lock and the community access control, before, Figure 2 As shown, the method also includes: S1001, in response to the user carrying a mobile smart lock and the smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; S1002, in response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; S1003, the smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second facial information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second facial information; Wherein, regarding the generation of the preset mapping relationship, the method further includes: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

[0037] Specifically, for example, the WiFi listening function of the entrance door lock B is deployed on the inside of the door. The entrance door lock B supports face recognition. When each family member performs face recognition and prepares to enter the house, the entrance door lock B detects the WiFi MAC set in the room before opening the door. When the door is opened, the member enters the house and closes the door, and then the entrance door lock B detects the WiFi MAC set in the room again. If a new WiFi MAC with a strong signal is added at this time, the WiFi MAC belongs to the family member. The entrance door lock B binds the facial feature vector of the member to the WiFi MAC. Therefore, the entrance door lock B can obtain the mobile phone WiFi MAC of each member, thereby establishing a preset mapping relationship.

[0038] S1004, the community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

[0039] Specifically, in this embodiment, when member A is ready to go out with a suitcase and presses the door handle, the entrance door lock B detects the WiFi MAC set in the room and temporarily generates a WiFi MAC set X; at the same time, it sends its own door lock ID and door lock IP address to the suitcase mobile smart lock A1.

[0040] When member A0 arrives at the community access control and prepares to go out, the access control reads the door lock ID and IP address from the suitcase and sends a "member going out" message to the door lock B. The door lock B then detects the WiFi MAC set in the room and temporarily generates a WiFi MAC set Y. At this time, Y has one less WiFi MAC than X, and this WiFi MAC is the WiFi MAC of member A0.

[0041] Therefore, door lock B finds the facial feature vector of member A0 based on the missing WiFi MAC, and replies a "member feature write" message to the access control, which contains the facial feature vector of member A0. After receiving it, the access control sends the facial feature vector of member A0 to the luggage lock A through short-range communication. Mobile smart lock A records the facial feature vector of member A0.

[0042] Based on this, in this embodiment, when family member A0 arrives at the community access control with large and small bags and suitcase A, the mobile smart lock A1 of suitcase A comes into close contact with the access control, and the mobile smart lock A1 sends the saved facial feature vector to the access control. The access control obtains the facial image of member A0 through a camera on site and extracts its facial feature vector. The access control compares the facial feature vector of member A0 on site with the facial feature vector obtained from the suitcase. If the similarity is higher than a threshold, it is considered a successful match and the access control allows the person to pass through. Otherwise, the person is refused to pass through.

[0043] In summary, the present embodiment has designed the following technical innovations: 1. The main door lock obtains the time when the suitcase enters and goes out, and determines whether it is a family member's suitcase based on the duration. If so, the facial feature vector set of the family members maintained by itself is sent to the door lock of the suitcase. 2. When the suitcase arrives at the access control, the access control obtains the facial feature vector set of the family members from the suitcase, and confirms whether the facial feature vector of the on-site personnel belongs to a member of the set. If OK, the person is allowed to pass, otherwise he is refused. 3. Door lock B cooperates with the community access control, and obtains the WiFi MAC of member A who goes out through two detections, and writes the facial feature vector of member A into the suitcase lock B through the access control, thereby reducing privacy leakage. Compared with the prior art, the embodiments of the present application have the following beneficial effects: making full use of the mobile smart lock carried by the user to automatically obtain user information facilitates the entry and exit of community members, and minimizes privacy leakage and protects privacy.

[0044] In addition, the second aspect of this embodiment provides an interactive control system based on multiple types of smart locks, wherein the multiple types of smart locks include smart door locks and mobile smart locks, and the system includes a first response module 301, an acquisition module 302, a comparison and control module 303, and a first control and storage module 304, wherein: The first response module 301 is used for responding to the close contact between the mobile smart lock and the community access control, and the mobile smart lock sends the pre-stored user face information to the access control; The acquisition module 302 is used to control the access control to obtain the user's facial information and collect the first facial image information of the person currently carrying the mobile smart lock; The comparison and control module 303 is used to compare the user's facial information and the first facial image information, and control the door to be opened according to the comparison result; The first control and storage module 304 is used to determine the pre-stored user face information in response to the close contact between the mobile smart lock and the community access control, according to the operation of the user carrying the mobile smart lock to open and close the door inside the smart door lock and the change of the indoor WiFi MAC address set detected by the smart door lock; Furthermore, the smart door lock has an indoor WiFi listening function; the mobile smart lock has WiFi; According to the user's mobile smart lock's internal opening and external closing operations and the smart door lock's detection of changes in the indoor WiFi MAC address set, the pre-stored user face information is determined, including: In response to the user's mobile smart lock carrying a smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; In response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; The smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second face information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second face information; The community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

[0045] Furthermore, the system further comprises an association module 305, which is used to: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

[0046] Furthermore, the system further includes a second control and storage module 306; the second control and storage module 306 is used for: When a user carries a mobile smart lock and opens the door from the outside and closes the door from the inside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; when a user carries a mobile smart lock and opens the door from the inside and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the exit time of the mobile smart lock; Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

[0047] Wherein, the pre-stored user face information includes the face information set; Comparing the user face information and the first face image information, and controlling the door to be opened according to the comparison result, including: If it is determined that there is a person feature vector in the face information set whose similarity with the first face image information exceeds a preset threshold, the verification is passed and the community access control is controlled to be opened.

[0048] In addition, the third aspect of the present invention provides a storage medium, which stores a computer program; the program is loaded and executed by a processor to implement the steps of the interactive control method based on multiple types of smart locks as described in the first aspect above.

[0049] In addition, the present application also discloses an electronic device, such as Figure 3 As shown, the electronic device includes: one or more processors, and a memory, wherein the memory is used to store one or more computer programs; it is characterized in that the computer program is configured to be executed by the one or more processors, and the program includes steps for executing the interactive control method based on multiple types of smart locks as described in the first aspect above.

[0050] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0051] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0052] The units described as separate components may or may not be physically separated. As a unit, it can be appreciated by those skilled in the art that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0053] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0054] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a grid device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0055] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An interactive control method based on multiple types of smart locks, characterized in that: The multi-type smart locks include smart door locks and mobile smart locks, and the method includes: In response to the close contact between the mobile smart lock and the community access control, the mobile smart lock sends the pre-stored user face information to the access control; wherein, before responding to the close contact between the mobile smart lock and the community access control, it also includes: determining the pre-stored user face information according to the inside opening and outside closing operation of the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock; The access control system obtains the user's facial information and collects the first facial image information of the person currently carrying the mobile smart lock; Compare the user face information and the first face image information, and control the door to be opened according to the comparison result.

2. The interactive control method based on multiple types of smart locks according to claim 1 is characterized in that: The smart door lock has an indoor WiFi listening function; the mobile smart lock has WiFi; The method of determining the pre-stored user face information according to the operation of opening and closing the door inside and outside the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock includes: In response to the user's mobile smart lock carrying a smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; In response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; The smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second face information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second face information; The community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

3. The interactive control method based on multiple types of smart locks according to claim 2 is characterized in that: The method further comprises: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

4. The interactive control method based on multiple types of smart locks according to claim 1 is characterized in that: In response to the close contact between the mobile smart lock and the community access control, the method also includes a storage step; the storage step includes: When a user carries a mobile smart lock and opens the door from the outside and closes the door from the inside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; when a user carries a mobile smart lock and opens the door from the inside and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the exit time of the mobile smart lock; Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

5. The interactive control method based on multiple types of smart locks according to claim 4 is characterized in that: The pre-stored user face information includes the face information set; Comparing the user face information and the first face image information, and controlling the door to be opened according to the comparison result, including: If it is determined that there is a person feature vector in the face information set whose similarity with the first face image information exceeds a preset threshold, the verification is passed and the community access control is controlled to be opened.

6. An interactive control system based on multiple types of smart locks, characterized in that: The multi-type smart locks include smart door locks and mobile smart locks. The system includes a first response module, a first control and storage module, an acquisition module, and a comparison and control module, wherein: A first response module, configured to respond to the close contact between the mobile smart lock and the community access control system, and the mobile smart lock sends the pre-stored user face information to the access control system; The first control and storage module is used to determine the pre-stored user face information in response to the close contact between the mobile smart lock and the community access control system, based on the internal opening and external closing operations of the smart door lock carried by the user and the changes in the indoor WiFi MAC address set detected by the smart door lock; An acquisition module is used to control the access control to obtain the user's facial information and collect the first facial image information of the person currently carrying the mobile smart lock; The comparison and control module is used to compare the user's facial information and the first facial image information, and control the door to be opened according to the comparison result.

7. The interactive control system based on multiple types of smart locks according to claim 6 is characterized in that: The smart door lock has an indoor WiFi listening function; the mobile smart lock has WiFi; The method of determining the pre-stored user face information according to the operation of opening and closing the door inside and outside the smart door lock carried by the user and the change of the indoor WiFi MAC address set detected by the smart door lock includes: In response to the user's mobile smart lock carrying a smart door lock opening and closing operation, the smart door lock detects the current indoor WiFi MAC address set, generates a temporary WiFi MAC address set, and sends the smart door lock ID and smart door lock IP address to the mobile smart lock carried by the current user; In response to the close contact between the mobile smart lock and the community access control, the community access control reads the smart door lock ID and the smart door lock IP address from the mobile smart lock, and sends an exit message to the smart door lock; The smart door lock detects the current indoor WiFi MAC address set according to the exit message and compares it with the temporary WiFi MAC address set, and uses the WiFi MAC address missing from the temporary WiFi MAC address set as the WiFi MAC address of the current user; the smart door lock determines that the current user's face is the second face information according to the current user's WiFi MAC address and the preset mapping relationship, and returns a write message to the community access control; the write message includes the second face information; The community access control sends the second facial information to the mobile smart lock, and the mobile smart lock stores the second facial information as pre-stored user facial information.

8. The interactive control system based on multiple types of smart locks according to claim 7 is characterized in that: The system further comprises an association module, configured to: In response to the smart door lock opening operation, a first facial image is captured. At the same time, changes in the indoor WiFi MAC address set before and after the smart door lock is opened and closed are monitored to obtain a first WiFi MAC address corresponding to the newly added mobile smart lock; the first facial image information and the first WiFi MAC address are associated to generate the preset mapping relationship.

9. The interactive control system based on multiple types of smart locks according to claim 6, characterized in that: The system further comprises a second control and storage module; the second control and storage module is used for: When a user carries a mobile smart lock and opens and closes the door from the outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the entry time of the mobile smart lock; When a user carries a mobile smart lock and opens and closes the door from the inside or outside, the smart door lock obtains the mobile smart lock ID through short-range communication and records the time when the mobile smart lock was used. Compare the entry time and the exit time. If the difference exceeds a preset time value, it is determined that the mobile smart lock is owned by a member of the smart door lock; then the smart door lock ID and the stored set of facial information of all family members are sent to the mobile smart lock, and the mobile smart lock stores the smart door lock ID and the set of facial information of family members.

10. A storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the interactive control method based on multiple types of smart locks as described in any one of claims 1 to 5.

Images