Member identification method and system based on intelligent door lock and storage medium

Abstract

The invention provides a member identification method and system based on an intelligent door lock and a storage medium. In response to a first operation, a first intelligent door lock captures a first face image, recognizes that the first face image is not a family member corresponding to the first intelligent door lock, marks that the first face image arrives, and sends a first message to an intelligent door lock platform; in response to the second operation, the first intelligent door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first intelligent door lock, marks that the first face image leaves, and sends a second message to the intelligent door lock platform; and determining the times of the first operation and the second operation in continuous time according to the first message and the second message, and determining that the member corresponding to the added first face is a first temporary member. Compared with the prior art, automatic member adding is achieved through linkage of the door lock and the platform; and a temporary member is linked with other door locks to pay attention, abnormity processing is carried out, and safety protection is achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart door locks, and in particular to a member identification method, system and storage medium based on a smart door lock. Background Art

[0002] In the prior art, general door locks also have the ability to convert facial images into facial feature vectors through neural networks, store them, and associate them with family members. For family members, the door lock will automatically unlock if it finds that the person is a family member through facial similarity comparison. However, it will not automatically unlock the door for non-family members.

[0003] However, it is cumbersome for the administrator to manually enter the family members, which is suitable for the entry of fixed members. For relatives who come to live in the home temporarily for a period of time, it is too troublesome to always rely on manual entry. Summary of the invention

[0004] The purpose of the embodiment of the present invention is to provide automatic identification of temporary family members. On the one hand, through the linkage between the door lock and the platform, automatic adding of members is realized to avoid tediousness for users; on the other hand, other door locks are linked to pay attention to temporary members and perform exception processing.

[0005] A first aspect of the present invention provides a member identification method based on a smart door lock, the method comprising: In response to a first operation, the first smart door lock captures a first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the arrival of the first facial image, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes a first operation time, the first facial image, and an arrival mark; In response to the second operation, the first smart door lock captures the first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the first facial image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first facial image, and a leaving mark; Determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0006] Furthermore, the method further includes a door lock registration step; the door lock registration step includes: The smart door lock uploads the facial images of family members to the door lock management platform; The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; The determining to add the member corresponding to the first face as a first temporary member includes: The first facial information, the first smart door lock ID, and the room number information corresponding to the first smart door lock are associated and stored in a temporary member mapping relationship in the mapping relationship.

[0007] Furthermore, the method further comprises: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

[0008] Furthermore, the method further comprises: If the third smart door lock detects the arrival or departure of the first face image, a temporary user access record is generated and sent to other associated and bound smart door locks based on the door lock management platform; wherein the third smart door lock is any one of the first smart door lock and the second smart door lock.

[0009] Furthermore, the method further comprises: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

[0010] In addition, a second aspect of the present invention provides a member identification system based on a smart door lock, the system comprising a first identification module, a second identification module and a determination module, wherein: A first identification module is used for responding to a first operation, the first smart door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the arrival of the first face image, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes a first operation time, the first face image, and an arrival mark; The second recognition module is used for responding to a second operation, the first smart door lock captures the first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the first face image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first face image and the leaving mark; The determination module is used to determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as the first temporary member.

[0011] Furthermore, the system further includes a door lock registration module; the door lock registration module is used to upload family member face images to the door lock management platform according to the smart door lock; the door lock management platform maps the uploaded different family member face images to different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; Furthermore, the determination module is also used to associate and store the first facial information, the first smart door lock ID, and the room number information corresponding to the first smart door lock into a temporary member mapping relationship in the mapping relationship.

[0012] Furthermore, the system further comprises an association binding module, which is used to: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

[0013] Furthermore, the association binding module is also used for: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

[0014] In addition, the third aspect of the present invention provides a storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member identification method based on the smart door lock as described in the first aspect above.

[0015] In the scheme of the present invention, in response to the first operation, the first smart door lock captures the first face image, identifies the first face image as a family member not corresponding to the first smart door lock, marks the first face image as arriving, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes the first operation time, the first face image, and the arrival mark; in response to the second operation, the first smart door lock captures the first face image, identifies the first face image as a family member not corresponding to the first smart door lock, marks the first face image as leaving, and sends a second message to the smart door lock platform; the second operation is an operation of closing the door lock from the outside; the second message includes the second operation time, the first face image, and the leaving mark; according to the first message and the second message, the number of the first operation and the second operation in the continuous time is determined, and the member corresponding to the first face is determined to be added as the first temporary member. Compared with the prior art, the embodiment of the present application has the following beneficial effects: on the one hand, the automatic addition of members is realized through the linkage between the door lock and the platform; on the other hand, when the temporary member becomes a member in the second family, other door locks are immediately linked to pay attention, and abnormal processing is performed to achieve security precautions. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 It is a flowchart of the steps of the member identification method based on the smart door lock disclosed in an embodiment of the present invention; Figure 2 It is a flowchart of the door lock registration steps disclosed in the embodiment of the present invention; Figure 3 It is a schematic diagram of the structure of a member information processing system based on a smart door lock disclosed in an embodiment of the present invention; Figure 4 It is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0018] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of this application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of this application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0019] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0020] It should be noted that the “plurality” mentioned in this article refers to two or more.

[0021] The implementation details of the technical solution of the embodiment of the present application are described in detail below: At present, many families in the community have installed smart door locks on their entrance doors (each door lock has an independent ID, door lock IP address, door lock geographic location, etc., as well as a built-in camera and a screen facing the interior of the room). The smart door locks of these families are connected to the Internet (door locks are usually connected to the Internet based on wifi), and are connected to the community "door lock management platform" and managed. Each smart door lock is registered with the platform and periodically updates the necessary information. The platform records the "door lock list" including the door lock ID, door lock IP address, door lock geographic location (including building number, floor, etc.), family information, etc.

[0022] Many families in the community have installed smart locks with cameras and screens on their entrance doors. The interconnection and operation of these smart locks can bring many value-added services.

[0023] The owner's mobile phone has APP installed. Each APP has a unique ID (such as the user name + mobile phone number used when registering), and supports reporting APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP, etc. to the platform, and periodically updates the necessary information. The platform records the "user list", which includes: serial number, APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP where the user's APP is located, and other user information.

[0024] When the owner's mobile phone APP registers with the door lock management platform, it needs to carry the door lock ID. After receiving it, the management platform binds the mobile phone APP-ID with the door lock-ID. Obviously, one door lock ID may correspond to the APP-ID of multiple family members, and one APP-ID may also correspond to multiple door lock IDs. This table is called the APP-door lock association table.

[0025] In addition, the smart door lock contains a camera facing the outdoors. The administrator can take photos of family members on the door lock in advance, and the door lock will report the photos to the "door lock management platform". The platform will map the family members into human feature vectors through a neural network and bind them to the room. Therefore, each room will contain the feature vectors of its own members.

[0026] The platform sends the member feature vectors and neural network models of each room to the door lock corresponding to the room, and the door lock saves the member vectors of its own room. The door lock also has the ability to convert facial images into facial feature vectors through neural networks. For family members, the door lock will automatically open the door if it finds that the family member is a family member through facial similarity comparison. However, it will not automatically open the door for non-family members.

[0027] However, it is cumbersome for the administrator to manually input family members, which is suitable for the input of fixed members, as shown in Table 1. For relatives who come to live at home temporarily for a period of time, it is too troublesome to always rely on manual input. Therefore, this embodiment designs a solution that can automatically identify temporary family members.

[0028] In the first aspect of this embodiment, a member identification method based on a smart door lock is implemented. Figure 1 , Figure 1 The present invention discloses a method for identifying a member based on a smart door lock. The method includes: S101, in response to a first operation, the first smart door lock captures a first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the arrival of the first facial image, and sends a first message to the smart door lock platform; the first operation is an operation to open the door lock from the outside; the first message includes a first operation time, a first facial image, and an arrival mark.

[0029] Furthermore, the method further includes a door lock registration step before responding to the first operation; Figure 2 As shown, the door lock registration step includes: S001, the smart door lock uploads the facial images of family members to the door lock management platform respectively; S002, the door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it.

[0030] Table 1 shows the family member information table registered by the door lock management platform. Usually, member 1 is the father, member 2 is the mother, and member 3 is the child. The platform maps family members into person feature vectors through a neural network and binds them to the room. Therefore, each room contains the feature vectors of its own members.

[0031] Table 1 Family member information

[0032] Further, in this embodiment, for example, the current temporary user is a relative.

[0033] When relatives A and B come to the house for the first time and arrive at door lock 35-2-204, the door lock is opened from the outside (the first operation); the door lock captures the faces of relatives A and B, and compares the features with the facial images of family members maintained locally. If it is found that they are not family members, the facial images of relatives A and B are converted into feature vectors, and a "outsider arrival" message is reported to the door lock management platform. The message contains the facial feature vectors of relatives A and B + the "arrival" mark + and the time of arrival.

[0034] The door lock management platform adds a record to the "temporary personnel table", including the room number, personnel feature vector, behavior content, door lock ID, etc., as shown in Table 2. The behavior content includes time and "arrival" or "departure". At the same time, the platform will also send a reminder message of "outsiders have arrived" to the APP of family member 1, including the facial photos of relatives A and B.

[0035] Table 2 Temporary staff information table

[0036] S102, in response to a second operation, the first smart door lock captures a first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the first facial image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first facial image, and a leaving mark; Specifically, in this embodiment, when relative A leaves 35-2-204 and the door is opened, the door lock can determine whether it is opened from the inside or from the outside. Since relative A is going out, the door lock can detect that the door is opened from the inside. When relative A closes the door from the outside before leaving (the second operation), the door lock will detect the image obtained by the camera. Since relative A pushes the door facing the door, the camera of the door lock will detect the face image. The door lock compares the obtained face image with the face images of family members saved locally. If it is found that the relative is not a family member, it will report the "outsider leaves" message to the door lock management platform. The message contains the facial feature vector of relative A + the "leave" mark. After receiving the message, the door lock management platform finds that the similarity with the face of relative A in the "temporary staff table" is higher than the threshold through comparison, and then records the "leave" information as shown in Table 3 below. At the same time, the platform will also send a reminder message of "outsider leaves" to the APP of family member 1, which contains the face photos of relatives A and B.

[0037] Table 3 Temporary staff information table

[0038] S103: Determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0039] In S103, the determination to add the member corresponding to the first face as the first temporary member includes: associating and storing the first face information, the first smart door lock ID, and the room number information corresponding to the first smart door lock into the temporary member mapping relationship in the mapping relationship.

[0040] Specifically, in this embodiment, when the platform finds that the number of arrivals and departures of relative A exceeds a certain threshold (for example, the number of arrivals + departures exceeds 10 times) within a continuous period of time (for example, 2 days or three days or a week, configured by the administrator), a "member addition confirmation" message is sent to the mobile APP of member 1 of the corresponding family.

[0041] After receiving the message, the APP of member 1 determines whether it is considered a member. If so, it sends a confirmation message, otherwise, it sends a rejection message. After the platform receives the confirmation message, it adds relative A to the member of room 35-2-204 as "member 4", but it needs to be marked as "temporary", and the facial feature vector of relative A is marked as "temporary" and sent to the door lock 35-2-204. After that, when the door lock 35-2-204 finds the facial image of relative A, it will no longer send the "outsider arrival" message to the door lock management platform. The platform will no longer send "outsider arrival" or "outsider departure" messages to the member APP.

[0042] In some embodiments, when a member APP receives a "outsider arrives" message from the platform, it can also actively apply to the platform to automatically add the member as a family member and send a "member addition" message to the platform, which contains the facial photo and room number of relative A. After the platform receives the request message, it adds relative A to the room 35-2-204 as "member 4", but it needs to be marked as "temporary", and the facial feature vector of relative A is marked as "temporary" and sent to the door lock 35-2-204. Subsequently, when the door lock 35-2-204 finds the facial image of relative A, it will no longer send the "outsider arrives" message to the door lock management platform. The platform will no longer send "outsider arrives" or "outsider leaves" messages to the member APP.

[0043] Preferably, in some embodiments, the method further comprises: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

[0044] Specifically, in this embodiment, when relative A visits room 36-1-302 again, the smart door lock of room 36-1-302 is door lock-3601202 (i.e., the second smart door lock). Member 1 of room 36-1-302 applies to the platform to add relative A as a family member, and sends a "member addition" message to the platform, which includes relative A's face photo and room number. After receiving the request message, the platform adds relative A to room 36-1-302 as "member 4", but needs to be marked as "temporary", and sends relative A's face feature vector and "temporary" mark to door lock-3601302.

[0045] The door lock management platform also compares the facial similarity with the members in the database and finds that the similarity with member 4 in room 35-2-204 exceeds the threshold. It then obtains the IP address of door lock 35-2-204 from the locally maintained door lock list and sends the IP address of door lock 35-2-204 to door lock-3601302. After receiving it, door lock-3601302 binds the facial feature vector of relative A to the IP address of door lock 35-2-204. The platform also sends the facial feature vector of relative A and the IP address of door lock-3601302 to door lock 35-2-204. After receiving it, door lock 35-2-204 binds the facial feature vector of relative A to the IP address of door lock-3601302.

[0046] In addition, since the second smart door lock includes one or more smart door locks, in some embodiments, relative A can become the third family member.

[0047] When relative A visits 36-1-202 again, member 1 of 36-1-202 applies to the platform to add relative A as a family member and sends a "member addition" message to the platform, which contains relative A's face photo and room number. After receiving the request message, the platform adds relative A to the 36-1-202 room as "member 4", but it needs to be marked as "temporary", and sends relative A's face feature vector "temporary" to door lock-3601202.

[0048] The platform also compares the facial similarity with the members in the database and finds that the similarity with member 4 in room 35-2-204 and member 4 in room 36-1-302 exceeds the threshold. It then obtains the IP address of door lock 35-2-204 and the IP address of door lock-3601302 from the locally maintained door lock list and sends the two IP addresses to door lock-3601202. After receiving the IP address, door lock-3601202 binds relative A's facial feature vector to the IP address of door lock 35-2-204 and the IP address of door lock-3601302. The platform also sends relative A's facial feature vector and the IP address of door lock-3601202 to door lock 35-2-204 and door lock-3601302. After receiving the IP address, door lock 35-2-204 and door lock-3601302 bind relative A's facial feature vector to the IP address of door lock-3601202.

[0049] Furthermore, the method also includes: if the third smart door lock detects the arrival or departure of the first face image, a temporary user access record is generated, and sent to other associated and bound smart door locks based on the door lock management platform; wherein the third smart door lock is any one of the first smart door lock and the second smart door lock.

[0050] Specifically, in this embodiment, when relative A comes to room 36-1-202 and reaches door lock 3601202, the door lock captures the face of relative A, and by performing feature comparison on the facial images of family members maintained locally, it is found that the relative is a "temporary" family member, and an "arrival" record is added for the member (as shown in Table 4); and the record is sent to door lock 35-2-204 and door lock 3601302 bound to relative A, and the content includes: relative A's feature vector, time m, and "arrival" mark.

[0051] Table 4 Door lock-3601202 temporary member information table

[0052] After receiving the information, door lock 35-2-204 and door lock 3601302 save it in the local "temporary member information table", as shown in the following table: Table 5 Door lock-35-2-204 temporary member information table

[0053] When relative A leaves 36-1-202, he closes the door before leaving. Since relative A faces the main door and pushes the door shut, the camera of the door lock will detect the face image. The door lock compares the obtained face image with the face image of the family member saved locally. If it is found that the family member is a "temporary" family member, a "leave" record will be added for the family member. The record is sent to the door lock 35-2-204 and door lock-3601302 bound to relative A, and the content includes: relative A's feature vector, time m, and "leave" mark.

[0054] Table 6 Door lock-3601202 temporary member information table

[0055] Furthermore, preferably, the method further comprises: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

[0056] Specifically, in this embodiment, the door lock 35-2-204 detects the arrival of a person, and through facial feature comparison, it is found that it is relative A who has arrived, but when searching the local temporary member information table, it is found that there is no record of relative A leaving, which means that there may be a problem with one of the relatives A (for example, wearing a human skin mask). Then, the door lock is immediately temporarily disabled to prevent relative A from entering or leaving, and a "Please confirm" message is immediately sent to the family member APP.

[0057] It should be noted that the "Please confirm" message contains: the face image of relative A, "Are you allowed to enter the house?"; at the same time, the local temporary member information table is searched to confirm which door lock sent the last arrival record of relative A. For example, if it is sent by door lock-3601202, a "pending confirmation" message is sent to door lock-3601202, containing: the face image of relative A, "Is relative A at home?"; after receiving the message, door lock-3601202 immediately temporarily disables the door lock to prevent relative A from entering or leaving, and sends a "Please confirm" message to the family member APP, containing: the face image of relative A, "Is he at home?". After receiving the message from the APP, the family member manually confirms it, and if there is any abnormality, an alarm is issued.

[0058] In summary, in this embodiment, automatic addition of members is achieved through the linkage between the door lock and the platform; abnormal warning is achieved through the linkage between the door locks and between the door lock and the APP. Security precautions are achieved through special treatment of "temporary" members; and when a temporary member becomes a member of the second family, other door locks are immediately linked to pay attention. If an abnormality is found, the relevant linked door locks are temporarily disabled to prevent relatives from entering or leaving and waiting for the owner's confirmation. Compared with the prior art, the embodiment of the present application has the following beneficial effects: on the one hand, automatic addition of members is achieved through the linkage between the door lock and the platform; on the other hand, when a temporary member becomes a member of the second family, other door locks are immediately linked to pay attention and abnormal processing is performed to achieve security precautions.

[0059] In addition, a second aspect of this embodiment provides a member identification system based on a smart door lock, wherein the smart door lock includes an external camera, such as Figure 3 As shown, the system includes a first identification module 301, a second identification module 302 and a determination module 303, wherein: The first recognition module 301 is used for responding to a first operation, the first smart door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the arrival of the first face image, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes a first operation time, the first face image, and an arrival mark; The second recognition module 302 is used for responding to a second operation, the first smart door lock captures the first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the first face image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first face image, and the leaving mark; The determination module 303 is used to determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0060] Furthermore, the system further includes a door lock registration module 300; the door lock registration module is used to upload family member face images to the door lock management platform according to the smart door lock; the door lock management platform maps the uploaded different family member face images to different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; Furthermore, the determination module 303 is also used to associate and store the first facial information, the first smart door lock ID, and the room number information corresponding to the first smart door lock into a temporary member mapping relationship in the mapping relationship.

[0061] Furthermore, the system further includes an association binding module 304, which is used to: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

[0062] Furthermore, the association and binding module 304 is also used to: if the third smart door lock detects the arrival or departure of the first face image, a temporary user access record is generated, and sent to other associated and bound smart door locks based on the door lock management platform; wherein the third smart door lock is any one of the first smart door lock and the second smart door lock.

[0063] Furthermore, the association binding module 304 is also used for: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

[0064] In addition, the third aspect of this embodiment provides a storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member identification method based on the smart door lock as described in the first aspect above.

[0065] In addition, the present application also discloses an electronic device, such as Figure 4 As shown, the electronic device includes: one or more processors, and a memory, wherein the memory is used to store one or more computer programs; it is characterized in that the computer program is configured to be executed by the one or more processors, and the program includes steps for executing the member identification method based on the smart door lock as described in the first aspect above.

[0066] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0067] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0068] The units described as separate components may or may not be physically separated. As a unit, it can be appreciated by those skilled in the art that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0069] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0070] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a grid device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0071] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A member identification method based on a smart door lock, characterized in that: The method comprises: In response to a first operation, the first smart door lock captures a first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the arrival of the first facial image, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes a first operation time, the first facial image, and an arrival mark; In response to the second operation, the first smart door lock captures the first facial image, identifies that the first facial image is not a family member corresponding to the first smart door lock, marks the first facial image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first facial image, and a leaving mark; Determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

2. The member identification method based on the smart door lock according to claim 1 is characterized in that: The method further includes a door lock registration step; the door lock registration step includes: The smart door lock uploads the facial images of family members to the door lock management platform; The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; The determining to add the member corresponding to the first face as a first temporary member includes: The first facial information, the first smart door lock ID, and the room number information corresponding to the first smart door lock are associated and stored in a temporary member mapping relationship in the mapping relationship.

3. The member identification method based on the smart door lock according to claim 2 is characterized in that: The method further comprises: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

4. The member identification method based on the smart door lock according to claim 3 is characterized in that: The method further comprises: If the third smart door lock detects the arrival or departure of the first face image, a temporary user access record is generated and sent to other associated and bound smart door locks based on the door lock management platform; wherein the third smart door lock is any one of the first smart door lock and the second smart door lock.

5. The member identification method based on the smart door lock according to claim 4 is characterized in that: The method further comprises: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

6. A member identification system based on smart door lock, characterized in that: The system comprises a first identification module, a second identification module and a determination module, wherein: A first identification module is used for responding to a first operation, the first smart door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the arrival of the first face image, and sends a first message to the smart door lock platform; the first operation is an operation of opening the door lock from the outside; the first message includes a first operation time, the first face image, and an arrival mark; The second recognition module is used for responding to a second operation, the first smart door lock captures the first face image, identifies that the first face image is not a family member corresponding to the first smart door lock, marks the first face image as leaving, and sends a second message to the smart door lock platform; the second operation is an external closing operation of the door lock; the second message includes the second operation time, the first face image and the leaving mark; The determination module is used to determine the number of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as the first temporary member.

7. The member identification system based on the smart door lock according to claim 6 is characterized in that: The system also includes a door lock registration module; the door lock registration module is used to upload family member face images to the door lock management platform according to the smart door lock; the door lock management platform maps the uploaded different family member face images to different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; The determination module is also used to associate and store the first facial information, the first smart door lock ID, and the room number information corresponding to the first smart door lock into a temporary member mapping relationship in the mapping relationship.

8. The member identification system based on the smart door lock according to claim 7 is characterized in that: The system further comprises an association binding module, configured to: In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an add message to the door lock management platform; the add message includes the first face image, the second smart door lock ID and the room number information corresponding to the first smart door lock; If it is determined that there is a first facial image in the temporary member mapping relationship stored in the door lock management platform and is associated with a first smart door lock, the first smart door lock IP address, the second smart door lock IP address, and the first facial image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

9. The member identification method based on the smart door lock according to claim 8 is characterized in that: The association binding module is also used for: If the third smart door lock detects the arrival of the first face image, and does not detect the departure of the first face image; at the same time, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily disabled; wherein the fourth smart door lock is any one of the first smart door lock and the second smart door lock except the third smart door lock; According to the confirmation message reply of the family member APP of the third smart door lock and the fourth smart door lock, the third smart door lock and / or the fourth smart door lock are controlled to open.

10. A storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member identification method based on the smart door lock as described in any one of claims 1 to 5.

Images