A method, system and storage medium for member recognition based on an intelligent door lock

Abstract

The present invention provides a member recognition method, system and storage medium based on an intelligent door lock. By responding to a first operation, a first intelligent door lock captures a first face image, recognizes that the first face image does not belong to a family member corresponding to the first intelligent door lock, marks the arrival of the first face image, and sends a first message to an intelligent door lock platform; by responding to a second operation, the first intelligent door lock captures a first face image, recognizes that the first face image does not belong to a family member corresponding to the first intelligent door lock, marks the departure of the first face image, and sends a second message to the intelligent door lock platform; according to the first message and the second message, the number of times of the first operation and the second operation within a continuous time is determined, and the member corresponding to the first face is determined to be a first temporary member. Compared with the prior art, through the linkage between the door lock and the platform, members can be automatically added; and for temporary members, other door locks are linked for attention and abnormal handling is carried out to achieve security prevention.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent door locks, and more particularly, to a method, system, and storage medium for member recognition based on an intelligent door lock. Background Art

[0002] In the prior art, ordinary door locks also have the ability to convert a face image into a face feature vector through a neural network, store it, and associate it with family members. For family members, when the door lock finds a match in face similarity, it will automatically unlock. However, for non-family members, it will not unlock automatically.

[0003] However, it is rather cumbersome for an administrator to manually enter family members, which is suitable for entering fixed members. For relatives who come to live at home temporarily for a period of time later, it is too troublesome to always rely on manual entry. Summary of the Invention

[0004] The purpose of the embodiments of the present invention is to automatically recognize temporary family members. On the one hand, through the linkage between the door lock and the platform, automatic member addition is realized, avoiding cumbersome operations for users. On the other hand, other door locks are linked to monitor temporary members and perform exception handling.

[0005] The first aspect of the present invention provides a method for member recognition based on an intelligent door lock, the method comprising:

[0006] In response to a first operation, a first intelligent door lock captures a first face image, recognizes that the first face image does not correspond to a family member of the first intelligent door lock, marks the arrival of the first face image, and sends a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark;

[0007] In response to a second operation, the first intelligent door lock captures a first face image, recognizes that the first face image does not correspond to a family member of the first intelligent door lock, marks the departure of the first face image, and sends a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and a departure mark;

[0008] Determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0009] Further, the method further includes a door lock registration step; the door lock registration step includes:

[0010] The intelligent door lock uploads the face images of family members to the door lock management platform respectively;

[0011] The door lock management platform maps the uploaded different family member face images to different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it;

[0012] Determining that the member corresponding to the first face added is a first temporary member includes:

[0013] Associatively storing the first face information, the first smart door lock ID, and the room number information corresponding to the first smart door lock into the temporary member mapping relationship in the mapping relationship.

[0014] Furthermore, the method further includes:

[0015] In response to the second smart door lock adding the first face image as a temporary member, the second smart door lock sends an adding message to the door lock management platform; the adding message includes the first face image, the second smart door lock ID, and the room number information corresponding to the first smart door lock;

[0016] If it is determined that there is a first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with the first smart door lock, then the first smart door lock IP address, the second smart door lock IP address, and the first face image are associated and bound, and the associated binding information is sent to the first smart door lock and the second smart door lock; the second smart door lock includes one or more smart door locks.

[0017] Furthermore, the method further includes:

[0018] If the third smart door lock detects the arrival or departure of the first face image, it generates a temporary user access record and sends it to other associated and bound smart door locks based on the door lock management platform; wherein, the third smart door lock is any one of the first smart door lock and the second smart door lock.

[0019] Furthermore, the method further includes:

[0020] If the third smart door lock detects the arrival of the first face image and does not detect the departure of the first face image; meanwhile, the fourth smart door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third smart door lock and the fourth smart door lock, and controls the third smart door lock and the fourth smart door lock to be temporarily invalid; wherein, the fourth smart door lock is any one of the first smart door lock and the second smart door lock other than the third smart door lock;

[0021] According to the confirmation message replies of the family member APPs of the third smart door lock and the fourth smart door lock, control the third smart door lock and / or the fourth smart door lock to open.

[0022] In addition, a second aspect of the present invention provides a member recognition system based on an intelligent door lock. The system includes a first recognition module, a second recognition module, and a determination module, where:

[0023] The first recognition module is configured to, in response to a first operation, capture a first face image by the first intelligent door lock, recognize that the first face image does not belong to a family member corresponding to the first intelligent door lock, mark the arrival of the first face image, and send a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark;

[0024] The second recognition module is configured to, in response to a second operation, capture a first face image by the first intelligent door lock, recognize that the first face image does not belong to a family member corresponding to the first intelligent door lock, mark the departure of the first face image, and send a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and a departure mark;

[0025] The determination module is configured to determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0026] Furthermore, the system further includes a door lock registration module; the door lock registration module is configured to upload the face images of family members to the door lock management platform according to the intelligent door lock respectively; the door lock management platform maps the uploaded different face images of family members to different family member information, establishes the mapping relationship and stores the family member information, the intelligent door lock ID, the intelligent door lock IP address, and the room number information corresponding to the intelligent door lock;

[0027] Furthermore, the determination module is further configured to associate and store the first face information, the first intelligent door lock ID, and the room number information corresponding to the first intelligent door lock in the temporary member mapping relationship in the mapping relationship.

[0028] Furthermore, the system further includes an association and binding module, which is configured to:

[0029] In response to the second intelligent door lock adding the first face image as a temporary member, the second intelligent door lock sends an adding message to the door lock management platform; the adding message includes the first face image, the second intelligent door lock ID, and the room number information corresponding to the first intelligent door lock;

[0030] If it is determined that there is a first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with a first intelligent door lock, then the IP address of the first intelligent door lock, the IP address of the second intelligent door lock, and the first face image are associated and bound, and the association and binding information is sent to the first intelligent door lock and the second intelligent door lock; the second intelligent door lock includes one or more intelligent door locks.

[0031] Furthermore, the association and binding module is further configured to:

[0032] If the third intelligent door lock detects the arrival of the first face image and does not detect the departure of the first face image; at the same time, the fourth intelligent door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third intelligent door lock and the fourth intelligent door lock, and controls the third intelligent door lock and the fourth intelligent door lock to be temporarily invalid; wherein, the fourth intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock other than the third intelligent door lock;

[0033] According to the confirmation message replies of the family member APPs of the third intelligent door lock and the fourth intelligent door lock, control the third intelligent door lock and / or the fourth intelligent door lock to open.

[0034] In addition, a third aspect of the present invention provides a storage medium, which stores a computer program; the program is loaded and executed by a processor to implement the steps of the member identification method based on an intelligent door lock as described in the first aspect above.

[0035] In the solution of the present invention, in response to a first operation, the first intelligent door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first intelligent door lock, marks the arrival of the first face image, and sends a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark; in response to a second operation, the first intelligent door lock captures a first face image, identifies that the first face image is not a family member corresponding to the first intelligent door lock, marks the departure of the first face image, and sends a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and a departure mark; according to the first message and the second message, determine the number of times of the first operation and the second operation within a continuous time, and determine to add the member corresponding to the first face as a first temporary member. Compared with the prior art, the embodiments of the present application mainly have the following beneficial effects: on the one hand, through the linkage between the door lock and the platform, automatic member addition is realized; on the other hand, when a temporary member becomes a member in a second family, other door locks are immediately linked for attention and abnormal handling is performed to achieve security prevention. Description of the Drawings

[0036] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for use in the embodiments. It should be understood that the following drawings only show some embodiments of the present invention, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other relevant drawings can also be obtained based on these drawings.

[0037] Figure 1 It is a schematic flowchart of the steps of the member identification method based on an intelligent door lock disclosed in the embodiments of the present invention;

[0038] Figure 2 It is a schematic flowchart of the door lock registration steps disclosed in the embodiments of the present invention;

[0039] Figure 3 It is a schematic structural diagram of a member information processing system based on an intelligent door lock disclosed in the embodiments of the present invention;

[0040] Figure 4 It is a schematic structural diagram of an electronic device disclosed in the embodiments of the present invention. Specific Embodiments

[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs; the terms used in the description of the present application in the specification are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification and claims of this application and the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second", etc. in the specification and claims of this application or the above drawings are used to distinguish different objects and not to describe a specific order.

[0042] The mention of "embodiments" in this context means that the specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of this application. The phrase may not necessarily refer to the same embodiment at every occurrence in the specification, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0043] It should be noted that: the "multiple" mentioned herein refers to two or more.

[0044] The following elaborates in detail on the implementation details of the technical solutions of the embodiments of this application:

[0045] At present, intelligent door locks have been installed on the entrance doors of many families in the community (each door lock has an independent ID, door lock IP address, door lock geographical location, etc., and includes a camera and a screen facing the interior of the room). The intelligent door locks of these families are all connected to the network (the door locks are usually connected to the network based on wifi), and are connected to the "door lock management platform" of the community and are managed. Each intelligent door lock registers with the platform and periodically updates necessary information. The platform records the "door lock list" which includes the door lock ID, door lock IP address, door lock geographical location (including building number, floor, etc.), and the information of the affiliated family, etc.

[0046] Intelligent locks with cameras and screens have been installed on the entrance doors of many families in the community. The interconnection and operation of these intelligent locks can bring many value-added services.

[0047] The mobile phones of the owners have installed APPs. Each APP has a unique ID (such as the username + mobile phone number used during registration), and supports reporting the APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP, etc. to the platform and periodically updating necessary information. The platform records the "user list", and the user list includes: serial number, APP-ID, mobile phone NFC-ID, mobile phone wifi mac, the mobile phone IP where the user APP is located, and other user information, etc.

[0048] When the mobile phone APP of the owner registers with the door lock management platform, it needs to carry the door lock ID. After receiving it, the management platform binds the mobile phone APP-ID with the door lock-ID. Obviously, one door lock ID may correspond to the APP-IDs of multiple family members, and one APP-ID may also correspond to multiple door lock IDs. This table is called the APP-door lock association table.

[0049] In addition, the intelligent door lock contains a camera facing the outdoors. Family members can be pre-recorded on the door lock by the administrator. The door lock reports the personnel photos to the "door lock management platform", and the platform maps the family members to personnel feature vectors through a neural network and binds them to the room. Thus, each room will contain the feature vectors of its own members.

[0050] The platform distributes the member feature vectors of each room and the neural network model to the door locks corresponding to the rooms, and the door locks save the member vectors of their own rooms. The door locks also have the ability to convert face images into face feature vectors through a neural network. For family members, when the door lock finds that it is a family member through face similarity comparison, it will automatically unlock. But for non-family members, it will not unlock automatically.

[0051] However, it is rather cumbersome for the administrator to manually enter family members, which is suitable for entering fixed members, as shown in Table 1. For relatives who come to live at home temporarily later, it is too troublesome to always rely on manual entry. Therefore, this embodiment designs a solution that can automatically identify temporary family members.

[0052] In the first aspect of this embodiment, a member recognition method based on an intelligent door lock is implemented. Please refer to Figure 1 , Figure 1 which is a schematic flowchart of a member recognition method based on an intelligent door lock disclosed in an embodiment of the present invention. The method includes:

[0053] S101, in response to a first operation, the first intelligent door lock captures a first face image, recognizes that the first face image does not correspond to a family member of the first intelligent door lock, marks the arrival of the first face image, and sends a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark.

[0054] Further, before the method responds to the first operation, it also includes a door lock registration step; as Figure 2 shown, the door lock registration step includes:

[0055] S001, the intelligent door lock uploads the face images of family members to the door lock management platform respectively;

[0056] S002, the door lock management platform maps the uploaded different face images of family members to different family member information, establishes the mapping relationship between the family member information, the intelligent door lock ID, the intelligent door lock IP address, and the room number information corresponding to the intelligent door lock, and stores it.

[0057] As shown in Table 1, it is the family member information table registered in the door lock management platform. Usually, Member 1 is the father, Member 2 is the mother, and Member 3 is the child. The platform maps family members to person feature vectors through a neural network and binds them to the room. Thus, each room will contain the feature vectors of its own members.

[0058] Table 1 Family Member Information Table

[0059]

[0060] Further, in this embodiment, for example, the current temporary user is a relative.

[0061] When relatives A and B first come to the house and arrive at the door lock 35-2-204, perform the door lock outward opening operation (the first operation); the door lock captures the faces of relatives A and B, and through feature comparison with the face images of family members maintained locally, it is found that they are not family members. Then, the face images of relatives A and B are converted into feature vectors, and a message of "outsiders arriving" is reported to the door lock management platform. The message includes the face feature vectors of relatives A and B, the "arrival" mark, and the arrival time.

[0062] The door lock management platform adds a record in the "temporary personnel table", including the room number, personnel feature vector, behavior content, door lock ID, etc., as shown in Table 2. Among them, the behavior content includes the time and "arrival" or "departure". At the same time, the platform also sends a reminder message of "outsiders arriving" to the APP of family member 1, including the face photos of relatives A and B.

[0063] Table 2 Temporary Personnel Information Table

[0064]

[0065] S102, in response to the second operation, the first intelligent door lock captures the first face image, identifies that the first face image is not a family member corresponding to the first intelligent door lock, marks the first face image as leaving, and sends a second message to the intelligent door lock platform; the second operation is the door lock outward closing operation; the second message includes the second operation time, the first face image, and the leaving mark;

[0066] Specifically, in this embodiment, when relative A goes out and leaves 35-2-204 and the door opens, the door lock can determine whether it is opened from the inside or the outside. Since relative A is going out, the door lock can detect that the door is opened from the inside. Before relative A leaves and closes the door from the outside (the second operation), the door lock will detect the image obtained by the camera. Since relative A faces the door and pushes it shut, the camera of the door lock will detect a face image. The door lock compares the obtained face image with the face images of family members saved locally and finds that it is not a family member, then reports a message of "outsiders leaving" to the door lock management platform. The message includes the face feature vector of relative A and the "leaving" mark. After receiving it, the door lock management platform records the "leaving" information as follows in Table 3 by comparing and finding that the face similarity of relative A in the "temporary personnel table" is higher than the threshold. At the same time, the platform also sends a reminder message of "outsiders leaving" to the APP of family member 1, including the face photos of relatives A and B.

[0067] Table 3 Temporary Personnel Information Table

[0068]

[0069] S103. Determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

[0070] In S103, the determination of adding the member corresponding to the first face as a first temporary member includes: associating and storing the first face information, the first intelligent door lock ID, and the room number information corresponding to the first intelligent door lock into the temporary member mapping relationship in the mapping relationship.

[0071] Specifically, in this embodiment, when the platform discovers that relative A arrives and leaves more than a certain threshold (for example, the number of arrivals + departures exceeds 10 times) within a continuous period of time (such as 2 days or three days or one week, configured by the administrator), it sends a "member addition confirmation" message to the mobile APP of member 1 of the corresponding family.

[0072] After receiving the message, the APP of member 1 determines whether to regard it as a member. If so, it sends a confirmation message; if not, it sends a veto message. After the platform receives the confirmation message, it adds relative A as a member of room 35-2-204, becoming "member 4", but needs to be marked as "temporary", and sends the "temporary" mark of the face feature vector of relative A to door lock 35-2-204. Subsequently, when door lock 35-2-204 discovers the face image of relative A, it no longer sends an "outsider arrival" message to the door lock management platform. The platform also no longer sends messages of "outsider arrival" or "outsider departure" to the member APP.

[0073] In some embodiments, when the member APP receives an "outsider arrival" message from the platform, it can also actively apply to the platform to be automatically added as a family member and send a "member addition" message to the platform, including the face photo of relative A and the room number. After the platform receives the request message, it adds relative A as a member of room 35-2-204, becoming "member 4", but needs to be marked as "temporary", and sends the "temporary" mark of the face feature vector of relative A to door lock 35-2-204. Subsequently, when door lock 35-2-204 discovers the face image of relative A, it no longer sends an "outsider arrival" message to the door lock management platform. The platform also no longer sends messages of "outsider arrival" or "outsider departure" to the member APP.

[0074] Preferably, in some embodiments, the method further includes:

[0075] In response to the second intelligent door lock adding the first face image as a temporary member, the second intelligent door lock sends an addition message to the door lock management platform; the addition message includes the first face image, the second intelligent door lock ID, and the room number information corresponding to the first intelligent door lock;

[0076] If it is determined that there is a first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with a first intelligent door lock, then the IP address of the first intelligent door lock, the IP address of the second intelligent door lock, and the first face image are associated and bound, and the association and binding information is sent to the first intelligent door lock and the second intelligent door lock; the second intelligent door lock includes one or more intelligent door locks.

[0077] Specifically, in this embodiment, when relative A visits 36-1-302 again, the intelligent door lock at 36-1-302 is door lock - 3601302 (i.e., the second intelligent door lock). Member 1 at 36-1-302 applies to the platform to add relative A as a family member and sends a "member addition" message to the platform, which includes the face photo of relative A and the room number. After receiving the request message, the platform adds relative A to the members of room 36-1-302, making it "member 4", but it needs to be marked as "temporary", and the face feature vector of relative A and the "temporary" mark are sent to door lock - 3601302.

[0078] The door lock management platform simultaneously compares the face similarity with the members in the library and finds that the similarity with member 4 in room 35-2-204 exceeds the threshold. Then, it obtains the IP address of door lock 35-2-204 from the door lock list maintained locally and sends the IP address of door lock 35-2-204 to door lock - 3601302; after receiving it, door lock - 3601302 binds the face feature vector of relative A with the IP address of door lock 35-2-204. The platform also sends the face feature vector of relative A and the IP address of door lock - 3601302 to door lock 35-2-204; after receiving it, door lock 35-2-204 binds the face feature vector of relative A with the IP address of door lock - 3601302.

[0079] In addition, since the second intelligent door lock includes one or more intelligent door locks. In some embodiments, relative A can be processed as the third family member.

[0080] When relative A visits 36-1-202 again, member 1 at 36-1-202 applies to the platform to add relative A as a family member and sends a "member addition" message to the platform, which includes the face photo of relative A and the room number. After receiving the request message, the platform adds relative A to the members of room 36-1-202, making it "member 4", but it needs to be marked as "temporary", and the face feature vector of relative A and the "temporary" mark are sent to door lock - 3601202.

[0081] The platform simultaneously compares the facial similarity with the members in the library. If it finds that the similarity with Member 4 in Room 35-2-204 and Member 4 in Room 36-1-302 exceeds the threshold, it obtains the IP address of Door Lock 35-2-204 and the IP address of Door Lock -3601302 from the list of door locks maintained locally, and sends the two IP addresses to Door Lock -3601202; after receiving them, Door Lock -3601202 binds the facial feature vector of Relative A with the IP addresses of Door Lock 35-2-204 and Door Lock -3601302. The platform also sends the facial feature vector of Relative A and the IP address of Door Lock -3601202 to Door Lock 35-2-204 and Door Lock -3601302; after receiving them, Door Lock 35-2-204 and Door Lock -3601302 bind the facial feature vector of Relative A with the IP address of Door Lock -3601202.

[0082] Further, the method further includes: if the third intelligent door lock detects the arrival or departure of the first facial image, it generates a temporary user access record and sends it to other intelligent door locks associated and bound based on the door lock management platform; wherein, the third intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock.

[0083] Specifically, in this embodiment, when Relative A comes to Room 36-1-202 and arrives at Door Lock -3601202, the door lock captures the face of Relative A. By comparing the features with the facial images of family members maintained locally, it finds that it is a "temporary" family member, and then adds an "arrival" record for this member (as shown in Table 4); and sends this record to Door Lock 35-2-204 and Door Lock -3601302 bound to Relative A, and the content includes: the feature vector of Relative A, time m, and "arrival" mark.

[0084] Table 4 Temporary Member Information Table of Door Lock -3601202

[0085]

[0086] After receiving them, Door Lock 35-2-204 and Door Lock -3601302 save them in the "Temporary Member Information Table" locally, as follows:

[0087] Table 5 Temporary Member Information Table of Door Lock -35-2-204

[0088]

[0089] When relative A goes out and leaves 36-1-202, relative A closes the door before leaving. Since relative A pushes the door while facing the door, the camera of the door lock will detect a face image. By comparing the obtained face image with the face images of family members saved locally, the door lock finds that it is a "temporary" family member, and then adds a "leave" record for this member. And send this record to the door lock 35-2-204 and door lock -3601302 bound to relative A, the content includes: the feature vector of relative A, time m, "leave" flag.

[0090] Table 6 Temporary Member Information Table of Door Lock -3601202

[0091]

[0092] Furthermore, preferably, the method further includes:

[0093] If the third intelligent door lock detects the arrival of the first face image and does not detect the departure of the first face image; at the same time, the fourth intelligent door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third intelligent door lock and the fourth intelligent door lock, and controls the third intelligent door lock and the fourth intelligent door lock to be temporarily invalid; wherein, the fourth intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock other than the third intelligent door lock;

[0094] According to the confirmation message reply of the family member APPs of the third intelligent door lock and the fourth intelligent door lock, control the third intelligent door lock and / or the fourth intelligent door lock to open.

[0095] Specifically, in this embodiment, the door lock 35-2-204 detects the arrival of a person. Through face feature comparison, it is found that relative A has arrived. However, by checking the local temporary member information table, it is found that relative A has no leave record, indicating that there may be a problem with one of the relatives A. Then immediately make the door lock temporarily invalid to prevent relative A from entering or leaving, and immediately send a "Please confirm" message to the family member APP of this family.

[0096] It should be noted that the "Please confirm" message includes: the face image of relative A, "Whether to allow entry into the house"; at the same time, check the local temporary member information table to confirm which door lock sent the last arrival record about relative A. For example, if it is sent by the door lock -3601202, then send a "To be confirmed" message to the door lock -3601202, including: the face image of relative A, "Whether relative A is at home"; after receiving it, the door lock -3601202 immediately makes the door lock temporarily invalid to prevent relative A from entering or leaving, and sends a "Please confirm" message to the family member APP of this family, including: the face image of relative A, "Whether at home". After receiving the message from the APP, the family member makes a manual confirmation. If there is an abnormality, report to the police for handling.

[0097] In summary, in this embodiment, through the linkage between the door lock and the platform, automatic member addition is achieved; through the linkage processing between door locks and between the door lock and the APP, abnormal warning is achieved. Through the special processing of "temporary" members, security prevention is achieved; and when a temporary member becomes a member in the second family, other door locks are immediately linked for attention. If an abnormality is found, the relevant linked door locks are temporarily disabled to prevent relatives from entering or leaving, waiting for the owner to confirm. Compared with the prior art, the embodiments of the present application mainly have the following beneficial effects: on the one hand, through the linkage between the door lock and the platform, automatic member addition is achieved; on the other hand, when a temporary member becomes a member in the second family, other door locks are immediately linked for attention and abnormal processing is performed to achieve security prevention.

[0098] In addition, the second aspect of this embodiment provides a member recognition system based on an intelligent door lock. The intelligent door lock includes an external camera, as Figure 3 shown. The system includes a first recognition module 301, a second recognition module 302, and a determination module 303, where:

[0099] The first recognition module 301 is configured to, in response to a first operation, capture a first face image by the first intelligent door lock, identify that the first face image is not a family member corresponding to the first intelligent door lock, mark the arrival of the first face image, and send a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark;

[0100] The second recognition module 302 is configured to, in response to a second operation, capture a first face image by the first intelligent door lock, identify that the first face image is not a family member corresponding to the first intelligent door lock, mark the departure of the first face image, and send a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and a departure mark;

[0101] The determination module 303 is configured to determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine that the member corresponding to the first face is added as a first temporary member.

[0102] Further, the system further includes a door lock registration module 300; the door lock registration module is configured to upload the face images of family members to the door lock management platform according to the intelligent door lock respectively; the door lock management platform maps the uploaded different face images of family members to different family member information, establishes the mapping relationship and stores the family member information, the intelligent door lock ID, the intelligent door lock IP address, and the room number information corresponding to the intelligent door lock;

[0103] Further, the determination module 303 is further configured to associate and store the first face information, the first intelligent door lock ID, and the room number information corresponding to the first intelligent door lock in the temporary member mapping relationship in the mapping relationship.

[0104] Further, the system further includes an association and binding module 304, configured to:

[0105] In response to the second intelligent door lock adding the first face image as a temporary member, the second intelligent door lock sends an adding message to the door lock management platform; the adding message includes the first face image, the second intelligent door lock ID, and the room number information corresponding to the first intelligent door lock;

[0106] If it is determined that there is the first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with the first intelligent door lock, then the IP addresses of the first intelligent door lock, the second intelligent door lock, and the first face image are associated and bound, and the association and binding information is sent to the first intelligent door lock and the second intelligent door lock; the second intelligent door lock includes one or more intelligent door locks.

[0107] Further, the association and binding module 304 is further configured to: if the third intelligent door lock detects the arrival or departure of the first face image, generate a temporary user access record, and send it to other intelligent door locks associated and bound based on the door lock management platform; where the third intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock.

[0108] Further, the association and binding module 304 is further configured to:

[0109] If the third intelligent door lock detects the arrival of the first face image and does not detect the departure of the first face image; at the same time, the fourth intelligent door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third intelligent door lock and the fourth intelligent door lock, and controls the third intelligent door lock and the fourth intelligent door lock to be temporarily invalid; where the fourth intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock other than the third intelligent door lock;

[0110] According to the confirmation message replies of the family member APPs of the third intelligent door lock and the fourth intelligent door lock, control the third intelligent door lock and / or the fourth intelligent door lock to open.

[0111] In addition, a third aspect of this embodiment provides a storage medium, which stores a computer program; the program is loaded and executed by a processor to implement the steps of the member recognition method based on an intelligent door lock as described in the first aspect above.

[0112] In addition, an embodiment of the present application also discloses an electronic device, such as Figure 4As shown, the electronic device includes: one or more processors, and a memory for storing one or more computer programs; characterized in that the computer program is configured to be executed by the one or more processors, and the program includes steps for performing the member identification method based on an intelligent door lock as described in the first aspect above.

[0113] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0114] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed couplings or direct couplings or communication connections to each other can be indirect couplings or communication connections through some interfaces, devices or units, and can also be electrical, mechanical or other forms of connection.

[0115] The units described as separate components may or may not be physically separated. As units, those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0116] In addition, the functional units in various embodiments of the present invention can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0117] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a grid device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs.

[0118] The specific embodiments described above further elaborate on the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only the specific embodiments of the present invention and is not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A member recognition method based on an intelligent door lock, characterized in that, The method includes: In response to a first operation, the first intelligent door lock captures a first face image, identifies that the first face image does not belong to a family member corresponding to the first intelligent door lock, marks the arrival of the first face image, and sends a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and an arrival mark; In response to a second operation, the first intelligent door lock captures a first face image, identifies that the first face image does not belong to a family member corresponding to the first intelligent door lock, marks the departure of the first face image, and sends a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and a departure mark; Determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

2. The member recognition method based on an intelligent door lock according to claim 1, wherein, The method further includes a door lock registration step; the door lock registration step includes: The intelligent door lock uploads the face images of family members to the door lock management platform respectively; The door lock management platform maps the uploaded different face images of family members to different family member information, establishes the mapping relationship and stores the family member information, the intelligent door lock ID, the intelligent door lock IP address, and the room number information corresponding to the intelligent door lock; The determination of adding the member corresponding to the first face as the first temporary member includes: Associatively store the first face information, the first intelligent door lock ID, and the room number information corresponding to the first intelligent door lock into the temporary member mapping relationship in the mapping relationship.

3. The member recognition method based on an intelligent door lock according to claim 2, wherein The method further includes: In response to the second intelligent door lock adding the first face image as a temporary member, the second intelligent door lock sends an adding message to the door lock management platform; the adding message includes the first face image, the second intelligent door lock ID, and the room number information corresponding to the first intelligent door lock; If it is determined that there is a first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with the first intelligent door lock, then associate and bind the first intelligent door lock IP address, the second intelligent door lock IP address, and the first face image, and send the associated binding information to the first intelligent door lock and the second intelligent door lock; the second intelligent door lock includes one or more intelligent door locks.

4. The member recognition method based on an intelligent door lock according to claim 3, wherein, The method further includes: If the third intelligent door lock detects the arrival or departure of the first face image, generate a temporary user access record and send it to other associated and bound intelligent door locks based on the door lock management platform; where the third intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock.

5. The member recognition method based on an intelligent door lock according to claim 4, characterized in that, The method further includes: If the third intelligent door lock detects the arrival of the first face image and does not detect the departure of the first face image; at the same time, the fourth intelligent door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third intelligent door lock and the fourth intelligent door lock, and controls the third intelligent door lock and the fourth intelligent door lock to be temporarily invalid; where the fourth intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock other than the third intelligent door lock; Control the third intelligent door lock and / or the fourth intelligent door lock to open according to the confirmation message reply of the family member APP of the third intelligent door lock and the fourth intelligent door lock.

6. A member recognition system based on an intelligent door lock, characterized in that, The system includes a first recognition module, a second recognition module, and a determination module, where: The first recognition module is used to, in response to a first operation, capture a first face image by the first intelligent door lock, identify that the first face image is not a family member corresponding to the first intelligent door lock, mark the arrival of the first face image, and send a first message to the intelligent door lock platform; the first operation is an operation of opening the door lock outward; the first message includes the first operation time, the first face image, and the arrival mark; The second recognition module is used to, in response to a second operation, capture a first face image by the first intelligent door lock, identify that the first face image is not a family member corresponding to the first intelligent door lock, mark the departure of the first face image, and send a second message to the intelligent door lock platform; the second operation is an operation of closing the door lock outward; the second message includes the second operation time, the first face image, and the departure mark; The determination module is used to determine the number of times of the first operation and the second operation within a continuous time according to the first message and the second message, and determine to add the member corresponding to the first face as a first temporary member.

7. The member identification system based on an intelligent door lock according to claim 6, wherein, The system further includes a door lock registration module; the door lock registration module is used to upload the face images of family members to the door lock management platform according to the intelligent door locks respectively; the door lock management platform maps the uploaded different face images of family members to different family member information, establishes the mapping relationship and stores the family member information, the intelligent door lock ID, the intelligent door lock IP address, and the room number information corresponding to the intelligent door lock; The determination module is further used to store the first face information, the first intelligent door lock ID, and the room number information corresponding to the first intelligent door lock in the temporary member mapping relationship in the mapping relationship.

8. The member recognition system based on an intelligent door lock according to claim 7, wherein The system further includes an association and binding module, which is used for: In response to the second intelligent door lock adding the first face image as a temporary member, the second intelligent door lock sends an adding message to the door lock management platform; the adding message includes the first face image, the second intelligent door lock ID, and the room number information corresponding to the first intelligent door lock; If it is determined that there is a first face image in the temporary member mapping relationship stored in the door lock management platform and it is associated with the first intelligent door lock, then the first intelligent door lock IP address, the second intelligent door lock IP address, and the first face image are associated and bound, and the association and binding information is sent to the first intelligent door lock and the second intelligent door lock; the second intelligent door lock includes one or more intelligent door locks.

9. The member recognition system based on an intelligent door lock according to claim 8, wherein, The association and binding module is further used for: If the third intelligent door lock detects the arrival of the first face image and does not detect the departure of the first face image; at the same time, the fourth intelligent door lock detects the arrival of the first face image, then the door lock management platform sends a confirmation message to the family member APPs of the third intelligent door lock and the fourth intelligent door lock, and controls the third intelligent door lock and the fourth intelligent door lock to be temporarily invalid; where the fourth intelligent door lock is any one of the first intelligent door lock and the second intelligent door lock other than the third intelligent door lock; Control the third intelligent door lock and / or the fourth intelligent door lock to open according to the confirmation message reply of the family member APP of the third intelligent door lock and the fourth intelligent door lock.

10. A storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member identification method based on an intelligent door lock according to any one of claims 1-5.

Images