A member information processing method, system and storage medium based on an intelligent door lock

Abstract

The present invention provides a method, a system and a storage medium for processing member information based on an intelligent door lock. By capturing a first face image and a second face image according to the first intelligent door lock in response to a first unlocking operation, identifying the first face image as a family member corresponding to the first intelligent door lock and the second face image as a non-family member corresponding to the first intelligent door lock, and sending a first message to the door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, the time information and the second face information corresponding to the first intelligent door lock; determining that the second face image is a family member corresponding to the second intelligent door lock according to the door lock management platform, and sending a second message to the second intelligent door lock; the second message includes the room number information, the time information and the family member information corresponding to the first intelligent door lock. Compared with the prior art, based on the interconnection of community door locks, the door locks report the door number information where the members are located, eliminating the anxiety of parents.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent door locks, and more particularly, to a method, system, and storage medium for processing member information based on an intelligent door lock. Background Art

[0002] Currently, primary school students in the same class usually live in the same community. Children often do not go home directly after school but run to their classmates' homes to study or play together, which makes their parents very anxious. Summary of the Invention

[0003] The purpose of the embodiments of the present invention is to eliminate parents' anxiety by connecting community door locks. When a child arrives at or leaves a classmate's home, the door lock reports relevant information, and the platform notifies the door lock of the child's own home of the information.

[0004] A first aspect of the present invention provides a method for processing member information based on an intelligent door lock. The intelligent door lock includes an external camera, and the method includes:

[0005] In response to a first unlocking operation of a first intelligent door lock, capturing a first face image and a second face image, identifying the first face image as a family member corresponding to the first intelligent door lock, and the second face image not being a family member corresponding to the first intelligent door lock, and sending a first message to a door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, time information, and second face information corresponding to the first intelligent door lock;

[0006] According to the door lock management platform, determining that the second face image is a family member corresponding to a second intelligent door lock, and sending a second message to the second intelligent door lock; the second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock.

[0007] Further, the method further includes a door lock registration step; the door lock registration step includes:

[0008] The intelligent door lock uploads the face images of family members to the door lock management platform respectively;

[0009] The door lock management platform maps the uploaded different face images of family members to different family member vectors, establishes the mapping relationship between the family member vectors, intelligent door lock IDs, and the room number information corresponding to the intelligent door locks, and stores the mapping relationship.

[0010] Further, the method further includes: in response to a second unlocking operation of a first intelligent door lock, if a person's external image is captured by the external camera of the first intelligent door lock but no face image is captured, sending a third message to the door lock management platform; the third message includes the person's external image, first face information, second face information, and a departure mark;

[0011] The door lock management platform sends a detection member message according to the third message.

[0012] Furthermore, the door lock management platform sends a detection member message according to the third message, including:

[0013] After receiving the third message, the door lock management platform generates an unknown person departure library according to the first face information, the second face information, the room number information corresponding to the first face, the room number information corresponding to the second face, and the intelligent door lock ID; and sends a detection member message to the corresponding intelligent door lock; the unknown person departure library includes the first face information, the second face information, and the departure time information.

[0014] Furthermore, the method further includes an unknown person departure library update step; the unknown person departure library update step includes:

[0015] If other intelligent door locks registered in the door lock management platform capture the first face information and / or the second face information again, and the first face information and / or the second face information is located in the unknown person departure library, then a status flag is sent to the corresponding first intelligent door lock and / or second intelligent door lock;

[0016] Delete the entry corresponding to the first face information and / or the second face information in the unknown person departure library, and update the unknown person departure library.

[0017] In addition, a second aspect of the present invention provides a member information processing system based on an intelligent door lock. The intelligent door lock includes an external camera. The system includes a first processing module and a second processing module, wherein:

[0018] The first processing module is used to capture a first face image and a second face image according to the first intelligent door lock in response to a first unlocking operation, identify that the first face image is a family member corresponding to the first intelligent door lock, and the second face image is not a family member corresponding to the first intelligent door lock, and send a first message to the door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, time information, and second face information corresponding to the first intelligent door lock;

[0019] The second processing module is used to determine that the second face image is a family member corresponding to the second intelligent door lock according to the door lock management platform, and send a second message to the second intelligent door lock; the second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock.

[0020] Further, the system further includes a door lock registration module; the door lock registration module is used to upload the face images of family members to the door lock management platform by the intelligent door lock respectively; the door lock management platform maps the uploaded different face images of family members into different family member vectors, establishes the mapping relationship between the family member vectors, the intelligent door lock ID, and the room number information corresponding to the intelligent door lock, and stores the mapping relationship.

[0021] Further, the system further includes a third processing module, which is used to send a third message to the door lock management platform if the first intelligent door lock responds to the second unlocking operation and no face image is captured according to the external camera of the first intelligent door lock but a person's external image is captured; the third message includes the person's external image, the first face information, the second face information, and a departure mark.

[0022] The door lock management platform sends a detection member message according to the third message.

[0023] Further, the door lock management platform sends a detection member message according to the third message, including:

[0024] After receiving the third message, the door lock management platform generates an unknown person departure library according to the first face information, the second face information, the room number information corresponding to the first face, the room number information corresponding to the second face, and the intelligent door lock ID; and sends a detection member message to the corresponding intelligent door lock; the unknown person departure library includes the first face information, the second face information, and the departure time information.

[0025] In addition, a third aspect of the present invention provides a storage medium, which stores a computer program; the program is loaded and executed by a processor to implement the steps of the member information processing method based on an intelligent door lock as described in the first aspect above.

[0026] In the solution of the present invention, in response to a first unlocking operation by a first intelligent door lock, a first face image and a second face image are captured. The first face image is recognized as a family member corresponding to the first intelligent door lock, and the second face image is not a family member corresponding to the first intelligent door lock. A first message is sent to the door lock management platform. The first unlocking operation is an outward opening operation. The first message includes the room number information, time information, and second face information corresponding to the first intelligent door lock. According to the door lock management platform, the second face image is determined to be a family member corresponding to a second intelligent door lock, and a second message is sent to the second intelligent door lock. The second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock. Compared with the prior art, the embodiments of the present application mainly have the following beneficial effects: Based on the interconnection of community door locks, when a child member arrives at or leaves a classmate's home, the door lock reports relevant information, and the platform notifies the door lock of the child's own home, facilitating understanding of the current location of the child member, as well as the arrival and departure itinerary, and eliminating parental anxiety. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0028] Figure 1 is a schematic flowchart of the steps of a method for signing for express delivery based on an intelligent door lock disclosed in an embodiment of the present invention;

[0029] Figure 2 is a schematic structural diagram of a member information processing system based on an intelligent door lock disclosed in an embodiment of the present invention;

[0030] Figure 3 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0031] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second", etc. in the specification and claims of this application or the above drawings are used to distinguish different objects and are not used to describe a specific order.

[0032] References herein to "embodiments" mean that particular features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0033] It should be noted that: "a plurality of" as referred to herein means two or more.

[0034] The following elaborates in detail on the implementation details of the technical solutions of the embodiments of the present application:

[0035] Currently, smart door locks are installed on the entrance doors of many families in the community (each door lock has an independent ID, door lock IP address, door lock geographical location, etc., and includes a camera and a screen facing the interior of the room). The smart door locks of these families are all connected to the network (the door locks are usually connected to the network based on wifi) and are connected to the community's "door lock management platform" and are managed. Each smart door lock registers with the platform and periodically updates necessary information. The platform records a "door lock list", which includes the door lock ID, door lock IP address, door lock geographical location (including building number, floor, etc.), and the information of the affiliated family, etc.

[0036] Smart locks with cameras and screens are installed on the entrance doors of many families in the community. The interconnection and operation of these smart locks can bring many value-added services.

[0037] The master's mobile phone has installed an APP. Each APP has a unique ID (such as the username + mobile phone number used during registration), and supports reporting the APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP, etc. to the platform and periodically updating necessary information. The platform records a "user list", and the user list includes: serial number, APP-ID, mobile phone NFC-ID, mobile phone wifi mac, the mobile phone IP where the user APP is located, and other user information, etc.

[0038] When the master's mobile phone APP registers with the door lock management platform, it needs to carry the door lock ID. After receiving it, the management platform binds the mobile phone APP-ID with the door lock-ID. Obviously, one door lock ID may correspond to the APP-IDs of multiple family members, and one APP-ID may also correspond to multiple door lock IDs. This table is called the APP-door lock association table.

[0039] In the first aspect of this embodiment, a method for processing member information based on a smart door lock is implemented. Please refer to Figure 1 , Figure 1It is a schematic flowchart of a method for processing member information based on an intelligent door lock disclosed in an embodiment of the present invention. The method includes:

[0040] S101, in response to a first unlocking operation by the first intelligent door lock, capture a first face image and a second face image, identify the first face image as a family member corresponding to the first intelligent door lock, and the second face image as a non-family member corresponding to the first intelligent door lock, and send a first message to the door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, time information, and second face information corresponding to the first intelligent door lock;

[0041] Further, before the S101, the method further includes a door lock registration step; the door lock registration step includes: the intelligent door lock uploads the face images of family members to the door lock management platform respectively; the door lock management platform maps the uploaded different face images of family members to different family member vectors, establishes the mapping relationship between the family member vectors, the intelligent door lock ID, and the room number information corresponding to the intelligent door lock, and stores them.

[0042] Specifically, in this embodiment, the intelligent door lock is equipped with a camera facing the outdoors. Family members can be pre-recorded on the door lock by the administrator, and the door lock reports the person's photo to the "door lock management platform". The platform maps family members to person feature vectors through a neural network and binds them to the room. Thus, each room will contain the feature vectors of its own members. Usually, member 1 is the father, member 2 is the mother, and member 3 is the child. Table 1 shows a family member information table of this embodiment. One family corresponds to a room number (house number), a set of member feature vectors, and a door lock ID.

[0043] Table 1 Family Member Information Table

[0044]

[0045] The platform distributes the member feature vectors of each room and the neural network model to the door locks corresponding to the rooms, and the door locks save the member vectors of their own rooms. The door locks also have the ability to convert face images into face feature vectors through a neural network.

[0046] For family members, when the door lock finds that it is a family member through face similarity comparison, it will automatically unlock. But for non-family members, it will not automatically unlock.

[0047] Specifically, for the handling of outsiders by the intelligent door lock system, this embodiment is exemplified as follows: When the little master of Room 35-2-204 brings classmate A from Room 36-1-202 and classmate B from Room 36-1-302 to his home. When classmate A and classmate B arrive at the door lock of Room 35-2-204, the door lock starts to perform the outward opening operation (such as fingerprint or face recognition or password input). The door lock captures the faces of classmate A and B, and by comparing the features with the face images of family members maintained locally, it is found that they are not family members. Then, the face images of classmate A and B are converted into feature vectors, and a message of "outsiders arrived" is reported to the door lock management platform. The message includes the face feature vectors of classmate A and B + an "arrived" mark, and carries the current time point as a timestamp.

[0048] The door lock management platform compares the face feature vectors of classmate A and B with all the face feature vectors in the database. It is found that the similarity between classmate A and member 3 of Room 36-1-202 is higher than the threshold (if the similarity is lower than the threshold, it is considered a person not maintained by this management platform and the information is ignored). So, a message "At a certain time point (referring to the current time point), member 3 arrives at Room 35-2-204" is sent to the door lock of Room 36-1-302 (assuming classmate A is member 3 of his own family), and the above timestamp is carried; and it is found that the similarity between classmate B and member 3 of Room 36-1-302 is higher than the threshold (if the similarity is lower than the threshold, it is considered a person not maintained by this management platform and the information is ignored). So, a message "At a certain time point (referring to the current time point), member 3 arrives at Room 35-2-204" is sent to the door lock of Room 36-1-302 (assuming classmate B is member 3 of his own family), and the above timestamp is carried.

[0049] After receiving the message, the door lock of Room 36-1-202 displays the message on the display screen inside the door lock. After receiving the message, the door lock of Room 36-1-302 displays the message on the display screen inside the door lock. Thus, the parents of both families know that their children have gone to the classmate's home in Room 35-2-204.

[0050] S102. Determine that the second face image is a family member corresponding to the second intelligent door lock according to the door lock management platform, and send a second message to the second intelligent door lock; the second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock.

[0051] Specifically, in this embodiment, when classmate A leaves Room 35-2-204, the system needs to notify the door lock of classmate A's home in time so that his parents can know the exact time when the child leaves Room 35-2-204 and keep track of the child's whereabouts.

[0052] When the main door opens, the door lock can determine whether it is opened from the inside or the outside. Since classmate A is leaving home, the door lock can detect that the main door is opened from the inside. Before classmate A leaves and closes the door, the door lock will detect the image obtained by the camera. If classmate A faces the main door and closes it, the camera of the door lock will detect a face image.

[0053] By comparing the obtained face image with the face images of family members saved locally, if the door lock finds that it is not a family member, it will report a message of "outsider leaving" to the door lock management platform. The message includes the face feature vector of classmate A + a "leaving" mark, and carries the current time point as a timestamp.

[0054] After receiving the message, the door lock management platform finds that the relative degree with member 3 in room 36-1-202 is higher than the threshold by comparison. So it sends a message to the door lock 36-1-202 in room 36-1-202: "At a certain time point (select the above timestamp), member 3 left room 35-2-204".

[0055] Further, the method further includes: when the first intelligent door lock responds to the second unlocking operation, if a person's outline image is captured by the external camera of the first intelligent door lock but no face image is captured, a third message is sent to the door lock management platform; the third message includes the person's outline image, the first face information, the second face information, and a leaving mark.

[0056] The door lock management platform sends a detection member message according to the third message.

[0057] Further, the door lock management platform sends a detection member message according to the third message, including:

[0058] After receiving the third message, the door lock management platform generates an unknown person leaving library according to the first face information, the second face information, the room number information corresponding to the first face, the room number information corresponding to the second face, and the intelligent door lock ID; and sends a detection member message to the corresponding intelligent door lock; the unknown person leaving library includes the first face information, the second face information, and the leaving time information.

[0059] Specifically, in this embodiment, when facing the "processing of the door lock system for an outsider leaving without looking back", this embodiment is exemplified as follows:

[0060] However, if classmate A leaves without looking back and the little master is responsible for closing the door, the door lock can only capture an image of a person's back and does not know who it is. So the door lock 35-2-204 reports a message of "unknown person leaving" to the door lock management platform, which includes the face feature vectors of classmate A and classmate B + a "leaving" mark, and a timestamp Z (the content is the current time point).

[0061] After the door lock management platform receives it, an entry A is generated in the "Unknown Person Left the Warehouse", including the face feature vectors of classmate A and classmate B, the timestamp Z, and the room number where they left (35-2-204). Then, "Detect Members" messages are sent to the door locks of classmate A and classmate B respectively, each containing the face feature vector of classmate A and the face feature vector of classmate B.

[0062] Furthermore, the method further includes an update step for the unknown person leaving the warehouse; the update step for the unknown person leaving the warehouse includes:

[0063] If other intelligent door locks registered with the door lock management platform capture the first face information and / or the second face information again, and the first face information and / or the second face information is located in the unknown person leaving the warehouse, then a status flag is sent to the corresponding first intelligent door lock and / or the second intelligent door lock;

[0064] Delete the entry corresponding to the first face information and / or the second face information in the unknown person leaving the warehouse, and update the unknown person leaving the warehouse.

[0065] Specifically, in this embodiment, when classmate A leaves classmate B's home and goes to classmate C's home. When classmate A arrives at classmate C's home (room number 35-2-404), the door lock of classmate C's home detects the face image of classmate A, conducts feature comparison, and finds that it is not a family member maintained locally. Then, the face image of classmate A is converted into a feature vector, and a "Stranger Arrived" message is reported to the door lock management platform. The message contains the face feature vector of classmate A + an "Arrived" flag. The door lock management platform compares the face feature vector of classmate A with the "Unknown Person Left the Warehouse" and finds that the similarity with classmate A in entry A exceeds the threshold. Then, a message "At a certain time point (timestamp Z), member 3 left room 35-2-204" is sent to door lock 36-1-202, and entry A in the "Unknown Person Left the Warehouse" is deleted. Then, a message "At a certain time point (the current time point), member 3 arrived at room 35-2-404" is sent to door lock 36-1-202.

[0066] If classmate A leaves classmate B's home, but doesn't go to classmate C's home and instead directly arrives at his own home, the door lock 36-1-202 detects classmate A's face image and conducts a feature comparison. If it finds that it is a family member maintained locally, it will open the door. At the same time, because the door lock 36-1-202 has received the "detect member" message from the platform, the platform sends a "member arrived" message containing classmate A's face feature vector. The door lock management platform finds that the feature vector of classmate A has a similarity higher than the threshold with the classmate A in the "unknown person left" message reported by the door lock, and then sends a message to the door lock 36-1-202: "At a certain time point (timestamp Z), member 3 left room 35-2-204", and deletes entry A in the "unknown person left database". Then it sends another message to the door lock 36-1-202: "At a certain time point (the current time point), member 3 arrived at room 35-2-404".

[0067] Furthermore, in this embodiment, preferably, a further improved design is proposed:

[0068] When classmate A leaves without looking back, the camera outside the door lock -3502204 can see his back, and thus know the clothes and pants he is wearing. Based on classmate A's back, the door lock -3502204 analyzes and obtains classmate A's structured information, including the colors of clothes, pants, backpack, hair color, length, etc. The door lock -3502204 packs the above structured information and sends it to all the door locks in this building, asking them to pay attention to pedestrians who match the above structured information, capture the corresponding faces, and feedback the feature vectors of these faces to the door lock -3502204, and at the same time, the feedback information carries the time point when the capture is taken.

[0069] The door locks R, U, Y, and X in this building respectively capture faces and feedback the face feature vectors to the door lock -3502204. After receiving them, the door lock -3502204 first sorts the above information based on the time point, which is the door locks R, U, X, Y in sequence, and then analyzes whether the route from the position of this door lock to the door lock Y is reasonable, and eliminates data with low probability (for example, from this lock to the door lock R to the door lock Y is a route to leave downstairs, while the door lock U is upstairs, so the data of the door lock U is eliminated - it is possible that the pedestrian captured by the door lock U has structured information similar to classmate A, such as similar clothing).

[0070] Finally, compare the similarity of the three facial feature vectors from the remaining data. If the pairwise similarity exceeds a certain threshold, then recognize the result and report the "outsider leaving" message to the door lock management platform, including the facial feature vector + leaving mark, and the leaving timestamp information; where the leaving timestamp adopts the time point when classmate A leaves. If the remaining three facial feature vectors are not pairwise similar, then there must be pedestrians wearing similar clothes on the reasonable route, and the above-mentioned facial feature vectors are not adopted. Thus, further, based on the structured information of the leaving personnel and the cooperation of multiple door locks, obtain facial information, accelerate information feedback, and the timestamp is the timestamp when the personnel leave; based on the rationality of the route, eliminate data with low possibility; in multiple feedbacks, if the facial feature vectors are pairwise similar, then adopt them, otherwise eliminate them, thereby further increasing the effect of facial care and detection.

[0071] In summary, in this embodiment, by the first intelligent door lock responding to the first unlocking operation, capturing the first facial image and the second facial image, identifying the first facial image as the family member corresponding to the first intelligent door lock, and the second facial image not being the family member corresponding to the first intelligent door lock, and sending the first message to the door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, time information, and second facial information corresponding to the first intelligent door lock; according to the door lock management platform determining that the second facial image is the family member corresponding to the second intelligent door lock, sending the second message to the second intelligent door lock; the second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock. Through the interconnection of community door locks, when a child member arrives at or leaves a classmate's home, the door lock reports relevant information, and the platform notifies the door lock of the child's own home, facilitating understanding of the current location of the child member, as well as the arrival and departure itinerary, and eliminating parents' anxiety.

[0072] In addition, a second aspect of this embodiment provides a member information processing system based on an intelligent door lock. The intelligent door lock includes an external camera, as Figure 2 shown. The system includes a first processing module 201 and a second processing module 202, where:

[0073] The first processing module 201 is configured to, according to the first intelligent door lock responding to the first unlocking operation, capture the first facial image and the second facial image, identify the first facial image as the family member corresponding to the first intelligent door lock, and the second facial image not being the family member corresponding to the first intelligent door lock, and send the first message to the door lock management platform; the first unlocking operation is an outward opening operation; the first message includes the room number information, time information, and second facial information corresponding to the first intelligent door lock;

[0074] The second processing module 202 is configured to determine, according to the door lock management platform, that the second face image is a family member corresponding to the second intelligent door lock, and send a second message to the second intelligent door lock; the second message includes the room number information, time information, and family member information corresponding to the first intelligent door lock.

[0075] Further, the system further includes a door lock registration module 200; the door lock registration module 200 is configured to upload the face images of family members to the door lock management platform respectively by the intelligent door locks; the door lock management platform maps the uploaded different face images of family members to different family member vectors, establishes the family member vectors, intelligent door lock IDs, and room number information corresponding to the intelligent door locks, and establishes and stores a mapping relationship.

[0076] Further, the system further includes a third processing module 203, configured to, if the first intelligent door lock responds to a second unlocking operation and no face image is captured but a person's external shape image is captured by the external camera of the first intelligent door lock, send a third message to the door lock management platform; the third message includes the person's external shape image, first face information, second face information, and a leaving mark.

[0077] The door lock management platform sends a detection member message according to the third message.

[0078] Further, the door lock management platform sends a detection member message according to the third message, including:

[0079] After receiving the third message, the door lock management platform generates an unknown person leaving library according to the first face information, second face information, room number information corresponding to the first face, room number information corresponding to the second face, and intelligent door lock ID; and sends a detection member message to the corresponding intelligent door lock; the unknown person leaving library includes the first face information, second face information, and leaving time information.

[0080] Further, the system further includes an unknown person leaving library update module; the unknown person leaving library update module is configured to, if other intelligent door locks registered in the door lock management platform capture the first face information and / or second face information again, and the first face information and / or second face information is located in the unknown person leaving library, send a status mark to the corresponding first intelligent door lock and / or second intelligent door lock; delete the entry corresponding to the first face information and / or second face information in the unknown person leaving library, and update the unknown person leaving library.

[0081] In addition, a third aspect of this embodiment provides a storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member information processing method based on an intelligent door lock as described in the first aspect above.

[0082] In addition, an embodiment of the present application also discloses an electronic device, such as Figure 3 shown, the electronic device includes: one or more processors, a memory for storing one or more computer programs; characterized in that the computer programs are configured to be executed by the one or more processors, and the programs include steps for performing the member information processing method based on an intelligent door lock as described in the first aspect above.

[0083] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of the examples have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0084] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed couplings or direct couplings or communication connections to each other can be indirect couplings or communication connections through some interfaces, devices, or units, and can also be electrical, mechanical, or other forms of connection.

[0085] The units described as separate components may or may not be physically separated. As units, those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of the examples have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0086] In addition, in each embodiment of the present invention, each functional unit can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0087] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a grid device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0088] The specific embodiments described above further elaborate on the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above is only the specific embodiment of the present invention and is not used to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A member information processing method based on a smart door lock, characterized in that: The smart door lock includes an external camera, and the method includes: According to the first smart door lock responding to the first unlocking operation, the first face image and the second face image are captured, the first face image is identified as a family member corresponding to the first smart door lock, and the second face image is not a family member corresponding to the first smart door lock, and a first message is sent to the door lock management platform; the first unlocking operation is an external opening operation; the first message includes the room number information corresponding to the first smart door lock, the time information, and the second face information; According to the door lock management platform, the second facial image is determined to be a family member corresponding to the second smart door lock, and a second message is sent to the second smart door lock; the second message includes the room number information, time information, and family member information corresponding to the first smart door lock.

2. The member information processing method based on the smart door lock according to claim 1 is characterized in that: The method further includes a door lock registration step; the door lock registration step includes: The smart door lock uploads the facial images of family members to the door lock management platform; The door lock management platform maps the uploaded facial images of different family members into different family member vectors, establishes the family member vector, smart door lock ID, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it.

3. The member information processing method based on the smart door lock according to claim 2 is characterized in that: The method further includes: according to the first smart door lock responding to the second unlocking operation, if the external camera of the first smart door lock captures the image of the person's appearance but not the image of the face, sending a third message to the door lock management platform; the third message includes the image of the person's appearance, the first face information, the second face information and the leaving mark; The door lock management platform sends a detection member message according to the third message.

4. The member information processing method based on the smart door lock according to claim 3 is characterized in that: The door lock management platform sends a detection member message according to the third message, including: After receiving the third message, the door lock management platform generates an unknown person leaving library based on the first facial information, the second facial information, the room number information corresponding to the first face, the room number information corresponding to the second face, and the smart door lock ID; and sends a detection member message to the corresponding smart door lock; the unknown person leaving library includes the first facial information, the second facial information and the departure time information.

5. The member information processing method based on the smart door lock according to claim 4 is characterized in that: The method further comprises a step of updating the unknown person leaving the database; the step of updating the unknown person leaving the database comprises: If other smart door locks registered on the door lock management platform capture the first face information and / or the second face information again, and the first face information and / or the second face information is in the unknown person leaving database, a status mark is sent to the corresponding first smart door lock and / or second smart door lock; Delete the entries corresponding to the first facial information and / or the second facial information in the unknown person leaving database, and update the unknown person leaving database.

6. A member information processing system based on smart door lock, characterized in that: The smart door lock includes an external camera, and the system includes a first processing module and a second processing module, wherein: A first processing module is used to capture a first face image and a second face image according to the first smart door lock responding to a first unlocking operation, identify the first face image as a family member corresponding to the first smart door lock, and the second face image as a family member not corresponding to the first smart door lock, and send a first message to a door lock management platform; the first unlocking operation is an external opening operation; the first message includes room number information corresponding to the first smart door lock, time information, and second face information; The second processing module is used to determine that the second facial image is a family member corresponding to the second smart door lock based on the door lock management platform, and send a second message to the second smart door lock; the second message includes the room number information, time information, and family member information corresponding to the first smart door lock.

7. The member information processing system based on the smart door lock according to claim 6 is characterized in that: The system also includes a door lock registration module; the door lock registration module is used to upload the facial images of family members to the door lock management platform respectively; the door lock management platform maps the uploaded facial images of different family members into different family member vectors, establishes the family member vector, the smart door lock ID, and the room number information corresponding to the smart door lock, establishes a mapping relationship and stores it.

8. The member information processing system based on the smart door lock according to claim 7 is characterized in that: The system further includes a third processing module, which is used to send a third message to the door lock management platform in response to the second unlocking operation according to the first smart door lock, if the external camera of the first smart door lock captures the image of the person's appearance but does not capture the image of the face; the third message includes the image of the person's appearance, the first face information, the second face information and the leaving mark; The door lock management platform sends a detection member message according to the third message.

9. The member information processing system based on the smart door lock according to claim 8 is characterized in that: The door lock management platform sends a detection member message according to the third message, including: After receiving the third message, the door lock management platform generates an unknown person leaving library based on the first facial information, the second facial information, the room number information corresponding to the first face, the room number information corresponding to the second face, and the smart door lock ID; and sends a detection member message to the corresponding smart door lock; the unknown person leaving library includes the first facial information, the second facial information and the departure time information.

10. A storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the member information processing method based on a smart door lock as described in any one of claims 1 to 5.

Images