A personnel monitoring method, system and storage medium based on intelligent door lock

Abstract

The present invention provides a personnel monitoring method, system and storage medium based on smart door locks. In response to a first operation or a second operation, the first smart door lock captures a first face image, determines that the first face image is a member of a preset category corresponding to the first smart door lock, starts a personnel monitoring function, and records and sends a first monitoring message to a door lock management platform; if the first smart door lock does not capture the first face image within a predetermined time after starting the personnel monitoring function, a second monitoring message is sent to the door lock management platform; and the door lock management platform sends a second monitoring message to the first family member APP associated with the first smart door lock ID. Compared with the prior art, the door lock judges the records of preset type personnel going out and leaving based on the personnel monitoring method of the smart door lock, which is convenient for real-time monitoring; through the collaboration between door locks, collaborative attention between door locks is achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart door locks, and in particular to a personnel monitoring method, system and storage medium based on a smart door lock. Background Art

[0002] In the prior art, smart door locks generally have face recognition functions. For family members, the door lock will automatically unlock if it finds that the person is a family member through face similarity comparison. However, for non-family members, the door will not be unlocked automatically. At present, there are many monitoring methods for elderly people living alone, but they cannot accurately determine the entry and exit status of people and the reminders, and the door locks cannot achieve coordinated attention. Summary of the invention

[0003] The purpose of the embodiment of the present invention is to provide a method for making judgments by monitoring the going out and leaving records of the concerned type of persons through door locks, so as to realize timely alarm; and to realize coordinated attention between door locks.

[0004] A first aspect of the present invention provides a personnel monitoring method based on a smart door lock, the method comprising:

[0005] In response to the first operation or the second operation, the first smart door lock captures the first face image, determines that the first face image is a member of the preset category corresponding to the first smart door lock, starts the personnel monitoring function, and records and sends a first monitoring message to the door lock management platform; the first operation is an operation of opening the door lock from the outside; the second operation is an operation of closing the door lock from the outside; the first monitoring message includes the time when the first face image performs the first operation or the second operation, and the first smart door lock ID;

[0006] If the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is activated, a second monitoring message is sent to the door lock management platform;

[0007] The door lock management platform sends a second monitoring message to the first family member APP associated with the first smart door lock ID.

[0008] Furthermore, the method further includes a door lock registration step; the door lock registration step includes:

[0009] The smart door lock uploads the facial images of family members to the door lock management platform;

[0010] The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

[0011] Furthermore, the second monitoring message includes a long-time absence message and a long-time absence message; if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started, sending the second monitoring message to the door lock management platform includes:

[0012] In response to the first operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform.

[0013] Furthermore, the method further includes a first association monitoring step; the first association monitoring step includes:

[0014] Sending a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes the first face image, the first smart door lock ID, and the second smart door lock ID;

[0015] The door lock management platform determines the second smart door lock IP address and the second family member APP corresponding to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP;

[0016] In response to the second smart door lock capturing the first face image, sending an arrival / departure message to the first smart door lock, and forwarding the message to the first family member APP by the first smart door lock;

[0017] According to the association monitoring confirmation message of the first smart door lock returned by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

[0018] The method further comprises a second association monitoring step, wherein the second association monitoring step comprises:

[0019] In response to the inner opening operation of the first smart door lock and the first smart door lock not capturing the first face image; the first smart door lock broadcasts a missing person message to other door locks registered on the door lock management platform; the missing person message includes the first face image, feedback duration, and the first smart door lock IP;

[0020] If the other door locks detect the first face image based on the missing person message and within the predetermined feedback time, they will send a found message to the first smart door lock, which will be forwarded by the first smart door lock to the first family member APP; the found message includes the ID of the other door lock and the house number of the other door lock.

[0021] In addition, the second aspect of the present invention provides a personnel monitoring system based on a smart door lock, the system comprising a monitoring module, a first sending module, and a second sending module; wherein:

[0022] A monitoring module, configured to respond to a first operation or a second operation, the first smart door lock captures a first face image, determines that the first face image is a member of a preset category corresponding to the first smart door lock, starts a personnel monitoring function, and records and sends a first monitoring message to a door lock management platform; the first operation is an operation of opening the door lock from the outside; the second operation is an operation of closing the door lock from the outside; the first monitoring message includes the time when the first face image performs the first operation or the second operation, and the first smart door lock ID;

[0023] A first sending module, configured to send a second monitoring message to a door lock management platform if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started;

[0024] The second sending module is used to send a second monitoring message to the first family member APP associated with the first smart door lock ID according to the door lock management platform.

[0025] Furthermore, the system further includes a door lock registration module; the door lock registration module is used to:

[0026] The smart door lock uploads the facial images of family members to the door lock management platform;

[0027] The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

[0028] Furthermore, the second monitoring message includes a long-time absence message and a long-time absence message; if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started, sending the second monitoring message to the door lock management platform includes:

[0029] In response to the first operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform.

[0030] Furthermore, the system further includes a first association monitoring module; the first association monitoring module is used to:

[0031] Sending a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes the first face image, the first smart door lock ID, and the second smart door lock ID;

[0032] The door lock management platform determines the second smart door lock IP address and the second family member APP corresponding to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP;

[0033] In response to the second smart door lock capturing the first face image, sending an arrival / departure message to the first smart door lock, and forwarding the message to the first family member APP by the first smart door lock;

[0034] According to the association monitoring confirmation message of the first smart door lock returned by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

[0035] In addition, the third aspect of the present invention provides a storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the personnel monitoring method based on the smart door lock as described in the first aspect above.

[0036] In the solution of the present invention, by responding to the first operation or the second operation, the first smart door lock captures the first face image, determines that the first face image is a member of the preset category corresponding to the first smart door lock, starts the personnel monitoring function, records and sends the first monitoring message to the door lock management platform; the first operation is the door lock opening operation; the second operation is the door lock closing operation; the first monitoring message includes the time of executing the first operation or the second operation of the first face image and the first smart door lock ID; if the first smart door lock does not capture the first face image within the predetermined time after starting the personnel monitoring function, the second monitoring message is sent to the door lock management platform; the door lock management platform sends the second monitoring message to the first family member APP associated with the first smart door lock ID. Compared with the prior art, the embodiment of the present application has the following beneficial effects: on the one hand, the door lock judges the records of the elderly going out and leaving, which is convenient for real-time monitoring; on the other hand, through the collaboration between the door locks, the collaborative attention between the door locks is realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0038] Figure 1 It is a flowchart of the steps of the personnel monitoring method based on the smart door lock disclosed in an embodiment of the present invention;

[0039] Figure 2 It is a flowchart of the door lock registration steps disclosed in the embodiment of the present invention;

[0040] Figure 3 Schematic diagram of the structure of a personnel monitoring system based on a smart door lock disclosed in an embodiment of the present invention; DETAILED DESCRIPTION

[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of this application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of this application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0042] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0043] It should be noted that the “plurality” mentioned in this article refers to two or more.

[0044] The implementation details of the technical solution of the embodiment of the present application are described in detail below:

[0045] At present, many families in the community have installed smart door locks on their entrance doors (each door lock has an independent ID, door lock IP address, door lock geographic location, etc., as well as a built-in camera and a screen facing the interior of the room). The smart door locks of these families are connected to the Internet (door locks are usually connected to the Internet based on wifi), and are connected to the community "door lock management platform" and managed. Each smart door lock is registered with the platform and periodically updates the necessary information. The platform records the "door lock list" including the door lock ID, door lock IP address, door lock geographic location (including building number, floor, etc.), family information, etc.

[0046] Many families in the community have installed smart locks with cameras and screens on their entrance doors. The interconnection and operation of these smart locks can bring many value-added services.

[0047] The owner's mobile phone has APP installed. Each APP has a unique ID (such as the user name + mobile phone number used when registering), and supports reporting APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP, etc. to the platform, and periodically updates the necessary information. The platform records the "user list", which includes: serial number, APP-ID, mobile phone NFC-ID, mobile phone wifi mac, mobile phone IP where the user's APP is located, and other user information.

[0048] When the owner's mobile phone APP registers with the door lock management platform, it needs to carry the door lock ID. After receiving it, the management platform binds the mobile phone APP-ID with the door lock-ID. Obviously, one door lock ID may correspond to the APP-ID of multiple family members, and one APP-ID may also correspond to multiple door lock IDs. This table is called the APP-door lock association table.

[0049] In addition, the smart door lock contains a camera facing the outdoors. The administrator can take photos of family members on the door lock in advance, and the door lock will report the photos to the "door lock management platform". The platform will map the family members into human feature vectors through a neural network and bind them to the room. Therefore, each room will contain the feature vectors of its own members.

[0050] The platform sends the member feature vectors and neural network models of each room to the door lock corresponding to the room, and the door lock saves the member vectors of its own room. The door lock also has the ability to convert facial images into facial feature vectors through neural networks. For family members, the door lock will automatically open the door if it finds that the family member is a family member through facial similarity comparison. However, it will not automatically open the door for non-family members.

[0051] In the first aspect of this embodiment, a method for monitoring people based on a smart door lock is implemented. This embodiment can be applied to the home of an elderly person living alone, where family members may not be able to look after the elderly person all the time. Figure 1 , Figure 1 1 is a flow chart of a method for monitoring personnel based on a smart door lock disclosed in an embodiment of the present invention. The method comprises:

[0052] S101, in response to a first operation or a second operation, the first smart door lock captures a first face image, determines that the first face image is a member of a preset category corresponding to the first smart door lock, starts a personnel monitoring function, and records and sends a first monitoring message to a door lock management platform; the first operation is an operation of opening the door lock from the outside; the second operation is an operation of closing the door lock from the outside; the first monitoring message includes the time when the first face image performs the first operation or the second operation, and the first smart door lock ID;

[0053] Specifically, in this embodiment, the preset category members can be elderly people who are over a certain age, such as 70 years old, who can be the members to be monitored. The smart lock can record the time when the elderly living alone leave or enter the door.

[0054] Specifically, in this embodiment, when an elderly person performs an operation to open or close the door lock from the outside, the elderly person's facial image is captured and it is determined that the elderly person is an elderly person (a member of a preset category, a person who needs to be monitored), then the personnel monitoring function is activated, and a first monitoring message is recorded and sent to the door lock management platform.

[0055] In some embodiments, if an elderly person has not left the house for several days, that is, the door lock has not detected the elderly person's face (i.e., the first face image) when the door is opened from the inside for several consecutive days, then a "no leaving for several consecutive days" message is reported to the door lock management platform, which contains the feature vector of the elderly person's face, the date and time when the elderly person was last detected entering the door, and the door lock ID of the elderly person. If an elderly person has not entered the house for several days, that is, the door lock has not detected the door being opened by scanning the elderly person's face (i.e., the first face image) from the outside for several consecutive days, then a "no entry for several consecutive days" message is reported to the door lock management platform, which contains the feature vector of the elderly person's face, the date and time when the elderly person was last detected leaving the door, and the door lock ID of the elderly person.

[0056] Furthermore, the method further comprises a door lock registration step; Figure 2 As shown, the door lock registration step includes:

[0057] S201, the smart door lock uploads the facial images of family members to the door lock management platform respectively;

[0058] S202, the door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

[0059] Table 1 shows the family member information table registered on the door lock management platform. Usually, member 1 is the father, member 2 is the mother, member 3 is the child, and member 4 is the grandmother. Among them, member 4 is over a certain age, such as 70 years old, and can be a member to be monitored. The platform maps family members into person feature vectors through a neural network and binds them to the room. Therefore, each room will contain the feature vectors of its own members.

[0060] Table 1 Family member information

[0061]

[0062] S102: If the first smart door lock does not capture the first facial image within a predetermined time after the personnel monitoring function is started, a second monitoring message is sent to the door lock management platform.

[0063] S103: Send a second monitoring message to the first family member APP associated with the first smart door lock ID according to the door lock management platform.

[0064] Further, preferably, the second monitoring message includes a long absence message and a long absence message. Further, preferably, if the first smart door lock does not capture the first facial image within a predetermined time after the personnel monitoring function is started, the second monitoring message is sent to the door lock management platform, including: in response to the first operation, if the first smart door lock does not capture the first facial image within a predetermined time after the personnel monitoring function is started, the long absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within a predetermined time after the personnel monitoring function is started, the long absence message is sent to the door lock management platform.

[0065] Specifically, in this embodiment, if the elderly only have entry records but no exit records, a message of "the elderly has not left for several consecutive days" will be reported to the door lock management platform. After receiving the message, the platform will find all APP-IDs associated with the door lock ID from the APP-door lock association table, and send the message of "the elderly has not left for many days" to these APP-IDs, thereby attracting the timely attention of the family.

[0066] If the elderly only have records of going out but no records of entering, the message "no entry for several consecutive days" will be reported to the door lock management platform. After receiving the message, the platform will find all APP-IDs associated with the door lock ID from the APP-door lock association table and send the message "the elderly have not entered for many days" to these APP-IDs, thereby attracting the family's timely attention.

[0067] Further, preferably, the method further comprises a first association monitoring step; the first association monitoring step comprises:

[0068] Sending a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes the first face image, the first smart door lock ID, and the second smart door lock ID;

[0069] The door lock management platform determines the second smart door lock IP address and the second family member APP corresponding to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP;

[0070] In response to the second smart door lock capturing the first face image, sending an arrival / departure message to the first smart door lock, and forwarding the message to the first family member APP by the first smart door lock;

[0071] According to the association monitoring confirmation message of the first smart door lock returned by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

[0072] Specifically, in this embodiment, for elderly A living alone, neighbors should take care of each other, and privacy should give way to safety. Children submit a "take care of family" message (i.e., a monitoring request message) to the platform in the APP, which contains the facial feature vector of the elderly and the elderly door lock ID (assuming it is door lock 1) and the neighbor door lock ID that they want to associate with the monitoring. After receiving it, the door lock management platform finds the door lock IP address corresponding to the elderly door lock ID from the door lock list, and sends a request message to the APP corresponding to the neighbor door lock ID. After the neighbor door lock APP (the second family member APP) agrees, an association message is sent to the neighbor door lock to realize the association between the elderly door lock and the neighbor door lock. In this way, the function of neighbors helping to perform elderly monitoring can be performed.

[0073] When the elderly door lock and the neighbor's door lock are associated, the elderly's face feature vector, door lock ID and door lock IP address are sent to other door locks in the community. After receiving, other door locks save the elderly's face feature vector, and the associated message includes the face feature vector, elderly door lock ID and elderly door lock IP.

[0074] When the elderly person goes out and closes the door without facing the door lock, and the door lock does not even detect the back, there is no record of this going out. If the elderly person visits the neighbor's house and stays for a few days or a period of time, the platform will alarm the children's APP, which is obviously a false alarm. In order to eliminate this misunderstanding, when the elderly person arrives at the neighbor's door lock and faces the neighbor's door lock B, the neighbor's door lock will record the elderly person's face. Through face comparison, if it is found that the similarity with the elderly person A living alone exceeds the threshold, it will send an "elderly arrival" message to the elderly door lock and the member APP corresponding to the elderly door lock. The elderly door lock will record the elderly person's arrival at the neighbor's house corresponding to the neighbor's door lock ID, and will not think that the elderly person has been away for many days and alarm.

[0075] In some embodiments, when the elderly arrive at the neighbor's house, a corresponding message can be sent to the elderly door lock, and the member APP corresponding to the elderly door lock sends a "elderly arrival" message. The member APP can return the associated monitoring confirmation message of the first smart door lock and cancel the monitoring function of the elderly. This is because the elderly has lived in the neighbor's house for a few days and has not gone out. Since there is someone taking care of the neighbor's house, the police should not be called.

[0076] In some embodiments, the following design can be supplemented: when door lock B has not detected the elderly person's face leaving for many days, before triggering the sending of the "elderly person has not left for many days" message to the platform, it is first determined whether door lock B has recorded the departure and entry records of family members in these days. If so and it does not exceed the threshold of no records, it is not necessary to send the "elderly person has not left for many days" message to the platform, otherwise the message will be sent.

[0077] The method further comprises a second association monitoring step, wherein the second association monitoring step comprises:

[0078] In response to the inner opening operation of the first smart door lock and the first smart door lock not capturing the first face image; the first smart door lock broadcasts a missing person message to other door locks registered on the door lock management platform; the missing person message includes the first face image, feedback duration, and the first smart door lock IP;

[0079] If the other door locks detect the first face image based on the missing person message and within the predetermined feedback time, they will send a found message to the first smart door lock, which will be forwarded by the first smart door lock to the first family member APP; the found message includes the ID of the other door lock and the house number of the other door lock.

[0080] Specifically, in this embodiment, if the elderly go out, the door lock of his own house does not capture the elderly face, but the door lock can sense that the door is opened. The elderly went to live in a neighbor's house for a few days, and the neighbor helped to open the door, resulting in the neighbor's door lock not capturing the elderly face. At this time, the door lock of his own house, door lock-old, cannot determine whether the elderly really went out. In order to determine the true situation, door lock-old actively broadcasts a "delayed person search message" containing the elderly's facial feature vector, the time required for feedback (for example, feedback must be given within 12 hours), and its own IP address; all neighbor door locks, including the door locks of the neighbors where the elderly go, will save the elderly's facial feature vector (and mark it with a "follow" mark) and the IP address of door lock-old after receiving it, and pay attention to the facial feature vector for 12 hours to see if the corresponding facial feature vector can be captured. If captured, a "found message" will be broadcast.

[0081] The camera inside the door lock of the neighbor's house captured the elderly's face within 12 hours. After comparison, it was confirmed that the elderly person was indeed the elderly person. Then a "found message" was sent to the door lock-old, which contained the elderly person's facial feature vector and the ID of the receiving door lock (door lock-old). The door lock-old (the first smart door lock) was further forwarded to the first family member's APP.

[0082] In some embodiments, if the door lock-old receives the above feedback "found message" within 12 hours, no alarm will be given; otherwise, if no "found message" or event of the old man returning is received for more than 12 hours, an alarm will be given. Other door locks receive the broadcast of "found message", and compare the facial feature vector in the "found message" with the saved facial feature vector with the "attention" mark. If there is a match, the facial feature vector will be deleted and no longer paid attention to.

[0083] In addition, as a preferred embodiment, in the above process, door lock-old is broadcast to all door locks, which will disturb everyone. The door lock that the elderly often go to must be visited by their family members frequently. Therefore, when door lock-old finds that a certain captured face feature vector reaches a certain threshold, such as 7 times, it sends the face feature vector to the platform, requests the door lock ID to which the face belongs, such as door lock-B, and saves it.

[0084] If the door lock is opened but the elderly person's face is not captured, a "specific delayed person search message" is first unicasted to door lock-B, which contains the elderly person's facial feature vector, the time required for feedback (for example, feedback must be given within 2 hours), and its own IP address. The waiting time is set to be shorter, for example, 2 hours. If door lock-B is found within 2 hours, a "found message" is unicasted to door lock-old. If door lock-B does not feedback the "found message" within 2 hours, door lock-old broadcasts a "delayed person search message" again, which contains the elderly person's facial feature vector, the time required for feedback (for example, feedback must be given within 12 hours), and its own IP address.

[0085] In summary, in this embodiment, by responding to the first operation or the second operation, the first smart door lock captures the first face image, determines that the first face image is a member of the preset category corresponding to the first smart door lock, starts the personnel monitoring function, records and sends the first monitoring message to the door lock management platform; the first operation is the door lock opening operation; the second operation is the door lock closing operation; the first monitoring message includes the time of executing the first operation or the second operation of the first face image and the first smart door lock ID; if the first smart door lock does not capture the first face image within the predetermined time after starting the personnel monitoring function, the second monitoring message is sent to the door lock management platform; according to the door lock management platform, the second monitoring message is sent to the first family member APP associated with the first smart door lock ID. Compared with the prior art, the embodiment of the present application has the following beneficial effects: on the one hand, the door lock judges the records of the elderly going out and leaving, which is convenient for real-time monitoring; on the other hand, through the collaboration between the door locks, the collaborative attention between the door locks is realized for special groups. And in order to avoid false alarms because the elderly go to live with neighbors for a few days, the misunderstanding is eliminated by designing the collaboration between the door locks.

[0086] In addition, the second aspect of this embodiment provides a personnel monitoring system based on a smart door lock, such as Figure 3 As shown, the system includes a monitoring module 301, a first sending module 302, and a second sending module 303; wherein:

[0087] The monitoring module 301 is used for responding to the first operation or the second operation, the first smart door lock captures the first face image, determines that the first face image is a member of the preset category corresponding to the first smart door lock, starts the personnel monitoring function, and records and sends a first monitoring message to the door lock management platform; the first operation is the door lock opening operation; the second operation is the door lock closing operation; the first monitoring message includes the time when the first operation or the second operation is performed by the first face image, and the first smart door lock ID;

[0088] The first sending module 302 is used to send a second monitoring message to the door lock management platform if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started;

[0089] The second sending module 303 is used to send a second monitoring message to the first family member APP associated with the first smart door lock ID according to the door lock management platform.

[0090] Furthermore, the system further includes a door lock registration module 304; the door lock registration module 304 is used to:

[0091] The smart door lock uploads the facial images of family members to the door lock management platform;

[0092] The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

[0093] Furthermore, the second monitoring message includes a long-time absence message and a long-time absence message; if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started, sending the second monitoring message to the door lock management platform includes:

[0094] In response to the first operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform.

[0095] Furthermore, the system further includes a first association monitoring module 305; the association monitoring module 305 is used to:

[0096] Sending a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes the first face image, the first smart door lock ID, and the second smart door lock ID;

[0097] The door lock management platform determines the second smart door lock IP address and the second family member APP corresponding to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP;

[0098] In response to the second smart door lock capturing the first face image, sending an arrival / departure message to the first smart door lock, and forwarding the message to the first family member APP by the first smart door lock;

[0099] According to the association monitoring confirmation message of the first smart door lock returned by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

[0100] The system further includes a second association monitoring module 306, wherein the second association monitoring module 306 is configured to:

[0101] In response to the inner opening operation of the first smart door lock and the first smart door lock not capturing the first face image; the first smart door lock broadcasts a missing person message to other door locks registered on the door lock management platform; the missing person message includes the first face image, feedback duration, and the first smart door lock IP;

[0102] If the other door locks detect the first face image based on the missing person message and within the predetermined feedback time, they will send a found message to the first smart door lock, which will be forwarded by the first smart door lock to the first family member APP; the found message includes the ID of the other door lock and the house number of the other door lock.

[0103] In addition, the third aspect of the present invention provides a storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the personnel monitoring method based on the smart door lock as described in the first aspect above.

[0104] In addition, an embodiment of the present application also discloses an electronic device, which includes: one or more processors, and a memory, wherein the memory is used to store one or more computer programs; characterized in that the computer program is configured to be executed by the one or more processors, and the program includes steps for executing the personnel monitoring method based on the smart door lock as described in the first aspect above.

[0105] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0106] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0107] The units described as separate components may or may not be physically separated. As a unit, it can be appreciated by those skilled in the art that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0108] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0109] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a grid device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0110] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A personnel monitoring method based on smart door lock, characterized in that: The method comprises: In response to the first operation or the second operation, the first smart door lock captures the first face image, determines that the first face image is a member of the preset category corresponding to the first smart door lock, starts the personnel monitoring function, and records and sends a first monitoring message to the door lock management platform; the first operation is an operation of opening the door lock from the outside; the second operation is an operation of closing the door lock from the outside; the first monitoring message includes the time when the first face image performs the first operation or the second operation, and the first smart door lock ID; If the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is activated, a second monitoring message is sent to the door lock management platform; Sending a second monitoring message to the first family member APP associated with the first smart door lock ID according to the door lock management platform; The method further comprises a first association monitoring step; the first association monitoring step comprises: Sending a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes the first face image, the first smart door lock ID, and the second smart door lock ID; The door lock management platform determines the second smart door lock IP address and the second family member APP corresponding to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP; In response to the second smart door lock capturing the first face image, sending an arrival / departure message to the first smart door lock, and forwarding the message to the first family member APP by the first smart door lock; According to the association monitoring confirmation message of the first smart door lock returned by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

2. The personnel monitoring method based on the smart door lock according to claim 1 is characterized in that: The method further includes a door lock registration step; the door lock registration step includes: The smart door lock uploads the facial images of family members to the door lock management platform; The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

3. The personnel monitoring method based on the smart door lock according to claim 1 is characterized in that: The second monitoring message includes a long-time absence message and a long-time absence message; if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started, the second monitoring message is sent to the door lock management platform, including: In response to the first operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform.

4. The personnel monitoring method based on the smart door lock according to claim 3 is characterized in that: The method further comprises a second association monitoring step, wherein the second association monitoring step comprises: In response to the inner opening operation of the first smart door lock and the first smart door lock not capturing the first face image; the first smart door lock broadcasts a missing person message to other door locks registered on the door lock management platform; the missing person message includes the first face image, feedback duration, and the first smart door lock IP; If the other door locks detect the first face image based on the missing person message and within the predetermined feedback time, they will send a found message to the first smart door lock, which will be forwarded by the first smart door lock to the first family member APP; the found message includes the ID of the other door lock and the house number of the other door lock.

5. A personnel monitoring system based on smart door locks, characterized in that: The system includes a monitoring module, a first sending module, and a second sending module; wherein: A monitoring module, configured to respond to a first operation or a second operation, the first smart door lock captures a first face image, determines that the first face image is a member of a preset category corresponding to the first smart door lock, starts a personnel monitoring function, and records and sends a first monitoring message to a door lock management platform; the first operation is an operation of opening the door lock from the outside; the second operation is an operation of closing the door lock from the outside; the first monitoring message includes the time when the first face image performs the first operation or the second operation, and the first smart door lock ID; A first sending module, configured to send a second monitoring message to a door lock management platform if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started; A second sending module, configured to send a second monitoring message to a first family member APP associated with the first smart door lock ID according to the door lock management platform; The first association monitoring module is used to send a monitoring request message to the door lock management platform based on the family member APP; the monitoring request message includes a first face image, a first smart door lock ID, and a second smart door lock ID; the door lock management platform determines the corresponding second smart door lock IP address and the corresponding second family member APP according to the second smart door lock ID, and sends an association message to the second smart door lock after the second family member APP agrees; the association message includes the first face image, the first smart door lock ID, and the first smart door lock IP; in response to the second smart door lock capturing the first face image, an arrival / departure message is sent to the first smart door lock, and the first smart door lock forwards it to the first family member APP; according to the association monitoring confirmation message returned to the first smart door lock by the first family member APP, the personnel monitoring function of the first smart door lock is canceled.

6. The personnel monitoring system based on the smart door lock according to claim 5 is characterized in that: The system further includes a door lock registration module; the door lock registration module is used to: The smart door lock uploads the facial images of family members to the door lock management platform; The door lock management platform maps the uploaded facial images of different family members into different family member information, establishes the family member information, smart door lock ID, smart door lock IP address, and room number information corresponding to the smart door lock, establishes a mapping relationship and stores it; the family member information includes member facial information.

7. The personnel monitoring system based on the smart door lock according to claim 6 is characterized in that: The second monitoring message includes a long-time absence message and a long-time absence message; if the first smart door lock does not capture the first face image within a predetermined time after the personnel monitoring function is started, the second monitoring message is sent to the door lock management platform, including: In response to the first operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform; in response to the second operation, if the first smart door lock does not capture the first facial image within the predetermined time after the personnel monitoring function is started, a long-term absence message is sent to the door lock management platform.

8. A storage medium storing a computer program; the program is loaded and executed by a processor to implement the steps of the personnel monitoring method based on a smart door lock as described in any one of claims 1 to 4.

Images