A multi-door-lock-based express delivery watching method and system

Abstract

The application discloses a kind of express look after method and system based on multi-lock, method includes: according to the express article monitoring instruction sent by master through mobile phone APP, the monitoring state of express article is obtained;According to the PIR sensor of door lock A detects that personnel b appears in front of door, generates the broadcast message of please help me monitor;According to the surrounding door lock B receives please help me monitor broadcast message, and is monitored to express article, and the cooperative monitoring execution state is obtained;According to the face image of personnel b collected by door lock A, compared with the list of registered information of household, and the monitoring recovery state is obtained;According to the express article movement or disappearance detected by door lock B in the cooperative monitoring process, the article movement alarm result is obtained.Using the embodiment of the application, the comprehensive monitoring of express article can be realized through the cooperative work between multiple intelligent door locks.

Description

Technical Field

[0001] The present invention belongs to the technical field of smart locks, and in particular to a courier guarding method and system based on multiple door locks. Background Art

[0002] With the rapid development of e-commerce, express delivery has become an integral part of modern life. However, during the delivery process, especially at doorsteps, express items are often at risk of theft, damage, or loss. This issue not only impacts consumers' shopping experience but also raises widespread concern about express delivery security. Traditional express delivery methods typically rely on couriers to leave packages at doorsteps, lacking effective monitoring and protection mechanisms, making it difficult to ensure the safety of express items.

[0003] With the popularity of online shopping and takeout, more and more people are using the convenient door-to-door delivery service. However, because the owner is not at home or it is inconvenient to open the door to receive the items immediately, and because there are no suitable lockers at the residents' doors, the items will be placed on the ground at the door by the deliveryman. In the absence of supervision, there is a risk that the express delivery will be taken away by someone. Summary of the Invention

[0004] The purpose of the present invention is to provide a courier guarding method and system based on multiple door locks to address the deficiencies in the prior art and to achieve comprehensive monitoring of courier items through the collaborative work of multiple smart door locks.

[0005] One embodiment of the present application provides a courier care method based on multiple door locks, the method comprising:

[0006] Courier monitoring activated: Based on the courier monitoring command sent by the owner via the mobile app, Door Lock A adjusts the direction of the PTZ camera to the preset position directly below. This adjustment is achieved through PTZ control, and the courier automatically searches and locks the courier based on the photo taken by the courier, obtaining the monitoring status of the courier.

[0007] Personnel detection and collaborative monitoring request: Door lock A's PIR sensor detects person B at the door and generates a broadcast message "Please help me monitor"; the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item and obtaining the collaborative monitoring request status.

[0008] Collaborative monitoring execution and feedback: Based on the broadcast message "Please help me monitor" received by the neighboring door lock B, the PTZ camera is adjusted toward door lock A to monitor the express item. The adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status.

[0009] Personnel identification and monitoring recovery: The facial image of person B, captured by door lock A, is compared with the resident registration information list. If the person is not the owner of the lock, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a reset message is sent to door lock B to obtain the monitoring recovery status.

[0010] Item movement detection and alarm: When door lock B detects the movement or disappearance of a courier during collaborative monitoring, it generates a notification message indicating that someone has taken the courier. The message, which includes a few seconds of video footage before and after the item is moved, is sent to door lock A via the local area network and forwarded to the owner's app, generating an item movement alarm.

[0011] Optionally, the express item monitoring initiation includes:

[0012] Receiving monitoring instructions: According to the courier monitoring instructions sent by the owner through the mobile phone APP, door lock A receives the instructions and extracts the photos taken by the courier; wherein, the receiving is realized through the local area network to obtain the monitoring instruction data;

[0013] PTZ direction adjustment: According to the monitoring command data, door lock A adjusts the direction of the PTZ camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control to obtain the adjusted PTZ direction;

[0014] Item search and locking: Based on the photos taken by the courier, door lock A searches for and locks the courier items using image search technology; wherein, the search is achieved through intelligent analysis of video images to obtain the locking status of the courier items.

[0015] Optionally, the personnel detection and collaborative monitoring request includes:

[0016] Personnel detection: The PIR sensor of door lock A detects that person B is in front of the door, and generates a personnel detection signal. The detection is achieved by infrared radiation sensing to obtain a personnel detection result.

[0017] Broadcast message generation: Based on the personnel detection results, a broadcast message is generated, asking "Please help me monitor"; wherein the message includes the request event ID, door lock ID and a photo of the express item, and the broadcast message data is obtained;

[0018] Broadcast message sending: According to the broadcast message data, it is sent to the surrounding door locks through the local area network; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message and obtain the broadcast sending status.

[0019] Optionally, the collaborative monitoring execution and feedback includes:

[0020] Broadcast message reception: Based on the broadcast message "Please help me monitor" received by the surrounding door lock B, the request event ID and door lock ID are extracted; wherein, the reception is realized through the local area network, and the broadcast message parsing result is obtained;

[0021] PTZ direction adjustment: Based on the broadcast message analysis results, door lock B adjusts the PTZ camera toward door lock A; wherein, the adjustment is achieved through preset position control to obtain the adjusted PTZ direction;

[0022] Reply message generation and sending: According to the adjusted pan-tilt direction, door lock B generates a reply message of "I am here to monitor"; wherein, the message is sent to door lock A via the local area network to obtain the collaborative monitoring feedback status.

[0023] Optionally, the personnel identification and monitoring recovery includes:

[0024] Facial image acquisition: The PTZ camera of door lock A acquires the facial image of person B; wherein the acquisition is achieved through PTZ control to obtain facial image data;

[0025] Face recognition and comparison: Based on the face image data, a similarity comparison is performed with the household registration information list; wherein, the comparison is achieved through a deep learning model to obtain the comparison result;

[0026] Monitoring recovery and reset notification: Based on the comparison results, if it is identified that the owner is not the lock owner, the PTZ camera will be turned back to the bottom to continue monitoring the express items, and a reset message will be generated; wherein, the message is sent to door lock B via the local area network to obtain the monitoring recovery status.

[0027] Optionally, the object movement detection and alarm includes:

[0028] Item movement detection: Detects the movement or disappearance of express items based on the video surveillance video of the pan-tilt camera of door lock B; wherein, the detection is achieved through intelligent analysis of video images to obtain the item movement detection result;

[0029] Alarm message generation: Based on the item movement detection results, a notification message is generated that someone has taken the package. The message includes a 5-second video before and after the item is moved, and the alarm message data is obtained.

[0030] Alarm message sending and forwarding: According to the alarm message data, it is sent to door lock A through the local area network and forwarded to the owner's APP; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm and obtain the alarm sending status.

[0031] Another embodiment of the present application provides a courier care system based on multiple door locks, the system comprising:

[0032] The start module is used to start the express item monitoring: according to the express item monitoring command sent by the owner through the mobile phone app, the door lock A adjusts the direction of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched and locked based on the photo taken by the courier, and the monitoring status of the express item is obtained;

[0033] The detection module is used for personnel detection and collaborative monitoring request: when the PIR sensor of door lock A detects the presence of person B in front of the door, a broadcast message "Please help me monitor" is generated; the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item and obtaining the collaborative monitoring request status;

[0034] The execution module is used for collaborative monitoring execution and feedback: based on the broadcast message "Please help me monitor" received by the surrounding door lock B, the PTZ camera is adjusted to face door lock A and monitor the express item; the adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status;

[0035] The identification module is used for personnel identification and monitoring recovery: the facial image of person B collected by door lock A is compared with the resident registration information list. If the person is not the owner of the lock, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a reset message is sent to door lock B to obtain the monitoring recovery status.

[0036] The alarm module is used for object movement detection and alarm: when door lock B detects the movement or disappearance of the express item during the collaborative monitoring process, it generates a notification message that someone has taken the express item. The message contains a video of the few seconds before and after the object is moved, which is sent to door lock A via the local area network and forwarded to the owner's app to obtain the object movement alarm result.

[0037] Yet another embodiment of the present application provides a storage medium, wherein the storage medium stores a computer program, wherein the computer program is configured to execute any of the above methods when run.

[0038] Yet another embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any of the above methods.

[0039] Compared with the prior art, the present invention provides a courier guarding method based on multiple door locks, which obtains the monitoring status of the courier items according to the courier item monitoring instruction sent by the owner through the mobile phone APP; generates a broadcast message of "Please help me monitor" when the PIR sensor of door lock A detects the appearance of person B in front of the door; obtains the collaborative monitoring execution status according to the surrounding door locks B receiving the broadcast message of "Please help me monitor" and monitoring the courier items; obtains the monitoring recovery status according to the facial image of person B collected by door lock A and comparing it with the resident registration information list; obtains the item movement alarm result according to the detection of the movement or disappearance of the courier items by door lock B during the collaborative monitoring process, thereby realizing comprehensive monitoring of the courier items through the collaborative work between multiple smart door locks. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A hardware structure block diagram of a computer terminal for a courier care method based on multiple door locks provided in an embodiment of the present invention;

[0041] Figure 2 A schematic diagram of a flow chart of a courier care method based on multiple door locks provided in an embodiment of the present invention;

[0042] Figure 3 A schematic structural diagram of a courier care system based on multiple door locks provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0043] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and are not to be construed as limiting the present invention.

[0044] The embodiment of the present invention first provides a courier guarding method based on multiple door locks, which can be applied to electronic devices such as computer terminals, specifically ordinary computers, etc.

[0045] The following describes it in detail by taking running on a computer terminal as an example. Figure 1 The hardware structure block diagram of a computer terminal for a courier guarding method based on multiple door locks provided by an embodiment of the present invention. Figure 1 As shown, the computer device includes a processor, a memory, and a network interface connected via a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0046] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, which, when executed, can cause the processor to execute any one of the courier care methods based on multiple door locks.

[0047] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0048] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any express care method based on multiple door locks.

[0049] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0050] It should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0051] See also Figure 2 The embodiment of the present invention provides a courier care method based on multiple door locks, which may include the following steps:

[0052] S201, Express Item Monitoring Started: Based on the express item monitoring command sent by the owner via the mobile phone app, door lock A adjusts the direction of the pan-tilt camera to a preset position directly below; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched and locked based on the photo taken by the courier, and the monitoring status of the express item is obtained;

[0053] Specifically, the express item monitoring startup includes:

[0054] Receiving monitoring instructions: According to the courier monitoring instructions sent by the owner through the mobile phone APP, door lock A receives the instructions and extracts the photos taken by the courier; wherein, the receiving is realized through the local area network to obtain the monitoring instruction data;

[0055] PTZ direction adjustment: According to the monitoring command data, door lock A adjusts the direction of the PTZ camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control to obtain the adjusted PTZ direction;

[0056] Item search and locking: Based on the photos taken by the courier, door lock A searches for and locks the courier items using image search technology; wherein, the search is achieved through intelligent analysis of video images to obtain the locking status of the courier items.

[0057] S202, Person Detection and Collaborative Monitoring Request: Door lock A's PIR sensor detects person B at the door, generating a broadcast message "Please help me monitor"; the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item, and obtaining the collaborative monitoring request status;

[0058] Specifically, the personnel detection and collaborative monitoring request includes:

[0059] Personnel detection: The PIR sensor of door lock A detects that person B is in front of the door, and generates a personnel detection signal. The detection is achieved by infrared radiation sensing to obtain a personnel detection result.

[0060] Broadcast message generation: Based on the personnel detection results, a broadcast message is generated, asking "Please help me monitor"; wherein the message includes the request event ID, door lock ID and a photo of the express item, and the broadcast message data is obtained;

[0061] Broadcast message sending: According to the broadcast message data, it is sent to the surrounding door locks through the local area network; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message and obtain the broadcast sending status.

[0062] S203, Collaborative Monitoring Execution and Feedback: Based on the broadcast message "Please help me monitor" received by the neighboring door lock B, the PTZ camera is adjusted toward door lock A to monitor the express item; the adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status;

[0063] Specifically, the collaborative monitoring execution and feedback includes:

[0064] Broadcast message reception: Based on the broadcast message "Please help me monitor" received by the surrounding door lock B, the request event ID and door lock ID are extracted; wherein, the reception is realized through the local area network, and the broadcast message parsing result is obtained;

[0065] PTZ direction adjustment: Based on the broadcast message analysis results, door lock B adjusts the PTZ camera toward door lock A; wherein, the adjustment is achieved through preset position control to obtain the adjusted PTZ direction;

[0066] Reply message generation and sending: According to the adjusted pan-tilt direction, door lock B generates a reply message of "I am here to monitor"; wherein, the message is sent to door lock A via the local area network to obtain the collaborative monitoring feedback status.

[0067] S204, Person Identification and Monitoring Restoration: The facial image of person B, captured by door lock A, is compared with the resident registration information list. If the person is not the lock's owner, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a "reset" message is sent to door lock B to restore monitoring status.

[0068] Specifically, the personnel identification and monitoring recovery includes:

[0069] Facial image acquisition: The PTZ camera of door lock A acquires the facial image of person B; wherein the acquisition is achieved through PTZ control to obtain facial image data;

[0070] Face recognition and comparison: Based on the face image data, a similarity comparison is performed with the household registration information list; wherein, the comparison is achieved through a deep learning model to obtain the comparison result;

[0071] Monitoring recovery and reset notification: Based on the comparison results, if it is identified that the owner is not the lock owner, the PTZ camera will be turned back to the bottom to continue monitoring the express items, and a reset message will be generated; wherein, the message is sent to door lock B via the local area network to obtain the monitoring recovery status.

[0072] S205, object movement detection and alarm: Based on the detection of the movement or disappearance of the express item by door lock B during the collaborative monitoring process, a notification message is generated that someone has taken the express item; wherein, the message includes a video of a few seconds before and after the object is moved, which is sent to door lock A via the local area network and forwarded to the owner's app to obtain the object movement alarm result.

[0073] Specifically, the object movement detection and alarm includes:

[0074] Item movement detection: Detects the movement or disappearance of express items based on the video surveillance video of the pan-tilt camera of door lock B; wherein, the detection is achieved through intelligent analysis of video images to obtain the item movement detection result;

[0075] Alarm message generation: Based on the item movement detection results, a notification message is generated that someone has taken the package. The message includes a 5-second video before and after the item is moved, and the alarm message data is obtained.

[0076] Alarm message sending and forwarding: According to the alarm message data, it is sent to door lock A through the local area network and forwarded to the owner's APP; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm and obtain the alarm sending status.

[0077] In practical applications, the present invention proposes a method of collaborative monitoring using multiple door locks and pan-tilt cameras to guard express items at the door, promptly detect and alert incidents of items being taken away by someone at the door, and retain process video images for event backtracking.

[0078] 1. Core Concept: When a courier places a package under door lock A and notifies owner A, the owner's app notifies door lock A to turn the pan / tilt downward to prevent the package from leaving the field of view. When person B arrives, door lock A's PIR sensor detects the presence of a person and notifies nearby door locks to adjust their orientation to help it keep an eye on the package. It then faces forward to perform facial recognition on the visitor. If the person is identified as a non-member, it continues to keep an eye on the package and unicasts a message to the camera assisting in keeping an eye on the package to restore the preset position. During this period, if the door lock responsible for assisting in keeping an eye on the package does not detect the movement of the package, it will return to the preset position according to the notification. If the object is found to have moved, it will send a 5-second video of the object before and after the movement to door lock A, which then forwards the video to owner A's app.

[0079] 2. The complete process of technical implementation is as follows:

[0080] (1) Prerequisites:

[0081] The owner's entrance door is equipped with a smart door lock equipped with a PTZ camera (each door lock has a unique door lock ID, door lock IP address, and door lock location). The door lock is connected to the cloud platform, registered with the platform, and periodically updated. The platform records a list of door locks, including the door lock ID, door lock IP address, and door lock location. Four preset positions are manually set for the PTZ camera based on the location of the door locks: front for face recognition, bottom for doorway floor monitoring, and two neighboring doorways for assistive monitoring. The default preset position for the PTZ camera is front. The preset position for the neighboring door is associated with the corresponding neighbor's door lock ID. The smart door lock records a list of resident registration information, including door lock ID, door lock address, name, facial image / feature vector, and the owner's mobile app ID.

[0082] Note: When manually setting four preset directions for the PTZ camera, you must consider the positions of the surrounding door locks and ensure that each door lock is set as a preset direction by at least one other door lock.

[0083] The owner installs the APP on his mobile phone and has a unique APP-ID. He can send and cancel the door lock "express item monitoring" command in the APP.

[0084] (2) After the express item is delivered to the doorstep, the owner is notified to receive it: When the courier delivers the item to the door, he presses the visitor doorbell. If no one inside the house responds, he places the item at the doorstep and takes a clear photo of the item placed at the doorstep (hereinafter referred to as the photo). The courier sends a notification message "The item has been placed at your doorstep" to the owner through the express APP, informing him that the item has been placed at the doorstep. The message content includes the photo of the item placed at the doorstep.

[0085] (3) The owner starts the door lock pan-tilt camera after receiving the message that the express delivery is delivered to the door: After the owner a receives the message that the express delivery is placed at the door, he immediately notifies the pan-tilt camera of this lock through the mobile phone APP to face directly downward to monitor the express delivery items on the ground at the door.

[0086] When the owner (referred to as "a" and the lock is "A") receives a notification from the courier on their phone that an item has been left at their door, they open the lock's app and tap "Express Item Monitoring" to request that lock A monitor the item at their door. The owner then uses the app to send a photo taken by the courier to lock A, which then rotates the PTZ camera to the preset position directly below (for monitoring items on the door's floor) and automatically searches for the item based on the photo. Upon finding the item, it adjusts the PTZ to continuously monitor it. If there are already items being continuously monitored, the PTZ camera automatically adjusts to expand the video capture area to simultaneously monitor multiple items at the door. If the owner arrives home or unlocks the door from the inside to retrieve the item, lock A's PTZ camera returns to the default preset position directly ahead.

[0087] Note: PTZ stands for Pan-Tilt-Zoom, where Pan refers to horizontal rotation, Tilt refers to vertical rotation, and Zoom refers to the zoom function. By adjusting PTZ, you can adjust the scope of the monitoring area (for example, in wide-angle mode, the entire area of ​​the door is monitored). The item search function is the image search function in video image intelligent analysis, that is, searching for corresponding express items in the video scene based on photos.

[0088] (4) When someone appears in front of the door lock, the lock will automatically dispatch the lock and surrounding door locks to participate in collaborative monitoring: If person B (the door lock does not know whether B is the owner of the lock) comes to door lock A, door lock A requests the surrounding door locks to help monitor the express items on the ground at the door (at this time, the PTZ camera of door lock A has left the position directly below, and the express items will have a gap without anyone monitoring them. In order to fill this gap in monitoring, A will request the surrounding door locks to cooperate in monitoring). At the same time, door lock A immediately turns the PTZ camera to enter the default preset position (directly in front) for face recognition.

[0089] When person B appears in front of door lock A and is detected by A's PIR (passive infrared sensor), door lock A sends a broadcast message "Please help me monitor" to other door locks. The message includes the request event ID, door lock ID (A), photos, etc. At the same time, door lock A immediately turns its pan-tilt camera to the front to capture the person's face image and perform facial recognition comparison.

[0090] After receiving the "Please help me monitor" broadcast request message, the nearby door lock B finds the ID of door lock A in its preset position. It immediately adjusts its pan-tilt camera to face door lock A according to the preset position, and uses image search to find and monitor the express item at A's door. At the same time, it unicasts a reply message "I will monitor" to inform A. The message content includes the request event ID of door lock A, the door lock ID (B), etc.

[0091] After sending a broadcast message "Please help me monitor," door lock A receives a unicast reply message "I will monitor" from door lock B. It then stores the message, which includes the request event ID and door lock ID (B). This allows A to know that B is assisting with monitoring. If door lock A doesn't receive a reply message to "I will monitor" after a 5-second delay, it sends a "Request for Assistance Monitoring Failed" alert to the platform. The message includes the door lock ID (A), the request event ID, and a timestamp (door lock A's current clock). The platform receives the alert and handles it according to its business logic.

[0092] Description: PIR sensor is a passive infrared sensor, which is mainly used to detect infrared radiation from the human body and realize motion detection. When someone approaches, it can trigger the door lock to execute a certain response, such as the PIR alarm triggering the pan-tilt camera to adjust the preset position; after the broadcast message is sent to the surrounding door locks, if there are multiple door locks respond, it does not matter. If no door lock responds to "Please help me monitor", it is possible that the door lock with this lock as the target in the preset position has a fault, then an alarm message will be sent (the message content includes: this lock requests assistance in monitoring but no door lock responds) to the platform, which will query and process it. This is not the focus of the present invention and will not be further explained.

[0093] (5) Monitoring of express items when a person unlocks the door to enter or leave: If person B is not the owner of door lock A after comparison, A will immediately turn its own PTZ camera back to the bottom to monitor the express items, and notify the assisting door lock B to stop monitoring (A is already in the monitoring state at this time). If the express item is found to be moved or disappears during the collaborative monitoring of door lock B, B will immediately send the video images of the item before and after 5 seconds to door lock A, which will forward it to A's owner's APP for review and disposal.

[0094] Door lock A captures a facial image of visitor B and compares it to the facial images / feature vectors in its resident registration list (checking whether the similarity value meets a threshold, typically set at 80%). If the person is not the lock's owner, it immediately rotates its PTZ camera back toward the delivery item to monitor it. It then extracts door lock B's IP address from the "I'm monitoring" message received from B and unicasts a "Please reset" message to B, containing the door lock's ID (A) and the requested event ID. Upon receiving the reset message, door lock B rotates its PTZ camera back to its default preset position, ending the process. If multiple door locks respond to the "I'm monitoring" message and participate in collaborative monitoring, A sends a unicast "Please reset" message to each participating lock, returning their PTZ cameras to their respective default preset positions (here, only door lock B is used as a representative participant in collaborative monitoring).

[0095] If person B who appears in front of door lock A is confirmed to be the owner of door lock A after comparison, door lock A will unlock the door for B, and B will move the express item into the door (because door lock A is already open, the pan-tilt camera of door lock A facing the express item will not be able to effectively monitor the express item at this time, while the door locks participating in collaborative monitoring are always in continuous monitoring, and there will be no monitoring gaps in this process).

[0096] During collaborative monitoring, if door lock B discovers that the express item in the video scene moves and disappears (B only performs video monitoring and does not identify the person who moves the express item), it will send a unicast notification message "Someone took the express item" to door lock A using 5 seconds of video before and after the item disappears. The message content includes the request event ID of door lock ID (A), door lock ID (B), and 5 seconds of video collected by B before and after the express item disappears at A's door.

[0097] Door lock A receives a notification message from door lock B that someone has taken the package and extracts a 5-second video clip from before and after the item disappears. Door lock A receives the video and forwards it to the owner's mobile app based on the APP ID in the resident registration list. It then deletes the "I'll monitor" message from door lock B.

[0098] The owner checks the video sent by the door lock through the mobile phone APP. If the courier was taken away by himself, ignore the video and click "Cancel courier monitoring" on the mobile phone APP interactive page. Door lock A adjusts the direction of the pan-tilt camera to the default preset position (straight ahead) according to the owner's cancellation command, and the courier monitoring process of door lock A ends (if A or B finds that the courier has been moved and disappeared, regardless of whether the owner sends the "Cancel courier monitoring" command through the mobile phone APP, the direction of the pan-tilt camera will be set to the default preset position (straight ahead), and the courier monitoring process of door lock A ends, because there is no item that needs to be monitored at the door at this time, and no further monitoring is required); if the owner checks the video and finds that the courier was not taken away by himself, he can check the video to find out who took the courier. If it is confirmed that a suspicious person took it away, he can call 110 and the public security organs will handle it.

[0099] After the courier leaves the express item at the doorstep, the PTZ camera of his own door lock and surrounding door locks is dispatched for coordinated monitoring, solving the problem of the express item being left unattended at the doorstep.

[0100] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile phone APP, the monitoring status of the express item is obtained; according to the PIR sensor of door lock A detecting the appearance of person B in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door locks B receiving the broadcast message of "Please help me monitor" and monitoring the express item, the collaborative monitoring execution status is obtained; according to the facial image of person B collected by door lock A, it is compared with the resident registration information list to obtain the monitoring recovery status; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained, so that comprehensive monitoring of the express item can be achieved through the collaborative work between multiple smart door locks.

[0101] Another embodiment of the present invention provides a courier care system based on multiple door locks, see Figure 3 , the system may include:

[0102] The start module 301 is used to start the express item monitoring: according to the express item monitoring instruction sent by the owner through the mobile phone app, the door lock A adjusts the direction of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched and locked based on the photo taken by the courier, and the monitoring status of the express item is obtained;

[0103] Detection module 302, for person detection and collaborative monitoring request: based on the PIR sensor of door lock A detecting the presence of person B in front of the door, a broadcast message "Please help me monitor" is generated; wherein the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item, and obtaining the collaborative monitoring request status;

[0104] Execution module 303 is used for collaborative monitoring execution and feedback: based on the broadcast message "Please help me monitor" received by the surrounding door lock B, the PTZ camera is adjusted toward door lock A to monitor the express item; the adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status;

[0105] Identification module 304 is used for person identification and monitoring recovery: it compares the facial image of person B, captured by door lock A, with the resident registration information list. If the person is not the lock owner, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a reset message is sent to door lock B to confirm the monitoring recovery status.

[0106] Alarm module 305 is used for item movement detection and alarm: based on the detection of the movement or disappearance of the express item by door lock B during the collaborative monitoring process, a notification message is generated that someone has taken the express item; wherein, the message contains a video of a few seconds before and after the item is moved, which is sent to door lock A via the local area network and forwarded to the owner's app to obtain the item movement alarm result.

[0107] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile phone APP, the monitoring status of the express item is obtained; according to the PIR sensor of door lock A detecting the appearance of person B in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door locks B receiving the broadcast message of "Please help me monitor" and monitoring the express item, the collaborative monitoring execution status is obtained; according to the facial image of person B collected by door lock A, it is compared with the resident registration information list to obtain the monitoring recovery status; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained, so that comprehensive monitoring of the express item can be achieved through the collaborative work between multiple smart door locks.

[0108] An embodiment of the present invention further provides a storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when running.

[0109] Specifically, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for performing the following steps:

[0110] S201, Express Item Monitoring Started: Based on the express item monitoring command sent by the owner via the mobile phone app, door lock A adjusts the direction of the pan-tilt camera to a preset position directly below; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched and locked based on the photo taken by the courier, and the monitoring status of the express item is obtained;

[0111] S202, Person Detection and Collaborative Monitoring Request: Door lock A's PIR sensor detects person B at the door, generating a broadcast message "Please help me monitor"; the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item, and obtaining the collaborative monitoring request status;

[0112] S203, Collaborative Monitoring Execution and Feedback: Based on the broadcast message "Please help me monitor" received by the neighboring door lock B, the PTZ camera is adjusted toward door lock A to monitor the express item; the adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status;

[0113] S204, Person Identification and Monitoring Restoration: The facial image of person B, captured by door lock A, is compared with the resident registration information list. If the person is not the lock's owner, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a "reset" message is sent to door lock B to restore monitoring status.

[0114] S205, object movement detection and alarm: Based on the detection of the movement or disappearance of the express item by door lock B during the collaborative monitoring process, a notification message is generated that someone has taken the express item; wherein, the message includes a video of a few seconds before and after the object is moved, which is sent to door lock A via the local area network and forwarded to the owner's app to obtain the object movement alarm result.

[0115] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile phone APP, the monitoring status of the express item is obtained; according to the PIR sensor of door lock A detecting the appearance of person B in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door locks B receiving the broadcast message of "Please help me monitor" and monitoring the express item, the collaborative monitoring execution status is obtained; according to the facial image of person B collected by door lock A, it is compared with the resident registration information list to obtain the monitoring recovery status; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained, so that comprehensive monitoring of the express item can be achieved through the collaborative work between multiple smart door locks.

[0116] An embodiment of the present invention further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.

[0117] Specifically, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0118] Specifically, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0119] S201, Express Item Monitoring Started: Based on the express item monitoring command sent by the owner via the mobile phone app, door lock A adjusts the direction of the pan-tilt camera to a preset position directly below; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched and locked based on the photo taken by the courier, and the monitoring status of the express item is obtained;

[0120] S202, Person Detection and Collaborative Monitoring Request: Door lock A's PIR sensor detects person B at the door, generating a broadcast message "Please help me monitor"; the broadcast message is sent to surrounding door locks via the local area network, requesting assistance in monitoring the express item, and obtaining the collaborative monitoring request status;

[0121] S203, Collaborative Monitoring Execution and Feedback: Based on the broadcast message "Please help me monitor" received by the neighboring door lock B, the PTZ camera is adjusted toward door lock A to monitor the express item; the adjustment is achieved through preset position control, and a reply message "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status;

[0122] S204, Person Identification and Monitoring Restoration: The facial image of person B, captured by door lock A, is compared with the resident registration information list. If the person is not the lock's owner, the PTZ camera is rotated back to the bottom to continue monitoring the express item, and a "reset" message is sent to door lock B to restore monitoring status.

[0123] S205, object movement detection and alarm: Based on the detection of the movement or disappearance of the express item by door lock B during the collaborative monitoring process, a notification message is generated that someone has taken the express item; wherein, the message includes a video of a few seconds before and after the object is moved, which is sent to door lock A via the local area network and forwarded to the owner's app to obtain the object movement alarm result.

[0124] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile phone APP, the monitoring status of the express item is obtained; according to the PIR sensor of door lock A detecting the appearance of person B in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door locks B receiving the broadcast message of "Please help me monitor" and monitoring the express item, the collaborative monitoring execution status is obtained; according to the facial image of person B collected by door lock A, it is compared with the resident registration information list to obtain the monitoring recovery status; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained, so that comprehensive monitoring of the express item can be achieved through the collaborative work between multiple smart door locks.

[0125] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings. The above is only a preferred embodiment of the present invention, but the scope of implementation of the present invention is not limited to what is shown in the drawings. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which do not exceed the spirit covered by the description and drawings, should be within the scope of protection of the present invention.

Claims

1. A courier care method based on multiple door locks, characterized in that: The method comprises: Courier monitoring starts: According to the courier monitoring command sent by the owner, door lock A adjusts the direction of the PTZ camera, searches and locks the courier based on the photo, and obtains the monitoring status of the courier; Personnel detection and collaborative monitoring request: When the sensor of door lock A detects person B, it generates a broadcast message "Please help me monitor" and sends the broadcast message to surrounding door locks to request assistance in monitoring express items and obtain the collaborative monitoring request status; wherein, the personnel detection and collaborative monitoring request includes: Personnel detection: According to the PIR sensor of door lock A, person B appears in front of the door and a personnel detection signal is generated; wherein, the detection is achieved by infrared radiation sensing to obtain the personnel detection result; Broadcast message generation: According to the personnel detection result, a broadcast message "Please help me monitor" is generated; wherein, the message contains the request event ID, door lock ID and express item photo, and the broadcast message data is obtained; Broadcast message sending: According to the broadcast message data, it is sent to surrounding door locks via the local area network; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message and obtain the broadcast sending status; Collaborative monitoring execution and feedback: The surrounding door lock B receives the broadcast message, adjusts the pan-tilt camera toward door lock A, and monitors the express items, and at the same time sends a reply message of "I will monitor" to door lock A to obtain the collaborative monitoring execution status; the collaborative monitoring execution and feedback include: broadcast message reception: based on the surrounding door lock B receiving the "Please help me monitor" broadcast message, extract the request event ID and door lock ID; wherein, the reception is implemented through the local area network to obtain the broadcast message parsing result; pan-tilt direction adjustment: according to the broadcast message parsing result, door lock B adjusts the pan-tilt camera toward door lock A; wherein, the adjustment is implemented through preset position control to obtain the adjusted pan-tilt direction; reply message generation and sending: according to the adjusted pan-tilt direction, door lock B generates a reply message of "I will monitor"; wherein, the message is sent to door lock A through the local area network to obtain the collaborative monitoring feedback status; Personnel identification and monitoring recovery: The facial image of person B collected by door lock A is compared with the resident registration information list. If the person is not the owner of the lock, the PTZ camera is turned back to continue monitoring the express item, and a reset message is sent to door lock B to obtain the monitoring recovery status; Item movement detection and alarm: Door lock B detects that the express item has moved or disappeared, generates a notification message that someone has taken the express item, sends the notification message to door lock A, and forwards it to the owner's app to obtain the item movement alarm result.

2. The method according to claim 1, characterized in that The express item monitoring startup includes: Receiving monitoring instructions: According to the courier monitoring instructions sent by the owner through the mobile phone APP, door lock A receives the instructions and extracts the photos taken by the courier; wherein, the receiving is realized through the local area network to obtain the monitoring instruction data; PTZ direction adjustment: According to the monitoring command data, door lock A adjusts the direction of the PTZ camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control to obtain the adjusted PTZ direction; Item search and locking: Based on the photos taken by the courier, door lock A searches for and locks the courier items using image search technology; wherein, the search is achieved through intelligent analysis of video images to obtain the locking status of the courier items.

3. The method according to claim 2, characterized in that The personnel identification and monitoring recovery includes: Facial image acquisition: The PTZ camera of door lock A acquires the facial image of person B; wherein the acquisition is achieved through PTZ control to obtain facial image data; Face recognition and comparison: Based on the face image data, a similarity comparison is performed with the household registration information list; wherein, the comparison is achieved through a deep learning model to obtain the comparison result; Monitoring recovery and reset notification: Based on the comparison results, if it is identified that the owner is not the lock owner, the PTZ camera will be turned back to the bottom to continue monitoring the express items, and a reset message will be generated; wherein, the message is sent to door lock B via the local area network to obtain the monitoring recovery status.

4. The method according to claim 3, characterized in that The object movement detection and alarm includes: Item movement detection: Detects the movement or disappearance of express items based on the video surveillance video of the pan-tilt camera of door lock B; wherein, the detection is achieved through intelligent analysis of video images to obtain the item movement detection result; Alarm message generation: Based on the item movement detection results, a notification message is generated that someone has taken the package. The message includes a 5-second video before and after the item is moved, and the alarm message data is obtained. Alarm message sending and forwarding: According to the alarm message data, it is sent to door lock A through the local area network and forwarded to the owner's APP; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm and obtain the alarm sending status.

5. A courier care system based on multiple door locks, characterized in that: The system comprises: The startup module is used to adjust the direction of the PTZ camera according to the express item monitoring instruction sent by the owner, search and lock the express item based on the photo, and obtain the monitoring status of the express item; Detection module, used for personnel detection and collaborative monitoring request: when the sensor of door lock A detects person B, it generates a broadcast message of "Please help me monitor" and sends the broadcast message to surrounding door locks to request assistance in monitoring express items and obtain the collaborative monitoring request status; wherein, the personnel detection and collaborative monitoring request include: personnel detection: according to the PIR sensor of door lock A, person B appears in front of the door and a personnel detection signal is generated; wherein, the detection is achieved by infrared radiation sensing to obtain the personnel detection result; broadcast message generation: according to the personnel detection result, a broadcast message of "Please help me monitor" is generated; wherein, the message contains the request event ID, door lock ID and express item photo to obtain the broadcast message data; broadcast message sending: according to the broadcast message data, it is sent to surrounding door locks via the local area network; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message and obtain the broadcast sending status; An execution module is used for collaborative monitoring execution and feedback: the surrounding door lock B receives the broadcast message, adjusts the pan-tilt camera toward the door lock A, and monitors the express items, and at the same time sends a reply message of "I will monitor" to the door lock A to obtain the collaborative monitoring execution status; the collaborative monitoring execution and feedback include: broadcast message reception: based on the surrounding door lock B receiving the "Please help me monitor" broadcast message, the request event ID and the door lock ID are extracted; wherein, the reception is implemented through the local area network to obtain the broadcast message parsing result; pan-tilt direction adjustment: according to the broadcast message parsing result, the door lock B adjusts the pan-tilt camera toward the door lock A; wherein, the adjustment is implemented through preset position control to obtain the adjusted pan-tilt direction; reply message generation and sending: according to the adjusted pan-tilt direction, the door lock B generates a reply message of "I will monitor"; wherein, the message is sent to the door lock A through the local area network to obtain the collaborative monitoring feedback status; The identification module is used for personnel identification and monitoring recovery: the facial image of person B collected by door lock A is compared with the resident registration information list. If the person is not the owner of the lock, the PTZ camera is turned back to continue monitoring the express item, and a reset message is sent to door lock B to obtain the monitoring recovery status; The alarm module is used for item movement detection and alarm: Door lock B detects that the express item has moved or disappeared, generates a notification message that someone has taken the express item, sends the notification message to door lock A, and forwards it to the owner's app to obtain the item movement alarm result.

6. The system according to claim 5, characterized in that The startup module is specifically used to: Receiving monitoring instructions: According to the courier monitoring instructions sent by the owner through the mobile phone APP, door lock A receives the instructions and extracts the photos taken by the courier; wherein, the receiving is realized through the local area network to obtain the monitoring instruction data; PTZ direction adjustment: According to the monitoring command data, door lock A adjusts the direction of the PTZ camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control to obtain the adjusted PTZ direction; Item search and locking: Based on the photos taken by the courier, door lock A searches for and locks the courier items using image search technology; wherein, the search is achieved through intelligent analysis of video images to obtain the locking status of the courier items.

7. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 4 when run.

8. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 4.

Images