Express nursing method and system based on multiple door locks

Abstract

The invention discloses an express nursing method and system based on multiple door locks, and the method comprises the steps: obtaining a monitoring state of an express item according to an express item monitoring instruction sent by an owner through a mobile phone APP; when a PIR sensor of a door lock A detects that a person b appears in front of a door, a broadcast message asking to help our monitor is generated; receiving a monitoring request broadcast message according to a peripheral door lock B, and monitoring an express item to obtain a cooperative monitoring execution state; the face image of the person b collected by the door lock A is compared with the resident registration information list to obtain a monitoring recovery state; and according to the fact that the door lock B detects that the express item moves or disappears in the cooperative monitoring process, an item moving alarm result is obtained. According to the embodiment of the invention, comprehensive monitoring of express items can be realized through cooperative work among a plurality of intelligent door locks.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a method and system for express delivery care based on multiple door locks. Background Art

[0002] With the rapid development of e-commerce, express delivery has become an indispensable part of modern life. However, during the delivery process of express items, especially at the doorstep delivery link, they often face the risks of being stolen, damaged or lost. This problem not only affects the shopping experience of consumers, but also has triggered widespread concern about express delivery security. The traditional express delivery method usually relies on the courier to place the package at the door, lacking effective monitoring and protection mechanisms, making it difficult to ensure the security of express items.

[0003] With the popularity of online shopping and takeaways, more and more people are using the convenient service of door-to-door delivery. However, due to the fact that the owner is not at home or inconvenient to open the door immediately to pick up the items, and there is no suitable locker for storing items at the doorstep of the household, the items will be placed on the ground at the door by the delivery person. Without supervision, there is a risk that the express delivery will be taken away by others. Summary of the Invention

[0004] The purpose of the present invention is to provide a method and system for express delivery care based on multiple door locks to solve the deficiencies in the prior art, and be able to achieve comprehensive monitoring of express items through the collaborative work of multiple intelligent door locks.

[0005] An embodiment of the present application provides a method for express delivery care based on multiple door locks, and the method includes: Start of express item monitoring: According to the express item monitoring instruction sent by the owner through the mobile phone APP, Door Lock A adjusts the orientation of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, and automatically searches for and locks the express item according to the photo taken by the courier, and obtains the monitoring status of the express item; Personnel detection and collaborative monitoring request: According to the PIR sensor of Door Lock A detecting that Person b appears in front of the door, generate a broadcast message of "Please help me monitor"; wherein, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item, and obtain the collaborative monitoring request status; Collaborative monitoring execution and feedback: According to the surrounding Door Lock B receiving the "Please help me monitor" broadcast message, adjusts the orientation of the pan-tilt camera towards Door Lock A and aims at the express item for monitoring; wherein, the adjustment is achieved through preset position control, and at the same time sends a reply message of "I will monitor" to Door Lock A, and obtains the collaborative monitoring execution status; Personnel Identification and Monitoring Recovery: Compare the face image of person b collected by Door Lock A with the list of household registration information. Among them, if it is identified that the person is not the owner of this lock, turn the pan-tilt camera back to directly below to continue monitoring the express item, and send a reset request message to Door Lock B to obtain the monitoring recovery status. Item Movement Detection and Alarm: Generate a notification message that someone has taken the express item according to the detection of the movement or disappearance of the express item by Door Lock B during collaborative monitoring. Among them, the message includes videos of several seconds before and after the item movement, and is sent to Door Lock A via the local area network and forwarded to the owner's APP to obtain the item movement alarm result.

[0006] Optionally, the start of express item monitoring includes: Monitoring Instruction Receiving: According to the express item monitoring instruction sent by the owner through the mobile APP, Door Lock A receives the instruction and extracts the photo taken by the courier. Among them, the receiving is implemented via the local area network to obtain the monitoring instruction data. Pan-Tilt Direction Adjustment: According to the monitoring instruction data, Door Lock A adjusts the orientation of the pan-tilt camera to the preset position directly below. Among them, the adjustment is implemented through PTZ control to obtain the adjusted pan-tilt direction. Item Search and Locking: According to the photo taken by the courier, Door Lock A searches for and locks the express item through image search technology. Among them, the search is implemented through intelligent analysis of video images to obtain the locked state of the express item.

[0007] Optionally, the personnel detection and collaborative monitoring request include: Personnel Detection: Generate a personnel detection signal according to the detection by the PIR sensor of Door Lock A that person b appears in front of the door. Among them, the detection is implemented through infrared radiation induction to obtain the personnel detection result. Broadcast Message Generation: Generate a broadcast message of "Please help me monitor" according to the personnel detection result. Among them, the message includes the request event ID, door lock ID, and photo of the express item to obtain the broadcast message data. Broadcast Message Sending: According to the broadcast message data, send it to the surrounding door locks via the local area network. Among them, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message to obtain the broadcast sending status.

[0008] Optionally, the collaborative monitoring execution and feedback include: Broadcast Message Receiving: Extract the request event ID and door lock ID according to the receipt of the "Please help me monitor" broadcast message by the surrounding Door Lock B. Among them, the receiving is implemented via the local area network to obtain the broadcast message parsing result. Pan-Tilt Direction Adjustment: According to the broadcast message parsing result, Door Lock B adjusts the orientation of the pan-tilt camera towards Door Lock A. Among them, the adjustment is implemented through preset position control to obtain the adjusted pan-tilt direction. Reply message generation and sending: According to the adjusted pan-tilt direction, Door Lock B generates a reply message for "I'll monitor"; among them, the message is sent to Door Lock A through the local area network to obtain the collaborative monitoring feedback status.

[0009] Optionally, the personnel identification and monitoring restoration includes: Face image collection: According to the pan-tilt camera of Door Lock A, collect the face image of person b; among them, the collection is realized through PTZ control to obtain face image data; Face recognition comparison: According to the face image data, perform a similarity comparison with the list of household registration information; among them, the comparison is realized through a deep learning model to obtain a comparison result; Monitoring restoration and reset notification: According to the comparison result, if it is identified that the person is not the owner of this lock, turn the pan-tilt camera back to directly below to continue monitoring the express item, and generate a reset message; among them, the message is sent to Door Lock B through the local area network to obtain the monitoring restoration status.

[0010] Optionally, the item movement detection and alarm includes: Item movement detection: According to the monitoring video of the pan-tilt camera of Door Lock B, detect the movement or disappearance of the express item; among them, the detection is realized through intelligent video image analysis to obtain the item movement detection result; Alarm message generation: According to the item movement detection result, generate a notice message that someone has taken the express; among them, the message includes the video 5 seconds before and after the item movement to obtain the alarm message data; Alarm message sending and forwarding: According to the alarm message data, send it to Door Lock A through the local area network and forward it to the owner's APP; among them, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm to obtain the alarm sending status.

[0011] Another embodiment of the present application provides a multi-door-lock-based express delivery care system, and the system includes: A startup module for starting express item monitoring: According to the express item monitoring instruction sent by the owner through the mobile APP, Door Lock A adjusts the pan-tilt camera to the directly below preset position; among them, the adjustment is realized through PTZ control, and automatically searches for and locks the express item according to the photo taken by the courier to obtain the monitoring status of the express item; A detection module for personnel detection and collaborative monitoring request: According to the PIR sensor of Door Lock A detecting that person b appears in front of the door, generate a broadcast message of "Please help me monitor"; among them, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item to obtain the collaborative monitoring request status; An execution module for collaborative monitoring execution and feedback: Based on the "Please help me monitor" broadcast message received by the surrounding door lock B, adjust the orientation of the pan-tilt camera towards door lock A and aim at the express item for monitoring; wherein, the adjustment is achieved through preset position control, and at the same time, send a "I'll monitor" reply message to door lock A to obtain the collaborative monitoring execution status. An identification module for personnel identification and monitoring restoration: Compare the face image of person b collected by door lock A with the list of household registration information; wherein, if it is identified that the person is not the owner of this lock, turn the pan-tilt camera back to directly below to continue monitoring the express item, and send a "Please reset" message to door lock B to obtain the monitoring restoration status. An alarm module for item movement detection and alarm: Based on the detection of the movement or disappearance of the express item by door lock B during collaborative monitoring, generate a notice message of "Someone has taken the express"; wherein, the message includes videos of several seconds before and after the item movement, and is sent to door lock A through the local area network and forwarded to the owner's APP to obtain the item movement alarm result.

[0012] Another embodiment of the present application provides a storage medium, in which a computer program is stored, and wherein the computer program is configured to execute the method described in any one of the above when running.

[0013] Another embodiment of the present application provides an electronic device, including a memory and a processor, a computer program is stored in the memory, and the processor is configured to run the computer program to execute the method described in any one of the above.

[0014] Compared with the prior art, a method for express delivery care based on multiple door locks provided by the present invention obtains the monitoring status of the express item according to the express item monitoring instruction sent by the owner through the mobile phone APP; generates a "Please help me monitor" broadcast message according to the detection by the PIR sensor of door lock A that person b appears in front of the door; obtains the collaborative monitoring execution status according to the surrounding door lock B receiving the "Please help me monitor" broadcast message and aiming at the express item for monitoring; obtains the monitoring restoration status according to the comparison of the face image of person b collected by door lock A with the list of household registration information; obtains the item movement alarm result according to the detection of the movement or disappearance of the express item by door lock B during collaborative monitoring, so as to be able to realize the comprehensive monitoring of the express item through the collaborative work among multiple intelligent door locks. Description of the Drawings

[0015] Figure 1 It is a hardware structure block diagram of a computer terminal for a method for express delivery care based on multiple door locks provided by an embodiment of the present invention; Figure 2 It is a flow schematic diagram of a method for express delivery care based on multiple door locks provided by an embodiment of the present invention; Figure 3Schematic structural diagram of an express delivery care system based on multiple door locks provided by an embodiment of the present invention. Detailed implementation manners

[0016] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0017] An embodiment of the present invention first provides an express delivery care method based on multiple door locks. This method can be applied to an electronic device, such as a computer terminal, specifically, a common computer, etc.

[0018] The following takes running on a computer terminal as an example to describe it in detail. Figure 1 Hardware structure block diagram of a computer terminal for an express delivery care method based on multiple door locks provided by an embodiment of the present invention. As Figure 1 shown, the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0019] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions. When the program instructions are executed, the processor can execute any express delivery care method based on multiple door locks.

[0020] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0021] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any express delivery care method based on multiple door locks.

[0022] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0023] It should be understood that the processor can be a Central Processing Unit (CPU), and the processor can also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0024] See Figure 2 , an embodiment of the present invention provides a method for express delivery care based on multiple door locks, which may include the following steps: S201, Start express item monitoring: According to the express item monitoring instruction sent by the owner through the mobile phone APP, Door Lock A adjusts the orientation of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, and automatically searches for and locks the express item based on the photo taken by the courier, obtaining the monitoring status of the express item; Specifically, the start of express item monitoring includes: Monitoring instruction reception: According to the express item monitoring instruction sent by the owner through the mobile phone APP, Door Lock A receives the instruction and extracts the photo taken by the courier; wherein, the reception is achieved through the local area network, obtaining the monitoring instruction data; Pan-tilt direction adjustment: According to the monitoring instruction data, Door Lock A adjusts the orientation of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, obtaining the adjusted pan-tilt direction; Item search and locking: According to the photo taken by the courier, Door Lock A searches for and locks the express item through image search technology; wherein, the search is achieved through intelligent analysis of video images, obtaining the locking status of the express item.

[0025] S202, Personnel detection and collaborative monitoring request: According to the PIR sensor of Door Lock A detecting that Person b appears in front of the door, generate a broadcast message of "Please help me monitor"; wherein, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item, obtaining the collaborative monitoring request status; Specifically, the personnel detection and collaborative monitoring request includes: Personnel detection: According to the PIR sensor of Door Lock A detecting that Person b appears in front of the door, generate a personnel detection signal; wherein, the detection is achieved through infrared radiation induction, obtaining the personnel detection result; Broadcast message generation: Based on the personnel detection results, generate a broadcast message of "Please help me monitor"; among them, the message includes a request event ID, a door lock ID, and a photo of the express item, and broadcast message data is obtained. Broadcast message sending: According to the broadcast message data, send it to the surrounding door locks through the local area network; among them, the sending uses a low-latency communication protocol to ensure the real-time nature of the message, and a broadcast sending status is obtained.

[0026] S203, Collaborative monitoring execution and feedback: According to the surrounding door lock B receiving the "Please help me monitor" broadcast message, adjust the orientation of the pan-tilt camera towards door lock A and aim at the express item for monitoring; among them, the adjustment is achieved through preset position control, and at the same time, send a reply message of "I'll monitor" to door lock A to obtain a collaborative monitoring execution status. Specifically, the collaborative monitoring execution and feedback include: Broadcast message reception: According to the surrounding door lock B receiving the "Please help me monitor" broadcast message, extract the request event ID and the door lock ID; among them, the reception is achieved through the local area network to obtain a broadcast message parsing result. Pan-tilt direction adjustment: According to the broadcast message parsing result, door lock B adjusts the orientation of the pan-tilt camera towards door lock A; among them, the adjustment is achieved through preset position control to obtain the adjusted pan-tilt direction. Reply message generation and sending: According to the adjusted pan-tilt direction, door lock B generates a reply message of "I'll monitor"; among them, the message is sent to door lock A through the local area network to obtain a collaborative monitoring feedback status.

[0027] S204, Personnel identification and monitoring restoration: Compare the face image of person b collected by door lock A with the list of household registration information; among them, if it is identified as not the owner of this lock, turn the pan-tilt camera back to directly below to continue monitoring the express item, and send a "Please reset" message to door lock B to obtain a monitoring restoration status. Specifically, the personnel identification and monitoring restoration include: Face image collection: According to the pan-tilt camera of door lock A, collect the face image of person b; among them, the collection is achieved through PTZ control to obtain face image data. Face recognition comparison: According to the face image data, perform a similarity comparison with the list of household registration information; among them, the comparison is achieved through a deep learning model to obtain a comparison result. Monitoring restoration and reset notification: According to the comparison result, if it is identified as not the owner of this lock, turn the pan-tilt camera back to directly below to continue monitoring the express item, and generate a "Please reset" message; among them, the message is sent to door lock B through the local area network to obtain a monitoring restoration status.

[0028] S205, Item Movement Detection and Alarm: Based on the detection of the movement or disappearance of the express item by Door Lock B during collaborative monitoring, a notification message indicating that someone has taken the express is generated. Among them, the message includes videos of several seconds before and after the item movement, which are sent to Door Lock A via the local area network and then forwarded to the owner's APP to obtain the item movement alarm result.

[0029] Specifically, the item movement detection and alarm include: Item Movement Detection: Based on the monitoring video of the pan-tilt camera of Door Lock B, detect the movement or disappearance of the express item. Among them, the detection is realized through intelligent analysis of video images to obtain the item movement detection result. Alarm Message Generation: Based on the item movement detection result, generate a notification message indicating that someone has taken the express. Among them, the message includes videos of 5 seconds before and after the item movement to obtain the alarm message data. Alarm Message Sending and Forwarding: Based on the alarm message data, send it to Door Lock A via the local area network and then forward it to the owner's APP. Among them, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm and obtain the alarm sending status.

[0030] In practical applications, the present invention proposes a method for collaborative monitoring using multiple door lock pan-tilt cameras to guard express items at the door, timely discover and alarm events of items at the door being taken away by others, and at the same time retain the process video images for event backtracking.

[0031] 1. Core Idea: When the courier places the express under Door Lock A and notifies the owner A, the owner's APP notifies Door Lock A to turn the pan-tilt towards the bottom to prevent the express item from leaving the field of view. When Person B arrives, the PIR sensor of Door Lock A detects the presence of someone, then broadcasts to nearby door locks to adjust their orientations to help keep an eye on the express item, while it faces forward for face recognition of the visitor. If the recognition shows that the person is not a member, it still faces towards and keeps an eye on the express, and unicasts to the cameras that assist in keeping an eye on the item to restore the preset position. During this period, if the door lock responsible for assisting in keeping an eye on the express does not detect item movement, it restores the preset position according to the notification. If it detects item movement, it sends the videos of 5 seconds before and after the item movement to Door Lock A, and Door Lock A forwards the videos to the APP of Owner A.

[0032] 2. The complete technical implementation process is as follows: (1) Preset Conditions: The main entrance door is installed with an intelligent door lock equipped with a pan-tilt camera (each door lock has a unique door lock ID, door lock IP address, and door lock geographical location), which is connected to the cloud platform, registered with the platform, and updated periodically. The platform records the door lock list, including the door lock ID, door lock IP address, door lock geographical location, etc. Four preset directions are manually set for the orientation of the pan-tilt camera according to the geographical locations between the door locks (the front is used to identify faces, the bottom is used to monitor the ground in front of the door, and two directions towards the neighbors' doors are used to assist neighbors in monitoring. The default preset direction of the pan-tilt camera is the front). The preset directions towards the neighbors' doors are bound to the door lock IDs of the corresponding neighbors. The intelligent door lock records the list of household registration information, including the door lock ID, door lock address, name, face image / feature vector, master's mobile phone APP-ID, etc.

[0033] Note: When manually setting four preset directions for the orientation of the pan-tilt camera, the surrounding door lock positions must be considered comprehensively to ensure that each door lock is set as the preset direction by at least one other door lock.

[0034] The master's mobile phone installs an APP with a unique APP-ID, and the "express item monitoring" command of the door lock can be sent and revoked in the APP.

[0035] (2) Notify the master to receive the express item after it is delivered to the door: When the courier delivers the goods to the door and presses the visitor doorbell, if there is no response inside the house, the item will be placed at the door, and a clear photo of the item placed at the door (hereinafter referred to as the photo) will be taken and sent through the courier APP a notification message of "The item has been placed at your door" to the master, informing that the item has been placed at the door, and the message content includes the photo of the item placed at the door.

[0036] (3) The master starts the door lock pan-tilt guard after receiving the message that the express has been delivered to the door: After master a receives the message that the express has been placed at the door, immediately notify the pan-tilt camera of this lock through the mobile APP to face the bottom to monitor the express item on the ground in front of the door.

[0037] When the master (abbreviated as a, and the door lock he belongs to is A) receives the notification message "The item has been placed at your door" sent by the courier on his mobile phone, the master opens the door lock APP, clicks on the "Express Item Monitoring" menu on the APP interaction page to call the door lock A to monitor the express items at the door. At this time, the master sends the photo taken by the courier to the door lock A through the operation of the APP. The door lock A turns the pan-tilt-zoom camera towards the preset position directly below (used to monitor the express items on the ground at the door), and automatically searches for the express items according to the photo. After finding the item, it adjusts the PTZ to align with the item for continuous monitoring. If there is already an express item being continuously monitored, then at this time, the pan-tilt-zoom camera automatically adjusts the PTZ to expand the video shooting area to be able to simultaneously monitor multiple items at the door. If the master arrives home or unlocks the door from inside to pick up the express item, the pan-tilt-zoom camera of the door lock A returns to the default preset position directly in front.

[0038] Note: PTZ refers to Pan-Tilt-Zoom. Pan means horizontal rotation, Tilt means vertical rotation, and Zoom means zoom function. By adjusting the PTZ, the monitoring area range can be adjusted (for example, when in the wide-angle state, the entire area at the door can be monitored); the item search function is the image search function in video image intelligent analysis, that is, searching for the corresponding express item in the video scene according to the photo.

[0039] (4) Automatically dispatch this lock and surrounding door locks to participate in collaborative monitoring when someone appears in front of the door lock: Suppose person b (at this time the door lock does not know whether b is the master of this lock) comes in front of the door lock A. The door lock A requests the surrounding door locks to assist in monitoring the express items on the ground at the door (at this time, the pan-tilt-zoom camera of the door lock A has left the position directly below, and there will be an empty gap in the monitoring of the express items. In order to fill this monitoring gap, A will request the surrounding door locks to collaborate in monitoring). At the same time, the door lock A immediately rotates the pan-tilt-zoom camera to enter the face recognition state at the default preset position (directly in front).

[0040] When person b appears in front of the door lock A and is detected by the PIR (Passive Infrared Sensor) sensor of A, the door lock A sends a broadcast message of "Please help me monitor" to other door locks, including the request event ID, door lock ID (A), photo, etc. At the same time, the door lock A immediately rotates the pan-tilt-zoom camera of this lock towards the front to capture the face image of the person coming and perform face recognition comparison.

[0041] After the surrounding door lock B receives the broadcast request message of "Please help me monitor" and finds the ID of the door lock A in its preset position, it immediately adjusts the pan-tilt-zoom camera of itself towards the door lock A according to this preset position, and uses the photo to search for and align with the express items at the door of A for monitoring. At the same time, it unicasts a reply message of "I'll monitor" to inform A, and the message content includes the request event ID of the door lock A, door lock ID (B), etc.

[0042] After the door lock A sends a broadcast message of "Please help me monitor" and receives a unicast "I'll monitor" reply message from the door lock B, it stores the message, which contains the request event ID and the door lock ID (B). At this time, A knows that B is assisting in the monitoring. If the door lock A does not receive any "I'll monitor" reply message after a 5-second delay, the door lock A sends an alarm message of "Request for assisted monitoring failed" to the platform. The message content includes the door lock ID (A), the request event ID, and the timestamp (the current clock of the door lock A). The platform receives the alarm message and processes it according to the business logic of the platform.

[0043] Note: The PIR sensor is a passive infrared sensor, mainly used to detect the infrared radiation of the human body to achieve motion detection. When someone approaches, it can trigger the door lock to execute a certain response. For example, when the PIR alarm is triggered, the pan-tilt camera adjusts the preset position. After sending a broadcast message to the surrounding door locks, if multiple door locks respond, it doesn't matter. If no door lock responds to "Please help me monitor", it may be that the door lock with the preset position set to this lock has a fault. Then an alarm message (the message content includes: no door lock responds to the request for assisted monitoring of this lock) is sent to the platform, and the platform queries and processes it. This is not the focus of the present invention and will not be further described.

[0044] (5) Monitoring of express items when a person unlocks and enters or leaves: If person b is not the owner of the door lock A after comparison, A immediately turns its pan-tilt camera back to directly below for monitoring of the express items, and at the same time notifies the assisting monitoring door lock B to stop monitoring (at this time, A is already in the monitoring state). If it is found during the collaborative monitoring of the door lock B that the express item has been moved and disappeared, B immediately sends the video images 5 seconds before and after the item was moved and disappeared to the door lock A, and A forwards them to the owner APP of A for viewing and handling.

[0045] The door lock A captures the face image of the incoming person b and calculates and compares the similarity with the face images / feature vectors in the resident registration information list of this lock (check whether the similarity value meets the threshold, and the threshold can generally be set to 80%). If the person is identified as not the owner of this lock, the pan-tilt camera of this lock immediately turns back to the direction pointing to the express item for monitoring of the express item. After extracting the IP address of the door lock B from the received "I'll monitor" message sent by B, a unicast reset notification message of "Please reset" is sent to B, and the content includes the door lock ID (A) and the request event ID. After receiving the reset notification message, the door lock B rotates the pan-tilt camera back to its default preset position and ends the process; if multiple door locks reply "I'll monitor" and participate in the collaborative monitoring, then A sends a unicast reset notification message of "Please reset" to each door lock participating in the collaborative monitoring, so that the orientations of their pan-tilt cameras are restored to their respective default preset positions (here, only the door lock B is used as a representative of the participating collaborative monitoring for description).

[0046] If the person b in front of the door lock A is verified to be the owner of the door lock A after comparison, the door lock A unlocks and opens the door for b, and b moves the express delivery item into the door (since the door lock A has been opened, at this time, the pan-tilt camera facing the door lock A of the express delivery item will not be able to effectively monitor the express delivery item, while the door locks participating in the collaborative monitoring are always in continuous monitoring, and there will be no monitoring gap during this process).

[0047] During the process of the door lock B participating in the collaborative monitoring, if B detects that the express delivery item in the video scene moves and disappears (B only performs video monitoring and does not identify the identity of the person moving the express delivery item), it will send a notification message of "Someone has taken the express delivery" to the door lock A in a unicast manner for the video of 5 seconds before and after the item disappears. The message content includes the request event ID of the door lock ID (A), the door lock ID (B), and the video of 5 seconds before and after the disappearance of the express delivery item at the door of A collected by B.

[0048] The door lock A receives the notification message of "Someone has taken the express delivery" sent by B and extracts the video of 5 seconds before and after the item disappears. The door lock A receives and forwards the video to the mobile APP of the owner according to the APP-ID in the household registration information list, and then deletes the message of "I will monitor" sent by the door lock B.

[0049] The owner checks the video sent by the door lock through the mobile APP. If the express delivery is taken by himself / herself, the video is ignored, and the owner clicks "Cancel the monitoring of the express delivery item" on the interactive page of the mobile APP. The door lock A adjusts the orientation of the pan-tilt camera to the default preset position (directly in front) according to the owner's cancellation instruction, and the monitoring process of the express delivery item by the door lock A ends (if A or B detects that the express delivery item has been moved and disappeared, regardless of whether it receives the instruction of "Cancel the monitoring of the express delivery item" sent by the owner through the mobile APP, the orientation of the pan-tilt camera will be adjusted to the default preset position (directly in front), and the monitoring process of the express delivery item by the door lock A ends, because there is no item to be monitored at the door at this time and there is no need to continue monitoring); if the owner checks the video and finds that the express delivery item is not taken by himself / herself, the owner can view the video to find out who took the express delivery item. If it is confirmed that a suspicious person took it, the owner can call the police at 110 and let the public security organ handle it.

[0050] After the courier puts the express delivery item at the door of the house, by scheduling the pan-tilt cameras of his own door lock and the surrounding door locks to collaborate in monitoring, the problem of the express delivery item being unattended at the door of the house is solved.

[0051] It can be seen that, according to the express item monitoring instruction sent by the owner through the mobile APP, the monitoring status of the express item is obtained; according to the PIR sensor of the door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door lock B receiving the broadcast message of "Please help me monitor" and aiming at the express item for monitoring, the collaborative monitoring execution status is obtained; according to the face image of person b collected by the door lock A, comparing it with the list of household registration information, the monitoring recovery status is obtained; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring, the item movement alarm result is obtained, so that through the collaborative work among multiple intelligent door locks, comprehensive monitoring of the express item can be realized.

[0052] Another embodiment of the present invention provides a courier care system based on multiple door locks. Refer to Figure 3 , the system may include: A start module 301, used for starting the monitoring of express items: According to the express item monitoring instruction sent by the owner through the mobile APP, the door lock A adjusts the orientation of the pan-tilt camera to the preset position directly below; wherein, the adjustment is achieved through PTZ control, and automatically searches for and locks the express item according to the photo taken by the courier, and obtains the monitoring status of the express item; A detection module 302, used for personnel detection and collaborative monitoring request: According to the PIR sensor of the door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; wherein, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item, and the collaborative monitoring request status is obtained; An execution module 303, used for collaborative monitoring execution and feedback: According to the surrounding door lock B receiving the broadcast message of "Please help me monitor", adjusts the orientation of the pan-tilt camera to the door lock A and aims at the express item for monitoring; wherein, the adjustment is achieved through preset position control, and at the same time sends a reply message of "I'll monitor" to the door lock A, and obtains the collaborative monitoring execution status; An identification module 304, used for personnel identification and monitoring recovery: According to the face image of person b collected by the door lock A, comparing it with the list of household registration information; wherein, if it is identified as not the owner of this lock, the pan-tilt camera is turned back to the position directly below to continue monitoring the express item, and a message of "Please reset" is sent to the door lock B, and the monitoring recovery status is obtained; An alarm module 305, used for item movement detection and alarm: According to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring, a notification message of "Someone has taken the express" is generated; wherein, the message includes the video of several seconds before and after the item movement, and is sent to the door lock A through the local area network and forwarded to the owner APP, and the item movement alarm result is obtained.

[0053] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile APP, the monitoring status of the express item is obtained; according to the PIR sensor of door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door lock B receiving the broadcast message of "Please help me monitor" and aiming at the express item for monitoring, the collaborative monitoring execution status is obtained; according to the face image of person b collected by door lock A, it is compared with the list of registered household information to obtain the monitoring recovery status; according to door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained, so that through the collaborative work among multiple intelligent door locks, the comprehensive monitoring of the express item can be realized.

[0054] An embodiment of the present invention further provides a storage medium, in which a computer program is stored, and the computer program is set to execute the steps in any one of the above method embodiments when running.

[0055] Specifically, in this embodiment, the above storage medium can be set to store a computer program for executing the following steps: S201, Start of express item monitoring: According to the express item monitoring instruction sent by the owner through the mobile APP, door lock A adjusts the orientation of the pan-tilt camera to the pre-set position directly below; wherein, the adjustment is realized through PTZ control, and the express item is automatically searched for and locked according to the photo taken by the courier to obtain the monitoring status of the express item; S202, Personnel detection and collaborative monitoring request: According to the PIR sensor of door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; wherein, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item to obtain the collaborative monitoring request status; S203, Collaborative monitoring execution and feedback: According to the surrounding door lock B receiving the broadcast message of "Please help me monitor", adjust the orientation of the pan-tilt camera to door lock A and aim at the express item for monitoring; wherein, the adjustment is realized through pre-set position control, and at the same time, a reply message of "I will monitor" is sent to door lock A to obtain the collaborative monitoring execution status; S204, Personnel identification and monitoring recovery: According to the face image of person b collected by door lock A, it is compared with the list of registered household information; wherein, if it is identified as not the owner of this lock, the pan-tilt camera is turned back to the position directly below to continue monitoring the express item, and a "Please reset" message is sent to door lock B to obtain the monitoring recovery status; S205, Item movement detection and alarm: According to door lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, a notification message of "Someone has taken the express" is generated; wherein, the message includes the video of several seconds before and after the item movement and is sent to door lock A through the local area network and then forwarded to the owner APP to obtain the item movement alarm result.

[0056] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile phone APP, the monitoring status of the express item is obtained; according to the PIR sensor of the door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding door lock B receiving the broadcast message of "Please help me monitor" and aiming at the express item for monitoring, the collaborative monitoring execution status is obtained; according to the face image of person b collected by the door lock A, it is compared with the list of registered household information to obtain the monitoring recovery status; according to the door lock B detecting the movement or disappearance of the express item during the collaborative monitoring, the item movement alarm result is obtained, so that through the collaborative work among multiple intelligent door locks, the comprehensive monitoring of the express item can be realized.

[0057] An embodiment of the present invention further provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0058] Specifically, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0059] Specifically, in this embodiment, the above processor may be configured to execute the following steps through a computer program: S201, Start of express item monitoring: According to the express item monitoring instruction sent by the owner through the mobile phone APP, the door lock A adjusts the orientation of the pan-tilt camera to the lower preset position; wherein, the adjustment is achieved through PTZ control, and the express item is automatically searched for and locked according to the photo taken by the courier to obtain the monitoring status of the express item; S202, Personnel detection and collaborative monitoring request: According to the PIR sensor of the door lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; wherein, the broadcast message is sent to the surrounding door locks through the local area network to request assistance in monitoring the express item to obtain the collaborative monitoring request status; S203, Collaborative monitoring execution and feedback: According to the surrounding door lock B receiving the broadcast message of "Please help me monitor", adjust the orientation of the pan-tilt camera to the door lock A and aim at the express item for monitoring; wherein, the adjustment is achieved through preset position control, and at the same time, a reply message of "I will monitor" is sent to the door lock A to obtain the collaborative monitoring execution status; S204, Personnel identification and monitoring recovery: According to the face image of person b collected by the door lock A, it is compared with the list of registered household information; wherein, if it is identified as not the owner of this lock, the pan-tilt camera is turned back to the lower position to continue monitoring the express item, and a "Please reset" message is sent to the door lock B to obtain the monitoring recovery status; S205, Item Movement Detection and Alarm: Based on the detection of the movement or disappearance of the express item by Door Lock B during the collaborative monitoring process, a notification message indicating that someone has taken the express is generated. Among them, the message includes the video of the few seconds before and after the item movement, which is sent to Door Lock A through the local area network and then forwarded to the owner's APP to obtain the item movement alarm result.

[0060] It can be seen that according to the express item monitoring instruction sent by the owner through the mobile APP, the monitoring status of the express item is obtained; according to the PIR sensor of Door Lock A detecting that person b appears in front of the door, a broadcast message of "Please help me monitor" is generated; according to the surrounding Door Lock B receiving the "Please help me monitor" broadcast message and aiming at the express item for monitoring, the collaborative monitoring execution status is obtained; according to the face image of person b collected by Door Lock A, it is compared with the list of household registration information to obtain the monitoring recovery status; according to Door Lock B detecting the movement or disappearance of the express item during the collaborative monitoring process, the item movement alarm result is obtained. Thus, through the collaborative work of multiple intelligent door locks, the comprehensive monitoring of express items can be realized.

[0061] The above has detailed the structure, features and effects of the present invention according to the embodiments shown in the diagrams. The above is only the preferred embodiment of the present invention, but the present invention is not limited to the scope shown in the drawings. Any changes made according to the concept of the present invention, or modified into equivalent embodiments with equivalent changes, still within the spirit covered by the specification and the drawings, shall be within the protection scope of the present invention.

Claims

1. A method for express delivery care based on multiple door locks, characterized in that, The method includes: Express item monitoring startup: According to the express item monitoring instruction sent by the owner, Door Lock A adjusts the orientation of the pan-tilt camera, searches for and locks the express item based on the photo, and obtains the monitoring status of the express item. Person detection and collaborative monitoring request: When the sensor of Door Lock A detects Person b, a broadcast message of "Please help me monitor" is generated and sent to the surrounding door locks to request assistance in monitoring the express item, and the collaborative monitoring request status is obtained. Collaborative monitoring execution and feedback: The surrounding Door Lock B receives the broadcast message, adjusts the orientation of the pan-tilt camera towards Door Lock A, and monitors the express item, and at the same time sends a reply message of "I'll monitor it" to Door Lock A, and the collaborative monitoring execution status is obtained. Person identification and monitoring restoration: According to the face image of Person b collected by Door Lock A, it is compared with the list of household registration information. If it is identified as not the owner of this lock, the pan-tilt camera is turned back, continues to monitor the express item, and sends a "Please reset" message to Door Lock B, and the monitoring restoration status is obtained. Item movement detection and alarm: When Door Lock B detects that the express item moves or disappears, a notification message of "Someone has taken the express" is generated and sent to Door Lock A and forwarded to the owner's APP, and the item movement alarm result is obtained.

2. The method according to claim 1, characterized in that, The express item monitoring startup includes: Monitoring instruction reception: According to the express item monitoring instruction sent by the owner through the mobile APP, Door Lock A receives the instruction and extracts the photo taken by the courier; wherein, the reception is realized through the local area network, and the monitoring instruction data is obtained. Pan-tilt direction adjustment: According to the monitoring instruction data, Door Lock A adjusts the orientation of the pan-tilt camera to the preset position directly below; wherein, the adjustment is realized through PTZ control, and the adjusted pan-tilt direction is obtained. Item search and lock: According to the photo taken by the courier, Door Lock A searches for and locks the express item through image search technology; wherein, the search is realized through intelligent video image analysis, and the locked state of the express item is obtained.

3. The method according to claim 2, wherein The person detection and collaborative monitoring request includes: Person detection: When the PIR sensor of Door Lock A detects that Person b appears in front of the door, a person detection signal is generated; wherein, the detection is realized through infrared radiation induction, and the person detection result is obtained. Broadcast message generation: According to the person detection result, a broadcast message of "Please help me monitor" is generated; wherein, the message includes the request event ID, door lock ID, and photo of the express item, and the broadcast message data is obtained. Broadcast message sending: According to the broadcast message data, it is sent to the surrounding door locks through the local area network; wherein, the sending adopts a low-latency communication protocol to ensure the real-time nature of the message, and the broadcast sending status is obtained.

4. The method according to claim 3, wherein The collaborative monitoring execution and feedback includes: Broadcast message reception: According to the surrounding Door Lock B receiving the broadcast message of "Please help me monitor", the request event ID and door lock ID are extracted; wherein, the reception is realized through the local area network, and the broadcast message parsing result is obtained. Pan-tilt direction adjustment: According to the broadcast message parsing result, Door Lock B adjusts the orientation of the pan-tilt camera towards Door Lock A; wherein, the adjustment is realized through preset position control, and the adjusted pan-tilt direction is obtained. Reply message generation and sending: According to the adjusted pan-tilt direction, Door Lock B generates a reply message of "I'll monitor it"; among them, the message is sent to Door Lock A through the local area network to obtain the collaborative monitoring feedback status.

5. The method according to claim 4, wherein The personnel identification and monitoring recovery include: Face image acquisition: According to the pan-tilt camera of Door Lock A, the face image of person b is acquired; among them, the acquisition is realized through PTZ control to obtain face image data; Face recognition comparison: According to the face image data, a similarity comparison is made with the list of household registration information; among them, the comparison is realized through a deep learning model to obtain the comparison result; Monitoring recovery and reset notification: According to the comparison result, if it is recognized that the person is not the owner of this lock, the pan-tilt camera is turned back to directly below to continue monitoring the express item, and a "Please reset" message is generated; among them, the message is sent to Door Lock B through the local area network to obtain the monitoring recovery status.

6. The method according to claim 5, characterized in that, The item movement detection and alarm include: Item movement detection: According to the monitoring video of the pan-tilt camera of Door Lock B, the movement or disappearance of the express item is detected; among them, the detection is realized through intelligent analysis of video images to obtain the item movement detection result; Alarm message generation: According to the item movement detection result, a notification message of "Someone has taken the express" is generated; among them, the message includes the video 5 seconds before and after the item movement to obtain the alarm message data; Alarm message sending and forwarding: According to the alarm message data, it is sent to Door Lock A through the local area network and forwarded to the owner's APP; among them, the sending adopts a low-latency communication protocol to ensure the real-time nature of the alarm to obtain the alarm sending status.

7. An express delivery care system based on multiple door locks, characterized in that, The system includes: A startup module, which is used to, according to the express item monitoring instruction sent by the owner, Door Lock A adjusts the orientation of the pan-tilt camera, searches for and locks the express item according to the photo, and obtains the monitoring status of the express item; A detection module, which is used for personnel detection and collaborative monitoring request: When the sensor of Door Lock A detects person b, a broadcast message of "Please help me monitor" is generated, and the broadcast message is sent to the surrounding door locks to request assistance in monitoring the express item to obtain the collaborative monitoring request status; An execution module, which is used for collaborative monitoring execution and feedback: The surrounding Door Lock B receives the broadcast message, adjusts the orientation of the pan-tilt camera towards Door Lock A, and aims at the express item for monitoring. At the same time, a reply message of "I'll monitor it" is sent to Door Lock A to obtain the collaborative monitoring execution status; An identification module, which is used for personnel identification and monitoring recovery: According to the face image of person b collected by Door Lock A, a comparison is made with the list of household registration information. If it is recognized that the person is not the owner of this lock, the pan-tilt camera is turned back to continue monitoring the express item, and a "Please reset" message is sent to Door Lock B to obtain the monitoring recovery status; An alarm module, which is used for item movement detection and alarm: Door Lock B detects the movement or disappearance of the express item, generates a notification message of "Someone has taken the express", and sends the notification message to Door Lock A and forwards it to the owner's APP to obtain the item movement alarm result.

8. The system according to claim 7, wherein The startup module is specifically used for: Monitoring instruction reception: According to the express item monitoring instruction sent by the owner through the mobile APP, Door Lock A receives the instruction and extracts the photo taken by the courier; among them, the reception is realized through the local area network to obtain the monitoring instruction data; Pan-tilt direction adjustment: According to the monitoring instruction data, Door Lock A adjusts the pan-tilt camera to the preset position directly below; among them, the adjustment is realized through PTZ control to obtain the adjusted pan-tilt direction. Item search and locking: According to the photos taken by the courier, Door Lock A searches for and locks the express item through image search technology; among them, the search is realized through intelligent analysis of video images to obtain the locked state of the express item.

9. A storage medium, characterized in that, The computer program is stored in the storage medium, wherein the computer program is set to execute the method described in any one of claims 1-6 when running.

10. An electronic device, comprising a memory and a processor, characterized in that, The computer program is stored in the memory, and the processor is set to run the computer program to execute the method described in any one of claims 1-6.

Images