Express delivery method and system based on door lock

Abstract

The invention discloses an express delivery method and system based on a door lock, and the method comprises the steps: collecting a face image of a courier through the door lock before the courier arrives at the door lock, and transmitting the face image to a platform for identity verification, thereby obtaining an express scanning result; according to an express item scanning result, express item information is extracted and compared with the resident registration information list, and an express item delivery notification state is obtained; after the courier leaves, the door lock enables the pan-tilt camera to face the position under the pan-tilt camera to conduct express item monitoring, and an express item monitoring state is obtained; when the owner picks up the express, the door lock adjusts the pan-tilt camera to face right ahead for face recognition, and an express signing result is obtained; and sending an express mail formal signing message to the platform and the owner APP according to an express mail signing result to obtain a signing information sending state. By means of the embodiment of the invention, the safety of the express item can be improved, the express delivery process is optimized, and the user experience is enhanced.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a method and system for express delivery based on a door lock. Background Art

[0002] In the context of the rapid development of digitalization and e-commerce, express delivery services have become an indispensable part of modern consumers' daily lives. However, with the rapid development of the express delivery industry, the issues of security and efficiency faced by express items during the delivery process have become increasingly prominent. Traditional express delivery methods usually rely on couriers to place packages at the door, lacking effective means of identity verification, information recording, and monitoring. This makes express items vulnerable to theft, damage, or misdelivery during the delivery process.

[0003] Enterprises engaged in express delivery business shall deliver express items to the agreed receiving address, recipient, or the designated consignee of the recipient, and inform the recipient or consignee to conduct an on-site inspection. However, in actual operation, the courier leaves after delivering the express item to the doorstep. At this time, the ownership of the express item is not clear, and it is also impossible to define whether it is signed by the owner, posing many potential risks. Summary of the Invention

[0004] The purpose of the present invention is to provide a method and system for express delivery based on a door lock to solve the deficiencies in the prior art, improve the security of express items, optimize the express delivery process, and enhance the user experience.

[0005] An embodiment of the present application provides a method for express delivery based on a door lock, and the method includes: Courier identity verification and express item scanning: Before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for identity verification; wherein, if the verification is successful, the express item barcode scanner is activated to scan the express item barcode and capture the express item image to obtain the express item scanning result; Express item information comparison and delivery notice: According to the express item scanning result, extract the express item information and compare it with the list of household registration information; wherein, if the comparison passes, send a message that the express item has been delivered to the owner APP and the platform to obtain the express item delivery notice status; Express item monitoring and motion detection: After the courier leaves, the door lock turns the pan-tilt camera downward for express item monitoring; wherein, the monitoring is achieved through video image target tracking or motion detection to obtain the express item monitoring status; Owner signature and identity binding: When the owner picks up the express item, the door lock adjusts the pan-tilt camera to face forward for face recognition; wherein, if the recognition is successful, sign for the express item through the express item barcode scanner and bind the signature information to the owner's identity to obtain the express item signature result; Signing Information Sending and Cache Cleaning: According to the signing result of the express delivery, send the official signing message of the express delivery to the platform and the host APP; among them, the message includes express delivery information, signer information and face image, and clean the signed express delivery information in the cache to obtain the signing information sending status.

[0006] Optionally, the courier identity verification and express delivery scanning include: Face Image Collection: Before the courier arrives at the door lock, the door lock collects the face image of the courier; among them, the collection is realized by a pan-tilt camera to obtain face image data; Identity Verification Request: According to the face image data, generate a message asking to confirm whether it is the courier; among them, the message is authenticated through the platform to obtain the verification result; Express Delivery Scanning and Image Capture: According to the verification result, if it is a courier, turn on the express delivery barcode scanner and scan the express delivery barcode; among them, the scanning is realized by the barcode scanner, and at the same time capture the express delivery image to obtain the express delivery scanning result.

[0007] Optionally, the express delivery information comparison and delivery notice include: Express Delivery Information Extraction: According to the express delivery scanning result, extract the express delivery information; among them, the information includes the waybill number, recipient name, recipient address and contact phone number to obtain the express delivery information data; Information Comparison and Inspection: According to the express delivery information data, compare it with the list of household registration information; among them, the comparison is realized by similarity calculation to obtain the comparison result; Delivery Notice Generation and Sending: According to the comparison result, if the comparison passes, generate a message that the express delivery has been delivered; among them, the message is sent to the host APP and the platform through the local area network to obtain the delivery notice status.

[0008] Optionally, the express delivery monitoring and motion detection include: Pan-Tilt Direction Adjustment: After the courier leaves, the door lock turns the pan-tilt camera downward; among them, the adjustment is realized by PTZ control to obtain the adjusted pan-tilt direction; Express Delivery Target Tracking: According to the adjusted pan-tilt direction, track the express delivery by the technology of searching for pictures by picture; among them, the tracking is realized by intelligent analysis of video images to obtain the express delivery tracking status; Motion Detection and Alarm: According to the express delivery tracking status, if the express delivery is detected to move, trigger an alarm; among them, the alarm is realized by video image motion detection to obtain the alarm status.

[0009] Optionally, the host signing and identity binding include: Face image acquisition and recognition: When the owner picks up the express delivery, the door lock adjusts the PTZ camera to face forward to collect the face image; among them, the acquisition is realized through PTZ control to obtain the face image data; Face comparison and identity confirmation: According to the face image data, compare it with the list of household registration information; among them, the comparison is realized through a deep learning model to obtain the comparison result; Express delivery scanning and signing: According to the comparison result, if the recognition is successful, sign for the express delivery through the express delivery barcode scanner; among them, the signing is realized through the barcode scanner to obtain the express delivery signing result; Identity binding and information sending: According to the express delivery signing result, bind the signing information to the owner's identity; among them, the binding is realized through information association, and send the official express delivery signing message to the platform and the owner's APP to obtain the identity binding status.

[0010] Optionally, the signing information sending and cache cleaning include: Signing information extraction: According to the express delivery signing result, extract the express delivery information and the signer information; among them, the information includes the waybill number, the signer's name, the contact phone number and the face image to obtain the signing information data; Message generation and sending: According to the signing information data, generate the official express delivery signing message; among them, the message is sent to the platform and the owner's APP through the local area network to obtain the message sending status; Cache cleaning: According to the message sending status, clean the signed express delivery information in the cache; among them, the cleaning is realized through data deletion to obtain the cache cleaning status.

[0011] Another embodiment of the present application provides an express delivery system based on a door lock, and the system includes: Verification module, used for courier identity verification and express delivery scanning: When the courier arrives in front of the door lock, the door lock collects the courier's face image and sends it to the platform for identity verification; among them, if the verification is successful, the express delivery barcode scanner is turned on to scan the express delivery barcode and capture the express delivery image to obtain the express delivery scanning result; Comparison module, used for express delivery information comparison and delivery notice: According to the express delivery scanning result, extract the express delivery information and compare it with the list of household registration information; among them, if the comparison passes, send the message that the express delivery has been delivered to the owner's APP and the platform to obtain the express delivery delivery notice status; Monitoring module, used for express delivery monitoring and motion detection: After the courier leaves, the door lock turns the PTZ camera downward to monitor the express delivery; among them, the monitoring is realized through video image target tracking or motion detection to obtain the express delivery monitoring status; The signing module is used to bind the owner's signature to the owner's identity: when the owner picks up the express, the door lock adjusts the PTZ camera to face forward for face recognition; if the recognition is successful, the express is signed for through the express barcode scanner, and the signature information is bound to the owner's identity to obtain the express signing result; The sending module is used for sending receipt information and clearing the cache: according to the express delivery receipt result, the formal receipt message of the express delivery is sent to the platform and the owner APP; wherein, the message contains the express delivery information, the information of the signatory and the face image, and the express delivery information that has been signed in the cache is cleared to obtain the sending status of the receipt information.

[0012] Yet another embodiment of the present application provides a storage medium, wherein the storage medium stores a computer program, wherein the computer program is configured to execute any of the above methods when running.

[0013] Yet another embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any of the methods described above.

[0014] Compared with the prior art, the present invention provides a door lock-based express delivery method. Before the courier arrives at the door lock, the door lock collects the courier's facial image and sends it to the platform for identity verification to obtain the express scanning result; based on the express scanning result, the express information is extracted and compared with the resident registration information list to obtain the express delivery notification status; after the courier leaves, the door lock points the pan-tilt camera directly downward to monitor the express and obtain the express monitoring status; when the owner picks up the express, the door lock adjusts the pan-tilt camera to point directly forward for facial recognition to obtain the express receipt result; based on the express receipt result, the express formal receipt message is sent to the platform and the owner's APP to obtain the receipt information sending status, thereby improving the safety of express items, optimizing the express delivery process, and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A hardware structure block diagram of a computer terminal for a door lock-based express delivery method provided by an embodiment of the present invention; Figure 2 A schematic diagram of a flow chart of a door lock-based express delivery method provided by an embodiment of the present invention; Figure 3 A schematic structural diagram of a door lock-based express delivery system provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0016] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, but should not be construed as limiting the present invention.

[0017] An embodiment of the present invention first provides a method for express delivery based on a door lock, which can be applied to an electronic device, such as a computer terminal, specifically, an ordinary computer, etc.

[0018] The following takes running on a computer terminal as an example for detailed description. Figure 1 It is a hardware structure block diagram of a computer terminal for a method for express delivery based on a door lock provided by an embodiment of the present invention. As Figure 1 shown, the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0019] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any method for express delivery based on a door lock.

[0020] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0021] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any method for express delivery based on a door lock.

[0022] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0023] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0024] See Figure 2, an embodiment of the present invention provides a method for express delivery based on a door lock, which may include the following steps: S201, Courier Authentication and Express Scanning: Before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for authentication; wherein, if the authentication is successful, the express barcode scanner is activated to scan the express barcode and capture the express image to obtain the express scanning result; specifically, the courier authentication and express scanning include: Face Image Capture: Before the courier arrives at the door lock, the door lock captures the courier's face image; wherein, the capture is implemented by a pan-tilt camera to obtain face image data; Authentication Request: Based on the face image data, generate a message asking to confirm whether it is the courier; wherein, the message is authenticated through the platform to obtain the authentication result; Express Scanning and Image Capture: According to the authentication result, if it is the courier, activate the express barcode scanner and scan the express barcode; wherein, the scanning is implemented by a barcode scanner, and at the same time, capture the express image to obtain the express scanning result.

[0025] S202, Express Information Comparison and Delivery Notification: According to the express scanning result, extract the express information and compare it with the list of household registration information; wherein, if the comparison passes, send a message that the express has been delivered to the master APP and the platform to obtain the express delivery notification status; specifically, the express information comparison and delivery notification include: Express Information Extraction: According to the express scanning result, extract the express information; wherein, the information includes the waybill number, recipient's name, recipient's address, and contact phone number to obtain the express information data; Information Comparison and Inspection: According to the express information data, compare it with the list of household registration information; wherein, the comparison is implemented through similarity calculation to obtain the comparison result; Delivery Notification Generation and Sending: According to the comparison result, if the comparison passes, generate a message that the express has been delivered; wherein, the message is sent to the master APP and the platform through the local area network to obtain the delivery notification status.

[0026] S203, Express Monitoring and Motion Detection: After the courier leaves, the door lock turns the pan-tilt camera downward for express monitoring; wherein, the monitoring is implemented through video image target tracking or motion detection to obtain the express monitoring status; specifically, the express monitoring and motion detection include: Pan-Tilt Direction Adjustment: After the courier leaves, the door lock turns the pan-tilt camera downward; wherein, the adjustment is implemented through PTZ control to obtain the adjusted pan-tilt direction; Express target tracking: According to the adjusted pan-tilt direction, track the express by image search technology; wherein, the tracking is realized through intelligent analysis of video images to obtain the express tracking status; Motion detection and alarm: According to the express tracking status, if the express is detected to move, trigger an alarm; wherein, the alarm is realized through motion detection of video images to obtain the alarm status.

[0027] S204, Master signature and identity binding: According to the master picking up the express, the door lock adjusts the pan-tilt camera to face forward for face recognition; wherein, if the recognition is successful, sign for the express through the express barcode scanner and bind the signature information to the master's identity to obtain the express signature result; specifically, the master signature and identity binding includes: Face image acquisition and recognition: According to the master picking up the express, the door lock adjusts the pan-tilt camera to face forward to acquire the face image; wherein, the acquisition is realized through PTZ control to obtain the face image data; Face comparison and identity confirmation: According to the face image data, compare it with the list of household registration information; wherein, the comparison is realized through a deep learning model to obtain the comparison result; Express scanning signature: According to the comparison result, if the recognition is successful, sign for the express through the express barcode scanner; wherein, the signature is realized through the barcode scanner to obtain the express signature result; Identity binding and information sending: According to the express signature result, bind the signature information to the master's identity; wherein, the binding is realized through information association and send the official express signature message to the platform and the master's APP to obtain the identity binding status.

[0028] S205, Signature information sending and cache cleaning: According to the express signature result, send the official express signature message to the platform and the master's APP; wherein, the message includes express information, signatory information and face image, and clean the signed express information in the cache to obtain the signature information sending status.

[0029] Specifically, the signature information sending and cache cleaning includes: Signature information extraction: According to the express signature result, extract the express information and signatory information; wherein, the information includes waybill number, signatory name, contact phone number and face image to obtain the signature information data; Message generation and sending: According to the signature information data, generate the official express signature message; wherein, the message is sent to the platform and the master's APP through the local area network to obtain the message sending status; Cache cleaning: According to the message sending status, clean the signed express information in the cache; wherein, the cleaning is realized through data deletion to obtain the cache cleaning status.

[0030] In practical applications, the present invention proposes a method for signing for express deliveries using a door lock. The door lock is used to scan and identify the express delivery, and face recognition is used to bind with the express delivery image to confirm the signature.

[0031] 1. Core idea: The door lock system is connected to the express delivery system, and the door lock can scan the express delivery number; when the courier scans on the camera of the corresponding door lock to obtain the information of the room to which it belongs, if it is correct, it will ring "beep", if it is not the correct room, it will prompt "Express delivery error"; if it is correct, the door lock sends a message to the owner's APP, and at the same time notifies the express delivery system that the relevant express delivery has been received but not signed by the owner; the door lock faces the express delivery, when the owner picks up the item, the door lock camera faces the face, and through the face feature vector and the member information saved locally to check, the owner's name is obtained, and if it is found to be the same as the express delivery recipient, it notifies the express delivery system to officially sign for it.

[0032] 2. The complete technical implementation process is as follows: (1) Prerequisites: An intelligent door lock with a pan-tilt camera and an express delivery barcode scanner is installed on the owner's entrance door (each door lock has an independent door lock ID, door lock IP address, and door lock geographical location), and it is connected to the cloud express delivery system platform (hereinafter referred to as the platform), registers with the platform, and updates periodically. The platform records the door lock list, including the door lock ID, door lock IP address, door lock geographical location, etc. The intelligent door lock records the list of household registration information, including the door lock ID, door lock address, name, face image / feature vector, contact phone number, etc. The owner's mobile phone installs the intelligent door lock APP, and each APP has a unique ID (such as the username + mobile phone number used during registration), and supports reporting the APP-ID. The pan-tilt camera is set with three preset positions: directly in front (for face capture and recognition comparison), scanning (for capturing the express delivery image when scanning the express delivery), and directly below (for guarding the express delivery left at the door).

[0033] The express delivery system platform (hereinafter referred to as the platform) saves the list of courier registration information, including courier ID, courier name, courier face image / feature vector, etc.

[0034] (2) Processing method for the courier to deliver the express delivery to the door: The courier brings the express delivery to the door lock. The door lock captures the courier's face image and sends it to the platform for identification and comparison to determine if it is the courier. If the comparison is successful, the platform notifies the door lock to enter the express delivery scanning and receiving mode. The door lock receives the express delivery through the express delivery barcode scanner, and while notifying the platform, it also notifies the owner that the express delivery has been delivered to the door and is waiting to be signed for.

[0035] Courier Identification and Express Package Scanning Preparation: When the courier arrives at the door lock in front of the resident's house, after the door lock detects and identifies the courier's face image, it extracts the feature vector of the face image and first calculates and compares the similarity with the face image / feature vector in the resident registration information list (check whether the similarity value meets the threshold, which can generally be set to 80%). If the courier is exactly the homeowner, the door lock will unlock and open the door (if the courier is exactly the homeowner, at this time, they should directly carry the express package home); if the courier is not the homeowner, the feature vector of the face image of the courier collected will be sent as a "Please confirm whether it is a courier" request query message to the platform, and the message content includes the door lock ID, the door lock IP address, the feature vector of the courier's face image, etc. The platform receives the "Please confirm whether it is a courier" request query message from the door lock, extracts the feature vector of the courier's face image in the message and calculates and compares the similarity with the face image / feature vector in the courier registration information list of the platform (check whether the similarity value meets the threshold, which can generally be set to 80%), and according to the door lock IP address in the message, it will reply a "Courier Confirmation Result" message to the door lock, and the message content includes the door lock ID, the door lock IP address, the feature vector of the face image, whether it is a courier or not; the door lock receives the "Courier Confirmation Result" message from the platform and processes it according to whether it is a courier or not. If it is a courier, it will light up the express package barcode scanner (referred to as the scanner) and rotate the pan-tilt camera towards the preset position of "scanning". If it is not a courier, the process will end (at this time, it may be a visitor or other person, and the scanner will not be lit).

[0036] Express parcel scanning and express parcel image capture: After the courier sees the scanner light up, the courier aligns the express parcel barcode with the express parcel scanner one by one. The scanner reads the barcode to extract the express parcel information, which includes the waybill number, recipient name, recipient address, contact phone number, etc. The door lock compares and checks the recipient name, recipient address, and contact phone number with the door lock address, name, and contact phone number recorded in the door lock household registration information list: If one of the recipient name (which may use a network name) and the contact phone number is correct, the express parcel inspection passes; if neither the address nor the contact phone number is correct, the express parcel inspection fails (in this case, it may be that someone filled in the wrong express address); if the recipient name, recipient address, and contact phone number are all wrong, the express parcel inspection fails (in this case, it may be that the courier delivered the wrong express parcel). If the express parcel inspection fails, it will prompt "Express parcel delivery error" in the form of voice or screen display, and the courier manually checks and confirms the recipient information (for example, the courier enters the express system platform through the APP of the mobile phone express system to query); if the express parcel inspection passes, it will ring a "beep" sound to indicate that the express parcel scanning is successful, and at the same time, a picture of the express parcel will be taken by the pan-tilt camera (each picture of the express parcel corresponds to the waybill number of the scanned express parcel). After all express parcels are scanned, the courier can leave after placing the express parcels on the ground directly below the door. The door lock caches the information of the delivered but unsigned express parcels, including the waybill number, delivery time (scanning time), picture of the express parcel (corresponding to the waybill number of the express parcel at the time of barcode scanning), recipient address, recipient name, recipient contact phone number, etc.

[0037] Sending express parcel delivery information and video monitoring: After the express parcel barcode is scanned successfully, the door lock sends a message of "Express parcel has been delivered" to the master's mobile phone APP (when sending a message to the master's mobile phone APP, the door lock queries the door lock household registration information list according to the recipient name or recipient contact phone number of the waybill number to obtain the APP-ID of the corresponding recipient, and then sends the express parcel delivery message of this recipient according to different APP-IDs), which includes the waybill number, delivery time (scanning time), picture of the express parcel, etc. The master receives the message of "Express parcel has been delivered" sent by the door lock through the mobile phone APP and can view the express waybill number and the picture of the express parcel; at the same time, the door lock sends a message of "Express parcel delivered but unsigned" to the platform, which includes the express waybill number, etc. After receiving the message of "Express parcel delivered but unsigned" sent by the door lock, the platform caches and waits for signing. After the courier leaves the door lock, the door lock immediately rotates the pan-tilt camera towards the preset position directly below the door to enter the video monitoring state of the express parcel.

[0038] (3)Method for the door lock PTZ camera to monitor express deliveries: After the courier leaves the door lock, the door lock turns the PTZ camera towards directly below the door (where the express delivery is placed) for video monitoring. An optional method is that the PTZ camera of the door lock can search for the express delivery in the video image in the form of image search by image based on the picture of the express delivery taken during the express delivery scanning, and perform video image target tracking and monitoring. It can also save a picture of the scene when the courier leaves with the express delivery placed at the door, and use the express delivery in the scene (if there may be multiple express deliveries stacked together, then this stack of express deliveries is regarded as a video monitoring target) as the monitoring target to perform target movement detection of the video image. If the movement of the express delivery is detected through target movement detection during video monitoring, an alarm can be triggered. This part of the content is not the focus of the present invention and will not be elaborated further.

[0039] (4)Method for the host to sign for the express delivery: When the host arrives home, sees and picks up the express delivery at the door, the door lock adjusts the PTZ camera to face directly forward to capture the face image of the host for face comparison. If the comparison is successful, the door lock enters the express delivery signing mode. The door lock signs for the express delivery through the express delivery barcode scanner, notifies the platform and at the same time notifies the recipient that the express delivery has been officially signed.

[0040] Express delivery movement detection and personnel face recognition: When person A comes to the door lock and picks up the express delivery, the PTZ camera of the door lock discovers that the express delivery has been taken away (i.e., the video detection result is that the express delivery has been moved) through movement detection (generally, the method of object movement detection in video images can be used), and immediately turns the orientation of the PTZ camera to the preset position directly in front for face detection and recognition, and calculates and compares the similarity with the face images / feature vectors in the list of household registration information (check whether the similarity value meets the threshold, and the threshold can generally be set to 80%). If A is the host, the door lock unlocks and opens the door, and at the same time performs express delivery scanning, signing and identity binding. If A is not the host, an alarm for the express delivery being taken away is immediately triggered. The door lock sends an alarm message to the platform, and the content includes the door lock ID, the face image of A, the video image segment of A picking up the express delivery, etc. The platform receives the alarm information and disposes of it according to the platform's early warning process. The platform alarm disposal process is not the focus of the present invention and will not be elaborated here.

[0041] Express delivery scanning and signing for receipt: When the express delivery is picked up by A and A is identified as the owner through face recognition, the door lock lights up the express delivery barcode scanner (hereinafter referred to as the scanner). A puts the express deliveries at the door in front of the scanner one by one for scanning. The scanner reads information such as the waybill number, recipient's name, recipient's address, and contact phone number of the express delivery, and compares it with the waybill number in the information of the undelivered and unsigned express deliveries cached in the door lock to check if there is a record. If it is an express delivery with a record cached, it will ring with a "beep" sound to indicate that the express delivery scanning is successful; if it is an express delivery not recorded in the cache (at this time, this express delivery may be left by someone else or the courier), then according to the method in step (2), it will be compared and checked with the door lock address, name, and contact phone number recorded in the door lock household registration information list based on the recipient's name, recipient's address, and contact phone number. If the check passes, it will ring with a "beep" sound to indicate that the express delivery scanning is successful. If the check fails (indicating that this express delivery does not belong to this household at this time), it will prompt "Express delivery delivery error" in the form of voice or screen display, and A will put the express delivery back on the ground at the door. The door lock sends a "misdelivered express delivery" message to notify the platform, and the message content includes the waybill number and the door lock address. After receiving the "misdelivered express delivery" notification information, the platform notifies the corresponding courier to pick up the misdelivered express delivery in front of the door lock according to the platform's early warning disposal process.

[0042] Identity binding of the express delivery recipient: The door lock extracts the corresponding express delivery information (including the waybill number, delivery time (scanning time), express delivery picture, recipient address, recipient name, recipient contact phone number, etc.) from the information of the delivered but undelivered express deliveries cached in the door lock based on the waybill number of the express delivery successfully scanned by A. It edits and sends a notification message of "Official receipt of the express delivery" to the platform and the owner's APP (when sending to the owner, the door lock queries the list of registered household information in the door lock according to the recipient name or recipient contact phone number of the waybill number to obtain the APP-ID of the corresponding recipient, and then sends the express delivery receipt message of this recipient according to different APP-IDs because the express deliveries belong to different owners). The message content includes the waybill number, delivery time (scanning time), express delivery picture, recipient address, recipient name (A), recipient contact phone number (A), and the face image of the recipient (the face of A captured when the door lock performs face comparison). After receiving the notification message of "Official receipt of the express delivery" sent by the door lock, the platform saves and applies the recipient address, recipient name (A), recipient contact phone number (A), and the face image of the recipient (the face of A captured when the door lock performs face comparison) in the message as the recipient information for the official receipt of this express delivery according to the business logic of the platform. (At this time, the official recipient of this express delivery is not necessarily the real recipient of the express delivery. The official recipient acts as a proxy for receiving the express delivery at this time because they are all family members of the same household, and it is trustworthy for family members to receive the express delivery on behalf of others). The door lock owner A can receive and view the express delivery receipt information belonging to themselves through the APP (both the recipient and the official recipient of the express delivery are themselves), while the door lock owner B (from the same family as A) can receive and view the information that their own express delivery has been received on their behalf by the owner A through the APP (the recipient of the express delivery is B, and the official recipient is A). If all the delivered but undelivered express deliveries cached in the door lock have been scanned and received by A, the cached information is deleted. If there are still undelivered express deliveries that have not been scanned, the information corresponding to the undelivered express deliveries that have not been scanned is continued to be cached, waiting to be deleted after successful scanning and receipt in the future.

[0043] Method for the door lock pan-tilt camera to continue monitoring the express delivery: The door lock compares the waybill number of the express delivery scanned and received by A with the information of the delivered but undelivered express deliveries cached to extract the corresponding express delivery information (including the waybill number, etc.). If there are undelivered express deliveries (for example, if 3 express deliveries are cached and A scans 2 express deliveries, there may still be one express delivery not scanned. At this time, it is possible that the express delivery was left behind by A, or A thought the express delivery was too large / heavy to move and temporarily did not pick it up), the express delivery may still be at the door (Situation 1). And in the previous step, the express delivery with the prompt of "Express delivery delivery error" when A scans will also be left at the door (Situation 2). When any one of the above two situations (Situation 1, Situation 2) exists (at this time, there is still an express delivery at the door), then when A enters the door and closes the door lock, the pan-tilt camera immediately rotates towards the preset position directly below and performs video monitoring of the express delivery items according to step (3).

[0044] After the courier delivers the express package to the doorstep, the express barcode scanner of the door lock and the pan-tilt camera cooperate to collect and send the delivery information and official signature information of the express package, solving the problem of full-process monitoring of the express package at the doorstep.

[0045] It can be seen that before the courier arrives at the door lock, the door lock collects the face image of the courier and sends it to the platform for identity verification to obtain the express package scanning result; according to the express package scanning result, the express package information is extracted and compared with the list of household registration information to obtain the express package delivery notice status; after the courier leaves, the door lock turns the pan-tilt camera downward for express package monitoring to obtain the express package monitoring status; when the host picks up the express package, the door lock adjusts the pan-tilt camera to face forward for face recognition to obtain the express package signature result; according to the express package signature result, the official express package signature message is sent to the platform and the host APP to obtain the signature information sending status, thereby improving the security of express items, optimizing the express delivery process, and enhancing the user experience.

[0046] Another embodiment of the present invention provides an express delivery system based on a door lock. Refer to Figure 3 , the system may include: The verification module 301 is used for courier identity verification and express package scanning: before the courier arrives at the door lock, the door lock collects the face image of the courier and sends it to the platform for identity verification; wherein, if the verification is successful, the express barcode scanner is activated to scan the express barcode and capture the express package image to obtain the express package scanning result; The comparison module 302 is used for express package information comparison and delivery notice: according to the express package scanning result, the express package information is extracted and compared with the list of household registration information; wherein, if the comparison passes, a message that the express package has been delivered is sent to the host APP and the platform to obtain the express package delivery notice status; The monitoring module 303 is used for express package monitoring and motion detection: after the courier leaves, the door lock turns the pan-tilt camera downward for express package monitoring; wherein, the monitoring is realized through video image target tracking or motion detection to obtain the express package monitoring status; The signature module 304 is used for host signature and identity binding: when the host picks up the express package, the door lock adjusts the pan-tilt camera to face forward for face recognition; wherein, if the recognition is successful, the express package is signed through the express barcode scanner, and the signature information is bound to the host identity to obtain the express package signature result; The sending module 305 is used for signature information sending and cache cleaning: according to the express package signature result, the official express package signature message is sent to the platform and the host APP; wherein, the message includes the express package information, the signatory information and the face image, and the express package information that has been signed in the cache is cleared to obtain the signature information sending status.

[0047] It can be seen that before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for identity verification to obtain the express delivery scanning result; according to the express delivery scanning result, the express delivery information is extracted and compared with the list of household registration information to obtain the express delivery notice status; after the courier leaves, the door lock turns the pan-tilt camera downward for express delivery monitoring to obtain the express delivery monitoring status; when the host picks up the express delivery, the door lock adjusts the pan-tilt camera to face forward for face recognition to obtain the express delivery signing result; according to the express delivery signing result, a formal express delivery signing message is sent to the platform and the host's APP to obtain the signing information sending status, thereby improving the security of express delivery items, optimizing the express delivery process, and enhancing the user experience.

[0048] An embodiment of the present invention also provides a storage medium, in which a computer program is stored, and the computer program is set to execute the steps in any one of the above method embodiments when running.

[0049] Specifically, in this embodiment, the above storage medium can be set to store a computer program for executing the following steps: S201, Courier identity verification and express delivery scanning: Before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for identity verification; wherein, if the verification is successful, the express delivery barcode scanner is activated to scan the express delivery barcode and capture the express delivery image to obtain the express delivery scanning result; S202, Express delivery information comparison and delivery notice: According to the express delivery scanning result, the express delivery information is extracted and compared with the list of household registration information; wherein, if the comparison passes, a message that the express delivery has been delivered is sent to the host's APP and the platform to obtain the express delivery notice status; S203, Express delivery monitoring and motion detection: After the courier leaves, the door lock turns the pan-tilt camera downward for express delivery monitoring; wherein, the monitoring is realized by video image target tracking or motion detection to obtain the express delivery monitoring status; S204, Host signing and identity binding: When the host picks up the express delivery, the door lock adjusts the pan-tilt camera to face forward for face recognition; wherein, if the recognition is successful, the express delivery is signed through the express delivery barcode scanner, and the signing information is bound to the host's identity to obtain the express delivery signing result; S205, Signing information sending and cache cleaning: According to the express delivery signing result, a formal express delivery signing message is sent to the platform and the host's APP; wherein, the message includes the express delivery information, the signer information and the face image, and the already signed express delivery information in the cache is cleared to obtain the signing information sending status.

[0050] It can be seen that before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for identity verification to obtain the express scanning result; according to the express scanning result, the express information is extracted and compared with the list of household registration information to obtain the express delivery notice status; after the courier leaves, the door lock adjusts the pan-tilt camera to face directly downward for express monitoring to obtain the express monitoring status; when the host picks up the express, the door lock adjusts the pan-tilt camera to face directly forward for face recognition to obtain the express signing result; according to the express signing result, an official express signing message is sent to the platform and the host APP to obtain the signing information sending status, thereby improving the security of express items, optimizing the express delivery process, and enhancing the user experience.

[0051] An embodiment of the present invention further provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0052] Specifically, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0053] Specifically, in this embodiment, the above processor may be configured to execute the following steps through a computer program: S201, Courier identity verification and express scanning: Before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for identity verification; among them, if the verification is successful, the express barcode scanner is activated to scan the express barcode and capture the express image to obtain the express scanning result; S202, Express information comparison and delivery notice: According to the express scanning result, the express information is extracted and compared with the list of household registration information; among them, if the comparison passes, a message that the express has been delivered is sent to the host APP and the platform to obtain the express delivery notice status; S203, Express monitoring and motion detection: After the courier leaves, the door lock adjusts the pan-tilt camera to face directly downward for express monitoring; among them, the monitoring is implemented through video image target tracking or motion detection to obtain the express monitoring status; S204, Host signing and identity binding: When the host picks up the express, the door lock adjusts the pan-tilt camera to face directly forward for face recognition; among them, if the recognition is successful, the express is signed through the express barcode scanner, and the signing information is bound to the host identity to obtain the express signing result; S205, Signing Information Sending and Cache Cleaning: According to the express delivery signing result, send the official signing message of the express delivery to the platform and the host APP; wherein, the message includes express delivery information, signer information and face image, and clean the signed express delivery information in the cache to obtain the signing information sending status.

[0054] It can be seen that before the courier arrives at the door lock, the door lock captures the face image of the courier and sends it to the platform for identity verification to obtain the express delivery scanning result; according to the express delivery scanning result, extract the express delivery information and compare it with the list of household registration information to obtain the express delivery arrival notice status; after the courier leaves, the door lock adjusts the pan-tilt camera to face directly downward for express delivery monitoring to obtain the express delivery monitoring status; when the host picks up the express delivery, the door lock adjusts the pan-tilt camera to face directly forward for face recognition to obtain the express delivery signing result; according to the express delivery signing result, send the official signing message of the express delivery to the platform and the host APP to obtain the signing information sending status, so as to improve the security of express delivery items, optimize the express delivery process, and enhance the user experience.

[0055] The above has detailed the structure, features and function effects of the present invention according to the embodiments shown in the drawings. The above is only the preferred embodiment of the present invention, but the present invention is not limited to the implementation scope shown in the drawings. Any changes made according to the concept of the present invention, or equivalent embodiments modified to equivalent changes, still within the spirit covered by the specification and drawings, shall be within the protection scope of the present invention.

Claims

1. A method for express delivery based on a door lock, characterized in that, The method includes: Courier authentication and express scanning: Before the courier arrives at the door lock, the door lock captures the courier's face image and sends it to the platform for authentication; among them, if the authentication is successful, the express barcode scanner is activated to scan the express barcode and capture the express image to obtain the express scanning result; Express information comparison and delivery notice: According to the express scanning result, extract the express information and compare it with the list of household registration information; among them, if the comparison passes, send a message that the express has been delivered to the master APP and the platform to obtain the express delivery notice status; Express monitoring and motion detection: After the courier leaves, the door lock turns the pan-tilt camera downward for express monitoring; among them, the monitoring is achieved through video image target tracking or motion detection to obtain the express monitoring status; Master signing and identity binding: When the master picks up the express, the door lock adjusts the pan-tilt camera to face forward for face recognition; among them, if the recognition is successful, sign for the express through the express barcode scanner and bind the signing information to the master's identity to obtain the express signing result; Sending signing information and cache cleaning: According to the express signing result, send a message of formal signing of the express to the platform and the master APP; among them, the message includes express information, signer information and face image, and clean the signed express information in the cache to obtain the signing information sending status.

2. The method according to claim 1, wherein The courier authentication and express scanning includes: Face image capture: Before the courier arrives at the door lock, the door lock captures the courier's face image; among them, the capture is achieved through the pan-tilt camera to obtain the face image data; Authentication request: According to the face image data, generate a message asking to confirm whether it is the courier; among them, the message is authenticated through the platform to obtain the authentication result; Express scanning and image capture: According to the authentication result, if it is the courier, activate the express barcode scanner and scan the express barcode; among them, the scanning is achieved through the barcode scanner, and at the same time capture the express image to obtain the express scanning result.

3. The method according to claim 2, characterized in that The express information comparison and delivery notice includes: Express information extraction: According to the express scanning result, extract the express information; among them, the information includes waybill number, recipient name, recipient address and contact phone number to obtain the express information data; Information comparison and check: According to the express information data, compare it with the list of household registration information; among them, the comparison is achieved through similarity calculation to obtain the comparison result; Delivery notice generation and sending: According to the comparison result, if the comparison passes, generate a message that the express has been delivered; among them, the message is sent to the master APP and the platform through the local area network to obtain the delivery notice status.

4. The method according to claim 3, wherein The express monitoring and motion detection includes: Pan-tilt direction adjustment: After the courier leaves, the door lock turns the pan-tilt camera downward; among them, the adjustment is achieved through PTZ control to obtain the adjusted pan-tilt direction; Express target tracking: According to the adjusted pan-tilt direction, track the express through the image search by image technology; among them, the tracking is achieved through intelligent video image analysis to obtain the express tracking status; Motion Detection and Alarm: According to the express delivery tracking status, if the movement of the express delivery is detected, an alarm is triggered; among them, the alarm is realized through video image motion detection to obtain the alarm status.

5. The method according to claim 4, wherein The master's signature and identity binding include: Face Image Acquisition and Recognition: When the master picks up the express delivery, the door lock adjusts the PTZ camera to face directly forward to acquire the face image; among them, the acquisition is realized through PTZ control to obtain the face image data; Face Comparison and Identity Confirmation: According to the face image data, it is compared with the list of household registration information; among them, the comparison is realized through a deep learning model to obtain the comparison result; Express Delivery Scanning and Signature: According to the comparison result, if the recognition is successful, the express delivery is signed by the express delivery barcode scanner; among them, the signature is realized through the barcode scanner to obtain the express delivery signature result; Identity Binding and Information Sending: According to the express delivery signature result, the signature information is bound to the master's identity; among them, the binding is realized through information association, and the official express delivery signature message is sent to the platform and the master's APP to obtain the identity binding status.

6. The method according to claim 5, wherein The signature information sending and cache cleaning include: Signature Information Extraction: According to the express delivery signature result, the express delivery information and the recipient information are extracted; among them, the information includes the waybill number, the recipient's name, the contact phone number and the face image to obtain the signature information data; Message Generation and Sending: According to the signature information data, an official express delivery signature message is generated; among them, the message is sent to the platform and the master's APP through the local area network to obtain the message sending status; Cache Cleaning: According to the message sending status, the signed express delivery information in the cache is cleared; among them, the cleaning is realized through data deletion to obtain the cache cleaning status.

7. A courier delivery system based on a door lock, characterized in that, The system includes: Verification Module, used for courier identity verification and express delivery scanning: When the courier arrives in front of the door lock, the door lock acquires the courier's face image and sends it to the platform for identity verification; among them, if the verification is successful, the express delivery barcode scanner is turned on to scan the express delivery barcode and capture the express delivery image to obtain the express delivery scanning result; Comparison Module, used for express delivery information comparison and delivery notice: According to the express delivery scanning result, the express delivery information is extracted and compared with the list of household registration information; among them, if the comparison passes, a message that the express delivery has been delivered is sent to the master's APP and the platform to obtain the express delivery delivery notice status; Monitoring Module, used for express delivery monitoring and motion detection: After the courier leaves, the door lock turns the PTZ camera downward to monitor the express delivery; among them, the monitoring is realized through video image target tracking or motion detection to obtain the express delivery monitoring status; Signature Module, used for master signature and identity binding: When the master picks up the express delivery, the door lock adjusts the PTZ camera to face directly forward for face recognition; among them, if the recognition is successful, the express delivery is signed by the express delivery barcode scanner, and the signature information is bound to the master's identity to obtain the express delivery signature result; A sending module, for sending receipt information and clearing cache: According to the express delivery receipt result, send a formal receipt message of the express delivery to the platform and the master APP; wherein, the message includes express delivery information, recipient information and a face image, and clear the information of the received express delivery in the cache to obtain the sending status of the receipt information.

8. The system according to claim 7, wherein The verification module is specifically used for: Collecting face images: Before the courier arrives at the door lock, the door lock collects the face image of the courier; wherein, the collection is implemented by a pan-tilt camera to obtain face image data; Requesting identity verification: According to the face image data, generate a message asking to confirm whether it is the courier; wherein, the message is verified for identity through the platform to obtain a verification result; Scanning the express delivery and capturing images: According to the verification result, if it is a courier, turn on the express delivery barcode scanner and scan the express delivery barcode; wherein, the scanning is implemented by the barcode scanner, and at the same time capture the express delivery image to obtain the express delivery scanning result.

9. A storage medium, characterized in that, A computer program is stored in the storage medium, wherein the computer program is set to execute the method according to any one of claims 1-6 when running.

10. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is set to run the computer program to execute the method according to any one of claims 1-6.

Images