Intelligent doorbell-based monitoring method and device, intelligent doorbell, and medium

Abstract

The application discloses a monitoring method and device based on a smart doorbell, a smart doorbell and a medium. The smart doorbell is provided with a downward monitoring device. The monitoring direction of the downward monitoring device is towards the bottom direction of the smart doorbell. The monitoring direction forms a preset included angle with the extension plane where the smart doorbell is located. The monitoring method based on the smart doorbell comprises the following steps: when a monitoring request corresponding to the downward monitoring device is detected, the downward monitoring device is started to collect first image data of the bottom area of the smart doorbell; and the first image data is sent to a terminal device associated with the smart doorbell. That is, the application collects the image of the ground in front of the door by setting the downwardly inclined camera, so that the user can monitor the goods delivered by the delivery personnel through the smart doorbell. The user can timely find out whether the goods are lost, and timely take countermeasures after the loss to reduce the loss.

Description

Technical Field

[0001] This application relates to the field of intelligent security technology, and in particular to a monitoring method, device, intelligent doorbell and medium based on an intelligent doorbell. Background Technology

[0002] With the development of the logistics and food delivery industries, people are receiving express deliveries and food orders more and more frequently. Currently, some places have express delivery lockers or food delivery lockers to ensure the safety of these goods. However, it should be noted that not all places have such facilities or conditions to place goods in them. In the absence of such facilities, some consumers will ask the delivery person to leave the express delivery or food order at their door after receiving a call from the delivery person. Although there are some doorbells with video functions on the market, which are usually used to image the face or upper half of the visitor, express delivery or food orders left at the door are still difficult to guarantee safety and are at risk of being lost, thus causing economic losses to consumers.

[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main purpose of this application is to provide a monitoring method, device, smart doorbell and medium based on a smart doorbell, which aims to solve the technical problem that express delivery or takeout placed in front of the door cannot be secure and is at risk of being lost.

[0005] To achieve the above objectives, this application provides a monitoring method based on a smart doorbell. The smart doorbell is equipped with a tilt monitoring device, the monitoring direction of which is directed towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The monitoring method based on the smart doorbell includes:

[0006] When a monitoring request corresponding to the tilt monitoring device is detected, the tilt monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell.

[0007] The first image data is sent to the terminal device associated with the smart doorbell.

[0008] Furthermore, the smart doorbell is also equipped with a main monitoring device, the monitoring direction of which is parallel to the horizontal plane. The step of activating the downward-tilting monitoring device to collect first image data of the bottom area of ​​the smart doorbell includes:

[0009] When a human body is detected within a preset range corresponding to the smart doorbell, a monitoring request is generated, the tilting monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell, and the main monitoring device is activated to collect second image data of the area in front of the smart doorbell.

[0010] Based on the first image data, determine whether the target human body in the second image data is the person who throws the item;

[0011] If it is determined that the target human body is not the person who threw the item, then the first image data and the second image data are discarded;

[0012] When the target human body is determined to be the person who throws the item, the first image data and the second image data are retained.

[0013] Furthermore, the step of determining whether the target human body in the second image data is the person who threw the item based on the first image data includes:

[0014] The first image data is identified based on a preset image recognition model;

[0015] When a change in the preset scene features is detected from the first image data, the target human body in the second image data is determined to be the person who threw the item.

[0016] Furthermore, the step of sending the first image data to the terminal device associated with the smart doorbell includes:

[0017] The current delivery status of the bottom area of ​​the smart doorbell is updated based on the first image data, wherein the current delivery status includes delivery and no delivery;

[0018] When the current delivery status changes from no delivery to delivery or the current delivery status remains at the delivery status after being updated, the first image data and the second image data are sent to the terminal device.

[0019] Furthermore, the current delivery status also includes picking up. After the step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the first image data, the method includes:

[0020] When the current delivery status changes from "delivered" to "not delivered" or "taken", determine whether the door associated with the smart doorbell is opened within a preset time period;

[0021] If the door is not opened within the preset time period, the step of sending the first image data and the second image data to the terminal device is performed, and an alarm message is sent to the terminal device.

[0022] Furthermore, the step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the image data includes:

[0023] Compare the current preset scene features in the first image data with the historical preset scene features in the historical first image data;

[0024] If the first number of the current preset scene features is greater than the second number of the historical preset scene features, then the current delivery status is updated to "delivered".

[0025] If the first quantity is less than the second quantity, then the current delivery status is updated to "taken" or "not delivered".

[0026] The historical first image data is updated based on the first image data.

[0027] Furthermore, the step of updating the delivery status to "taken" or "not delivered" includes:

[0028] When the first quantity is less than the second quantity and the first quantity is zero, the current delivery status is updated to "no delivery".

[0029] When the first quantity is less than the second quantity and the first quantity is not zero, the current delivery status is updated to "taken".

[0030] Furthermore, to achieve the above objectives, this application also provides a monitoring device based on a smart doorbell, wherein the smart doorbell is equipped with a tilt monitoring device, the monitoring direction of which is directed towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The monitoring device based on the smart doorbell includes:

[0031] The acquisition module is used to activate the tilt monitoring device to acquire first image data of the bottom area of ​​the smart doorbell when a monitoring request corresponding to the tilt monitoring device is detected.

[0032] The sending module is used to send the first image data to a terminal device associated with the smart doorbell.

[0033] In addition, to achieve the above objectives, this application also provides a smart doorbell, which includes: a memory, a processor, and a self-test program for the smart doorbell stored in the memory and executable on the processor. When the self-test program for the smart doorbell is executed by the processor, it implements the steps of the monitoring method based on the smart doorbell as described above.

[0034] In addition, to achieve the above objectives, this application also provides a medium storing a self-test program for a smart doorbell, wherein when the self-test program for the smart doorbell is executed by a processor, it implements the steps of the monitoring method based on the smart doorbell described above.

[0035] This application proposes a monitoring method, device, smart doorbell, and medium based on a smart doorbell. The smart doorbell is equipped with a downward-tilting monitoring device. The acquisition direction of the downward-tilting monitoring device is located below the horizontal line and forms a preset angle with the horizontal line. When a monitoring request corresponding to the downward-tilting monitoring device is received, the downward-tilting monitoring device is activated to acquire first image data; the first image data is then sent to a terminal device associated with the smart doorbell. In other words, this application uses a downward-tilting camera to acquire images of the ground in front of the door, allowing users to monitor goods delivered by delivery personnel through the smart doorbell. Users can promptly detect whether goods are missing and take timely measures to minimize losses if lost. Attached Figure Description

[0036] Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of this application;

[0037] Figure 2 This is a flowchart illustrating the first embodiment of the monitoring method based on a smart doorbell according to this application;

[0038] Figure 3 This is a flowchart illustrating the second embodiment of the monitoring method based on a smart doorbell according to this application;

[0039] Figure 4 This is a flowchart illustrating the third embodiment of the monitoring method based on a smart doorbell according to this application;

[0040] Figure 5 This is a schematic diagram of the structure of the smart doorbell in the monitoring method based on the smart doorbell of this application.

[0041] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0042] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0043] like Figure 1 As shown, Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of this application.

[0044] The device in this application embodiment can be a smart video doorbell, or it can be an electronic terminal device with display function such as a video monitor, smartphone, PC, tablet computer, or laptop computer.

[0045] like Figure 1 As shown, the device may include: a processor 1001, such as a CPU; a network interface 1004; a user interface 1003; a memory 1005; and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0046] Optionally, the device may also include a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, a WiFi module, and so on. Sensors may include light sensors, motion sensors, and other sensors. Specifically, light sensors may include ambient light sensors and proximity sensors. The ambient light sensor can adjust the display brightness according to the ambient light level, while the proximity sensor can turn off the display and / or backlight when the mobile terminal is moved to the ear. As a type of motion sensor, a gravity accelerometer can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity, and can be used for applications that identify the mobile terminal's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition functions (such as pedometers, taps), etc. Of course, the mobile terminal may also be equipped with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, which will not be elaborated here.

[0047] Those skilled in the art will understand that Figure 1 The device structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0048] like Figure 1As shown, the memory 1005, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a self-test program for the smart doorbell.

[0049] exist Figure 1 In the device shown, network interface 1004 is mainly used to connect to the backend server and communicate data with it; user interface 1003 is mainly used to connect to the client (user end) and communicate data with it; and processor 1001 can be used to call the self-test program of the smart doorbell stored in memory 1005. The monitoring direction of the tilting monitoring device is towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extension surface where the smart doorbell is located, and performs the following operations:

[0050] When a monitoring request corresponding to the tilt monitoring device is detected, the tilt monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell.

[0051] The first image data is sent to the terminal device associated with the smart doorbell.

[0052] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0053] The smart doorbell is also equipped with a main monitoring device. The monitoring direction of the main monitoring device is parallel to the horizontal plane. The step of activating the tilting monitoring device to collect first image data of the bottom area of ​​the smart doorbell includes:

[0054] When a human body is detected within a preset range corresponding to the smart doorbell, a monitoring request is generated, the tilting monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell, and the main monitoring device is activated to collect second image data of the area in front of the smart doorbell.

[0055] Based on the first image data, determine whether the target human body in the second image data is the person who throws the item;

[0056] If it is determined that the target human body is not the person who threw the item, then the first image data and the second image data are discarded;

[0057] When the target human body is determined to be the person who throws the item, the first image data and the second image data are retained.

[0058] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0059] The step of determining whether the target human body in the second image data is a person who throws the item based on the first image data includes:

[0060] The first image data is identified based on a preset image recognition model;

[0061] When a change in the preset scene features is detected from the first image data, the target human body in the second image data is determined to be the person who threw the item.

[0062] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0063] The step of sending the first image data to the terminal device associated with the smart doorbell includes:

[0064] The current delivery status of the bottom area of ​​the smart doorbell is updated based on the first image data, wherein the current delivery status includes delivery and no delivery;

[0065] When the current delivery status changes from no delivery to delivery or the current delivery status remains at the delivery status after being updated, the first image data and the second image data are sent to the terminal device.

[0066] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0067] The current delivery status also includes picking up. After the step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the first image data, the method includes:

[0068] When the current delivery status changes from "delivered" to "not delivered" or "taken", determine whether the door associated with the smart doorbell is opened within a preset time period;

[0069] If the door is not opened within the preset time period, the step of sending the first image data and the second image data to the terminal device is performed, and an alarm message is sent to the terminal device.

[0070] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0071] The step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the image data includes:

[0072] Compare the current preset scene features in the first image data with the historical preset scene features in the historical first image data;

[0073] If the first number of the current preset scene features is greater than the second number of the historical preset scene features, then the current delivery status is updated to "delivered".

[0074] If the first quantity is less than the second quantity, then the current delivery status is updated to "taken" or "not delivered".

[0075] The historical first image data is updated based on the first image data.

[0076] Furthermore, the processor 1001 can call the self-test program of the smart doorbell stored in the memory 1005, and also perform the following operations:

[0077] The step of updating the delivery status to "taken" or "not delivered" includes:

[0078] When the first quantity is less than the second quantity and the first quantity is zero, the current delivery status is updated to "no delivery".

[0079] When the first quantity is less than the second quantity and the first quantity is not zero, the current delivery status is updated to "taken".

[0080] Reference Figure 2 This application discloses a first embodiment of a monitoring method for a smart doorbell. The smart doorbell is equipped with a tilt monitoring device. The monitoring direction of the tilt monitoring device faces the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The monitoring method based on the smart doorbell includes:

[0081] Step S10: When a monitoring request corresponding to the tilt monitoring device is detected, the tilt monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell.

[0082] It should be noted that although some doorbell products are equipped with cameras, these cameras are used to capture the facial features or upper body of visitors. Since the goods placed by delivery personnel are usually on the ground, the camera will not be able to monitor the goods on the ground, and therefore the security of the goods cannot be guaranteed.

[0083] Therefore, to address the aforementioned issues, this application configures a downward-tilting monitoring device for the smart doorbell. The monitoring direction of the downward-tilting monitoring device faces the bottom of the doorbell. The monitoring device can be a visual sensor, and the corresponding monitoring direction is the optical axis direction of the visual sensor lens. Furthermore, the monitoring direction of the monitoring device forms a preset angle with the extended surface where the smart doorbell is located. The extended surface where the smart doorbell is located can be the wall where the smart doorbell is installed, and the preset angle can be 45°. This allows the smart doorbell in this application to capture images of the ground, thereby achieving the purpose of monitoring goods placed in front of the door by delivery personnel.

[0084] Specifically, when a monitoring request corresponding to the tilt monitoring device is received, the corresponding tilt monitoring device is activated to collect the first image data. The monitoring request can be generated after a visitor presses the doorbell, or it can be actively sent by the user through a terminal device. The first image data is the image of the ground area corresponding to the bottom of the doorbell.

[0085] Step S20: Send the first image data to the terminal device associated with the smart doorbell.

[0086] Specifically, the first image data will be sent to a terminal device associated with the smart doorbell. This terminal device is typically the user's smartphone, but can also be other electronic devices with display capabilities. After the delivery person delivers the goods, the user can display the first image data on the terminal device, thereby monitoring the delivered goods. This allows the user to promptly detect if goods are lost and take timely action to minimize losses.

[0087] For reference Figure 5 , Figure 5 The smart doorbell 10 in the monitoring method based on the smart doorbell of this application includes at least a tilt monitoring device 1 for collecting image data of the ground. In addition, the smart doorbell 10 may also include a main monitoring device 2 and a doorbell button 3. The main monitoring device 2 is used to monitor relevant images of visitors, while the doorbell button 3 can be used to trigger the tilt monitoring device 1 and the main monitoring device 2 to collect image data. However, it should be noted that the triggering conditions of the tilt monitoring device 1 and the main monitoring device 2 of the smart doorbell 10 in this embodiment are not limited to pressing the doorbell button 3.

[0088] In this embodiment, the smart doorbell is equipped with a tilt monitoring device. The monitoring direction of the tilt monitoring device is towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The monitoring method based on the smart doorbell includes: when a monitoring request corresponding to the tilt monitoring device is detected, activating the tilt monitoring device to collect first image data of the bottom area of ​​the smart doorbell; and sending the first image data to a terminal device associated with the smart doorbell. That is, this application uses a downward-tilted camera to collect images of the ground in front of the door, allowing users to monitor goods delivered by delivery personnel through the smart doorbell. Users can promptly detect whether goods are lost and take timely measures to reduce losses if lost.

[0089] Reference Figure 3 Based on the first embodiment of the monitoring method for a smart doorbell in this application, a second embodiment of the monitoring method for a smart doorbell in this application is proposed. The parts identical to those in the above embodiment can be referred to the above content and will not be repeated here. The smart doorbell is also equipped with a main monitoring device, the monitoring direction of which is parallel to the horizontal plane. The step of activating the downward-tilting monitoring device to collect first image data of the bottom area of ​​the smart doorbell includes:

[0090] Step S100: When a human body is detected within the preset range corresponding to the smart doorbell, the monitoring request is generated, the tilting monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell, and the main monitoring device is activated to collect second image data of the area in front of the smart doorbell.

[0091] It should be noted that the smart doorbell in this embodiment is also equipped with a main monitoring device. The monitoring direction of the main monitoring device is parallel to the horizontal plane, and it can collect relevant images of the delivery person. Here, the horizontal plane usually refers to the plane formed by relatively still water. Under ideal conditions, the monitoring direction being parallel to the horizontal plane means that the monitoring direction is perpendicular to the wall where the smart doorbell is installed. In the above embodiments, the monitoring requests are all generated based on preset human operations, so the monitoring of the situation in front of the door is relatively passive.

[0092] To address the aforementioned issues, this application generates a monitoring request when a human body is detected within a preset range corresponding to the smart doorbell, thereby activating the tilting monitoring device and the main monitoring device to acquire images. The detection method can be through an infrared detection device configured on the doorbell; human body detection methods are currently quite mature and will not be elaborated upon here. Upon detecting a person near the doorbell, the main monitoring device and the tilting monitoring device are activated to acquire image data. The image data includes first image data and second image data, with the first image data acquired by the tilting monitoring device and the second image data acquired by the main monitoring device. It should be noted that this embodiment proactively triggers the monitoring device on the doorbell to acquire image data through human body detection, thereby improving the proactiveness of monitoring.

[0093] Step S200: Based on the first image data, determine whether the target human body in the second image data is the person who throws the item;

[0094] Specifically, the first image data is the image corresponding to the ground. By judging whether there is an increase or decrease in items in the first image data, it can be determined whether the target human body in the second image data is the person who throws the items.

[0095] Furthermore, the step of determining whether the target human body in the second image data is a person who throws the item based on the first image data includes:

[0096] Step S201: Recognize the first image data based on a preset image recognition model;

[0097] Step S202: When a change in the preset scene features is detected from the first image data, the target human body in the second image data is determined to be the person who throws the item.

[0098] Specifically, a pre-trained image recognition model is used to identify scene features in the first image data. Scene features can be any package, such as express delivery or takeout goods. The training samples for the image recognition model can be images of the ground in front of an outdoor door, categorized into photos with and without packages. The image recognition model can be trained using labeled photos. This enables the image recognition model to recognize images with and without packages. It is understood that detecting changes in the preset scene features in the first image data—such as a change from no package to package, a change from package to no package, or a change in the number of packages—can identify the target person in the second image data as a person placing or receiving goods at the door.

[0099] Step S210: When it is determined that the target human body is not the person who threw the item, the first image data and the second image data are discarded.

[0100] Step S220: When it is determined that the target human body is the person who throws the item, the first image data and the second image data are retained.

[0101] Specifically, determining that the target person is not the person placing the item actually means that the person passing by the door may be a passerby. To avoid unnecessary memory usage, the image data collected at this time (including the first and second image data) can be discarded. Conversely, if the target person is determined to be the person placing the item, and the person placing the item includes either the delivery person or the person taking it. For the delivery person, the image data collected at this time will include the entire process of the delivery person completing the delivery, so it can be retained. It should be noted that for the person taking the item, the person taking it may be malicious or the user may take it themselves, so the image data of this process can also be saved for use as evidence in rights protection.

[0102] In this embodiment, the smart doorbell will detect whether a person is passing by, and further determine whether the person passing by is a person who takes or delivers an item. When it is determined that the person passing by is a person who takes or delivers an item, the image data of the delivery and taking processes will be saved as evidence for subsequent rights protection.

[0103] Reference Figure 4 Based on the second embodiment of the monitoring method based on a smart doorbell in this application, a third embodiment of the monitoring method based on a smart doorbell in this application is proposed. The parts that are the same as those in the above embodiments can be referred to the above content and will not be repeated here. The step of sending the first image data to the terminal device associated with the smart doorbell includes:

[0104] Step A10: Update the current delivery status of the bottom area of ​​the smart doorbell based on the first image data, wherein the current delivery status includes delivery and no delivery;

[0105] Specifically, the first image data saved at this time can be used to update the current delivery status of the bottom area of ​​the smart doorbell. The current delivery status can be divided into delivery and no delivery, and the current delivery status will be set to no delivery by default in the initial stage.

[0106] Furthermore, the step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the image data includes:

[0107] Step A100: Compare the current preset scene features in the first image data with the historical preset scene features in the historical first image data;

[0108] This section explains the types of scene feature changes. In a real-world scenario, when a delivery person places an item in front of the door, the scene feature in the first image data changes from non-existent to present. If another delivery person continues to deliver items, the number of scene features will increase. If someone takes an item, the number of scene features will decrease (they may take all the items or only some of them).

[0109] Specifically, the first image data can be compared with historical first image data. It should be noted that if the target person is determined not to be the person who will deliver the item, the corresponding image data will be discarded. Therefore, there may be cases where historical first image data is not available. In this case, it is assumed that the historical first image data has no scene features (i.e., the delivery status is assumed to be no delivery). The first number of current scene features in the first image data is compared with the second number of historical scene features in the historical first image data.

[0110] Step A210: If the first number of the current preset scene features is greater than the second number of the historical preset scene features, then update the current delivery status to "delivered".

[0111] Specifically, when the first quantity is greater than the second quantity, it indicates that the scene features have increased, that is, new products have been placed in front of the door. The corresponding delivery status will be updated to "delivery in progress", including changing from "no delivery" to "delivery in progress" or maintaining the "delivery in progress" status.

[0112] Step A220: If the first quantity is less than the second quantity, then update the current delivery status to "taken" or "not delivered".

[0113] Specifically, when the first quantity is less than the second quantity, it indicates a decrease in scene characteristics, meaning the goods have been taken from the door (but there are cases where they are almost taken and cases where they are not), and the delivery status is updated to "taken" or "not delivered." Further, when the first quantity is less than the second quantity and the first quantity is zero, the current delivery status is updated to "not delivered"; when the first quantity is less than the second quantity and the first quantity is not zero, the current delivery status is updated to "taken."

[0114] Step A300: Update the historical first image data based on the first image data.

[0115] Specifically, the first image data is used as historical first image data, and is used as the basis for judging the change in the number of preset scene features in the new first image data.

[0116] Step A20: When the current delivery status changes from no delivery to delivery or the current delivery status is updated and remains in the delivery state, the first image data and the second image data are sent to the terminal device.

[0117] Specifically, when a delivery person delivers an item at the door, the current delivery status may change from no delivery to delivery, or remain in the delivery status after the update. Therefore, the image data collected at this time can be saved and sent to the terminal device. It is understandable that when the terminal device is the user's smartphone, it can remind the user that the goods have been delivered.

[0118] Furthermore, after the step of updating the current delivery status based on the image data, the method includes:

[0119] Step A30: When the current delivery status changes from "delivered" to "not delivered" or "taken", determine whether the door associated with the smart doorbell is opened within a preset time period;

[0120] Specifically, when the current delivery status changes from "delivery received" to "no delivery received" or "taken," it indicates that the item placed at the door has been taken. Further, determining whether the person who took the item is the user involves checking if the door associated with the smart doorbell has been opened within a preset time period. This is achieved by establishing a circuit based on the door lock. When the door is opened, the lock cylinder and limit mechanism in the lock separate, breaking the circuit and thus determining if the door was opened. It's understandable that when a user returns home and takes an item from the door, they open the door and enter the house; therefore, checking if the door is open helps determine if the person taking the item is the user. If the door is opened within the preset time period, no warning message needs to be sent to the user.

[0121] Step A40: If the door is not opened within the preset time period, then the step of sending the first image data and the second image data to the terminal device is executed, and an alarm message is sent to the terminal device.

[0122] Specifically, if the door is not opened within a preset time period, the image data collected at this time can be sent to the terminal device as an alarm message to alert the user that the goods may be at risk of being stolen.

[0123] In this embodiment, the type of person passing by will be further determined, and if it is determined that the person taking the item is the user, it will be determined whether the person taking the item is the user. If it is determined that the person taking the item is not the user, a warning message will be sent to the terminal device to prompt the user to take countermeasures in a timely manner to reduce the user's losses.

[0124] Furthermore, this application embodiment also provides a monitoring device based on a smart doorbell, wherein the smart doorbell is equipped with a tilt monitoring device, the monitoring direction of the tilt monitoring device is towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extension surface where the smart doorbell is located. The monitoring device based on the smart doorbell includes:

[0125] The acquisition module is used to activate the tilt monitoring device to acquire first image data of the bottom area of ​​the smart doorbell when a monitoring request corresponding to the tilt monitoring device is detected.

[0126] The sending module is used to send the first image data to a terminal device associated with the smart doorbell.

[0127] Optionally, the smart doorbell is further equipped with a main monitoring device, the monitoring direction of which is parallel to the horizontal plane, and the data acquisition module is further used for:

[0128] When a human body is detected within a preset range corresponding to the smart doorbell, a monitoring request is generated, the tilting monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell, and the main monitoring device is activated to collect second image data of the area in front of the smart doorbell.

[0129] Based on the first image data, determine whether the target human body in the second image data is the person who throws the item;

[0130] If it is determined that the target human body is not the person who threw the item, then the first image data and the second image data are discarded;

[0131] When the target human body is determined to be the person who throws the item, the first image data and the second image data are retained.

[0132] Optionally, the acquisition module is further configured to:

[0133] The first image data is identified based on a preset image recognition model;

[0134] When a change in the preset scene features is detected from the first image data, the target human body in the second image data is determined to be the person who threw the item.

[0135] Optionally, the sending module is further configured to:

[0136] The current delivery status of the bottom area of ​​the smart doorbell is updated based on the first image data, wherein the current delivery status includes delivery and no delivery;

[0137] When the current delivery status changes from no delivery to delivery or the current delivery status remains at the delivery status after being updated, the first image data and the second image data are sent to the terminal device.

[0138] Optionally, the current delivery status also includes retrieval, and the sending module is further configured to:

[0139] When the current delivery status changes from "delivered" to "not delivered" or "taken", determine whether the door associated with the smart doorbell is opened within a preset time period;

[0140] If the door is not opened within the preset time period, the step of sending the first image data and the second image data to the terminal device is performed, and an alarm message is sent to the terminal device.

[0141] Optionally, the sending module is further configured to:

[0142] Compare the current preset scene features in the first image data with the historical preset scene features in the historical first image data;

[0143] If the first number of the current preset scene features is greater than the second number of the historical preset scene features, then the current delivery status is updated to "delivered".

[0144] If the first quantity is less than the second quantity, then the current delivery status is updated to "taken" or "not delivered".

[0145] The historical first image data is updated based on the first image data.

[0146] Optionally, the sending module is further configured to:

[0147] When the first quantity is less than the second quantity and the first quantity is zero, the current delivery status is updated to "no delivery".

[0148] When the first quantity is less than the second quantity and the first quantity is not zero, the current delivery status is updated to "taken".

[0149] The smart doorbell-based monitoring device provided in this application employs the smart doorbell-based monitoring method described in the above embodiments, aiming to solve the technical problem that currently, packages or takeout left at the front door are not secure and are at risk of being lost. Compared with the prior art, the beneficial effects of the smart doorbell-based monitoring provided in this application are the same as those of the smart doorbell-based monitoring method described in the above embodiments, and other technical features of this smart doorbell-based monitoring device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0150] In addition, to achieve the above objectives, this application also provides a smart doorbell device, which includes: a memory, a processor, and a smart doorbell-based monitoring program stored in the memory and executable on the processor. When the smart doorbell-based monitoring program is executed by the processor, it implements the steps of the smart doorbell-based monitoring method described above.

[0151] The specific implementation method of the self-testing device for the smart doorbell in this application is basically the same as the embodiments of the monitoring method based on the smart doorbell described above, and will not be repeated here.

[0152] In addition, to achieve the above objectives, this application also provides a computer medium storing a smart doorbell-based monitoring program, which, when executed by a processor, implements the steps of the smart doorbell-based monitoring method described above.

[0153] The specific implementation method of the computer medium in this application is basically the same as the various embodiments of the monitoring method based on the smart doorbell described above, and will not be repeated here.

[0154] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0155] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0156] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, smart video doorbell, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0157] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A monitoring method based on a smart doorbell, characterized in that, The smart doorbell is equipped with a tilt monitoring device and a main monitoring device. The tilt monitoring device monitors towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The main monitoring device monitors in a direction parallel to the horizontal plane. The monitoring method based on the smart doorbell includes: When a human body is detected within a preset range corresponding to the smart doorbell, a monitoring request is generated, the tilting monitoring device is activated to collect first image data of the bottom area of ​​the smart doorbell, and the main monitoring device is activated to collect second image data of the area in front of the smart doorbell. The first image data and the second image data are sent to the terminal device associated with the smart doorbell; The step of sending the first image data and the second image data to the terminal device associated with the smart doorbell includes: The current delivery status of the bottom area of ​​the smart doorbell is updated based on the first image data, wherein the current delivery status includes delivery, no delivery, and pickup. When the current delivery status changes from "delivered" to "not delivered" or "taken", determine whether the door associated with the smart doorbell is opened within a preset time period; If the door is not opened within the preset time period, the step of sending the first image data and the second image data to the terminal device associated with the smart doorbell is executed, and an alarm message is sent to the terminal device.

2. The monitoring method based on a smart doorbell as described in claim 1, characterized in that, After the steps of activating the tilt monitoring device to collect first image data of the bottom area of ​​the smart doorbell and activating the main monitoring device to collect second image data of the front area of ​​the smart doorbell, the following steps are included: Based on the first image data, determine whether the target human body in the second image data is the person who throws the item; If it is determined that the target human body is not the person who threw the item, then the first image data and the second image data are discarded; When the target human body is determined to be the person who throws the item, the first image data and the second image data are retained.

3. The monitoring method based on a smart doorbell as described in claim 2, characterized in that, The step of determining whether the target human body in the second image data is a person who throws the item based on the first image data includes: The first image data is identified based on a preset image recognition model; When a change in the preset scene features is detected from the first image data, the target human body in the second image data is determined to be the person who threw the item.

4. The monitoring method based on a smart doorbell as described in claim 2, characterized in that, The step of sending the first image data and the second image data to the terminal device associated with the smart doorbell includes: When the current delivery status changes from no delivery to delivery or the current delivery status remains at the delivery status after being updated, the first image data and the second image data are sent to the terminal device.

5. The monitoring method based on a smart doorbell as described in claim 1, characterized in that, The step of updating the current delivery status of the bottom area of ​​the smart doorbell based on the first image data includes: Compare the current preset scene features in the first image data with the historical preset scene features in the historical first image data; If the first number of the current preset scene features is greater than the second number of the historical preset scene features, then the current delivery status is updated to "delivered". If the first quantity is less than the second quantity, then the current delivery status is updated to "taken" or "not delivered". The historical first image data is updated based on the first image data.

6. The monitoring method based on a smart doorbell as described in claim 5, characterized in that, The step of updating the current delivery status to "taken" or "not delivered" includes: When the first quantity is less than the second quantity and the first quantity is zero, the current delivery status is updated to "no delivery". When the first quantity is less than the second quantity and the first quantity is not zero, the current delivery status is updated to "taken".

7. A monitoring device based on a smart doorbell, characterized in that, The smart doorbell is equipped with a tilt monitoring device and a main monitoring device. The tilt monitoring device monitors towards the bottom of the smart doorbell, and the monitoring direction forms a preset angle with the extended surface where the smart doorbell is located. The main monitoring device monitors in a direction parallel to the horizontal plane. The monitoring device based on the smart doorbell includes: The acquisition module is used to generate a monitoring request when a human body is detected within a preset range corresponding to the smart doorbell, activate the tilting monitoring device to acquire first image data of the bottom area of ​​the smart doorbell, and activate the main monitoring device to acquire second image data of the area in front of the smart doorbell. The sending module is used to update the current delivery status of the bottom area of ​​the smart doorbell based on the first image data, wherein the current delivery status includes delivery, no delivery, and pickup; when the current delivery status changes from delivery to no delivery or pickup, it determines whether the door associated with the smart doorbell is open within a preset time period; if the door is not opened within the preset time period, it executes the step of sending the first image data and the second image data to the terminal device associated with the smart doorbell, and sends an alarm message to the terminal device.

8. A smart doorbell, characterized in that, The smart doorbell includes: a memory, a processor, and a smart doorbell monitoring program stored in the memory and executable on the processor. When the smart doorbell monitoring program is executed by the processor, it implements the steps of the smart doorbell-based monitoring method as described in any one of claims 1 to 6.

9. A medium, characterized in that, The medium stores a monitoring program for a smart doorbell, which, when executed by a processor, implements the steps of the monitoring method based on a smart doorbell as described in any one of claims 1 to 6.

Images